Amazon S3 Request data

Request Body for Amazon S3
{
     "type": string,
     "id_attribute": string,
     "payload": {
       "bucket": string,
       "path": string ,
       "security": {
         "aws_key": string,
         "aws_secret": string,
         "region": string
       },
       "read_options": {
           "separator": string
       }
     }
 }
Field
Type
Value
type
string
Required. "S3"
id_attribute
string
Optional. Name of the column in data that represents the identifier of the row. Read more here​
bucket
string
Required. Name of S3 bucket
path
string
Required. Full path of file inside the bucket. Read more here​
aws_key
string
Required. AWS access key
aws_secret
string
Required. AWS secret key
region
string
Required. AWS region
read_options
json
Provide this only for CSV input if there is a separator like “,” or “\t”. For parquet and json, omit read_options and separator
separator
string
For CSV only,  
‘,’ for CSV

Snowflake Request data

Delta Lake Request

Last modified 1yr ago

Field	Type	Value
type	string	Required. "S3"
id_attribute	string	Optional. Name of the column in data that represents the identifier of the row. Read more here
bucket	string	Required. Name of S3 bucket
path	string	Required. Full path of file inside the bucket. Read more here
aws_key	string	Required. AWS access key
aws_secret	string	Required. AWS secret key
region	string	Required. AWS region
read_options	json	Provide this only for CSV input if there is a separator like “,” or “\t”. For parquet and json, omit read_options and separator
separator	string	For CSV only, ‘,’ for CSV