Amazon S3 Request data

Request Body for Amazon S3

{
     "type": string,
     "id_attribute": string,
     "payload": {
       "bucket": string,
       "path": string ,
       "security": {
         "aws_key": string,
         "aws_secret": string,
         "region": string
       },
       "read_options": {
           "separator": string
       }
     }
 }

Field

Type

Value

type

string

Required. "S3"

id_attribute

string

Optional. Name of the column in data that represents the identifier of the row. Read more here

bucket

string

Required. Name of S3 bucket

path

string

Required. Full path of file inside the bucket. Read more here

aws_key

string

Required. AWS access key

aws_secret

string

Required. AWS secret key

region

string

Required. AWS region

read_options

json

Provide this only for CSV input if there is a separator like “,” or “\t”. For parquet and json, omit read_options and separator

separator

string

For CSV only,

‘,’ for CSV

Last updated