Amazon S3

The Amazon S3 output in ArcGIS Velocity allows you to write output features to files in an Amazon S3 bucket.

Example

After performing analysis in a big data analytic, a researcher wants to write the output spatial or tabular features to files in an Amazon S3 bucket.

Usage notes

Keep the following in mind when working with the Amazon S3 output:

• The Dataset parameter specifies the name of the folder to which ArcGIS Velocity will write to the Amazon S3. This folder will contain one or more files, depending on the size of the output.
• The Secret Key value is encrypted the first time the analytic is saved and it is stored in an encrypted state.
• When specifying the Folder Path value, use forward slashes (/).
• This output is only available in big data analytics.
• The following output data formats are available:
  • Delimited
  • JSON
  • GeoJSON
  • Esri JSON
  • Parquet
  • Shapefile
• Data exported in a delimited format will include SHAPE and DATE fields. The SHAPE field will contain geometry in WKT format. The DATE field is provided if the data includes a START_TIME key field.
• Data exported in the JSON format will provide geometry in the Esri JSON format.
• The following Amazon S3 actions are required for your user policy associated with the provided Amazon key for Velocity to successfully connect to your Amazon S3 bucket and data in the provided bucket and folder path to write data.
  • The s3:ListBucket action must be allowed for the specified bucket.
  • The following actions must be allowed on the specified folder path and subresources (arn:aws:s3:::yourBucketName/*) for an Amazon S3 output to write data:
    • s3:PutObject
    • s3:GetObject
    • s3:DeleteObject

Parameters

The following are the parameters for the Amazon S3 output:

Parameter	Description	Data type
Access Key	The Amazon access key ID for the S3 bucket, for example, AKIAIOSFODNN7EXAMPLE. Velocity uses the provided access keys to load specified data sources into the application. For details on Amazon access keys, see AWS security credentials in the AWS documentation.	String
Secret Key	The Amazon secret access key for the S3 bucket, for example, wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY. Velocity uses the provided access keys to load specified data sources into the application. The secret key is encrypted the first time the analytic is saved and is stored in an encrypted state. For details on Amazon secret access keys, see AWS security credentials in the AWS documentation.	String
S3 Bucket Name	The name of the Amazon S3 bucket where the file or files will be written.	String
Folder Path	The folder path of the folder where the output dataset folder and files will be written. To write the output folder and files to the root level of an Amazon S3 bucket, enter a single forward slash, for example, /. To write the output folder and files to a folder, enter a forward slash followed by the path to the folder, for example, /data_folder.	String
Dataset	The name of the folder that will contain the output file or files. The file or files written to this folder will be automatically named and divided into multiple files as needed. Do not include file extensions in the Dataset parameter.	String
Write Mode	The write modes to write features to files in Amazon S3. The available write modes are as follows: Overwrite Append Error if exists	String