Amazon S3

The Amazon S3 output in ArcGIS Velocity allows you to write output features to files on an Amazon S3 bucket.

Example

After performing analysis in a big data analytic, a researcher wants to write the output spatial or tabular features to files on an Amazon S3 bucket.

Usage notes

• The Dataset parameter specifies the name of the folder to which ArcGIS Velocity will write to the Amazon S3. This folder will contain one or more files, depending on the size of the output.
• The Secret Key will be encrypted the first time the analytic is saved and it will be stored in an encrypted state.
• When specifying the Folder Path, use forward slashes (/).
• This output is only available in big data analytics.
• The following output data formats are available:
  • Delimited
  • JSON
  • GeoJSON
  • EsriJSON
  • Parquet
  • Shapefile
• Data exported in a delimited format will include SHAPE and DATE fields. The SHAPE field will contain geometry in WKT format. The DATE field is provided if the data includes a START_TIME key field.
• Data exported in the JSON format will provide geometry in the EsriJSON format.
• Certain Amazon S3 actions are required for your user policy associated with the provided Amazon key for Velocity to successfully connect to your Amazon S3 bucket and data in your provided bucket and folder path to write data.
  • The s3:ListBucket action is required to be allowed for the specified bucket.
  • The following actions are required to be allowed on the specified folder path and subresources (arn:aws:s3:::yourBucketName/*) for an Amazon S3 output to write data:
    • s3:PutObject
    • s3:GetObject
    • s3:DeleteObject

Parameters

Parameter	Description	Data type
Access Key	Amazon access key ID for the S3 bucket—for example: AKIAIOSFODNN7EXAMPLE. Velocity will use the provided access keys to load specified data sources into the application. For details on Amazon access keys, see Understanding and getting your AWS credentials in the AWS documentation.	String
Secret Key	Amazon secret access key for the S3 bucket—for example: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY. Velocity will use the provided access keys to load specified data sources into the application. The secret key will be encrypted the first time the analytic is saved and will be stored in an encrypted state. For details on Amazon secret access keys, see Understanding and getting your AWS credentials in the AWS documentation.	String
S3 Bucket Name	The name of the Amazon S3 bucket to which the file or files should be written.	String
Folder Path	The folder path of the folder to which the output dataset folder and files should be written. To write the output folder and files to the root level of an Amazon S3 bucket, enter a single forward slash—for example: /. To write the output folder and files to a folder, enter a forward slash followed by the path to the folder—for example: /data_folder.	String
Dataset	The name of the folder to which to write will contain the output file or files. The file or files written to this folder will be automatically named and broken into multiple files as needed. Do not include file extensions in the dataset name property.	String
Write Mode	The available write modes to write features to files in Amazon S3. The available write modes are as follows: Overwrite Append Error if exists	String