Amazon S3

Read records from files stored in an Amazon S3 bucket and perform analysis in ArcGIS Analytics for IoT.

Example

  • A researcher wants to load hundreds of delimited text files that are stored in an Amazon S3 bucket to perform analysis in Analytics for IoT.
  • A GIS department stores commonly used boundary shapefiles in an Amazon S3 bucket and wants to load the county boundary shapefile into Analytics for IoT as an aggregation boundary.

Usage notes

  • All files identified in the Amazon S3 bucket by the naming pattern in the dataset property must have the same schema and geometry type.
  • Your secret access key will be encrypted the first time you save your analytic and stored in an encrypted state.
  • When specifying the folder path, use forward slashes (/).
  • After configuring source connection properties, see Configure input data to learn how to define the schema and the key properties.

Parameters

ParameterExplanationData Type

Access key

Amazon access key ID for the S3 bucket, for example AKIAIOSFODNN7EXAMPLE.

Analytics for IoT will use the provided access keys to load specified data sources into the application.

Amazon documentation on Access Keys

String

Secret key

Amazon secret access key for the S3 bucket, for example wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY.

Analytics for IoT will use the provided access keys to load specified data sources into the application.

Your secret access key will be encrypted the first time you save your analytic and stored in an encrypted state.

For more information, see Access Keys (Access Key ID and Secret Access Key) in the AWS documentation.

String

S3 bucket name

The name of the Amazon S3 bucket containing the files to read.

String

Folder path

The folder path of the folder containing the file(s) to be loaded into Analytics for IoT.

  • If loading the file(s) from the root level of an Amazon S3 bucket, enter a single forward slash. For example:
    • /
  • If loading the file(s) from a folder in the Amazon S3 bucket, enter a forward slash followed by the path to the folder. For example:
    • /gis_data_folder/folder_containing_desired_dataset

String

Dataset

The name of the file to read if loading a single file, or a pattern indicating a set of files, followed by the file type extension.

In order to build a pattern indicating a set of files an asterisk (*) can be used as a wildcard either on its own or in conjunction with a partial file name.

All files identified by the naming pattern must have the same schema and geometry type. For example:

  • If loading a single file in a folder:
    • filename.csv
  • If loading all files in a folder:
    • *.shp
  • If loading select files in a folder:
    • sensor_data_201*.json

String

Considerations and limitations

  • All files identified in the Amazon S3 bucket by the naming pattern in the dataset property must have the same schema and geometry type.
  • Ingesting JSON with an array of objects referenced by a root node is currently not supported for Amazon S3 or Azure Blob Storage.