Work with data sources

A data source loads static or near real-time data into a real-time or big data analytic.

In real-time analytics, data sources load data used in conjunction with tools that require an ancillary spatial or tabular dataset to enrich, filter, join to, or calculate distance from events. When a real-time analytic starts, data from a data source is loaded once. To leverage dynamic data for these operations, a feed should be configured and used as join data in analytic tools.

In big data analytics, data sources load the data that will be processed by the tools and written to outputs.

The following data source types are available in ArcGIS Velocity:

• Standard Geographies
  • United States
  • World

• ArcGIS
  • Feature Layer
  • Feature Layer (archive)
• Cloud
  • Amazon S3
  • Azure Blob Store
  • Azure Cosmos DB
• Web and Messaging
  • HTTP Poller
  • RSS

Examples

The following are examples of using a data source:

• An environmental scientist configures an Amazon S3 source in a big data analytic to load hundreds of delimited .csv files for analysis.
• A GIS analyst configures a Feature Layer source in a real-time analytic to load United States Census Bureau census tract data to enrich incoming sensor observations with information about the census tract they intersect.

Add a source

You can add sources to existing real-time or big data analytics. Additionally, you can add a source when creating a new big data analytic. Follow the steps below to add a source when creating a new big data analytic:

1. Open the ArcGIS Velocity app.
2. Click Big Data from the menu on the left to access the Big Data Analytics page.
3. Click the Create big data analytic button to create a new big data analytic.
4. Search or choose a source type from the following categories:
   • Standard Geographies
   • ArcGIS
   • Cloud
   • Web and Messaging
5. Provide source configuration details. The configuration parameters vary depending on the source type.
6. Configure the schema, key fields, and polling settings in the same way for all source types. For more information, see Configure input data.

The configured source is available in the big data analytic. You can now add and configure tools to analyze the data and send the results of the analysis to various outputs.

Edit a source

You can edit an existing source in a real-time or big data analytic to adjust connection parameters, schema configuration, key fields, and polling settings. To edit a source in an analytic, do one of the following:

• Double-click the source node to see additional details.
• Click the edit button to access the source configuration wizard.