A data source loads static or near real-time data into a real-time or big data analytic.
In real-time analytics, data sources load data used in conjunction with tools that require an ancillary spatial or tabular dataset to enrich, filter, join to, or calculate distance from events. When a real-time analytic starts, data from a data source is loaded once. To leverage dynamic data for these operations, a feed should be configured and used as join data in analytic tools.
In big data analytics, data sources load the data that will be processed by the tools and written to outputs.
The following data source types are available in ArcGIS Velocity:
- Standard Geographies
- United States
- World
- ArcGIS
- Cloud
- Web and Messaging
Examples
The following are examples of using a data source:
- An environmental scientist configures an Amazon S3 source in a big data analytic to load hundreds of delimited .csv files for analysis.
- A GIS analyst configures a Feature Layer source in a real-time analytic to load United States Census Bureau census tract data to enrich incoming sensor observations with information about the census tract they intersect.
Add a source in a real-time analytic
You can add a source only to an existing real-time analytic. Follow the steps below to add a source to an existing real-time analytic:
- Open the ArcGIS Velocity app.
- Click Real-Time from the menu to access the Real-Time Analytics page.
- Click the Create real-time analytic button, and then click Existing feed.
- Select an existing feed and click Confirm to open the analytic.
- Expand the configuration pane and click Sources. Choose a source type from the following categories:
- Stadard Geographies
- ArcGIS
- Cloud
- Web and Messaging
- Provide source configuration details.
The configuration parameters vary depending on the source type.
- Configure the schema, key fields, and polling settings in the same way for all source types.
The configured source is available in an existing real-time analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Add a source when creating a new big data analytic
Follow the steps below to add a source when creating a new big data analytic:
- Open the ArcGIS Velocity app.
- Click Big Data from the menu to access the Big Data Analytics page.
- Click the Create big data analytic button to create a new analytic.
- Search or choose a source type from the following categories for big data analytic:
- ArcGIS
- Cloud
- Web and Messaging
- Provide source configuration details.
The configuration parameters vary depending on the source type.
- Configure the schema, key fields, and polling settings in the same way for all source types.
The configured source is available in a new big data analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Add a source to an existing big data analytic
Follow the steps below to add a source to an existing big data analytic:
- Open the ArcGIS Velocity app.
- Click Big Data from the menu to access the Big Data Analytics page.
- Choose an existing big data analytic available under the My Content page.
- Click the Edit button to update an existing analytic.
- Expand the configuration pane and click Sources. Choose a source type from the following categories:
- Standard Geographies
- ArcGIS
- Cloud
- Web and Messaging
- Provide source configuration details.
The configuration parameters vary depending on the source type.
- Configure the schema, key fields, and polling settings in the same way for all source types.
The configured source is available in an existing big data analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Edit a source
You can edit an existing source in a real-time or big data analytic to adjust connection parameters, schema configuration, key fields, and polling settings. To edit a source in an analytic, double-click the source node to see additional details or click the edit button to access the source configuration wizard.