Common analysis issues and solutions

Listed below are issues and solutions you may encounter in ArcGIS Analytics for IoT when performing analysis in real-time and big data analytics. If you encounter an issue not addressed below, work with your administrator to contact Esri Support.

Note:

For issues and solutions related to accessing the Analytics for IoT application, signing in, or creating and starting items, see Troubleshooting for general issues and solutions.

Data configuration issues

Big data analytic issues

Coordinate system issues

No time is defined or operation requires the features to have time

Many tools including track-based tools, temporal filters or joins, and tools performing time step analysis require the input data to have time specified.

Time is specified on data by identifying the Start Time and/or End Time key fields. For more information on how to specify start and end times, see Configure input data.

If the Start Time or End Time fields are not identified, tools requiring features to have time will report an error such as Dataset is invalid: operation requires the features to have time or Dataset is invalid: no time is defined.

The inbound features do not have geometry specified

Many of the analytic tools in either a real-time or big data analytic require the input dataset have geometry specified. Geometry can be configured for features in one of four ways, including:

If you receive this error message, you will need to either configure geometry in your feed or source configuration, or by using a Calculate Fields or Map Fields tool to configure an Arcade expression that generates a geometry object.

At least one valid TRACK_ID field needs to be selected or Dataset is invalid: operation requires TRACK_ID tag set errors

Many track-based analytic tools such as Calculate Journeys, Calculate Motion Statistics, and others require the input data to have a Track ID field specified.

A track ID is a field in an incoming message or dataset that relates observations to specific entities. For example, a truck might be identified by its license plate number or an aircraft by an assigned flight number. These identifiers can be used as track ID's to track the events associated with a particular real-world entity or set of incidents. A track ID is specified as part of a feed or data source schema. For more information, see Configure input data.

If a track ID is not specified, track-based analytic tools will report an error such as At least one valid TRACK_ID field needs to be selected.

Recurring big data analytic task took longer to run than the set recurrence interval. The next job will be skipped.

Big data analytics can be scheduled and configured to run periodically, run periodically within a time frame, or to run at a recurring time.

This message will be written to the logs if an analytic is still running at the time of another scheduled run. For example, if an analytic is configured to run every 1 minute but took roughly 3 minutes to complete.

If this message appears frequently in the logs of a big data analytic, address this by either allocating additional resources in the run settings so the analytic completes faster or adjust the recurrence interval so the analytic can finish before the next scheduled run.

The recurring big data analytic failed because insufficient resources were available in the Analytics for IoT environment.

When a big data analytic is scheduled to run at a certain time or to recur repeatedly, sufficient resources must be available in the Analytics for IoT environment in order to fulfill each run at the time it runs.

If the Analytics for IoT environment does not have sufficient resources for the recurring big data analytic to perform its processing at the time of the run, each run will be skipped until sufficient resources are available. Analytics for IoT will keep attempting to run the big data analytic each time it is scheduled to run or recur.

Analytic failed, log message encountered: "Big data analytic task {id} ran out of memory during execution. Adjust the configuration to avoid failures."

When certain tools are present in an analytic and large volumes of data are being processed, additional run settings resources may need to be provided in order to ensure a successful run. If you encounter this log message, please adjust the run settings and change from a default plan to a Large or Extra Large plan.

If you have increased your run settings resources yet still encounter this error, please contact Esri Technical Support or the product team.

Analytic failed, status tooltip or log message encountered: "The analytic failed with the reason OOMKilled (out of memory killed) for the driver pod. Please increase run setting resources and run again."

When certain tools are present in an analytic and large volumes of data are being processed, additional run settings resources may need to be provided in order to ensure a successful run. If you encounter this log message, please adjust the analytic run settings and change from a default plan to a Large or Extra Large plan.

If you increased your run settings resources and are still encountering this error, contact Esri Support.

Future enhancements will automatically increase the relevant resources in order to ensure a successful analytic run as part of a retry policy.

The input dataset is in a geographic coordinate system, but this operation requires a projected coordinate system.

Several analytic tools only work with data in either a geographic or projected coordinate system. For example, the Calculate Density tool can only process data that is in a projected coordinate system. The solution is to configure the Project tool prior which will project the data to a projected coordinate system such as well-known id ( or WKID) 102100, which refers to WGS 1984 Web Mercator Auxiliary Sphere.

Planar and geodesic spatial relationships

When configuring spatial relationships such as near planar or near geodesic in analytic tools, you must choose the correct spatial relationship respective to the coordinate system of the input data for the tool.

Specifically when configuring near planar spatial relationships, the spatial reference of both the target and join datasets must both be a projected coordinate system. To address this, either use a near geodesic spatial relationship or use the Project tool to alter the target and/or join datasets to be in a projected coordinate system.