Skip To Content

Data manager

Data reports and management tools are provided to help open data administrators identify issues with problematic items and datasets on your open data site, disable automatic download caching, and allow manual resyncing. You can see your site's items and datasets by clicking the Data tab. Itemsrefers to ArcGIS Online items, which can be entire services, whereas datasets refers to individual datasets, or the layers within a service.

Issues in your data report are categorized into warnings or errors. When viewing your datasets, you can filter by warnings or errors and search for specific datasets. If all the data was successfully indexed, no warnings or errors appear on your site.

Note:

If you do not have anonymous access enabled for your organization, uncheck the Belongs to My Organization check box to see your data.

Warnings

These are datasets that have been successfully indexed but may present an issue with either the metadata or the downloading of filtered datasets. The most common warning is related to metadata, where a service has been shared as open data instead of the individual layers. This can present a problem, since all the datasets that derive from the service will have the same description, tags, and summary. You can fix a missing license warning by adding a license to the Access and Use Constraintssection of the respective ArcGIS Online item. Query performance warnings appear when the service takes longer than 1500 milliseconds to respond to a simple count query.

Errors

You'll see an error if the dataset failed to index. This could happen because the server is behind the firewall, or the item being indexed is not supported, such as a raster layer within a map service that's been shared as open data. These errors can be corrected by removing the item from your Open Data group.

You may also see errors if you refresh the data manager while you are updating or overwriting a service. These errors disappear when the service is finished updating.

Manual reset

While datasets on ArcGIS Open Data should update when your services update, there are times when data needs to be manually reset. Each dataset in the data manager has a circular arrow button beside it. Clicking this button triggers a sync of the data and refreshes the download cache, ensuring your users get the most up-to-date data views, statistics, and downloads.

Download cache

Each dataset has an option where you can set the download cache to manual or automatic updates; automatic is the default. For datasets that are set to automatic, the download cache is dropped every 24 hours and is regenerated the next time a user downloads the dataset. This ensures users are getting the most up-to-date data and is beneficial for datasets such as crime, which update frequently. For datasets that are set to manual, the download cache is updated only when the administrator manually resets the dataset. This is helpful to reduce server strain and is recommended for large datasets that do not update frequently, such as parcels or contours.

You cannot designate the download cache as manual or automatic in the following instances:

  • Dataset is hosted in ArcGIS Online—All datasets hosted in ArcGIS Online have automatic updates of the download cache. ArcGIS Online handles the load, and your users will always have the most recent data.
  • Dataset is owned by another organization—Download cache status can only be changed by the dataset owner.
  • Dataset references an external URL or document—PDFs, Microsoft Office documents, URLs, and web maps that appear in the data manager do not generate download caches, and the settings are disabled.

Note:

Your organization must have anonymous access enabled in order to set the download cache to manual or automatic.