Use Community Data Aggregation

The Community Data Aggregation solution delivers a set of capabilities that help you transform and load data source data (for example, addresses and parcels) in to target dataset with a standard information model.

In this topic, you’ll learn how to use the solution by assuming the role of a user and performing the workflows below.

This solution supports two parcel data aggregation models, both of which are supported by the same set of tools:

• The Contributor Model allows authoritative data producers to update the community layers directly on a regular schedule.
• The Aggregator Model allows authoritative data producers to send their data to a community aggregator so the community layer can be updated.

Choose a parcel data aggregation model (Contributor or Aggregator) and configure Data Assistant to load the source data.

Quick tour ofData Assistant tools

The Data Assistant add-in includes a set of tools that are organized on the Data Assistant toolbar. These tools allow you to create data mapping files and load or replace data in the target datasets.

Tool	Tool name	Description
	New File	Creates a source-target configuration file for the selected source and target datasets.
	Data Mapper	Defines the field mapping and settings for the selected source-target configure file.
	Preview	Creates a preview of the output from the source-target configuration file in a local database with a subset of records.
	Stage Data	Stages results in a local database using a subset of the records.
	Append Data	Appends data into the target dataset from the source dataset according to the settings in the source-target configuration file.
	Replace Data	When the Replace By Field Value option has been enabled and configured, replaces data in the target dataset from the source dataset according to the settings in the source-target configuration file.
	Settings	Provides optional settings for the data mapping tool.

Load data using the Data Assistant add-in

The Data Assistant add-in can be used by organization staff to migrate data from a source to a target dataset, as well as schedule automated updates of the community layers.

Update the community layer

The Data Assistant add-in includes a series of tools for migrating data to the CommunityParcels and CommunityAddresses hosted feature layers, as well as updating this data on a regular interval.

To migrate the source data to one of the hosted feature layers provided and configure updates, complete the following steps:

1. Open the data aggregation project in ArcGIS Pro.
2. Sign in to your ArcGIS organization and make it the active portal.
3. Click the Data Assistant ribbon.
4. Click the New File button.
5. For the Source Dataset parameter, browse to and select the source dataset, and click OK.
6. For the Target Dataset parameter, browse to and select the CommunityParcels or CommunityAddresses dataset, and click OK.

   Note:

   When appending or replacing the hosted feature layer for CommunityAddresses and CommunityParcels, you need to enable editing for the feature layer.

7. For the Source-Target Configuration File parameter, browse to an output location and provide a name, and click OK.
8. Click Run.
9. Click Data Mapper, click Open a configuration file (xml), and browse to and select the configuration file you just created.
10. Click Fields.
11. Select the source fields and review the initial field mapping. Configure any additional fields and required data assistant methods. Once complete, click Apply.

    Tip:

    For hosted feature layers in ArcGIS Online, click the Data tab and click Fields for more information about each field in the data model.

12. Optionally, on the Data Assistant tab, click Preview, and browse to and select a configuration file. For Number of Features, specify the amount you want to generate in the preview.
13. Click Run.
14. Click Append Data or Replace Data, and browse to and select the configuration file you created previously.
    • If you are contributing or aggregating data for the first time, choose Append Data. The tool will add all features in the source dataset to the target dataset.
    • If you are updating existing data in the target dataset, choose Replace Data. The tool will use a defined query to replace specific features in the target dataset.
15. Click Run.

Note:

In the Settings tool, the Update Match Library option allows you to use the updated field mapping to use fuzzy logic to speed up data loading in the future.

Schedule updates

The Data Assistant tools can be used with Windows Task Scheduler to update layers on a regular interval. Scheduled updates ensure users have access to current information to support decision making.

To update community data on a schedule, complete the following steps:

1. Using ArcGIS Pro, open the Python window
2. Import ArcPy by typing the following command:

   import arcpy

3. Import a Python toolbox from the Data Assistant tools by typing the following command:

   arcpy.ImportToolbox(r"C:\Users\user\AppData\Local\Esri\ArcGISPro\AssemblyCache\{28142961-b645-420f-ba2a-72bcf8212558}\GPTools\DataLoadingAssistant.tbx")

4. Specify the .xml configuration file by typing the following command:

   arcpy.dla.ReplaceData(r"C:\Users\youruserprofile\Documents\ArcGIS\Projects\MyProject\ReplaceData.xml")

   Note:

   Using the Append Data and Replace data tools, you can specify multiple .xml files. Separate each .xml file with a semicolon (;).

5. Right-click in the Python window and choose Save Transcript to save a new Python file.
6. Open Windows Task Scheduler.

   Note:

   Use the Windows Start menu search box to find Windows Task Scheduler.

7. Click Action > Create Task and name the task.
8. Click the Actions tab and click New.
9. Set Action to Start a Program.
10. Browse to the location of your ArcGIS Pro Python installation.
    C:\Program Files\ArcGIS\Pro\bin\Python\Scripts\propy.bat
11. In the Add Arguments text box, provide the full path of the script saved in step 5.