Migrate data

In this workflow, you will use the Data Mapping workbook to create a migration workspace that will facilitate the transfer of the source data into the asset package.

Create migration workspace

First, you will create a migration workspace that contains a modified asset package and a preconfigured data loading workspace. To create the migration workspace, complete the following steps:

1. In the Utility Data Management Support toolbox, expand the Data Migration toolset and click the Create Migration Workspace tool.
2. In the tool pane, set the following parameters:
   1. For Source Dataset, browse to the Source_Data folder and choose SanitarySewer_Naperville_SourceData.gdb.
   2. For Asset Package, browse to Sewer Utility Network Essentials > Data Models > SewerEssentials_AssetPackage.gdb and click OK.
   3. For Data Mapping Spreadsheet, browse to Working_Data > DataMapping > Naperville_DataMapping_Extended and choose DataMapping.xlsx.

      Note:

      If the newly created subdirectory is not visible, refresh the view.

   4. For Service Territory Polygon, browse to Source_Data > SanitarySewer_Naperville_SourceData.gdb > SewerStormwater > ServiceTerritory and click OK.

      Note:

      The service territory extent represents the area in which the network topology for your utility network is maintained.

      Note:

      The asset package generated by this tool will inherit the coordinate system of the service territory that is provided.

   5. For Output Location, select Working_Data > MigrationWorkspace.
   6. For Output Folder Name, type Naperville_Migration.

      The Naperville_Migration folder will contain a copy of the asset package with any modifications that have been specified, an associations.csv file, and a data loading workspace.

      Note:

      The modified asset package will become the new target asset package for subsequent steps.

   7. Check the Copy Fields box.

      Note:

      By choosing this option, all fields present in the source but missing in the target will be replicated. Any fields you have included in the Exclude Fields worksheet will be disregarded and not transferred.

   8. Expand Data Loading Tools Options.
   9. Check the Field Name Similarity box.
   10. Check the Domain Coded Value Description Similarity box.
   11. For Data Loading Mapping Table, click the Browse button and select the Sewer_DataLoading_MatchTable.csv file located in the Source_Data folder.

       Note:

       Alternatively, the provided .csv file can be loaded into the Mapping Table worksheet in the DataMapping Excel workbook. If you load the .csv file into the worksheet, the Data Loading Mapping Table parameter can be left blank.

   12. Leave Calculate Row Count Statistics unchecked.
   13. Leave Create Matches by Subtype unchecked.

       Note:

       The Create Matches by Subtype parameter has been deprecated and has no effect on the output of the tool.

       

3. Click Run.

Running the tool delivers three key outputs. The first output is the modified asset package enhanced with copied fields and newly introduced asset types. It reflects the modifications made to the original asset package based on the data migration. The second output is a Data Loading Workspace, which is a crucial component that will aid in matching the fields between the source and target datasets. It serves as a workspace for further refining field matching. The third output is a .csv file of created associations. These associations are premapped in the data loading workbook to the C_Associations table in the target asset package.

Note:

In this tutorial, you were provided with a match table (Sewer_DataLoading_MatchTable.csv) that was used to create the data loading workspace. This match table is used by Data Loading to ensure that all the field and domain matches in this tutorial were correctly aligned, so you will not need to do any extra work. When you apply this step to your own data, you will have to do your own domain and field matching. For more information on the Data Loading tools and how they work, you can review the Data Loading help pages.

Load data

After you have set up the migration workspace, you will load the data into the asset package. To load your data, complete the following steps:

1. In the Data Management Tools toolbox, expand the Data Loading toolset, and click the Load Data Using Workspace tool.
2. In the tool pane, for Data Reference Workbook, browse to Working_Data > MigrationWorkspace > Naperville_Migration > DataLoadingWorkspace, choose DataReference.xlsx, and click OK.

   

3. Click Run.

After the tool finishes, your source data is loaded into the target asset package.

You can now continue to the Create the utility network workflow.