Introduction to data migration

The data migration tutorial guides you through the migration from a geometric network-based dataset to the Sewer Utility Network Foundation using a sample dataset previously provided with the Water Geometric Network Editing and Analysis solution.

This tutorial covers the following topics:

  • Preparing your environment and data for the migration process
  • Creating a source-to-target mapping of your existing data and extending the utility network schema
  • Migrating your data and maintaining data integrity and relationships
  • Building the utility network for the sewer system
  • Addressing any errors that may arise during the migration process
  • Configuring subnetworks to optimize network performance and analysis

Key terms

The following terms are associated with the Sewer Utility Network Foundation and the data migration process. Familiarizing yourself with these key terms and exploring the associated documentation will help you gain a deeper insight into the terminology and concepts for successfully migrating data into the Sewer Utility Network Foundation.

  • Asset group—The attribute that represents the major classification of utility network classes.
  • Asset package—In a utility network, a collection of related assets that are grouped together for management and analysis purposes.
  • Asset type—The attribute that represents the minor classification of utility network classes.
  • Data mapping—The process of creating a relationship between the source data and the target schema to facilitate data migration.
  • Data migration—The process of transferring data from one system to another while maintaining data integrity and relationships.
  • Dirty area—The areas created to track the location of edits made to a network that need to be validated or corrected. These serve as an indicator that a change to the network has taken place that is not reflected in the network topology.
  • Network errors—Issues that arise during the data migration process that affect the integrity and functionality of the utility network.
  • Network topology—The management of information about features and the maintenance of the connectivity between features.
  • Sewer Utility Network Essentials (Essential model)—A data model that includes core components and functionality to support basic network management operations.
  • Sewer Utility Network Expanded (Expanded model)—A data model that includes advanced functionality and components for network management operations.
  • Subnetwork—A subset of a utility network that enables efficient network analysis and management.
  • Tier—Defines a collection of individual subnetworks that all share the same properties and adhere to the same restrictions.
  • Utility network—A comprehensive framework in ArcGIS that models utility systems such as water, gas, electric, and sewer networks.

Tools used in this tutorial

This tutorial uses several toolboxes and extensions for ArcGIS Pro to efficiently migrate data.

The Utility Data Management Support toolbox comes with all Utility Network Foundations. It helps with common utility network workflows and includes following key tools:

  • Create Simple Data Mapping—Maps source data to target classes in an asset package. Mapping is done with an Excel workbook.
  • Create Migration Workspace—Uses the Excel workbook that was generated by the Create Simple Data Mapping tool to apply the changes to create a modified asset package and a prepopulated Data Loading workspace.
  • Create Utility Network Copy Workbook—Generates an Excel workbook that will be used to define aspects of a source asset package that will be migrated to a target asset package.
  • Apply Utility Network Copy Workbook—Uses the Excel workbook that was generated by the Create Utility Network Copy Workbook tool to apply the changes to the target asset package.
  • Update Data Sources—Repaths all layers in a map to a target geodatabase.
  • Sync the C Tables Asset Group/Type—Syncs the Asset Group, Asset Type, and Association Type values in the C_Association and C_SubnetworkControllers table to the values of the rows in the domain tables.

The Utility Network Package toolbox includes following key tools:

  • Asset Package to Geodatabase—Uses an asset package to apply domain networks, related tables, and properties of a utility network to a new file or mobile geodatabase.
  • Assign Terminal Connections—Assigns terminal connection properties based on utility network rules and, optionally, the digitized direction of the line.

The Utility Network toolset includes following key tools:

  • Enable Topology—Enables the topology of the utility network.
  • Disable Topology—Disables the topology of the utility network.
  • Add Rule—Adds rules to the utility network.
  • Update Subnetwork—Updates subnetwork information in the Subnetworks table, the SubnetLine feature class, and subnetwork system diagrams for the specified subnetworks.
  • Update Is Connected—Updates the IsConnected attribute on all the network features for the specified utility network based on connectivity.

The Data Loading toolset includes the Load Data Using Workspace tool, which loads data from a source database to a target database using a populated Data Loading workspace, which is a collection of Excel workbooks.

ArcGIS Data Reviewer includes a set of quality control (QC) tools that allow an efficient and consistent data review process.

After you complete this tutorial, you will have a comprehensive understanding of the data migration process and be equipped to leverage the full potential of the Sewer Utility Network Foundation.

You can now proceed to the Get started workflow.