Use data models

Note:

Data engineering is available in Insights desktop. All Insights in ArcGIS Online and Insights in ArcGIS Enterprise users have access to Insights desktop. For more information, see Overview of ArcGIS Insights.

Data engineering is currently in Preview.

In Insights, data engineering workflows are completed using models in data workbooks. Dataset and column tools applied to a dataset are added to the data model automatically. Running the data model creates a dataset that can be used for analysis in Insights.

Run a data model

The tables in a data workbook display a view of the datasets with the data engineering tools applied. You must run the model to create an output dataset that can be used for analysis.

Complete the following steps to run a data model:

1. Open a data workbook, add data, and apply tools to clean and prepare your data, if necessary.
2. Click the output dataset in the data model.

   Note:

   If your view is table only, click the Show model button . If a map is visible, click the Switch to model button .

   The Output location window appears.

3. Choose one of the following tabs:
   • Local content (default)—The output dataset is saved as a local dataset in Insights desktop.
   • Database—The output dataset is written to a database. A local dataset that references the database table is also created.
4. Provide a title, tags, and description for the output dataset.
5. If you are writing the dataset to a database, do the following:
   1. For Connection, choose the name of the database.
   2. Optionally, select Name tables and provide a name for the table in the database.

      If no name is given, a default name is applied.

6. Click Save.

   The output dataset name updates.

7. Click the Run model button .

   A warning appears informing you that the data model may take several minutes to run. You will not be able to use the data workbook while the data model is running.

   Note:

   The warning does not appear for datasets with fewer than 20,000 features.

8. Click Yes, run.

   The data model runs. A window appears tracking the progress of the data model.

9. Click Close to close the window when the data model has completed.

The output dataset is saved in the chosen destination. The dataset can be added to a workbook and used to perform analysis.

Refresh datasets

When data is imported into a data workbook, it is imported as either a sample or a copy of the full dataset. Changes made to the original dataset are not automatically visible in the data workbook. Refreshing a dataset updates the sample or copy so that the latest data is available for your data engineering workflow.

Complete the following steps to refresh a dataset in a data model:

1. In the data model, click the dataset you want to refresh.

   Note:

   If your view is table only, click the Show model button . If a map is visible, click the Switch to model button .

2. Click the Refresh dataset button .

Edit tools

Tools in a data model can be edited to update the parameters. Editing tools may affect the tools run downstream.

Complete the following steps to edit a tool in a data model:

1. In the data model, click the tool you want to edit.

   Note:

   If your view is table only, click the Show model button . If a map is visible, click the Switch to model button .

2. Click the Edit button .
3. Update the necessary parameters in the tool dialog box.

   Depending on the tool, you may need to click Apply or Done to complete the updates.

The tool is updated and the updates are reflected in the table.

Remove tools and datasets

Unnecessary tools and datasets can be removed from a data model.

Removing tools and datasets will also remove dependent tools run downstream. For example, a column is converted to a string type, and Find and replace is used to search for specific strings and replace them with other values. If the Convert data type tool is removed, the Find and replace tool is also removed because it is dependent on the column being a string type.

Note:

Removing a dataset from the data model also removes it from the data pane.

Complete the following steps to remove a tool or dataset in a data model:

1. In the data model, click the tool or dataset you want to remove.

   Note:

   If your view is table only, click the Show model button . If a map is visible, click the Switch to model button .

2. Click the Delete button .

The tool or dataset is removed from the data model.