The October 2024 update for ArcGIS Data Pipelines includes new tools, the ability to overwrite existing layers, improved credit reporting, and more. For more information, see the What's New in Data Pipelines (November 2024) blog article.
Tools
The following tools are available:
- Dissolve—Dissolve allows you to combine polygon or polyline geometries that intersect. You can combine geometries based on intersection only or on intersection and matching attributes.
- Pivot—Pivot allows you to convert a long dataset (many rows) to a wide dataset (many fields) using values from an existing field to create new fields. Use aggregate functions to calculate values for the new fields.
Outputs
The output feature layer tool includes a parameter to overwrite existing feature layers. Use this new Overwrite if layer already exists parameter to change the schema, geometry type and all records of an existing feature layer. For example, if the source data often has fields added or removed and you want that to be reflected in the existing feature layer, use the overwrite option. Also, if you're iterating on a data pipeline but have already created an output, you can use the overwrite parameter to rerun the workflow to create the latest results. To learn more about the overwrite parameter, see the output Feature layer topic.
General enhancements
The following general enhancements are available:
- Use notes to document a workflow, or share context with collaborators. You can add a note to the data pipeline generally to document its purpose or usage, or you can add a note to specific elements to outline information such as details about the source data, how or why certain tool parameters are used, or what the output feature layer can be used for.
- The connection details dialog box now displays an estimate of the amount of credits you spent while working in the editor. The estimate is calculated based on how long you have been connected. To learn more about connections in Data Pipelines, see Compute resources.