Parquet feature layer (Beta)

Use records in Parquet feature layers (Beta) as input to ArcGIS Data Pipelines.

To learn more about Parquet feature layers (Beta), see the ArcGIS Blog article Scaling your GIS workflows with the new Parquet feature layer (Beta) in ArcGIS Online.

Note:

This feature is currently in beta. Share your experience, request enhancements, and seek support through the Beta Features Feedback forum in the Data Pipelines Community. If your organization has blocked beta apps and capabilities, you will not have access to this feature.

Usage notes

Keep the following in mind when working with the Parquet feature layer (Beta) input:

• Using the Parquet feature layer (Beta) input, you can load data from Parquet feature layers.
• When you add a Parquet feature layer (Beta) input to the canvas, the Select a Parquet feature layer modal appears, where you can browse to and select a Parquet feature layer item. You can browse your content, content that has been shared with you, and content that is available to your organization and ArcGIS Online.
• To change the selected Parquet feature layer, click the Parquet feature layer parameter.
• To improve the performance of reading input datasets, consider the following options:
  • Use the Use caching parameter to store a copy of the dataset. The cached copy is only maintained while at least one browser tab open to the editor is connected. This may make it faster to access the data during processing. If the source data has been updated since it was cached, uncheck this parameter and preview or run the tool again.
  • After configuring an input dataset, configure any of the following tools that limit the amount of data being processed:
    • Filter by attribute—Maintain a subset of records that contain certain attribute values.
    • Filter by extent—Maintain a subset of records within a certain spatial extent.
    • Select fields—Maintain only the fields of interest.
    • Clip—Maintain a subset of records that intersect with specific geometries.

Limitations

The following are known limitations of the Parquet feature layer (Beta) input:

• This feature is currently in beta. Share your experience, request enhancements, and seek support through the Beta Features Feedback forum in the Data Pipelines Community. If your organization has blocked beta apps and capabilities, you will not have access to this feature.
• Parquet feature layers must have a geometry. Tables are not supported.
• The geometry for Parquet feature layers will always be stored in the WGS 1984 (4326) coordinate system.
• Parquet feature layers are optimized for storage, and for visualization workflows in Map Viewer. They are not currently supported for use as input to analysis tools, direct editing workflows, or for use in ArcGIS Pro.

Licensing requirements

The following licensing and configurations are required:

• Creator or Professional user type
• Publisher, Facilitator, or Administrator role, or an equivalent custom role

To learn more about Data Pipelines requirements, see Requirements.