Skip To Content

Feature layer

The Feature layer output writes data pipeline datasets to a hosted feature layer or hosted table. You can create a feature layer or table, replace the data in an existing feature layer or table, or add and update records in an existing feature layer or table.

Parameters

The following table outlines the parameters used in the Feature layer output:

ParameterDescription

Input dataset

The dataset that will be written as a feature layer.

Geometry

The point, line, or polygon geometry field containing the locations that will be used in the output feature layer. If no geometry field is specified, the output will be a hosted table.

Time type

Specifies the time type of the output feature layer. The options are Instant, Interval, or None. None is the default.

Time

The time field containing the time stamps that will be used in the output layer. This parameter is required if Time type is Instant.

Start time

The time field containing the start time stamps that will be used in the output layer. This parameter is required if Time type is Interval.

End time

The time field containing the end time stamps that will be used in the output layer. This parameter is required if Time type is Interval.

Output method

Specifies the method that will be used to write the output results. The options are Create (this is the default), Replace, or Add and update.

Feature layer

The hosted feature layer or table that will be replaced with new data. This parameter is required if Output method is Replace or Add and update.

Unique identifier

Specifies the field containing unique values for each record. This parameter is required to update existing records in a feature layer using the Add and update output method.

Output name

The name for the output feature layer or table.

Folder

The output folder where the feature layer or table will be saved.

String field length

An optional parameter for specifying the length of all output string fields. The default is 4000 single-byte characters .

Usage notes

To run a data pipeline, at least one output must be configured.

Use the Input dataset parameter to identify the dataset that will be written as a hosted feature layer or table.

Use the Geometry parameter to optionally set geometry on the output. If the input dataset has a single geometry field, it will be specified by default. If the input dataset has multiple geometry fields, specify the one that will be used in the feature layer. Geometry fields not specified in this parameter will be dropped and not available in the output. If no geometry field is specified, the output result will be a table.

Optionally, you can set time on the output by specifying a value for Time type. The options are as follows:

  • Instant—A single moment in time. Use the Time parameter to specify the field that represents the time of the record. Time fields must be of type date.
  • Interval—An interval in time represented by a start time and an end time. Use the Start time parameter to specify the field that represents the start time of the record, and the End time parameter to specify the field that represents the end time of the record. Time fields must be of type date.
  • None—The output feature layer will not have time.
Date fields are stored in feature layers and tables using the format milliseconds from epoch and coordinated universal time (UTC). The values will be displayed differently depending on where you are viewing the data. For example, querying the feature service REST end point will return values in milliseconds from epoch, such as 1667411518878. The same value in the Data Pipelines editor will display as 11/02/2022 5:51 PM.

To modify the item properties, such as the summary or tags, browse to your portal content page and edit the feature layer item directly.

Learn more about item details in ArcGIS Online

Use the Output method parameter to specify how the data pipeline results will be written to a feature layer or table. The options are as follows:

  • Create—A hosted feature layer or table will be created. The output will be stored in your portal content. The output will contain the features (or rows) and fields (or columns) from the input dataset.
  • Replace—The data in an existing feature layer or table will be completely replaced.
  • Add and update—Append new records or update existing records in a feature layer or table. To update existing records, you must specify a field containing unique values to identify existing records by using the Unique identifier parameter. The field you specify must be set as a unique field on the feature layer or table item page. See Add a unique constraint to a field for more information.

Use the String field length parameter to specify the length of the string fields to be created in the output feature layer. The specified length applies to all output string fields. The default is 4,000 single-byte characters. If strings in your input dataset exceed the specified string length, the values will be truncated and written to the output feature layer.

Limitations

The following are known limitations of the Feature layer output:

  • You can only write to a single layer or table for each output. To create multiple outputs, you must configure multiple output feature layer elements in the diagram. Each output will be stored in your portal content as its own item.
  • If you have multiple output feature layers configured and one fails to write, the data pipeline will continue writing the remaining output feature layers. Any output feature layers that failed during write will be rolled back.
  • Not all field types supported from input sources will be maintained when writing results to a feature layer. See the table below for details on how field types will be converted.
  • You cannot use Replace or Add and update for feature layers or tables you do not own unless you are an administrator, or the layer or table is shared with a shared update group that you are a member of.
  • When using Replace or Add and update, the fields are updated based on matching field names. Field matching is case sensitive. To match field names to the desired output layer, use the Map fields tool. To modify a selection of field names, use the Update fields tool.
  • When using the Replace option, the following limitations apply:
    • Replacing data for a feature layer or table that is the origin of a relationship is not supported.
    • If sync is enabled on the feature layer or table, replace is not supported.
    • The geometry type of the layer to replace must be the same as the input dataset. For example, you cannot replace a table with polygons, or replace points with polylines.
    • The time type of the layer to replace must be the same as the input dataset. For example, you cannot replace instant time properties with interval time properties.
    • If the spatial reference of the layer to replace is different than the input geometry, the input geometry will be projected to the spatial reference of the layer to replace.
    • If a field exists in the data pipeline result but not in the layer to replace, it will not be added to the layer.
    • If a field exists in the layer to replace but not in the data pipeline result, it will be maintained in the layer and appended with null values or the default values defined by the feature layer.
  • The String field length parameter applies to all output string fields. To create a feature layer with string fields of varying lengths, define your own layer and use the replace output method using the layer you just created. This will maintain the lengths of the fields you defined and update the feature layer with the records from your data pipeline. To learn more about creating a feature layer, see Define your own layer.

Field types and values from the input dataset can be converted to new types and values that are supported in the output feature layer. Data type conversions are outlined in the following table:

Input dataset field typeOutput feature layer field typeNotes

String

esriFieldTypeString

String fields in output feature layers are created with a length of 4,000 by default. Use the String field length parameter to specify a different length. Values that exceed the specified length will be truncated.

Small integer

esriFieldTypeInteger

Integer

esriFieldTypeInteger

Big integer

esriFieldTypeBigInteger

Float

esriFieldTypeSingle

Double

esriFieldTypeDouble

Date

esriFieldTypeDate

Date fields will be written without a time zone and stored in the format of milliseconds from epoch. When using preview to view date values, the time zone of the locale of the browser or client will be used.

Learn more about date fields in ArcGIS Online

Date only

esriFieldTypeDateOnly

Blob

esriFieldTypeString

BLOB values will be converted to base64 encoded strings in the output feature layer. When previewing this field in the app, the values will be converted to a string ("BLOB").

Boolean

esriFieldTypeString

Boolean values will be converted to strings and stored in the feature layer in a string field. True values will be written as "True" and false values will be written as "False".

Array

esriFieldTypeString

Array values will be converted and stored as string fields.

Map

esriFieldTypeString

Map values will be converted and stored as string fields.

Struct

esriFieldTypeString

Struct values will be converted and stored as string fields.

Geometry

esriFieldTypeGeometry

The geometry field can represent point, line, or polygon geometries depending on the Geometry parameter value.

Licensing requirements

The following licensing and configurations are required:

  • Creator or GIS Professional user type
  • Publisher, Facilitator, or Administrator role, or an equivalent custom role

To learn more about Data Pipelines requirements, see Requirements.

Related topics