Skip To Content

Workload management in Deep Learning Studio

Available with Image Server

The Deep Learning Studio workload is defined by the project, roles, and work units. When you start Deep Learning Studio, the first step is to create a project for the deep learning process. However, there are defined roles in the group to consider before creating the Deep Learning Studio project. In each project, the work is divided into units that will be completed by the members of the group according to their role.

Project

A Deep Learning Studio project is created in ArcGIS Enterprise as an item that can be shared with others in your organization. The project aggregates the processes and work to accomplish the deep learning analysis. Three tasks are available to start the deep-learning process:

  • Prepare training data
  • Train model
  • Run interference

When the Prepare training data task is chosen, the project must be configured for the task. Configuration options include setting the data source, schema for training samples, group assignment, and work units.

Roles

A specified Deep Learning Studio role is related to your privileges in ArcGIS Enterprise. The roles are not specified during project creation. A project owner has the same capabilities as an analyst due to their similar privileges in the organization. However, the capability to mark as complete is only granted to the creator of the project (the project owner). The sample collector role is available to all users with editing privileges in the organization.

RoleConfigure project for Prepare training dataCollect training samplesReview training samplesExport training samplesTrain modelRun inferencing toolDelete project

Project owner

X

X

X

X

X

X

X

Analyst

X

X

X

X

X

Sample collector

X

  • Project owner—A project owner oversees the entire deep learning process and sets up the project with the data, assigns the groups, and defines the data sources. A project owner can participate in all of the processes in a Deep Learning Studio project.
  • Analyst—An analyst in a Deep Learning Studio project can participate in all of the work in the project, including collecting samples, training a model, using inferencing tools, and generating output. They combine their GIS and deep-learning knowledge to generate output from the deep learning analysis.
  • Sample collector—The sample collector role is for members of a group who will only participate in the collection of training samples.

Depending on the project, not all roles may be necessary, and they are not required. They are recommended for larger projects with many users contributing to the work. Members in Deep Learning Studio groups are managed in the same way as groups in ArcGIS Enterprise. For more information about ArcGIS Enterprise groups, see Create groups.

Work units

When a project owner defines the data source for a Deep Learning Studio project, the spatial extent of the input data source is considered as the total area to be completed for the project by default. During project configuration, a project owner can divide the work units into smaller units to define areas for training or divide the sample collection into smaller areas to be completed by a team of sample collectors. These defined work units are used for review of sample collections and must be marked as complete to be used in model training.

Custom spatial extents can be refined through a polygon feature layer during project configuration.

Individual work units overlaid on an imagery layer
An imagery layer is divided into smaller individual work units.

Work unit status can be one of three options during the training sample collection process. The work unit status can be:

  • Queued - meaning that it is ready to have the training samples collected. After a project is configured, all work units will have the initial status of Queued.
  • In progress - meaning that sample collection is being performed. Once a user starts collecting training samples or editing training samples on a work unit, the work unit status will be updated from Queued to In progress.
  • Pending review - meaning a sample collector who previously worked on this unit has done with the work unit and the work unit status has been updated from In progress to Pending review. A work unit in Pending review status can be picked by a reviewer to start reviewing the samples in this work unit.
  • In review - meaning that a reviewer has begun reviewing the samples in it. The work unit status has updated from Pending review to In review until the review has been completed.
  • Reviewed - meaning that a reviewer has finished reviewing the work unit and the status of the work unit has been changed from In review to Reviewed.
    Note:

    If there are rejected samples within the work unit, when the completes the review of the work unit, a prompt will ask whether the work unit status should return to Queued until the rejected samples are corrected or remain as Reviewed.

You can manually update the work unit status through the Review Training Samples page. You can click individual work units within the map, from the table, or the pop-up and use the menu to manually change the work unit status. If you need to change multiple work units, then you can batch select more work units and click the Update button to modify the work unit status.

Training sample status

Analysts can monitor the status of the project through the work unit status, which indicates the current stage of the project. Within the overall work unit status, individual training samples can have one of following status options:

  • Pending approval - is the initial status of each training sample. By default, all training samples have this status and this will not change until a reviewer approves or rejects the sample.
  • Approved - indicates that the reviewer has approved the training sample.
  • Rejected - indicates that the reviewer has rejected the training sample.
Caution:

Only training samples that have been Approved will be exported to image chips. Training samples with any other status will be excluded from the export process.

Review dashboards

Within the Prepare training step, during the Review training sample substep, a dashboard is created to manage the review process. Within the dashboard, the work units, the training samples to be reviewed, and the status of the review process will all be visible. The dashboards allow the review process to be intuitive and allows the process to be completed efficiently.