Skip To Content

Workload management in Deep Learning Studio

Available with Image Server

The Deep Learning Studio workload is defined by the project, roles, and work units. When you start Deep Learning Studio, the first step is to create a project for the deep learning process. However, there are defined roles in the group to consider before creating the Deep Learning Studio project. In each project, the work is divided into units that will be completed by the members of the group according to their role.

Project

A Deep Learning Studio project is created in ArcGIS Enterprise as an item that can be shared with others in your organization. The project aggregates the processes and work to accomplish the deep learning analysis. Three tasks are available to start the deep-learning process:

  • Prepare training data
  • Train model
  • Run interference

When the Prepare training data task is chosen, the project must be configured for the task. Configuration options include setting the data source, schema for training samples, group assignment, and work units.

Roles

A specified Deep Learning Studio role is related to your privileges in ArcGIS Enterprise. The roles are not specified during project creation. A project owner has the same capabilities as an analyst due to their similar privileges in the organization. However, the capability to mark as complete is only granted to the creator of the project (the project owner). The sample collector role is available to all users with editing privileges in the organization.

RoleConfigure project for Prepare training dataCollect training samplesReview training samplesExport training samplesTrain modelRun inferencing toolDelete project

Project owner

X

X

X

X

X

X

X

Analyst

X

X

X

X

X

Sample collector

X

  • Project owner—A project owner oversees the entire deep learning process and sets up the project with the data, assigns the groups, and defines the data sources. A project owner can participate in all of the processes in a Deep Learning Studio project.
  • Analyst—An analyst in a Deep Learning Studio project can participate in all of the work in the project, including collecting samples, training a model, using inferencing tools, and generating output. They combine their GIS and deep-learning knowledge to generate output from the deep learning analysis.
  • Sample collector—The sample collector role is for members of a group who will only participate in the collection of training samples.

Depending on the project, not all roles may be necessary, and they are not required. They are recommended for larger projects with many users contributing to the work. Members in Deep Learning Studio groups are managed in the same way as groups in ArcGIS Enterprise. For more information about ArcGIS Enterprise groups, see Create groups.

Work units

When a project owner defines the data source for a Deep Learning Studio project, the spatial extent of the input data source is considered as the total area to be completed for the project by default. During project configuration, a project owner can divide the work units into smaller units to define areas for training or divide the sample collection into smaller areas to be completed by a team of sample collectors. These defined work units are used for review of sample collections and must be marked as complete to be used in model training.

Custom spatial extents can be refined through a polygon feature layer during project configuration.

Individual work units overlaid on an imagery layer
An imagery layer is divided into smaller individual work units.

Work unit status can be one of three options during the training sample collection process. The work unit status can be:

  • Queued - meaning that it is ready to have the training samples collected.
  • In progress - meaning that sample collection is being performed.
  • Pending review - meaning it is waiting to be reviewed and is marked as Completed by the training sample collector.
  • In review - meaning that the training samples are in the process of being reviewed.
  • Reviewed - meaning that the work unit has been reviewed and is ready to be used to create image chips.

Review dashboards

Within the Prepare training step, during the Review training sample substep, a dashboard is created to manage the review process. Within the dashboard, the work units, the training samples to be reviewed, and the status of the review process will all be visible. The dashboards allow the review process to be intuitive and allows the process to be completed efficiently.