This deep learning model is used to detect and segment trees in high-resolution drone or aerial imagery. Tree segmentation can be used for applications such as vegetation management, forestry, urban planning, and so on. High-resolution aerial and drone imagery can be used for tree detection because of its high spatiotemporal coverage.
This deep learning model is based on DeepForest and has been trained on data from the National Ecological Observatory Network. The model also uses Segment Anything Model (SAM) by Meta that is trained on 1-Billion mask dataset (SA-1B), which comprises a diverse set of 11 million images and over 1 billion masks.
License requirements
To complete this workflow, the following are the license requirements:
- ArcGIS Desktop—ArcGIS Image Analyst extension for ArcGIS Pro
- ArcGIS Enterprise—ArcGIS Image Server
- ArcGIS Online—ArcGIS Pro or Professional Plus user type.
Model details
This model has the following characteristics:
- Input—8-bit, 3-band high-resolution aerial imagery.
- Output—Feature class containing separate masks for each tree.
- Compute—This workflow is compute intensive, and a GPU with compute capability of 6.0 or higher is recommended.
- Applicable geographies—This model is designed to work well across the United States.
- Architecture—This model is based on the DeepForest Python package and uses the RetinaNet model architecture implemented in Torchvision and open-source Segment Anything Model (SAM) by Meta.
- Accuracy metrics—This model has precision and recall scores of 0.66 and 0.79, respectively.
Access and download the model
Download the Tree Segmentation pretrained model from ArcGIS Living Atlas of the World. Alternatively, access the model directly from ArcGIS Pro, or consume it in ArcGIS Image for ArcGIS Online.
- Browse to ArcGIS Living Atlas of the World.
- Sign in with your ArcGIS Online credentials.
- Search for Tree Segmentation and open the item page from the search results.
- Click the Download button to download the model.
You can use the downloaded .dlpk file directly in ArcGIS Pro, or upload and use it in ArcGIS Enterprise. Additionally, you can fine-tune the pretrained model if necessary.
Release notes
The following are the release notes:
| Date | Description |
|---|---|
| July 2023 | First release of Tree Segmentation |