Human life is precious, and in the event of any unfortunate occurrence, highest efforts are made to safeguard it. To provide timely aid or undertake extraction of humans in distress, it is critical to accurately locate them. There has been an increased usage of drones to detect and track humans in such situations. Drones are used to capture high-resolution images after natural and human-made disasters. It is possible to find survivors from a drone feed, but that requires manual analysis. This is a time-consuming process and is prone to human error.
This model is capable of detecting humans by looking at drone imagery and can draw bounding boxes around their exact location. Deep learning models are highly capable of learning complex semantics and can produce better results. Use this deep learning model to automate the task of detection, reducing the time and effort required significantly.
To complete this workflow, the following are the license requirements:
- ArcGIS Desktop—ArcGIS Image Analyst extension for ArcGIS Pro
- ArcGIS Enterprise—ArcGIS Image Server
- ArcGIS Online—ArcGIS Image for ArcGIS Online
This model has the following characteristics:
- Input—High-resolution (1–5 cm) individual drone images or an orthomosaic.
- Output—Feature class containing detected humans.
- Compute—This workflow is compute intensive, and a GPU with minimum CUDA compute capability of 6.0 is recommended.
- Applicable geographies—The model is expected to work well in coastal areas of Africa but can also be tried in other areas.
- Architecture—This model uses the FasterRCNN model architecture implemented in ArcGIS API for Python.
- Accuracy metrics—This model has an average precision score of 0.728 for humans and 0.671 for possibly a human class.
Access and download the model
Download the Human Detection (Drone Imagery) pretrained model from ArcGIS Living Atlas of the World. Alternatively, access the model directly from ArcGIS Pro, or consume it in ArcGIS Image for ArcGIS Online.
- Browse to ArcGIS Living Atlas of the World.
- Sign in with your ArcGIS Online credentials.
- Search for Human Detection (Drone Imagery) and open the item page from the search results.
- Click the Download button to download the model.
You can use the downloaded .dlpk file directly in ArcGIS Pro, or upload and use it in ArcGIS Enterprise. Additionally, you can fine-tune the pretrained model if necessary.
The following are the release notes: