Skip To Content

Create gaussian splat from reality capture

Gaussian splat layer is a 3D layer type that can be generated from drones or aerial imagery. Gaussian splat layer is for applications requiring high fidelity, such as monitoring faculties or infrastructure, or other important assets.

Gaussian splat layers are suitable when very fine details need to be displayed that are difficult to capture in a mesh layer. While for city- or country-wide mapping where naturally a lower coverage and resolution is given, the mesh layer cannot only visualize the captured reality but also be used to give height information to features.

Gaussian splatting is a technique in computer graphics that renders a 3D scene from millions of so-called Gaussian splats. They can be seen as fuzzy ellipsoids that are defined by their position, rotation, size, color, and transparency. Gaussian splats are optimized during a training process. When rendered together, Gaussian splats blend to form a smooth, photorealistic representation in 3D.

splats rendering

A diagram shows individual splats rendered on the screen.

Workflows

You can generate Gaussian splats, from the same acquired imagery as you would use to create mesh data. To obtain a Gaussian splat layer of outstanding quality, a high coverage of images and a multiplicity of different oblique image views in high resolution is required. These prerequisites for the inputs enable your scene representation to be rich in detail and just look like reality.

Camera frustums

Camera frustums representing the coverage of images

Gaussian splat layer

Gaussian splat layer created using ArcGIS Pro Reality Studio.

You can use ArcGIS Reality Studio, ArcGIS Drone2Map, and ArcGIS Reality for ArcGIS Pro to create a gaussian splat dataset.

You can visualize the gaussian splat layer in ArcGIS Pro and create a web layer or use the gaussian splat layer in a web scene in ArcGIS Online.

Considerations

Gaussian splat layers are best suited for drone captures because of the high coverage from many different angles. You can use aerial imagery as well, but there is a higher chance that not all areas are covered sufficiently, and you may see gaps or blurry areas.

For smaller areas, like a construction site, a plant or factory site or to monitor infrastructure assets like bridges or telecom towers a gaussian splat layer will enable you to visualize very details.

Required software

ArcGIS Reality Suite  s a family of products for site-, city-, and country-wide reality mapping. If you are using drones, you will also be able to use  ArcGIS Drone2Map. 

ArcGIS Reality Studio is a scalable stand-alone application for processing aerial and drone imagery.

ArcGIS Reality for ArcGIS Pro brings reality mapping to ArcGIS Pro. Once the results are generated, you need an ArcGIS Online publisher account to publish Gaussian splat layers.

Explore the following resources to learn more about Gaussian splat layers.

ArcGIS help documentation

Reference material for ArcGIS products:

ArcGIS blogs, stories and technical papers

Supplemental guidance about concepts, software functionality, and workflows:

Videos

Esri-produced videos that clarify and demonstrate concepts, software functionality, and workflows:

Tutorials

Guided, hands-on lessons based on real-world problems:

Esri training

Authoritative learning resources focusing on key ArcGIS skills:

Esri community

Online 3D community to connect, collaborate, and share experiences: