Skip to content
  • There are no suggestions because the search field is empty.

Gaussian Splatting in PIX4D

IN THIS ARTICLE

What is Gaussian splatting?
How does Gaussian splatting work?
Which projects benefit from the Gaussian splatting Technique
Best practices for data acquisition
Which PIX4D product can create Gaussian splatting?

What is Gaussian splatting?

Gaussian splatting is an advanced technique for 3D scene reconstruction and rendering that models a scene as a set of 3D Gaussians instead of conventional meshes or point clouds, enabling highly detailed 3D models with photorealistic rendering.

How does Gaussian splatting work?

Rather than a single algorithm, Gaussian splatting is a family of techniques, with some prioritizing speed, others focus on rendering quality or geometric accuracy. But all Gaussian splatting techniques share the same basic primitive to build their models: the 3D Gaussian.

3D Gaussians have two unique advantages over traditional 3D primitives like discrete 3D points. First, thanks to their semi-transparent and gradually changing appearance, large numbers of Gaussians can be blended smoothly, making them ideal for high-quality rendering. The process of generating a rendered image from a set of Gaussians is called “splatting“ because it involves projecting them onto the image plane and spreading (or "splatting") their contribution across multiple pixels.

Think of spray painting onto a surface. Each spray dot is a "splat" that overlaps with others, forming a smooth, blended result. Similarly, Gaussian splatting overlays the projected Gaussians to create a seamless final image.

The second key advantage of Gaussians as a building block is mainly relevant for the construction of the model from input images. Thanks to the mathematical properties of a 3D model made of Gaussians, we can precisely predict how changes in their parameters (position, scale, opacity, rotation, and color) will affect the resulting renders. This allows us to iteratively tweak the Gaussian models so that, when seen from the right angle, they look exactly like the real-world photos.

At PIX4D, we combine the strengths of Gaussian splatting with the reliability and actionability of traditional photogrammetry outputs. Our processing pipeline generates an accurately scaled and georeferenced Gaussian splatting model, while also producing a point cloud and a mesh built from this model, which benefits from Gaussian splatting’s ability to reconstruct finer details.

Which projects benefit from the Gaussian splatting Technique

The Gaussian splatting technique significantly enhances the accuracy and realism of 3D modeling, particularly when dealing with objects that have intricate geometric details and fine structural elements.

This technique is especially effective for capturing complex shapes, which are often challenging to represent using more traditional approaches. Additionally, it excels in handling thin structures like pipes, wires, and other elongated elements that require high precision to avoid visual artifacts or loss of detail.

This technique provides a smoother, more continuous representation of object surfaces, improving visual fidelity.

Best practices for data acquisition

Gaussian splatting is a 3D reconstruction technique based on images; high-quality results depend directly on how the images are captured. For optimal accuracy reconstruction, the area of interest should be covered from multiple viewpoints, ensuring it is visible in several overlapping images. 

To know more about the best practices for data acquisiton, please refer to the following articles:

Which PIX4D product can create Gaussian splatting?

PIX4D offers multiple products that can create Gaussian splatting: