EXP-071 · live demoGet your place in 3D →
360 walk to 3D

A walk through our local park, rebuilt as it happens.

One short walk with a 360 camera. Watch the park build up in 3D around the camera, in the order the camera first saw it, then step into the finished Gaussian splat and look around.

Frame 0 / 0Points 0Replay
Rebuilding the park as the camera walks
Loading the walk…
Walk
Finished 3D
–

Capture record

What went in, and what came out

How we built it

From a 360 walk to a park you can step into

  1. Place every frame

    We keep the sharpest moment in every third of a second from both of the X6's fisheye lenses, used raw with no stitching. COLMAP solves the two lenses together as one rig, so both always face opposite ways from the same spot, and works out where the camera was at every moment.

  2. Train the splat, leave people out

    An open-vocabulary detector and SAM 2.1 mask every person in every frame, the person holding the camera included, plus the pram and hands. LichtFeld Studio fits 1.5 million Gaussians to the rest. Any faint trace of a person left behind is turned grey.

  3. Order it by time

    Every part of the splat is tagged with the first frame whose camera saw it close enough. Playing those tags in order replays the park appearing as the walk goes on.

  4. Hand over to the splat

    At the end of the walk the points give way to the full Gaussian splat, the same scene drawn photoreal, and you can look around it.

Limits

  • This is a replay. The reconstruction was made offline on one graphics card, then played back in the order the camera saw things. It does not run live as the video plays.
  • Metres are approximate: the scale comes from assuming the camera was held at 1.6 m.
  • The 360 camera sees all around, but only from one path. Step away from it in the finished splat and the far sides of trees and fences are missing or streaked.
  • People are not rebuilt: they are masked out before training, and any trace that survives is drawn as grey blur, never in true colour. The source video is not shown, because it shows our family.
  • This is our own footage, filmed on an Insta360 X6.