Getting Started with Arcturus Vision Gaussian XR
Learn how to install the app and experience 3D Gaussian Splatting scenes in immersive 3D.
■Install the App
1. Turn on your Steam Frame and sign in to your Steam account through the Steam app.
2. Search for “Arcturus Vision Gaussian XR” in the Steam app and select “Add to Library.”
3. Open “Library” and enter “arc” in the search bar.
4. Select “Arcturus Vision Camera,” then select “Install.”
ーEnter the scenes
Open the first scene from the Arcturus Vision Gaussian XR home screen.
1. Point either controller at “Enter Scenes.”
2. Press the controller trigger once.
3. Wait for the first scene to appear.
Note: You can also press the thumbstick on either controller to close the home screen and open the scene.
ーNavigate in Arcturus Vision Gaussian XR
1. Move and Rotate
1. Point either controller at “Enter Scenes.”
2. Move the right thumbstick left or right to rotate your view.
3. Press the “X” or “B” button to rotate your view by a fixed angle.
2. Adjust Scene Size, Reset Position, Switch Scenes, and View Help
・Adjust the scene size: Hold down the grip buttons on both controllers and move your hands farther apart or closer together to adjust the size of the scene.
・Reset the view: Press the “A” button to reset the viewing position.
・Switch scenes: Press the left thumbstick to switch to the previous scene, or press the right thumbstick to switch to the next scene.
・Show/hide help: Press the “View” button on the left controller or the “Menu” button on the right controller to show or hide the controller help.
Note: If you lose track of your position or orientation while navigating, release the grip buttons and press the “A” button to reset the view to the center position and orientation.
■Create a Gaussian Scene from Camera Recordings
Convert MP4 files recorded with Arcturus Vision Camera and transferred to your computer into a “scene.sog” file that can be viewed in Arcturus Vision Gaussian XR.
This initial version is designed for use on a Linux workstation equipped with an NVIDIA GPU. Before you begin, make sure all required software is installed.
・uv
・COLMAP, available as colmap on your PATH
・LichtFeld Studio, available as LichtFeld-Studio on your PATH
1.Download and Extract the Script
1. Download the AV Cam to 3DGS script.
2. Extract the downloaded file and open a terminal in the folder containing “avcam_to_3dgs.py.”
3. Run the following command to make the script executable:
chmod +x avcam_to_3dgs.py
2.Run the Conversion
Specify the synced Camera MP4 file and a new output directory, then run the following command:
.avcam_to_3dgs.py recording.mp4 output-directory
LichtFeld Studio will launch, allowing you to monitor the training progress.
To run the process without displaying the interface, add “–headless” to the command:
./avcam_to_3dgs.py recording.mp4 output-directory –headless
The script extracts and tone-maps the synchronized stereo images, then uses the calibration and trajectory data included in the recording to build an aligned COLMAP scene.
It then trains at half resolution, limits the number of Gaussians to 1.5 million, and outputs the resulting file to “output-directory/scene.sog.”
If the Process Stops Before Completion
・Add “–resume” to the same command and run it again.
・For the initial run, use a new, empty output directory.
Note: For maximum detail, add “–training-image-scale 1”. This will increase training time and GPU memory usage.
Note: Hardware-accelerated video decoding and GPU-accelerated COLMAP will be used automatically when supported. If they are not available, a warning will appear and the process will fall back to CPU processing.
■Transfer a Completed 3DGS Scene to Steam Frame
Copy your completed 3D Gaussian Splatting scene to Steam Frame and view it in Arcturus Vision Gaussian XR.
1. Export the completed scene as a bundled SOG v2 file with the “.sog” extension.
2. If Arcturus Vision Gaussian XR is running, close the app.
3. Connect your Steam Frame to your Mac or PC via USB and make sure Developer Mode is enabled.
4. Open Terminal or PowerShell in an environment where adb is available, then run the appropriate command for your computer.
Note: In the example command, replace the source path with the location of the completed SOG file on your Mac or PC.
macOS Terminal
adb push “/path/to/your-scene.sog”\
“/home/steamos/.local/share/Steam/steamapps/common/ArcturusVisionGaussianXR/Scenes/”
Windows PowerShelll
adb push “C:\path\to\your-scene.sog”`
“/home/steamos/.local/share/Steam/steamapps/common/ArcturusVisionGaussianXR/Scenes/”
5. Wait until adb confirms that the file transfer has completed successfully. Once the transfer is complete, launch Arcturus Vision Gaussian XR from your Steam Library.
Arcturus Vision Gaussian XR will automatically detect compatible scenes in the “Scenes” folder when the app launches.