Stable3R

Streaming 3D Reconstruction with Stable Geometric References

NeurIPS 2026

1 Zhejiang University2 AMAP CVLab, Alibaba

† Corresponding author

NRGBD geometric context probe: StreamVGGT mean ATE changes substantially as intermediate frames are added, while Stable3R remains lower and more stable.
Context sensitivity on NRGBD.

Stable geometric
references.

Refine historical memory and reduce first-frame bias—without revising past predictions.

Abstract

Causal attention and KV-caching enable streaming 3D reconstruction, but information-poor early caches and first-frame anchoring can introduce persistent geometric bias. Stable3R addresses both sources of instability: lookahead attention refines historical caches as new observations arrive, while a frame-equivariant architecture with prefix-relative pose supervision reduces reliance on a single initial frame. Together, these designs improve reconstruction quality and camera pose estimation while preserving a strictly causal inference schedule.

Method

Stable3R framework: an image encoder and frame attention feed a QU-KV cache, followed by historical U updates, lookahead attention, and camera and geometry prediction heads.

Lookahead attention

New observations refine historical memory.

Prefix-relative supervision

Learn relative poses across the observed prefix.

Parallel training
Original paper diagram of block-wise causal attention, diagonal dependency order, update kernels, and attention kernels.

Interactive comparison

Common-input reconstruction comparison

Point error0 cm≥10 cm

StreamVGGT

Stable3R

Ours

Ground truth

RGB-D reference
Selected scene only

Loading real point clouds…

Details & sources

Matched RGB frames · 518 × 392 · BF16 · full history. Same camera, point size and error scale; no model-specific filtering. RGB-D ground truth is used for evaluation. Error colors measure distance to the full GT cloud, not the display subset.

Evaluation: first-camera GT coordinates, median depth shift/scale normalization, 224 × 224 center crop, correspondence Sim(3), and point-to-point ICP (0.1 m). Acc ↓: predicted-to-GT distance; Comp ↓: GT-to-predicted distance; NC ↑: normal consistency.

Drag to rotate, Shift/right-drag to pan, scroll/pinch to zoom. Arrow keys rotate; +/− zoom; R resets. Views are synchronized; there is no automatic rotation.

Three selected examples, not a dataset-wide average. Frame IDs, metrics & source hashes

Paper results

Original reconstruction comparison of CUT3R, TTT3R, StreamVGGT, LongStream, and Stable3R, with staircase and dynamic indoor examples under sparse and mid-length settings.
Sparse (top) and 25-frame (bottom) reconstructions. Stable3R: rightmost.

3D reconstruction

NRGBD 25-frame reconstruction results from the manuscript
MethodAccuracy ↓Completeness ↓Normal consistency ↑
MeanMedianMeanMedianMeanMedian
CUT3R0.0800.0460.0530.0250.8200.958
TTT3R0.0870.0490.0550.0280.8080.948
StreamVGGT0.0790.0550.0590.0320.8460.983
LongStream0.0780.0500.0520.0240.8360.975
Stable3R0.0220.0140.0200.0100.8840.987
Protocol & metrics

Paper Table 1. Uniformly sampled 25-frame sequences.

Accuracy: predicted-to-reference distance. Completeness: reference-to-predicted distance. Normal consistency: surface-normal agreement. ↓ Lower is better; ↑ higher is better.

Bold: best; underline: second best. Paper table data

Camera pose estimation

Sintel camera pose results from the manuscript
MethodATE ↓RPE translation ↓RPE rotation ↓
CUT3R0.2100.0710.607
TTT3R0.2090.0820.683
StreamVGGT0.2320.0820.669
LongStream0.1940.0760.604
Stable3R0.1160.0540.425
Protocol & metrics

Paper Table 3. Sim(3)-aligned trajectories. TUM-dynamics and ScanNet: 90 frames; Sintel: 20–50 frames. ATE: absolute translation error; RPE: relative pose error. All metrics are lower-is-better.

TUM trajectory comparisons for five methods: red predicted camera paths versus dashed gray ground truth. Stable3R is shown in the last column.
TUM trajectories · Red: prediction; dashed gray: ground truth.