NCS-LVTF: A Layered Vision–Temporal Fusion Framework for Continuous 6-DoF Tracking of Non-Cooperative Satellites in Close-Range Proximity NCS-LVTF:面向近距逼近的非合作衛星連續 6-DoF 追蹤分層視覺–時序融合框架

論文 · 2027

發表IEEE 國際機器人與自動化會議(ICRA 2027) · 審稿中

作者Jiaqing Chen, ShaSha Fan, Jiaming Liu, Haomin Gu, Tianshu Wang, Yonghe Zhang, Chengyu Ma

署名說明第一作者

關鍵詞Non-cooperative satellite, continuous 6-DoF tracking, close-range proximity, layered vision–temporal fusion, B-ESKF, OoV-aware perception, depth-consistency gating, learned-gated ICP, NCS-Prox, on-orbit servicing

  1. 提出 NCS-LVTF(Non-Cooperative Satellite Layered Vision–Temporal Fusion)分層流水線,面向非合作衛星近距逼近的連續 6-DoF 追蹤:融合多模態視覺、基於動力學的時序先驗、B-ESKF(時序偏置誤差狀態卡爾曼濾波)融合,以及學習門控的 ICP 精修,在 NCS-Prox Tier 3 測試集上顯著優於外部基線。
  2. 建構面向近距視野塌縮的穩健視覺模組:訓練階段採用 OoV 感知微調(可見性掩碼熱力圖監督與距離/可見度樣本重加權),推理階段以深度一致性門控(DCR)拒識不可靠 PnP,並回退至迴歸分支,使近距誤差顯著低於獨立骨干與先前架構。
  3. 發布 NCS-Prox 三層資料集以填補公開基準空白:Tier 1 大規模靜態視覺語料(約 10 萬幀)用於模組訓練,Tier 2 翻滾動力學語料(1000 條軌跡)用於時序模型驗證,Tier 3 含 70 個連續逼近場景(同步 RGB-D、點雲、IMU 與軌跡真值)用於端到端系統評測;完整配置在 Tier 3 Test 上達到 eR=1.72°、et=4.57 cm。

摘要

Continuous 6-DoF pose tracking is essential for non-cooperative satellite proximity operations and on-orbit servicing; nevertheless, dedicated methods for the close-range rendezvous phase remain scarce. At close range, neither modality alone is reliable: out-of-view (OoV) conditions can cause catastrophic visual failures, while dynamics-only propagation inevitably accumulates drift under model mismatch and long-horizon extrapolation. Most existing fusion pipelines inject temporal information through filtering alone and do not exploit the physical structure implicit in motion history. We propose NCS-LVTF (Non-Cooperative Satellite Layered Vision–Temporal Fusion), a layered vision–temporal fusion framework for continuous 6-DoF tracking of non-cooperative satellites in close-range proximity. OoV-robust, depth-gated multimodal visual observations form the core sensing stream, while physics-based tumbling propagation supplies a temporal prior periodically assimilated through B-ESKF (temporally-biased ESKF) with adaptive observation noise, along with learned-gated ICP geometric refinement and a series of supporting modules and system-level optimizations. We also introduce NCS-Prox, a unified three-tier dataset for close-range non-cooperative proximity tracking: Tier 1 provides a large-scale static visual corpus for module training, Tier 2 a tumbling-dynamics corpus for temporal-model validation, and Tier 3 comprises 70 continuous approach scenarios with synchronized RGB-D imagery, point clouds, IMU, and trajectory ground truth for end-to-end system evaluation. Under the NCS-Prox Tier 3 evaluation protocol, experiments show that NCS-LVTF consistently outperforms vision-only and dynamics-only baselines, achieving eR=1.72° and et=4.57 cm on the held-out Tier 3 test split.