multi-modal localization for autonomous lunar landerlairlab/16831/....rwfisher.pdf · multi-modal...
TRANSCRIPT
![Page 1: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/1.jpg)
Multi-Modal Localization for Autonomous Lunar Lander
Robert Fisher Heather Jones
![Page 2: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/2.jpg)
Localizing Relative to the Moon
• Extended Kalman Filter • Lunar Reconnaissance Orbiter Data
– Laser altimeter ranges – Camera images
![Page 3: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/3.jpg)
Motion Model
• xt+1 = xt + vt * dt + 0.5*at*dt2
• vt+1 = vt + at*dt
• Accelerations treated as controls, calculated from ground truth position
![Page 4: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/4.jpg)
Error with Motion Model Only (Starting on ground-truth trajectory)
Position Error (m) Velocity Error (m/s)
![Page 5: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/5.jpg)
LRO Laser Altimeter, Digital Elevation Map
5 points per frame ~28 frames per second
![Page 6: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/6.jpg)
Laser Measurement Model: Single Point Range
Position (m) Velocity (m/s)
![Page 7: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/7.jpg)
Laser Measurement Model: Terrain Correlation to Sequence of
Ranges
![Page 8: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/8.jpg)
LRO Camera Images
Map Observation
![Page 9: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/9.jpg)
LRO Camera Images
Map Observation
![Page 10: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/10.jpg)
SIFT Keypoints
Map Observation
![Page 11: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/11.jpg)
Image Measurement Model
0 5 10 15 20 25 30 35 400
500
1000
1500
2000
2500
2360 2380 2400 2420 2440 2460 2480 2500 2520 2540 25600
0.002
0.004
0.006
0.008
0.01
0.012
0.014
![Page 12: Multi-Modal Localization for Autonomous Lunar Landerlairlab/16831/....rwfisher.pdf · Multi-Modal Localization for Autonomous Lunar Lander Robert Fisher Heather Jones . Localizing](https://reader030.vdocuments.site/reader030/viewer/2022040513/5e678559c1ec69766f6bc404/html5/thumbnails/12.jpg)
References • Avrim Blum, Tom Mitchell. “Combining labeled and unlabeled data with co-
training”, COLT 1998. • Arturo Gil, et al. “Monte carlo localization using sift features”, In Jorge S.
Marques, Nicolas Perez de la Blanca, and Pedro Pina, eds., Pattern Recognition and Image Analysis, vol. 3522 of Lecture Notes in Computer Science, pp. 623-630. Springer 2005.
• Andrew E. Johnson, et al. “A general approach to terrain relative navigation for planetary landing”, In AIAA 07, 2007.
• A. Oliva and A. Torralba. “Building the gist of a scene: the role of global image features in recognition”, Progress in brain research, 155:23-36, 2006.
• Christian Siagian and Laurent Itti. “Biologically inspired mobile robot vision localization”, 2006.
• David G. Lowe. “Distinctive image features from scale-invariant keypoints”, International Journal of Computer Vision, 60:91-110, 2004.
• Gordon Chin, et al. “Lunar Reconnaissance Orbiter Overview: The Instrument Suite and Mission”, Springer 2007.
• Leena Singh, Sungyung Lim. “On Lunar on-orbit Vision-Based Navigation: Terrain Mapping, Feature Tracking driven EKF”, AIAA Guidance 2008.