Visual SLAM for dynamic environments based on object detection and optical flow for dynamic object removal

Charalambos Theodorou
,
Vladan Velisavljevic
,
Vladimir Dyo

Briteyellow Ltd

Research Output: Contribution to journal Article Peer-review

Open access

Abstract

In dynamic indoor environments and for a Visual Simultaneous Localization and Mapping (vSLAM) system to operate, moving objects should be considered because they could affect the system’s visual odometer stability and it is position estimation accuracy. vSLAM can use feature points or a sequence of images as it is only source of input in order to perform localization while simultaneously creating a map of the environment. A vSLAM system based on ORB-SLAM3 and on YOLOR was proposed in this paper. The newly proposed system in combination with an object detection model (YOLOX) applied on extracted feature points is capable of achieving 2-4% better accuracy as compared to VPS-SLAM and DS-SLAM. Static feature points such as signs and benches were used to calculate the camera position and dynamic moving objects were eliminated by using the tracking thread. A specific custom personal dataset that includes indoor and outdoor RGB-D pictures of train stations including dynamic objects and high density of people, ground truth data, sequence data, video recording with the train stations and X, Y, Z data was used to validate and evaluate the proposed method. The results show that ORB-SLAM3 with YOLOR as object detection achieves 89.54% of accuracy in dynamic indoor environments compared to previous systems such as VPS-SLAM.