Title
A Reinforcement Learning Based Dirt-Exploration for Cleaning-Auditing Robot
Abstract
Cleaning is one of the fundamental tasks with prime importance given in our day-to-day life. Moreover, the importance of cleaning drives the research efforts towards bringing leading edge technologies, including robotics, into the cleaning domain. However, an effective method to assess the quality of cleaning is an equally important research problem to be addressed. The primary footstep towards addressing the fundamental question of "How clean is clean" is addressed using an autonomous cleaning-auditing robot that audits the cleanliness of a given area. This research work focuses on a novel reinforcement learning-based experience-driven dirt exploration strategy for a cleaning-auditing robot. The proposed approach uses proximal policy approximation (PPO) based on-policy learning method to generate waypoints and sampling decisions to explore the probable dirt accumulation regions in a given area. The policy network is trained in multiple environments with simulated dirt patterns. Experiment trials have been conducted to validate the trained policy in both simulated and real-world environments using an in-house developed cleaning audit robot called BELUGA.
Year
DOI
Venue
2021
10.3390/s21248331
SENSORS
Keywords
DocType
Volume
audit robot, path planning, reinforcement learning, cleaning-auditing
Journal
21
Issue
ISSN
Citations 
24
1424-8220
0
PageRank 
References 
Authors
0.34
0
4