A Robust Filter for Marker-less Multi-person Tracking in Human-Robot Interaction Scenarios

1Department of Engineering for Innovation Medicine, University of Verona, Italy
2GRASP Laboratory, University of Pennsylvania, USA.

Abstract

Pursuing natural and marker-less human-robot interaction (HRI) has been a long-standing robotics research focus, driven by the vision of seamless collaboration without physical markers. Marker-less approaches promise an improved user experience, but state-of-the-art struggles with the challenges posed by intrinsic errors in human pose estimation (HPE) and depth cameras. These errors can lead to issues such as robot jittering, which can significantly impact the trust users have in collaborative systems. We propose a filtering pipeline that refines incomplete 3D human poses from an HPE backbone and a single RGB-D camera to address these challenges, solving for occlusions that can degrade the interaction. Experimental results show that using the proposed filter leads to more consistent and noise-free motion representation, reducing unexpected robot movements and enabling smoother interaction.

Video


BibTeX

@inproceedings{Martini2024,
      title={A Robust Filter for Marker-less Multi-person Tracking in Human-Robot Interaction Scenarios},
      author={Martini, Enrico and Parekh, Harshil and Peng, Shaoting and Bombieri, Nicola and Figueroa, Nadia},
      booktitle={2024 33rd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
      pages={1-6},
      year={2024},
      organization={IEEE}
    }