In this group project at Imperial College London, we equipped Robot DE NIRO, a collaborative mobile-manipulation platform from the Robot Intelligence Lab , with various state-of-the-art capabilities, including autonomous navigation, localization and mapping, manipulation, face-, speech- and object recognition, speech I/O, a state machine and a GUI. The software is integrated with ROS and written in Python. Online documentation is available.
This project was very challenging as we had to learn both the hardware and software of various components and integrate them so to work in real-time. This is our final presentation that highlights some of the key design features. For details, please read the paper or consult the documentation.
Moreover, we presented an accepted paper on our work at the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems in Madrid, one of the premier robotics conference - and my first international academic conference ever attended! It was a blast! :-)
After the presentation, we also had a poster to present.
We were also privileged to present our work at Imperial Festival, a yearly event featuring exciting research at Imperial College London.
And here are some audience reactions, I guess they speak for themselves :-)
Here are some further resources, for those who are interested: