My caption 😄


In this group project at Imperial College London, we equipped Robot DE NIRO, a collaborative mobile-manipulation platform from the Robot Intelligence Lab , with various state-of-the-art capabilities, including autonomous navigation, localization and mapping, manipulation, face-, speech- and object recognition, speech I/O, a state machine and a GUI. The software is integrated with ROS and written in Python. Online documentation is available.

This project was very challenging as we had to learn both the hardware and software of various components and integrate them so to work in real-time. This is our final presentation that highlights some of the key design features. For details, please read the paper or consult the documentation.

Moreover, we presented an accepted paper on our work at the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems in Madrid, one of the premier robotics conference - and my first international academic conference ever attended! It was a blast! :-)

After the presentation, we also had a poster to present.

We were also privileged to present our work at Imperial Festival, a yearly event featuring exciting research at Imperial College London.

And here are some audience reactions, I guess they speak for themselves :-)

Our project also found some interest in tech news: Techxplore wrote a feature on our work. Also, you can find related news articles in Indonesian, Turkish, Arab and in this blog post.

This work would not have been possible without my fantastic teammates Sagar Doshi Nico Smuts, John Lingi, Kim Rants and the day and night support of our advisor Petar Kormushev.

Here are some further resources, for those who are interested:

Paper: DE NIRO paper
Code: DE NIRO code base
Documentation: DE NIRO docs