Ubuntu Mobile app enabled Robotics( Raspberry Pi and arduino involved)

Similar projects worth following
Project MrRobot is an Ubuntu Mobile app enabled Robotics which has the feature of voice, touch and shake control to interact with the Rapiro robot. This project is done within 28 hrs in Ubuntu Shenzhen Hackathon by our team E-minors. All the code is onpensourced and the arduino based Rapiro robot is opensouced as well with their code and 3d construction which means you could 3d print the part and build one yourself!!!

Our instructable lead you through the whole process of :

  1. how to deploy the code from Ubuntu Sdk to mobile
  2. learn how the intergrate with voice and text recognizable intelligent API to build a voice controlled ubuntu mobile app.
  3. how to implement a server on raspberry Pi to listen messages from app through web socket.
  4. some tips within the ui design


  1. Ubuntu Mobile
  2. Raspberry Pi wifi dongle
  3. Rapiro Robot
  4. music box (if needed)

Software Tools required

  1. Ubuntu QT sdk
  2. Pi with Raspbian
  3. Arduino IDE (if you wanna build the robot yourself)
  4. API

github address:MrRobot

  • 1
    Step 1

    Project Showcase(voice control ongoing)

    Working model

    the app has using 3 kinds of interactive methods. The first is touch screen which can allow user to directly touch the GUI to control the robot. Secondly, The API of accelerometer can detect serval movement like shake, that can also triggered some acts from Rapiro. On the bottom of the UI you can see a touch button which is the voice control button. Once you touch the button it will start to record the audio and you need to tap it when you finish the recording.

  • 2
    Step 2

    Install Ubuntu QT sdk and deploy the code on Ubuntu phone

    have a look of the details on our github channel.

  • 3
    Step 3

    Install a Web Server on your Pi

    Using wifi dongle to get on local wireless network

    Download the codes

    git clone



    Setting on boot startup adding a shell command at rc.local

    # Print the IP address
    _IP=$(hostname -I) || true
    if [ "$_IP" ]; then
    printf "My IP address is %s\n" "$_IP"
    python /home/pi/RapiroWithRaspi/ &

    Github address:RapiroWithRaspi

View all 5 instructions

Enjoy this project?



Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates