Close
0%
0%

Teletouch

TeleTouch is a open source robotic system that allows mimicking user’s finger motions/gestures to be transferred in a desired remote locatio

Similar projects worth following
0 followers
Robotics offers an efficient way for assistive devices to maintain many errands. In this study it is aimed to present a proof of concept robotic study that is called TeleTouch. TeleTouch is a robotic system that allows mimicking user’s finger motions/gestures to be transferred in a desired remote location with in an acceptable delay. In the implementation Leap motion sensor, Raspberry Pi, and Arduino systems are used. 3D printers printed Hand model is actuated by Arduino system which is responsible for driving the servo motors connected the hand model. Raspberry PI is used not only for transferring camera view of the hand model to the controlling remote system but also it is used for transferring to finger attributes to the Arduino system. A software is developed in .Net platform to gather the user’s attributes of the fingers from leap motion sensor system. Delay times of the local and remote system investigated and understood that proposed system successfully transfer mo

All source code in github page.

Methodology

Project construction is planned in three basic stages. The first stage includes the user interface software. In the second step, the finger and hand values can be accessed via the internet and at the same time the Python code is written in order to transfer the image on the TCP / IP protocol. Finally, the Arduino platform was chosen to read the control and sensor values of the servo motors. First of all, the user attaches Leap Motion to his computer. Then it starts the application, which is prepared in C #. When the user moves his / her hands and fingers; Hand information is read and interpreted by the application. Then the user enters the IP address of the device he wants to connect to and then connects to the opposite device (to server). The connected device is actually a small computer. The preferred card in this project is Raspberry Pi. Alternatively, cards such as BeagleBone may be used. The most important feature of these cards is to have an operating system (Linux) embedded in them. With this operating system it is possible to run complex programs that microcontrollers can not run. In this context, the Python code in Raspberry Pi responds to requests to connect over IP (clients). After the connection, the Arduino card connected to Raspberry Pi reads the sensor values via the serial port and the media information is sent to the interface. These values are plotted in real time on the interface. Hand and finger data from the interface are also sent to Arduino in the same way. These are converted to PWM waves for robot hand control and are provided for hand movement. In addition, the user interface from the camera on the robot hand goes to the camera image and the media data read from the sensor.

  • 5 × Servo Motors
  • 1 × Raspberry Pi
  • 1 × Tele-Board V1.3.5
  • 1 × Arduino Nano
  • 1 × Wooden Plates

View all 7 components

  • 1
    3D Printing

    First of all we should print all of the parts from 3D printer. In first try we used model from bq3D.

  • 2
    Installing the Cover

    After mounting each servo motor, let's put in the system. You should watch out the aligment of the motors.

  • 3
    Circuit Designs & Schematics

    The current circuit so basic and so easy to control the sytem. We designed a PCB that you can you use in these project. It uses Arduino Nano as a controller. This board can drive 5 servo motor individually. Also it has got humidity(DHT11), temperature(LM35) and light intensity sensors. Also card includes two N-Type transistor that user can use in their applications. Also board has got a Sensorboard connector that user can solder and use.

View all 4 instructions

Enjoy this project?

Share

Discussions

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates