How To Turn Your Smartphone Into A Robot

How To Turn Your Smartphone Into A Robot

they have published their plans along with the software that makes it all possible so that anybody can build smart, capable robots for around $50 (provided they have a smartphone).

The approach is straightforward. The researchers begin with a design for a four-wheeled robot powered by batteries. The chassis is simple, consisting of a bottom plate that houses the wheels, motors and microcontroller, and a top plate with a universal smartphone holder. The team say that with a consumer 3D printer, the plates take a full day to print. The materials cost around $5.

OpenBot: a robot powered by a smartphone

(Credit: OpenBot)

The other components — four motors and wheels, a speed sensor, Arduino Nano board and motor driver — cost only $25. In fact, the biggest single cost is the three rechargeable lithium batteries that together cost $21 and last for around 45 minutes.

The team also supplies the software, which comes in two parts. The first sits on the Arduino Nano board and acts a bridge between the smartphone and the motors. It looks after the batteries and basic motor actuation tasks.

The second is an Android app which integrates data from the onboard camera, gyroscope, accelerometer, GPS and so on. This provides real time images of the robot’s environment, as well as information about acceleration, location and light intensity. It also processes this data using the open source TensorFlow Lite AI infrastructure to recognize people and objects and for route planning in real time.

The system can also connect by Bluetooth to external game controllers such as those for the PS4 and Xbox, which allow users to interact with the robot. But these are not essential. “The use of a controller is optional and is not needed for autonomous operation,” say Müller and Koltun.

The result is a remarkably powerful little robot that is simple to make at home, at educational establishments or indeed anywhere else. The researchers have put it through its paces by training it to follow a person and to navigate autonomously through relatively simple known and unknown environments.

Autonomous Navigation

The results are impressive. You can watch the robot autonomously navigating and following a young person here. And the team have validated the set up on a wide range of smartphones ranging from relatively basic devices such as the Nokia 2.2 right up to powerful machines such as the Huawei P30 and Google Pixel 4 XL. “Our experiments have shown that a $50 robot body powered by a smartphone is capable of person following and real-time autonomous navigation,” say Müller and Koltun.

Unsurprisingly, the more powerful devices perform best. “The cheapest low-end phone (Nokia 2.2) performs worst but is surprisingly still able to follow the person about half of the time,” they say. That performance should get better quickly. “We expect that even low-end phones will be able to run complex AI models reliably in the near future.”

Of course, this isn’t the first time that robot makers have attempted to use smartphones in their designs. But previous projects have been hampered by the capabilities of phones in the past or have used the phones as controllers rather than as the brains of the device. Most are no longer being updated and none have attempted to promote robotics on this scale by making the designs freely available.

That makes the OpenBot project unique. ”We hope that the presented work will open new opportunities for education and large-scale learning via thousands of low-cost robots deployed around the world,” say the researchers, adding that they expect other capabilities to be added soon, such as natural language processing. “We also expect the basic ideas presented in this work to extend to other forms of robot embodiment, such as manipulators, aerial vehicles and watercraft.”

It’s not hard to imagine how this kind of work can be exploited by grass roots teams around the world. For example, these kinds of machines could act as robotic security systems, as robotic companions and even as robotic guide dogs.

Time to get to work!


Ref: OpenBot: Turning Smartphones into Robots
arxiv.org/abs/2008.10631

XL subscribe to our newsletter banner

Get the latest news and advice on COVID-19, direct from the experts in your inbox. Join hundreds of thousands who trust experts by subscribing to our newsletter.

Send your news and stories to us news@climaxradio.co.uk or newstories@climaxnewsroom.com and WhatsApp: +447747873668.

Before you go...

Democratic norms are being stress-tested all over the world, and the past few years have thrown up all kinds of questions we didn't know needed clarifying – how long is too long for a parliamentary prorogation? How far should politicians be allowed to intervene in court cases? To monitor these issues as closely as we have in the past we need your support, so please consider donating to The Climax News Room.