A wheelchair controlled by eye movements

Myrijam Stoetzer, 14, and Paul Foltin, 15, are from Duisburg in Germany. They have built a system for controlling a wheelchair using eye movements.

A standard webcam with the infrared filter removed tracks eye movements, and the eye is illuminated by (invisible) infrared light from LEDs to allow the system to work in low light conditions. A Raspberry Pi is used to process the video stream to obtain the position of the pupil and compare it with adjustable preset values representing forward, reverse, left and right. The command is then verified with a switch that is currently manual but that should eventually detect small movements of the tongue or cheek.

Myrijam and Paul

Myrijam and Paul demonstrate their wheelchair control system
Photo credit: basf.de

An Arduino controls recycled windscreen wiper motors via relays to turn custom 3D-printed wheels that sit against the tyres of the wheelchair and push the left and right wheels backwards or forwards to control movement and direction. The camera casing is also 3D-printed to Paul and Myrijam’s own design. The latest feature addition is a collision detection system using IR proximity sensors to detect obstacles.

This is their first project after moving on from LEGO Mindstorms, and they’ve chosen to use Python with the OpenCV image processing library for their first build using a full programming language, teaching themselves as they go along.

After finding that the Raspberry Pi 1 was a little slow to handle the image processing, Paul and Myrijam tried alternatives before switching to the Raspberry Pi 2 when it became available. It’s their preferred option considering cost and speed together, and they have said they’d welcome help to better their system’s performance by improving their code or by using the Pi 2’s four cores more efficiently.

Myrijam and Paul have been competing in Jugend forscht, the German science competition for young people, refining and extending their system as they have progressed through the competition, moving on from a model robotic platform to a real second-hand wheelchair, and using prize money from earlier rounds to fund improvements for later stages. At the weekend, they took their project to the final, where they were judged national winners in the “world of work” category. We’d like to offer them our heartfelt congratulations – we’re monumentally impressed by their work!

You can read more on Myrijam’s blog and on Hackaday, where you can also get in touch with this talented duo if you’re interested in helping them with their excellent project.


ColinD avatar

“This is their first project after moving on from LEGO Mindstorms”. Kudos, lots and lots of kudos.

John avatar

This is fantastic! Great work!

Yvan T. avatar

Wow. That is impressive.

Congratulations to Myrijam and Paul, great works.

Keep the spark of imagination alive.

Marcos Benedetti avatar

This is good idea! Great work!

David Fildes avatar

Wow,that’s awesome. Great to see technology that can improve quality of life, even better to see that level of creativity and talent in people so young.

winkleink avatar

Looks like the kind of people who could benefit from an Infra-red camera. Allow them to make it without having to hack a camera.

Steve Foster avatar

Wow! How great is that. This is definitely something to share with my Pi club at school tomorrow. Thank you for finding and sharing that Helen.

Jeremy avatar

This an astonishing design. Considering its their first big project and learning Python as they go, these two have serious potential! Well done to them.

Another example of how the Pi is improving the world apart from its primary objective, education.

Nicolas avatar

Awesome project, congratulations!
just a question out of curiosity, is the ir led tracking system not too bad for the eye?

Naveen avatar

Excellent Job folks! Wish u all the success ahead. These tiny dreams will definitely lead u to best of ur capabilities.

Will look forward to work together as i’m one of u, who has similar dreams.


Siddartha avatar

Congratulations to Myrijam and Paul, for your great works. Really this is an impressive idea. Hats off..

Comments are closed