No Joystick. No hands.

How about driving a robotic wheelchair using facial expressions, head movement, eye tracking or speech recognition? Meet Wheelie, the hands-free solution that can capture points from your face and voice using Intel Realsense technology and translate them into wheelchair commands.

Each person might have different facial physical limitation or comfort constraints. Others will prefer to use the head movement or even eye-tracking solution.

Wheelie was designed to be simple and comfortable. That's Wheelie, fun for some, very useful for those who really need it.

FACIAL Expressions

How about driving a robotic wheelchair using facial expressions? Meet Wheelie, the hands-free solution that can capture nearly 80 points from your face using Intel RealSense technology to set up key expressions. Each key expression can control something on the wheelchair. Let's take a ride!

  1. Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek.
  2. Pick up 5 of them.
  3. Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.
  4. Now you're ready to go!
  5. Want to know more? Download the Press Release for further details! ENGLISH | PORTUGUESE

HEAD Movements

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go! Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands. Just natural as you think!

Yes. You can stop controlling the wheelchair with you head movement whenever you want. You can disable and enable the interface using two simple facial expressions: a Kiss will make Wheelie track your head, a Full-Smile makes it stop.

Summing up:

  1. Detect head orientation along 3 axes: yaw, pitch and roll
  2. Use one facial expression to Stop and block the interface and a second one to release it.
  3. It does not matter if you are tall or short.
  4. If something wonderful happens around and you need to turn your head quickly to see it, don't' miss the opportunity! Go ahead. Wheelie will promptly stop the wheelchair for you in these cases.

SPEECH Recognition

Wheelie takes the Intel® RealSense™ speech recognition to another level. Now there is a safe and comfortable option to control the robotic wheelchair using voice commands. Here we combine the Intel® RealSense™ speech recognition command to the shared control of the robotic wheelchair to safely drive around. The vocabulary can be set out to meet the patient's needs!

  1. Wheelie can recognize voice commands such as "Move Forward", "Turn Right", "Stop" and others.
  2. Wheelie supports commands in English and Portuguese .
  3. You can set your own voice commands.
  4. Don't worry if you are in the middle of a conversation. Wheelie tries its best to recognize when the sentence said is supposed to be a given command or not.'

EYE-Tracking and Heat Maps

If you are into advertising research or marketing you have probably enjoyed this combination. It can reveal where people really look over ads, movies, designs or mockups. Here let's use them to drive the wheelchair!

  1. Eye Tracking and Heat maps combined.
  2. Accuracy. The challenge was to develop the interface on a regular/small window.
  3. This version features a 6.8" window from corner to corner. So far, it has been proven to be a reasonable size. For reference, the iPad Mini 3 display is 7.9".
  4. Take a look, Let it burn and drive!