© 2024 WKNO FM
Play Live Radio
Next Up:
0:00 0:00
Available On Air Stations

In Eye Control, A Promise To Let Your Tablet Go Hands-Free

The open-source software produced by the Gaze Group uses infrared light to track the pupils of users' eyes, allowing them to control the cursor on a mobile or desktop computer.
Gaze Group
The open-source software produced by the Gaze Group uses infrared light to track the pupils of users' eyes, allowing them to control the cursor on a mobile or desktop computer.

Forget touch screens and voice recognition — what if you could control your computer just by looking at it? Gaze-based interaction has been around for 20 years, used mainly by people with disabilities. But the technology could be available to the masses soon, allowing users to move a cursor with their eyes, or turn the pages of an e-book without lifting a finger.

In Denmark, an eye-control research group has just turned itself into a business, hoping to be part of the next wave of usability.

If you look at the big names in eye-control technology, you'll notice that most companies are based in the U.S. or Northern Europe, places where there's enough private wealth or government support to help people with disabilities pay for pricey specialized equipment.

"But not everyone gets it," says usability expert Sune Alstrup Johansen, of the Gaze Group at the IT University of Copenhagen. "And obviously if you look at the rest of the world, a lot of people don't have access to these expensive eye trackers."

Johansen, a Ph.D. student, spent years working on the question of how to make the systems cheaper.

"After a while, we figured out that probably the best way is to go for a mass-market approach," he says, "where everybody would have this available."

Just over a year ago, Johansen and his colleagues spun off into The Eye Tribe, a company with the goal of making it possible for all people to control mobile devices with their eyes. He explains how it works:

"You have infrared light that is projected toward your face. And the infrared light is then reflected in your pupil. And by seeing those reflections, we can pretty easily — well, not easily," he adds with a laugh — "with our algorithms, we can easily calculate where you're looking."

The snag is the infrared light, which is not a standard feature on most smartphones and tablets. Johansen says that adding it wouldn't be a huge change, as it means switching out a filter on the camera that comes on most mobile devices.

Still, it is a change — and that means convincing manufacturers that mainstream users are going to want it. And what's more mainstream than Fruit Ninja, one of the most popular game apps in the world?

In the game, players swipe across a touch screen to slice flying fruit into pieces. In the Eye Tribe's version, you slice and dice using only your eyes.

When I ask to try it, Javier San Agustin hands me a modified Windows 8 tablet.

"So you hold it like that, and now you need to do the calibration process," he says. "Just follow the dot."

I follow the dot so the computer can get to know my eyes, which sounds easy enough. But it's weird using a sense organ as a muscle. I feel like an unpracticed superhero with lasers coming out of my eyes — which may explain why I somehow manage to fail the calibration (twice).

"Let's try again," San Agustin says.

Once I do pass and actually play Fruit Ninja, it's pretty amazing. But just because what the Eye Tribe is doing is flashy, that doesn't mean it's a sure thing. There are plenty of other companies working on different versions of eye-control and eye-tracking technology. Some may not be as precise, or require changes in hardware.

Still, one way or another, "This will happen," says John Paulin Hansen, who heads the research group that spawned the Eye Tribe. But he adds that it won't happen in a vacuum.

"It's a small part of a very big change that's happening to the way that we interact with computers," he says. "I hope our children will look back on us and think, 'Oh my God, it was so hard back then to use a computer. You had to sit down in front of it all day!' "

For Stig Langvad, change can't come fast enough. He's the head of Denmark's umbrella organization for people with disabilities. Because of a spinal cord injury, Langvad relies on voice control to use his computer, reciting commands like, "Type. Control. Enter."

The system works fine, but it's slow. When he needs to make a selection, Langvad brings up a nine-square grid on his screen, and then narrows in on his target by choosing the appropriate square over and over, shrinking the grid.

And then, finally, he can say, "Mouse click."

If Langvad could just move a cursor with his eyes, he says, "It would be much easier, it would be much faster — and it would be much more silent."

That's not all it would be. For people with disabilities, eye-control technology becoming mainstream would bring another important change.

"Then I can go to any computer, and then I can control it and I can use it, instead of just bringing my own," Langvad says. "So I'll be a part of society on an equal foot, instead of being a special solution."

He adds, "To me, it is going to change the world. And I think it's delicious, to be a part of that process."

Copyright 2021 NPR. To see more, visit https://www.npr.org.

After taking a semester off from college to intern with Vermont Public Radio in 1999, Sidsel was hooked. She went on to work as a reporter and producer at WNYC in New York and WAMU in Washington, DC before moving to New Mexico in 2007. As KUNM’s Conservation Beat reporter, Sidsel covered news from around the state having to do with protection of our earth, air and water. She also kept up a blog, earth air waves, filled with all the bits that can’t be crammed into the local broadcast of Morning Edition and All Things Considered. When not interviewing inspiring people (or sheep), Sidsel could be found doing underdogs with her daughters at the park.