(ORDO NEWS) — American scientists are developing a tool called EyeMU that allows users to perform operations on a smartphone using a glance and simple hand gestures.
With the new technology, you don’t have to look at the small screen of your smartphone and constantly miss the right key. It will be enough just to look right
As more people watch movies, edit videos, read the news and follow social media on their smartphones, these devices are growing in size to make the screen more comfortable and the device itself more powerful.
The problem with bulky phones is that they often require a second hand or voice commands to operate, which is quite inconvenient. Fortunately, this can be fixed by changing the smartphone management system.
How to control your phone with your eyes
Gaze analysis and prediction technologies are not new, but for the full use of this technology in smartphones, a sufficient level of its functionality is required.
At the moment, when implementing such an application on a phone, the “Midas problem” can arise, because the device will constantly fix your gaze, and the slightest distraction will lead to opening several applications and calling someone close.
Software that accurately tracks eye movement can solve this problem. The authors of the new development used the Google Face Mesh tool to study the gaze patterns of users looking at different areas of the screen and visualize cartographic data.
The team then developed a gaze predictor that uses a smartphone’s front-facing camera to capture what the viewer is looking at and register the purpose of their gaze.
Scientists have made the tool more productive by combining the gaze predictor with the smartphone’s built-in motion sensors to trigger commands.
For example, a user can stare at a notification long enough to pin it as a target, and move the phone to the left to hide it, or to the right to reply to a message, for example. Similarly, the user can zoom in on the phone to zoom in, or move it back to turn off gaze control.
So far, the technology allows solving only fairly simple tasks, but the authors hope to expand its functionality in the future. Well, we would try!
Contact us: [email protected]