Device control still relies heavily on hands and eyes, but this can be challenging for some people, such as those with disabilities or in situations where hands and eyes are occupied. Although voice recognition technology has been a great solution, it does have its limitations, such as accuracy and privacy concerns. To address this problem, researchers at the University of Chicago have developed an open source lip-based user interface called LipIO, which allows for both input and output of information.
How LipIO works
LipIO is built with easy-to-find components, such as a flexible plastic sheet with conductive traces and five electrodes on the top and bottom of the sheet. The blade is placed on the skin above the lip, and the electrodes at the bottom provide output via electrostimulation, while the electrodes at the top receive input from the tongue or lower lip via capacitive touch sensing. . To handle inputs, outputs, and interactions with external devices, a Seeeduino XIAO development board is used with a Microchip SAM D21 microcontroller, an MPR121 capacitive touch sensor, and a RehaStim electrical stimulator to provide user feedback.
Potential LipIO Use Cases
Although the current prototype can be very invasive, with wires running from the lips and behind the ears to the control unit, LipIO has great potential for use. For example, it can be integrated with navigation apps to provide directions to a cyclist or to tune a guitar while a musician is playing. It can also be used in virtual reality and gaming or allow people with medical conditions to interact with electronic devices in ways previously impossible.
The impact of LipIO on the inclusion of people with disabilities
LipIO is a huge step forward in developing alternative user interfaces that benefit people with disabilities and in situations where hands and eyes are full. The fact that LipIO is open source and uses easy-to-find components makes it accessible and affordable for those who need it. However, as the researchers point out, the current prototype is still obtrusive, and additional work will be needed to make it more compact and socially acceptable.
As we move towards a more inclusive future, it’s important to continue to explore new ways to increase device accessibility. LipIO is an exciting solution that can help people with disabilities have more autonomy and freedom. However, there is still a lot to be done to improve the technology and make it more accessible to more people.
You have it on github, at github.com/humancomputerintegration/LipIO
