DPMA grants Semanux patent
The German Patent and Trademark Office grants Semanux an exclusive patent for a multimodal, contactless selection process on the computer.
In today's digitalized world, interacting with computer systems is an essential part of our everyday lives. However, while traditional input methods such as keyboards and mice are taken for granted by many of us, they often present obstacles for people with physical disabilities or in situations where hygiene is of the utmost importance. The need for alternative input methods became particularly clear during the COVID-19 pandemic, when many people became aware for the first time of the possible transmission of germs at devices such as ticket machines, bank terminals and digital kiosk systems. The patent-pending process developed by the founders of Semanux offers an innovative way to select controls on screens hands-free.
Our patent is based on a multimodal selection process that combines three touchless modalities. First, the user's eye gaze position is detected, a method already known from eye tracking in the past. But our technology goes one step further: by incorporating a control signal - such as voice input via a microphone - the accuracy of the input control is significantly increased. This combination ensures that even commercially available webcams and other cameras are sufficient to enable precise input. The use of commercially available computer components not only simplifies implementation, but also reduces costs for the end user.
Schematic representation of the patented process.
The heart of the system is a computer equipped with a video camera and sensors that record control signals. A webcam, which is either connected separately or integrated into the screen, continuously supplies video images in high resolution and frame rate, while a microphone acts as a sensor to record acoustic commands. All processing takes place in real time, which ensures a smooth and intuitive usage.
In contrast to exclusively voice-based control, which relies on clear and unadulterated signal transmission and therefore reaches its limits in the event of background noise or speech impediments, our method combines visual and acoustic elements. This symbiotic connection enables greater flexibility and accuracy, which is particularly advantageous when adjusting eye gaze positions.
The technology according to the invention is not limited to desktop computers or mobile devices. It also offers huge potential in contexts where computers are used in automated systems such as ticket machines or information kiosks. Thanks to its adaptability to different screen sizes and environments, the system is suitable for both private and public applications.
Our patent represents the next step in human-computer interaction. It combines the precision of modern technology with the need to create barrier-free and hygienic solutions. This opens up a new dimension of digitalization that is both individualized and compatible with the masses - a digital future in which touch no longer plays a role.
The patent with the number 10 2022 110 291.2 was filed with the German Patent and Trademark Office (DPMA) on April 27, 2022 and disclosed on November 2, 2023. The quality of the patent is underlined by the fact that there were only two oppositions from the patent office and no oppositions from competitors after disclosure. The patent was therefore granted with legal effect on August 3, 2024 - a milestone for Semanux!
