Semanux

Facial Expressions

You can set and configure your facial expressions as an input device for Semanux Access.

You can find the facial expression settings under Type of Settings: All > Input > Facial Expressions.

Settings window for facial expressions

Make sure that you have activated Camera as Input and Head Movement Control.

To activate facial expressions as an input in Semanux Access, check the box for Activate facial expressions as input. Semanux Access applies machine learning to the webcam image to recognize facial expressions. Currently, Semanux Access offers the recognition of four different facial expressions: mouth opening, smiling, closing eyes, and opening eyes.

When your facial expression is recognized, the color of the eyes or mouth changes from dark gray to the accent color.

Open your lower jaw downward while keeping your head and nose stable until the mouth is filled with a color.

When you normally open your mouth, like while speaking or eating, you usually move your entire head slightly upward as well. This can cause unwanted effects when using Semanux Access, such as the track suddenly jumping upward and triggering the action at a spot above the desired position. Therefore, make sure to keep your head and nose stable and only open the lower jaw downward. This way, the track remains at the desired spot, and the track does not jump.

The sensitivity should be set high enough that normal talking does not interfere with usage. For most users, a medium sensitivity setting is suitable here.

Put on a smile by moving your mouth corners upward. If you have simultaneously assigned an action to the "mouth opening" facial expression, make sure that during the smile your mouth remains closed and only your mouth corners move.

The sensitivity should be set in such a way that you are already recognized as smiling with a moderate raising of the mouth corners. For most users, a medium sensitivity setting is suitable here.

Your eyes are recognized as closed when your eyelid covers the iris and pupil entirely or to a large extent. You should set the sensitivity so that your eyes are not recognized as closed in their normal open state. For most users, a medium sensitivity setting is suitable here.

Your eyes are recognized as open when you open your eyelids wide. You should set the sensitivity so that your eyes are not recognized as open in their normal open state. For most users, a high sensitivity setting is suitable here.

For each of the possible facial expressions, you can set the sensitivity and hold time separately. The sensitivity determines the intensity of the recognized facial expression at which the action associated with it is considered triggered. Set the sensitivity to higher values to avoid false triggers and to lower values to have less effort in triggering.

The hold time determines the duration (in milliseconds) of the recognized facial expression at which the associated action is considered triggered. Set the hold time to higher values to avoid false triggers (e.g., with twitches) and to lower values to have a direct and fast user experience.

In the default setting Head Movement + Facial Expressions, mouth opening is used to start the Precision Mode and closing the mouth to exit Precision Mode while simultaneously performing a left-click. Further usage options can be found under Mouse Clicks, Scrolling, Drag-and-Drop, the Virtual Keyboard, Action Menu, Magnifier Menu, or Pause.

You still have questions?

Get in touch with us! We are happy to help personally.