Trace, Panel & Dwell Time
Now we want to start using the computer without a mouse and keyboard.
With the trace, you control which actions are performed when and where these actions happen
With the default settings, the trace appears as an orange circle. However, if you prefer, you can adjust the appearance of the trace to your liking (see Settings: Trace). Here are some examples of how the trace can look:
The trace is the method you use to operate your computer with Semanux Access because you can move it without a mouse and keyboard. How you move it specifically depends on which preset you have chosen:
- Preset with Head Movement
Turn your head to the left, and the trace will move to the left. The same applies if you turn your head to the right, up or down. You can basically say that you are pointing with your nose at the active spot on the screen. Imagine a straight line pointing from your nose to the screen.
If you are having trouble moving the trace to the edges of the screen with your head movements, we recommend performing a Head Alignment. It usually works better after that. - Preset: Only Controller
You can move the trace with the left analog stick of your controller. - Preset: Only Eye Movement
Look at the screen to position the trace.
If you are having trouble with the trace not following your gaze accurately enough, we recommend performing an Eye Tracker Calibration. It usually works better after that.
Now you can move the trace, for example over an icon on your desktop. However, when you do this, nothing will happen yet because you first need to select an action.
The Panel is a list of actions that are constantly available to you at the screen edge:
With the default settings, the Panel is located on the right side of the screen and is mostly collapsed, so only a narrow strip is visible, and it doesn't take up much space (left image). When you move the trace to the screen edge, the Panel expands to full width and shows a list of actions (right image).
If needed, you can customize which actions are available in the Panel (see Settings: Panel). Depending on the preset you selected, your Panel may contain different actions. So don't be surprised if it doesn't look exactly like the image above.
But how can an action be selected in the Panel? For this, you just need to move the trace over an action and keep it there for a while.
This is what it looks like when you select the left-click action:
In the left image, you see how it looks before the trace moves over the left-click action. In the middle image, the trace has just moved over the action. Do you see how the tile with the action is slowly darkening? In the right image, the trace has been over the action for a little while. The tile is now almost completely dark. When the tile is fully dark, the left-click action is performed.
This process is called Dwell Time because you dwell on a spot for a certain amount of time until an action is performed. You can set the dwell time duration to suit your personal preferences, depending on how quickly you want it to happen (see Settings: Dwell Time).
Dwell Time isn't just used for selecting actions from the Panel, but also for executing actions themselves, such as left-clicking or using the virtual keyboard. More information on this will be provided in the respective sections on these topics.
If you accidentally performed an action in the Panel while experimenting and aren't sure how to get back, don't worry. Most actions work by holding the trace still for a while until they are performed. After that, the Panel will be visible again. Additionally, some actions like left-click provide a Cancel button at the place where the Panel usually is, which cancels the current action. You can operate this button in the same way using dwell time, just like the actions in the Panel.
Semanux Access is designed to operate the computer without a mouse and keyboard. Nonetheless, you can also use all the functions of Semanux Access with a mouse. This can be helpful if you or someone else needs to assist you with operating the system.
Such assistance is usually necessary when head control or eye gaze control isn't working correctly yet. Then, you can use the mouse to expand the Panel by moving the mouse to the screen edge over the collapsed Panel. Clicking on one of the buttons in the Panel with the mouse allows you to quickly perform actions such as Settings, Camera Alignment, or Calibration.
