
AP Photo
Embodiments of the Sony invention relate to user interface technology that provides feedback to the user based on the user's gaze and a secondary user input, such as a hand gesture. In one embodiment, a camera-based tracking system tracks the gaze direction of a user to detect which object displayed in the user interface is being viewed. The tracking system also recognizes hand or other body gestures to control the action or motion of that object, using, for example, a separate camera and/or sensor.
TAGGED: patents,
video games,
Sony