This revision provides assistance through two interaction modalities: (i) a visual interaction modality where the person interacts through a touch screen device with text and pictures (ii) an auditory interaction modality where the subject is able to interact with the interface through speech recognition and the interface interacts with the subject through speech synthesis.
The person interacts with the social structures of the occupational environment ("interaction" here refers to the person's contact and communication with his or her surroundings, comprising several cognitive operations).
The research showed, for instance, that the person interacting with speech to text was less likely than in other activities to scan a crosswalk for pedestrians.
The software, Jacob notes, can also take advantage of the history of the person interacting with it.
So if we can draw attention to something bright about the face which lifts the features… then the person interacting with us will perceive us as more attractive and pay more attention to what we say". .
And it doesn't work well when the person interacts with a separate object, like a table or game controller — it would likely try to interpret those as weird extensions of limbs.
Once a person experiences a number of different diseases, the issue then becomes how the person interacts with different healthcare interfaces.
"The person interacting with the assistant could be in love," Spivack said.
The first is the person's face detection used as input for the second stage which is the recognition of the face of the person interacting with the robot, and the third one is the tracking of this face along the time.
Watching Gannon interact with the robot who can "see" with the aid of motion capture markers that the person interacting with it must hold or wear is surprisingly cute.
Contextual information consisted of the starting time and the occupation of the observed person, the type and number of patients the observed person saw, how many times and with whom the observed person interacted.
