Switching reference frame preferences during verbally assisted haptic graph comprehension.

Haptic-audio interfaces allow haptic exploration of statistical line graphs accompanied by sound or speech, thus providing access to exploration by visually impaired people. Verbally assisted haptic graph exploration can be seen as a task-oriented collaborative activity between two partners, a haptic explorer and an observing assistant, who are disposed to individual preferences for using reference frames. The experimental findings reveal that haptic explorers' spatial reference frames are mostly induced by hand movements, leading to action perspective instead of conventionally left-to-right spatiotemporal perspective.

Multimodal cognitive interface for robot navigation.

To build effective interactions between humans and robots, they should have common ground of understanding that creates realistic expectations and forms the basis communications. An emerging approach to doing this is to create cognitive models of human reasoning and behavior selection. We have developed a robot navigation system that uses both spatial language and graphical representation to describe route-based navigation tasks for a mobile robot.