HRI Background Study

When robots and people stop expecting the same thing

A background study of how a robot working near people could read their reactions and notice that something has gone wrong.

A background study, not finished research. This site summarises what I've read and the ideas it led me to. The PDV and HEV methods described here are my own working ideas, and they haven't been validated.

The problem

Left: a robot stopped at a physical safety boundary under ISO/TS 15066. Right: a face with measured signals, showing that distraction, confusion and surprise appear earlier.

Safety standards such as ISO/TS 15066 limit a collaborative robot's speed, separation and force. They don't consider what the person is thinking. Yet people often show distraction, confusion or surprise in their face, gaze, head and voice seconds before anything physical happens.

The idea: two directions

PDV: robot → person HEV: person → robot

PDV: Personal Deviation Violation

The robot notices that the person has left their own normal behaviour, or hasn't given a response it expected.

HEV: Human Expectation Violation

The person reacts to something the robot did as unexpected.

What I found in the literature

Most work I read looks at one direction. This table shows how each one touches the main ideas, as I understood them. A half circle means partly.

WorkBoth directionsAttributionFace, gaze, voice and speechNo labels for the person's sideSafety-linked response
Stiber 2025◐
Ngo 2026◐◐
Kontogiorgos 2022◐
Wachowiak 2026◐◐
Bajcsy 2022◐◐
ERR@HRI 2.0◐◐◐

Moving to new test data is hard. In Jiang 2025, robot-mistake detection fell from an F1 of 0.71 in validation to 0.26 on the hidden test set. False alarms are another common obstacle.

Go directly to