An operator has to decide how much to rely on a robot team. The interface affects that decision.

Earlier work that feeds into this: mixed reality interfaces for explaining cyber-physical attacks to operators and policymakers (book chapter, Stanford talk).

Questions

  • How can an interface show that one robot in twelve is probably lying, without too many false alarms?
  • What should an explanation from a robot team look like?

Papers

  • When a VLM judges whether a robot succeeded, it leans towards “yes” (FailBench). An operator who trusts that judge inherits the bias.
  • Agreement between two models is only evidence if their errors are independent. See disagreement between models.
  • A robot that hedges when its models disagree, as GoGet does when counting, gives the operator something to calibrate against.

Related: multi-robot systems, semantic coordination, evaluating language models.