The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction

Dix A, Arlinghaus CS, Harkin AM, Pannasch S (2023)
In: ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction. André E, Chetouani M, Vaufreydaz D, Lucas G, Schultz T, Morency L-P, Vinciarelli A (Eds); New York: Association for Computing Machinery: 555-563.

Konferenzbeitrag | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Dix, Annika; Arlinghaus, Clarissa SabrinaUniBi ; Harkin, Anna Marie; Pannasch, Sebastian
Herausgeber*in
André, Elisabeth; Chetouani, Mohamed; Vaufreydaz, Dominique; Lucas, Gale; Schultz, Tanja; Morency, Louis-Philippe; Vinciarelli, Alessandro
Abstract / Bemerkung
Despite incredible technological progress in the last decades, latency is still an issue for today's technologies and their applications. To better understand how latency and resulting feedback delays affect the interaction between humans and cyber-physical systems (CPS), the present study examines separate and joint effects of visual and auditory feedback delays on performance and the motor control strategy in a complex visuomotor task. Thirty-six participants played the Wire Loop Game, a fine motor skill task, while going through four different delay conditions: no delay, visual only, auditory only, and audiovisual (length: 200 ms). Participants’ speed and accuracy for completing the task and movement kinematic were assessed. Visual feedback delays slowed down movement execution and impaired precision compared to a condition without feedback delays. In contrast, delayed auditory feedback improved precision. Descriptively, the latter finding mainly appeared when congruent visual and auditory feedback delays were provided. We discuss the role of temporal congruency of audiovisual information as well as potential compensatory mechanisms that can inform the design of multisensory feedback in human-CPS interaction faced with latency.
Erscheinungsjahr
2023
Titel des Konferenzbandes
ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction
Seite(n)
555-563
Konferenz
25th International Conference on Multimodal Interaction (ICMI'25)
Konferenzort
Paris
Konferenzdatum
2023-10-09 – 2023-10-13
Page URI
https://pub.uni-bielefeld.de/record/2983574

Zitieren

Dix A, Arlinghaus CS, Harkin AM, Pannasch S. The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction. In: André E, Chetouani M, Vaufreydaz D, et al., eds. ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction. New York: Association for Computing Machinery; 2023: 555-563.
Dix, A., Arlinghaus, C. S., Harkin, A. M., & Pannasch, S. (2023). The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction. In E. André, M. Chetouani, D. Vaufreydaz, G. Lucas, T. Schultz, L. - P. Morency, & A. Vinciarelli (Eds.), ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction (pp. 555-563). New York: Association for Computing Machinery. https://doi.org/10.1145/3577190.3614111
Dix, Annika, Arlinghaus, Clarissa Sabrina, Harkin, Anna Marie, and Pannasch, Sebastian. 2023. “The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction”. In ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction, ed. Elisabeth André, Mohamed Chetouani, Dominique Vaufreydaz, Gale Lucas, Tanja Schultz, Louis-Philippe Morency, and Alessandro Vinciarelli, 555-563. New York: Association for Computing Machinery.
Dix, A., Arlinghaus, C. S., Harkin, A. M., and Pannasch, S. (2023). “The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction” in ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction, André, E., Chetouani, M., Vaufreydaz, D., Lucas, G., Schultz, T., Morency, L. - P., and Vinciarelli, A. eds. (New York: Association for Computing Machinery), 555-563.
Dix, A., et al., 2023. The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction. In E. André, et al., eds. ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction. New York: Association for Computing Machinery, pp. 555-563.
A. Dix, et al., “The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction”, ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction, E. André, et al., eds., New York: Association for Computing Machinery, 2023, pp.555-563.
Dix, A., Arlinghaus, C.S., Harkin, A.M., Pannasch, S.: The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction. In: André, E., Chetouani, M., Vaufreydaz, D., Lucas, G., Schultz, T., Morency, L.-P., and Vinciarelli, A. (eds.) ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction. p. 555-563. Association for Computing Machinery, New York (2023).
Dix, Annika, Arlinghaus, Clarissa Sabrina, Harkin, Anna Marie, and Pannasch, Sebastian. “The Role of Audiovisual Feedback Delays and Bimodal Congruency for Visuomotor Performance in Human-Machine Interaction”. ICMI'23: Proceedings of the 25th International Conference on Multimodel Interaction. Ed. Elisabeth André, Mohamed Chetouani, Dominique Vaufreydaz, Gale Lucas, Tanja Schultz, Louis-Philippe Morency, and Alessandro Vinciarelli. New York: Association for Computing Machinery, 2023. 555-563.

Link(s) zu Volltext(en)
Access Level
Restricted Closed Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar