Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach

Peters C, Wachsmuth S, Hoey J (2009)
In: Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments. ACM International Conference Proceeding Series, . New York, NY, USA: ACM: 1-8.

Download
Campus/VPN
Conference Paper | Published | English
Abstract
This paper presents a learning technique for visual event recognition in a system that assists persons with dementia during handwashing. The challenge is that persons with dementia present a wide variety of behaviors during a single task, typically changing their behaviours drastically from day to day. Any attempt at modeling this variety requires a large set of features, image regions, and temporal dynamics. In this paper, we approach this challenge by supervised learning of generative models from manually segmented and labelled video sequences. Our method uses a generic set of appearance-based colour, motion and texture features, over a static set of regions. We then present two HMM architectures that incorporate multiple image regions by either fusing on a feature-level, or later in the recognition process using a mixture-of-experts approach, in which a gating HMM is applied for the dynamic selection between specialised expert HMMs. Our models are trained on a clinical database of videos, and we compare the HMM approaches with a nearest neighbours scheme. Our results confirm the challenge we present, and indicate that our generative modelling techniques are suitable for inclusion in future prototypes of the hand washing assistant.
Publishing Year
Conference
Int. Conf. on Pervasive Technologies Related to Assistive Environments (PETRA)
Location
Corfu, Greece
Conference Date
2009-06-10
PUB-ID

Cite this

Peters C, Wachsmuth S, Hoey J. Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach. In: Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments. ACM International Conference Proceeding Series. New York, NY, USA: ACM; 2009: 1-8.
Peters, C., Wachsmuth, S., & Hoey, J. (2009). Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach. Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments, 1-8.
Peters, C., Wachsmuth, S., and Hoey, J. (2009). “Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach” in Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments ACM International Conference Proceeding Series (New York, NY, USA: ACM), 1-8.
Peters, C., Wachsmuth, S., & Hoey, J., 2009. Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach. In Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments. ACM International Conference Proceeding Series. New York, NY, USA: ACM, pp. 1-8.
C. Peters, S. Wachsmuth, and J. Hoey, “Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach”, Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments, ACM International Conference Proceeding Series, New York, NY, USA: ACM, 2009, pp.1-8.
Peters, C., Wachsmuth, S., Hoey, J.: Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach. Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments. ACM International Conference Proceeding Series. p. 1-8. ACM, New York, NY, USA (2009).
Peters, Christian, Wachsmuth, Sven, and Hoey, Jesse. “Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach”. Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments. New York, NY, USA: ACM, 2009. ACM International Conference Proceeding Series. 1-8.
Main File(s)
Access Level
Campus/VPN UniBi Only
Last Uploaded
2014-06-17 15:24:58

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search