Serena Yu-Ching Yeung,
Graduate Student,
Stanford University

ABSTRACT:
Artificial intelligence has begun to impact healthcare in areas including electronic health records, medical images, and genomics. But one aspect of healthcare that has been largely left behind thus far is the physical environments in which healthcare delivery takes place: hospital wards, operating rooms, and senior living facilities, among others. In this talk I will discuss my work on endowing hospitals with ambient intelligence, using computer vision-based human activity understanding in the hospital environment to assist clinicians with complex care. I will first present our implementation of an AI-Assisted Hospital where we have equipped units at two partner hospitals with visual sensors. I will then discuss our work on human activity understanding, a core problem in computer vision. I will present methods for dense and detailed recognition of activities, and efficient action detection, important requirements for ambient intelligence. I will discuss these in the context of two clinical applications, automated documentation of intensive care unit care activities and hand hygiene compliance. Finally, I will present work and future directions for integrating this new source of healthcare data into the full clinical data ecosystem, towards full realization of an AI-Assisted Hospital.