CyPhy A Cyber-Physiotherapy Solution

Cyber-Physiotherapy

• Provide physical healthcare to patient in remote areas where medical resource is scarce• Provide convenient preliminary injury assessment at local

facility or at home

User Roles

• Doctor• Patient• Trainer• Offline viewer

User Roles

• Doctor• Patient• Trainer• Offline viewer

• Doctor site: non-immersive• Patient site: immersive• Trainer site: immersive• Offline site: non-immersive• Storage: record database

System Entities

Immersive vs. Non-immersive

• Immersive (patient, trainer)

• Non-immersive (doctor, offline viewer)

Multimodality

Architecture: Basic Version

 Patient Site

 Trainer Site

 Doctor Site  Storage

 Offline Viewer

Content Stream Bundles

SAV• Skeleton• Audio• Video (2D, 240x160)

PB• Point Cloud• Body sensing data

Architecture: Basic Version

 Patient Site

 Trainer Site

 Doctor Site  Storage

 Offline Viewer

SAV

PBFull Version

Selected Version

Selected Version

Architecture: Basic Version

 Patient Site

 Trainer Site

 Doctor Site  Storage

 Offline Viewer

1

2

3

1Audio Instruction

2Tag

3Query

Architectural Variations

• Basic • Trainer = Doctor • Trainer = Storage

Pat Train

Doc Store

Offlin

Pat Doc/Train

Store

Offlin

Pat Doc

Train/Store

Offlin

Various Scenarios

• Group Training • 1-1 Therapy • Offline Assessment

Pat Train

Doc Store

Offlin

Pat Doc/Train

Store

Offlin

Pat Doc

Train/Store

Offlin

More Technical Details On…

• Selective Streaming• Shannon Chen, Zhenhuan Gao, Klara Nahrstedt, and Indranil Gupta, "3DTI Amphitheater: Towards 3DTI Broadcasting", ACM

Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 11, No. 2s, Article 47, Feb. 2015• Shannon Chen, Klara Nahrstedt, and Indranil Gupta,

"3DTI Amphitheater: A Manageable 3DTI Environment with Hierarchical Stream Prioritization", Proc. ACM Multimedia Systems (MMSys), Singapore, Mar. 2014

• Aadhar Jain, Ahsan Arefin, Raoul Rivas, Chien-nan Chen, and Klara Nahrstedt, "3D Teleimmersive Activity Classification Based on Application-System Metadata", Proc. ACM Multimedia (MM), Barcelona, Spain, Oct. 2013

• Zhenhuan Gao, Shannon Chen, and Klara Nahrstedt,"FreeViewer: A 3D Tele-Immersive Intelligent Director", to appear in Proc. ACM Multimedia (MM), Orlando, Florida, USA, Nov. 2014

• Content Compression• Shannon Chen and Klara Nahrstedt, "Impact of Morphing-based Frame Synthesis on Bandwidth Optimization for 3DTI Video",

Proc. IEEE International Symposium on Multimedia (ISM), Anaheim, California USA, Dec. 2013• Shannon Chen, Pengye Xia, and Klara Nahrstedt,

"Activity-Aware Adaptive Compression: A Morphing-based Frame Synthesis Application in 3DTI", Proc. ACM Multimedia (MM), Barcelona, Spain, Oct. 2013 [Winner of Huawei/3D Life Grand Challenge 2013]

• Shannon Chen and Klara Nahrstedt, "Activity-based Synthesized Frame Generation in 3DTI Video", Proc. IEEE International Conference of Multimedia and Expo (ICME), San Jose, California USA, Jul. 2013 [Best Paper Nominee]

• Resource adaptation• Sabrina Schulte, Shannon Chen, and Klara Nahrstedt,"Stevens' Power Law in 3D Tele-immersion: Towards Subjective Modeling

of Multimodal Cyber Interaction", to appear in Proc. ACM Multimedia (MM), Orlando, Florida, USA, Nov. 2014

More on http://cairo.cs.uiuc.edu/