Augmented Reality and Collaborative Work in Patient ... - Cortexial

LCD-Projector. Do not disturb the relation between patient and physician. Head-Mounted-Display (HMD) and Hand-Held-Display (HHD) are not usable ...
1MB taille 6 téléchargements 236 vues
Augmented Reality and Collaborative Work in Patient-Physician Relationship Bluteau Jeremy Information Technologies for Health - 4th year From Mai 10, 2005 to July 26, 2005

Polytech'Grenoble University Joseph Fourier, France At University of Tsukuba, Japan Computer Vision and Image Media Laboratory

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Internship context Subject Presentation Methodologies

System Overview

Results

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Context of internship Japan

Advanced technologies Important Research background

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Context of internship Japan

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Context of internship

College of Engineering Systems and Graduate school of Systems and Information

Laboratory of Computer Vision and Image Media

...

...

...

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

Physician in 1940's

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

Physician in 1940's

Physician now

http://www.praxim-medivision.com/

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

Physician in 1940's

Physician now

Relationship between patient and physician need to be improve

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

Augmented Reality : Combination of real world and computer generated data. Involves Real-time, 3D rendering, Video capture, Modeling,...

Explanation of AR

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

Augmented Reality could help by : Providing the “doctor” view to the patient ●

The patient acquire useful knowledges to understand his doctor



It becomes easier to inform and get informed consent

Showing the location body components inside body ●

The patient can localize his pain directly on his body

Augmented Reality and Collaborative Work in Patient-Physician Relationship Subject Presentation

System Idea

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Project management

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Project management

Augmented Reality and Collaborative Work in Patient-Physician Relationship

System overview ARToolKit for Augmented Reality

LCD-Projector Do not disturb the relation between patient and physician Head-Mounted-Display (HMD) and Hand-Held-Display (HHD) are not usable

Augmented Reality and Collaborative Work in Patient-Physician Relationship

System overview ARToolKit for Augmented Reality LCD-Projector Drawbacks

Augmented Reality and Collaborative Work in Patient-Physician Relationship

System overview ARToolKit for Augmented Reality LCD-Projector Thermal solution Thermal camera is not disturbed by the visible light

Thermal camera

Thermal markers

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Results : Prototype system

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Results : Calibration between Projector and Thermal Camera

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Results : Calibration between Projector and Thermal Camera

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Results : Projection of augmentations

Placement of the thermal marker

Projection of inside body components directly on patient's skin or over clothes

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Results : Paper redaction for ICAT

International Conference on Artificial Reality and Telexistence

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Future of this project ... The paper has been accepted (29 August 2005) ● Poster or Demonstration presentation at the ICAT Conference (New Zealand) Dear Jeremy Bluteau We are happy to inform you that your paper 157 - See-Through Medical Examination: Visual support for Medical Consultation by using Projector-Based Augmented Reality and Thermal markers has been accepted to ICAT 2005 as a full paper. […] We look forward to seeing you in Christchurch, New Zealand! Sincerely yours, Greg Welch, Sang Chul Ahn, and Haruo Noma ICAT 2005 Program Co-Chairs

COMMENTS to the author(s)

COMMENTS to the author(s)

This is a very nice paper, I like the approach and the results seem to be fine.

This is a very nice paper, I like the approach and the results seem to be fine.

One is not clear is if it has been tested in medical environment. What is the opinion of medical staff regarding this approach.

One is not clear is if it has been tested in medical environment. What is the opinion of medical staff regarding this approach.

It is absolutely necessary to validate such an approach with medical people.

It is absolutely necessary to validate such an approach with medical people.

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Future of this project ... The paper has been accepted (29 August 2005) ● Poster or Demonstration presentation at the ICAT Conference (New Zealand) Software improvements ● Friendly interface ● Improve speed of application ● New 3D models oriented on pathologies Validation of this application in real context

New kind of commercials applications ?

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Conclusion ●



A new system to improve Patient-Physician relationship has been designed and is usable. Great opportunity to learn Computer Vision technologies in the laboratory of Computer Vision and Image Media.



Promotion of Polytech'Grenoble in Japan.



Incredible opportunity to write a first paper.





Chance to visit some beautiful places in Japan and discovering another culture. Improve new communication skills and open-mindedness.

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Thank you for your attention...

Questions ?

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Photos of Japan

Augmented Reality and Collaborative Work in Patient-Physician Relationship

Augmented Reality and Collaborative Work in Patient-Physician Relationship Bluteau Jeremy From Mai 10, 2005 to July 26, 2005

Fin...