The Persuasive Mirror: computerized persuasion for healthy living Ana C. Andrés del Valle - Agata Opalach “health is a state of complete physical, mental and social well-being and not merely the absence of disease or infirmity” World Health Organization (1948) “[…] mens sana in corpore sano” D.I. Iuvenalis (60-127)
The Concept Accenture’s Intelligent Home Services Initiative
Social & Psychological Considerations
Context & Scope
Captology
[1]
Communications Sensors Artificial Intelligence Europe: Population by age group, 1950 - 2050 800 700 600 500 400 300 200
Age 65+
100
Age 15-64
0
Elderly Care Crisis • Staffing Shortages • Prohibitive Costs • Caregiver Burnout • Wish to stay independent
Age 0-14 1950
1970
1995
2025
2050
Elderly deal with many losses • Former roles and status • Spouse • Family and friends • Decline in economic insecurity • Loss of familiar surroundings
Result • poor self-esteem • lack of self-satisfaction • loss of motivation
Goals: To motivate healthy living & to improve self-image
punishment
positive
negative
Giving or getting something pleasant, e.g. a weekly pay check or a compliment
Taking away or avoiding something unpleasant, e.g. avoiding stress/pain by not going to a dentist
Administering or receiving something unpleasant, e.g. being fired or spanked, or “
Taking away or being deprived of something pleasant, e.g. being denied TV or fun activity or the car
Negative reinforcement strengthens the previous behavior. Punishment reduces or stops the previous behavior.
© 2005 Accenture All rights reserved.
Computers As Persuasive Technologies An interactive technology that attempts to change a person’s attitudes or behaviors computers Web sites mobilephones PDAs video games desktop software smart environments specialized devices kiosks virtual reality
persuasion behavior change
Augmented Mirror
regular mirror
monitored data display
Visual Feedback
Forecast of Appearance Evolution: Fattening:
visual feedback reflection
ageing:
expected deformation from AAM mapped model
Results obtained applying the Face Transformer (University of St. Andrews)[7]
Digital mirror using two cameras and a screen Multimodal monitoring for behavior analysis Image processing for visual feedback
Image processing involved: • Face tracking • Active appearance models • Principal component analysis
Digital Mirror
Behavior Monitoring
• Morphing • Color processing
attitude change
captology
motivation change in worldview
Virtual View Point:
compliance
camera Screen
"If the computer can sense it, it can influence it" BJ Fogg, Stanford University
What Motivates Behavior Change?
Reinforcement vs. Punishment reinforcement
References
Technical Challenges
• Set realistic goals - Success in attaining short-term goals generates motivation - Expectations beyond capabilities decrease motivation • Simply observing your actions will often change them.
Mirror user
object
At least two image inputs to reduce occlusions
The final image depends on the eye position and direction • detect the position of the eyes: AAM tracking • project on a new plan corresponding to the desired point of view
The Persuasive Mirror reinforces positive and discourages negative behavior to help people coach themselves
Personal Activity Monitor[15]
Smart Fridge: Diet Control
[18]
We have to deal with two inputs • find the best algorithm to create one image from two inputs: Dynamic Programming (improvement of Criminisi’s technique[3]) Results:
• Reward the desired behavior while ignoring or punishing the unwanted behavior. • Provide feedback to make the person aware of their progress.
Computerized Weight Control
right camera
screen image
left camera
Future Work
• Develop enhanced visual feedback • Build sensor-input connection to the mirror • Design a customizable procedure to adapt the mirror to the user goals Expected controversial issues Can we trust a computer/Moral and ethical concerns • A prototype should be injected into society to evaluate usefulness • Collaboration with psychology specialists during prototype piloting
Knows behavior with respect to goals, rewards positive behavior, discourages negative behavior
1. Accenture (2004). Intelligent Home Services. Retrieved March, 23 2005 from http://www.accenture.com/ihs 2. Cialdini, R. B. (2001). Influence. Science and Practice. Allyn & Bacon Publishers, MA. ISBN 0-321-01147-3. 3. Criminisi, A., Shotton, J., Blake, A. & Torr, P. (2004) Efficient dense stereo and novel-view synthesis for gaze manipulation in one-to-one teleconferencing. [Technical Report] MSR-TR-2003-59, Microsoft Research. 4. Cullinan, C., & Agamanolis, S. (2003). Reflexion: a responsive virtual mirror for interpersonal communication (video). Proc. 8th European Conference on Computer Supported Cooperative Work. 5. DigitalFlowers (2003, April 21). Digital flower keeps tabs on love. BBC News, retrieved March 23, 2005 from: http://news.bbc.co.uk/2/hi/technology/2953455.stm 6. Evans, H., Hansen, & H., Roussel, D. (2004). More about MirrorSpace. Research Report. LRI, Université Paris Sud, France. 7. Face Transformer (2005). Morphing-based face transformer at Perception Laboratory, School of Psychology, University of St Andrews, Scotland. Retrieved March 29, 2005 from: http://www.dcs.st-and.ac.uk/~morph/Transformer/index.html 8. Fogg, B. J. (2003). Persuasive technology: using computers to change what we think and do. Morgan Kaufmann Publishers. 9. François, A. R. J., & Kang, E.-Y. E. (2003). A handheld mirror simulation. Proc. Int. Conference on Multimedia and Expo. 10. Hall, D. L., & Linas J. (2001). Handbook of multisensor data fusion. CRC Press. 11. Healthwear™ Weight Loss System (2005). Retrieved March, 29 2005 from: http://www.healthwear.com/hw/home.do 12. Hutchinson, H. et al. (2003). Technology probes: inspiring design for and with families. Proc. ACM CHI 2003 Conference on Human factors in Computing Systems, 17-23. 13. IHS Accenture (2005). Accenture Technology Labs Intelligent Home Services initiative. Retrieved March 25, 2005 from: http://ww.accenture.com/ihs 14. Intille, S., & Larson K. (2003) Designing and evaluating supportive technology for homes. Proc. IEEE/ASME International Conference on Advanced Intelligent Mechatronics. 15. PAM (2005). Personal Activity Monitor ™. Retrieved March, 29 2005 from: http://www.pam.com/ 16. Philips Mirror/TV (2003). A display integrated into a mirror. Retrieved March 25, 2005 from: http://www.research.philips.com/newscenter/archive/2003/mirrortv.html 17. Pryor, K. (1999). Don’t shoot the dog! The new art of teaching and training. Bantam Books. ISBN 0-553-38039-7. 18. Stegmann, M. B., Ersbøll, B. K. and Larsen, R.. (2003) FAME - A Flexible Appearance Modelling Environment, IEEE Transactions on Medical Imaging, vol.22(10), pp. 1319-1331. 19. Tucker-Ladd, C. E. (2000). Psychological self-help. Mental Health Net. Retrieved March 23, 2005 from: http://mentalhelp.net/psyhelp/ 20. Ushida, K., Tanaka, Y., Naemura, T., & Harashima, H. (2002). i-mirror: an interaction/information environment based on a mirror metaphor aiming to install into our life space. Proc.12th Int. Conference on Artificial Reality and Telexistence, 113-118. 21. Vernier, F., Nigai, L, Lachenal, C., & Coutaz, J. (1999). Interface augmentée par effet miroir [Augmented interface by mirror effect] Proc. 11èmes journées francophones sur l’interaction Homme Machine. 158-165.
