J i m    H o l l a n
Distinguished Professor of Cognitive Science & Professor of Computer Science
Founding Co-Director of Distributed Cognition and HCI Lab & UC San Diego Design Lab

My research explores the cognitive consequences of computational media. It is motivated by a belief that we are at the beginning of a paradigm shift in thinking about representational media, one that is starting to appreciate the importance of representations that are not only dynamic and interactive but also adapt to the structure of tasks, the history and context of activities, and our relationships with others. My goal is to better understand the cognitive, computational, and social ecology of dynamic interactive adaptive systems.

My interests span across cognitive design, distributed and embodied cognition, human-computer interaction, multiscale information visualization, multimodal interaction, cognitive ethnography, and software tools for design and visualization. My work involves four intertwined activities: developing theory and methods, designing representations, implementing prototypes, and evaluating their effectiveness to better understand the broader design space in which they are situated.

Current research is funded by the National Science Foundation (NSF) and Microsoft Research. Recently completed research has been funded by California's Digital Media Innovation Program, Chancellor's Interdisciplinary Collaboratories Program, Darpa, Intel, Microsoft, Nissan, NSF, Sony, Toyota, and the UC MICRO Program.

Honored to have received the ACM SIGCHI Lifetime Research Award in 2015.


courses current academic year
Fall 2023 No Class
recent research publications
Visualization Psychology: Foundations for an Interdisciplinary Reserarch Programme.
Amy R. Fox and James D. Hollan, Visualization Psychology, Editor Danielle Albers Szafir, book chapter in press, 2021.
From Detectables to Inspectables: Understanding Qualitative Analysis of Audiovisual Data.
Krishna Subramanian, Johannes Maas, Jan Borchers, and James D. Hollan. In Proceedings of the 2021 ACM Conference on Human Factors in Computing Systems, CHI 2021, ACM, May 2021. (Honorable Mention Award.)
Towards a Dynamic Multiscale Personalized Information Space: Beyond Application and Document Centered Views of Information.
Amy R. Fox, Philip Guo, Clemens Nylandsted Klokmose, Peter Dalsgaard, Arvind Satyanarayan, Haijun Xia and James D. Hollan, 4th International Conference on the Art, Science, and Engineering of Programming (’20), March 23–26, 2020, Porto, Portugal. Proceedings of the Convivial Computing Salon at PROGRAMMING 2020. https://doi.org/10.1145/3397537.3397542
When Graph Comprehension Is An Insight Problem.
Amy R. Fox, Caren Walker, and James D. Hollan, Proceedings of the Annual Meeting of the Cognitive Science Society. Montreal, Canada, 330-336, 2019.
Read It This Way: Scaffolding Comprehension for Unconventional Statistical Graphs
Amy R. Fox and James D. Hollan, International Conference on Theory and Application of Diagrams, 40-47, 2018. https://doi.org/10.1007/978-3-319-91376-6_40
Exploration and Explanation in Computational Notebook.
Adam Rule, Aurelien Tabard, and James D. Hollan, Proceedings of CHI 2018, ACM Conference on Human Factors in Computing Systems, 2018.
Stories We Tell Ourselves: Using Visual Histories to Make Sense of Interrupted Activities.
Adam Rule, Aurelien Tabard, and James D. Hollan, Human Computer Interaction, 511-558, 2017.
Sharing, Human Values, and Computer Activity Tracking.
Karen Boyd, Adam Rule, Aurelien Tabard, and James D. Hollan, Proceeding os ACM Computer Supported Cooperative Work and Social Computing , 233-236, 2016.
Thinking in 4D.
Adam Rule, Aurelien Tabard, and James D. Hollan, Proceeding of ACM Computer Supported Cooperative Work and Social Computing , 389-392, 2016.
Traces: A Flexible Open-Source Activity Tracker for Workplace Studies.
Adam Rule, Aurelien Tabard, and James D. Hollan, Workshop ACM Computer Supported Cooperative Work and Social Computing , 1-6, 2016.
Hands that Speak: An Integrated Approach to Studying Complex Human Communicative Body Movements.
Nadir Weibel, So-One Hwang, Stven Rick, Erfin. Sayyari, Dan Lenzen, and James D. Hollan, Proceedings of HICSS-49, Hawaii International Conference on System Sciences, Kauai, HI, USA, January 2016.
Thinking with Computers.
James D. Hollan, SIGCHI Lifetime Research Award, Proceeding of CHI'15, ACM Conference on Human Factors in Computing Systems, Seoul, Korea, 817-820, 2015.
Restoring the Context of Interrupted Work with Desktop Thumbnails.
Adam Rule, Aurelien Tabard, Karen Boyd, and James D. Hollan, Cognitive Science Society , 2045-2050, 2015.
Gesture and Action Recognition.
Nadir Weibel and James D. Hollan. Abstracts of ISGS 2014, International Society of Gestures Studies 6, San Diego, USA, July 2014. Panel on Sensing Technologies.
Designing Audio-Enhanced Paper Photos for Older Adult Emotional Wellbeing
Anne Marie Piper, Nadir Weibel, and James D. Hollan, International Journal of Human-Computer Studies, 629-639, 2014.
Factors affecting physician-patient communication in the medical exam room
Jennifer Lyons, Ram Dixit, Colleen Emmenegger, Nadir Weibel, and James D. Hollan. Proceedings of HCI International 2013, 15th International Conference on Human-Computer Interaction (Abstracts)
Interpreter-Mediated Physician-Patient Communication: Opportunities for Multimodal Healthcare Interfaces
Nadir Weibel, Colleen Emmenegger, Jennifer Lyons, Ram Dixit, Linda L. Hill, and James D. Hollan. Proceedings of PervasiveHealth 2013, International Conference on Pervasive Computing Technologies for Healthcare, Venice, Italy, May 2013.
Multimodal Data Analysis and Visualization to Study Usability of Electronic Health Records
Nadir Weibel, Shazia Ashfaq, Alan Calvitti, Zia Agha, and James D. Hollan. Proceedings of PervasiveHealth 2013, International Conference on Pervasive Computing Technologies for Healthcare, Venice, Italy, May 2013.
Reifying Social Movement Trajectories
Adam Fouse Nadir Weibel, Chris Johnson, and Jim Hollan. Proceedings of CHI'13, ACM Conference on Human Factors in Computing Systems, Paris, France, in press, 2013. (PDF)
Interactive Space: A Framework for Prototyping Multitouch Interaction On and Above the Desktop
Yang Liu, Nadir Weibel, and James D. Hollan. Proceedings of CHI 2013, ACM Conference on Human Factors in Computing Systems (Work-in-Progress), Paris, France, May 2013.
Audio-Enhanced Paper Photos: Encouraging Social Interaction at Age 105
Anne Marie Piper, Nadir Weibel, and Jim Hollan. Proceedings of CSCW'13, ACM Conference on Computer Supported Cooperative Work and Social Computing, San Antonio, TX, USA, in press, 2013. (PDF)
Activity-Enriched Computing: Capturing and Mining Activity Histories.
James D. Hollan Computer, 84-87, 2012.
Microanalysis of Active Reading Behaviors to Inform Design of Interactive Desktop Workspaces
Matthew Hong, Anne Marie Piper, Nadir Weibel, Simon Olberding, and James D Hollan. Proceedings of ITS12, ACM Conference on Interactive Tabletops and Surfaces, Cambridge, MA, USA, 215-224, 2012. (PDF)
TraumaPen: A Paper-Digital Interface for Information Capture and Display in Time-Critical Medical Work
Aleksandra Sarcevic, Nadir Weibel, James D. Hollan and Randall Burd, Proceedings of PervasiveHealth 2012, International Conference on Pervasive Computing Technologies for Healthcare, San Diego, CA, USA, 17-24, 2012. (PDF)
Digital Pen and Paper Practices in Observational Research
Nadir Weibel, Adam Fouse, Colleen Emmenegger, Whitney Friedman, Edwin Hutchins, and James D. Hollan. Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems, Austin, TX, USA, 1331-1340, 2012. (PDF)
TAP & PLAY: An End-User Toolkit for Authoring Interactive Pen and Paper Language Activities
Anne Marie Piper, Nadir Weibel, and James D. Hollan Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems, Austin, TX, USA, 149-158, 2012. (PDF)
TAP & PLAY: An End-User Toolkit for Authoring Interactive Pen and Paper Language Activities
Anne Marie Piper, Nadir Weibel, and James D. Hollan Extended Abstracts (Interactivity) of CHI 2012, ACM Conference on Human Factors in Computing Systems, Austin, TX, USA, 2012. (PDF)
Using Overlays to Support Collaborative Interaction with Display Walls
Arvind Satyanarayan, Nadir Weibel and James D. Hollan.Proceedings of IUI 2012, International Conference on Intelligent User Interfaces, Lisbon, Portugal, 105-108, 2012. (PDF)
A Pen-Based Toolkit for Authoring Collaborative Language Activities
Anne Marie Piper, Nadir Weibel and James D. Hollan.Extended Abstracts of CSCW 2012, Seattle, USA,, 269-270, 2012. (PDF)
Write-N-Speak: Authoring Multimodal Digital-Paper Materials for Speech-Language Therapy,
Anne Marie Piper, Nadir Weibel, and James D. Hollan. Transactions on Accessible Computing (TACCESS), 1-20, 2011. (PDF)
Supporting Medical Communication for Older Patients with a Shared Touch-Screen Computer
Anne Marie Piper and James D. Hollan. International Journal of Medical Informatics, in press, 2011. (PDF)
Ubiquitous Sketching for Social Media
Lisa L. Cowan, Nadir Weibel, Laura Pina, William G. Griswold, and James D. Hollan. Proceedings of MobileHCI, in press, 2011. (PDF)
Supporting an Integrated Paper-Digital Workflow for Observational Research
Nadir Weibel, Adam Fouse, Edwin Hutchins, and James D. Hollan. Adjunct Proceedings of International Conference on Intelligent User Interfaces, 257-266, 2011. (PDF)
Projector Phone Use: Practices and Social Implications.
Lisa L. Cowan, Nadir Weibel, Laura Pina, William G. Griswold, and James D. Hollan. Personal and Ubiquitous Computing, 1-11, 2011. (PDF)
recent graduate students and other collaborators
COGNITIVE SCIENCE

COMPUTER SCIENCE

SOCIOLOGY
Pierre Fastrez, David Fox, Jean-Baptiste Haue, Ron Hightower, Terry Jones, Derek Lomas, Melanie McComsey, Lars Mueller, Saeko Nomura, Malte Risto, Carsten Roeker, Nadir Weibel

COLLABORATORS
additional recent research publications
Plink It: Paper-Based Links for Cross-Media Information Space
Jurgen Steimle, Nadir Weibel, Simon Olberding, Max Muhlhauser, and James D. Hollan. Adjunct Proceedings of ACM Symposium on User Interface Software and Technology, 1969-1974, 2011. (PDF)
ChronoViz: A System for Supporting Navigation of Time-Coded Data
Adam Fouse, Nadir Weibel, Edwin Hutchins, and James D. Hollan. Proceedings of ACM Conference on Human Factors in Computing Systems, 299-304, 2011. (PDF)
Physical and Digital Media Usage Patterns on Interactive Tabletop Surfaces
Jürgen Steimle, Mohammadreza Khalilbeigi, Max Mühlhäuser, and James D. Hollan. Proceedings of ACM International Conference on Interactive Tabletops and Surfaces (ITS 2010), 167-176, 2010. (PDF)
Engaging the Periphery for Visual Communication on Mobile Phones
Lisa L. Cowan, William G. Griswold, Louise Barkhuus, and James D. Hollan. Proceedings of the IEEE Hawaii International Conference on Systems Sciences, 1-10, 2010. (PDF)
Enabling Social Interactions through Real-time Sketch-Based Communication
Nadir Weibel, Lisa G. Cowan, Laura R. Pina, William G. Griswold, and James D. Hollan. Adjunct Proceedings of ACM Symposium on User Interface Software and Technology, 1405-406, 2010. (PDF)
DataPrism: A Tool for Analyzing Multimodal Data
Adam Fouse and James D. Hollan. Proceedings of Measuring Behavior 2010: 7th International Conference on Methods and Techniques in Behavioral Research, 1-4, 2010. (PDF)
Exploring Pen and Paper Interaction with High-Resolution Wall Displays
Nadir Weibel, Anne Marie Piper, and James D. Hollan. Adjunct Proceedings of ACM Symposium on User Interface Software and Technology, 455-456, 2010. (PDF)
HIPerPaper: Introducing Pen and Paper Interfaces for Ultra-Scale Wall Displays
Nadir Weibel, Anne Marie Piper, and James D. Hollan. Adjunct Proceedings of ACM Symposium on User Interface Software and Technology, 203-210, 2010. (PDF)
Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy
Anne Marie Piper, Nadir Weibel, and James D. Hollan. Proceedings of the 12th International Conference on Computers and Accessibility (ACM ASSETS 2010), 203-210. (PDF)
Applications of Projector Phones for Social Applications
Lisa Cowen, William G. Griswold, and James D. Hollan. Proceedings of Ubiprojection Workshop, Pervasive, 2010. (PDF)
Exploring the Accessibility and Appeal of Surface Computing for Older Adult Health Care Support
Anne Marie Pipoer, Ross Campbell, and James Hollan. Proceedings of the 28th International Conference on Human Factors in Computing Systems (ACM CHI2010), 907-916, 2010. (PDF)
Augmenting Interactive Tabletops with Translucent Tangible Controls
Malte Weiss, James D. Hollan, and Jan Borchers. Tabletops - Horizontal Interactive Displays (Christian Müller-Tomfelde, Editor), 149-170, 2010. (PDF)
Opportunities and Challenges for Augmented Environments: A Distributed Cognition Perspective
James D. Hollan and Edwin L. Hutchins. User Friendly Environments: From Meeting Rooms to Digital Collaborative Spaces ( S. Lahlou, Editor), 237-259, 2010 (PDF)
Scaffolding Embodied Practices in Professional Education
Amaya Becvar Weddle and James D. Hollan. Mind, Culture, and Activity: An International Journal, 17, 2010, 119-148. (PDF)
Analyzing Multimodal Communication around a Shared Tabletop Display
Ann Marie Piper and James D. Hollan. Proceedings of the European Conference on Computer Supported Cooperative Work (ECSCW), September 9-11, 2009, Vienna, Austria, 283-302. (PDF)
Tabletop Displays for Small Group Study: Affordances of Paper versus Digital Materials
Ann Marie Piper and James D. Hollan. Proceedings of the 27th International Conference on Human Factors in Computing Systems (ACM CHI2009), 2009, 1227-1236. (PDF)
SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops
Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, Jim Hollan, Jan Borchers. Proceedings of the 27th International Conference on Human Factors in Computing Systems (ACM CHI2009), 2009, 481-490. (PDF)
Capturing and Restoring the Context of Everyday Work: A Case Study at a Law Office
Gaston R. Cangiano and James D. HollanLecture Notes in Computer Science, HCII 2009, 2009, 945-954. (PDF)
Papiercraft: A Gesture-Based Command System for Interactive Paper
Chunyuan Liao, François Guimbretière, Ken Hinckley, and James D. Hollan. ACM Transactions on Computer-Human Interaction. 14, 4 (Jan. 2008), 1-27 (PDF)
A Diary Study of Mobile Information Needs
Timothy Sohn, Kevin A. Li, William G. Griswold, and James D. Hollan. CHI 2008: ACM Conference on Human Factors in Computing Systems, 2008, 433-442 (PDF)
Representational Gestures as Cognitive Artifacts for Developing Theories in a Scientific Laboratory
Amaya Becvar, James Hollan, and Edwin Hutchins. In Resources, Co-Evolution, and Artifacts: Theory in CSCW, Ackerman, M.S., Halverson, C.A., Erickson, T., and Kellogg, W.A. (Eds.), 2008, 117-143. (PDF)
SLAP: Silicone Illuminated Active Peripherals
Malte Weiss, Roger Jennings, Julie Wagner, Ramsin Khoshabeh, Jan Borchers, and James D. Hollan. IEEE Tabletops and Interactive Surfaces, October 1-3, 2008, Amsterdam, the Netherlands (PDF)
Tapping and Rubbing: Exploring New Dimensions of Tactile Feedback with Voice Coil Motors
Kevin A. Li, Patrick Baudisch, William G. Griswold, and James D. Hollan. UIST 2008: ACM Symposium on User Interface Software and Technology (PDF)
Supporting Medical Conversations Between Deaf and Hearing Individuals with Tabletop Displays
Anne Marie Piper and James D. Hollan. CSCW 2008: ACM Computer Supported Cooperative Work (PDF)