DiamondSpace

Fluid interaction and meaningful visualization are the key for multi-surface, multi-device, interactive spaces to become the users' true cognitive prosthesis. Such interactive environments, local or remotely connected, are suitable for a variety of application domains, including collaborative interactive spaces for businesses, education, scientists, and offices, emergency response and mission control centers, urban planning rooms, as well as geospatial visualization and analysis.

Background & Objective:  While incorporating many of our related research outcome and findings, including PDH, DiamondTouch, DiamondSpin, and UbiTable, DiamondSpace uniquely addresses the research challenge of how multiple interactive display surfaces, including multi-touch multi-user tabletops, electronic walls, and laptop/desktop displays, can be used in concert to create flexible visualization and workspaces in which people can explore, understand, utilize and manipulate information from many data sources and types.

Technical Discussion:  Our research is situated within a three-pronged agenda.  (1) Multi-surface Visualization and Interaction (MVI): developing three distinct conceptual models of data sharing, visualization, manipulation and application interactions across multiple surfaces: independent, reflective and coordinated/multi-view.  (2) Interaction Techniques: designing and developing novel interaction techniques including freehand touch gestures, as well as interaction techniques that span across multiple displays and interaction surfaces.  (3) Evaluation: We conduct evaluations, exploring the efficacy of new techniques, as well as the fundamental perception and tactial properties of touch surfaces.

Outside Collaborations:  Harvard University's Initiative in Innovative Computing Center; Ravin Balakrishnan, University of Toronto.

Future Direction:  We have started to incorporate very large data walls into the DiamondSpace research investigation. Interacting with large data walls presents new challenges including large display area beyond arms' reach, visual and perceptual distortion, and multi-user collaboration.

Contacts:
Chia Shen
Clifton Forlines

Publications:
Tse, E.; Shen, C.; Greenberg, S.; Forlines, C., "Enabling Interaction with Single User Applications through Speech and Gestures on a Multi-User Tabletop", Advanced Visual Interfaces (AVI), May 2006 (AVI 2006, TR2005-130)

Tse, E.; Greenberg, S.; Shen, C.; Forlines, C., "Multimodal Multiplayer Tabletop Gaming", International Workshop on Pervasive Gaming Applications (PerGames), May 2006 (PerGames 2006, TR2006-009)

Wigdor, D.; Shen, C.; Forlines, C.; Balakrishnan, R., "Effects of Display Position and Control Space Orientation on User Preference and Performance", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 1-59593-372-7, pp. 309-318, April 2006 (ACM Press, TR2006-015)

Wu, M.; Shen, C.; Ryall, K.; Forlines, C.; Balakrishnan, R., "Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 185-192, January 2006 (IEEE Xplore, TR2005-109)

Everitt, K.; Shen, C.; Ryall, K.; Forlines, C., "MultiSpace: Enabling Electronic Document Micro-mobility in Table-Centric, Multi-Device Environments", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 27-34, January 2006 (IEEE Xplore, TR2005-110)

Ryall, K.; Ringel Morris, M.; Everitt, K.; Forlines, C.; Shen, C., "Experiences With and Observations of Direct-Touch Tables", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 89-96, January 2006 (IEEE Xplore, TR2005-108)

Forlines, C.; Shen, C., "DTLens: Multi-user Tabletop Spatial Data Exploration", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-271-2, pp. 119-122, October 2005 (ACM Press, TR2005-096)

Everitt, K.; Shen, C.; Ryall, K.; Forlines, C., "Modal Spaces: Spatial Multiplexing to Mediate Direct-Touch Input on Large Displays", ACM Conference on Human Factors in Computing Systems (CHI) Short Paper, April 2005 (CHI 2005, TR2005-002)

Forlines, C.; Shen, C.; Buxton, B., "Glimpse: A Novel Input Model for Multi-Level Devices", ACM Conference on Human Factors in Computing Systems (CHI) Short Paper, ISBN: 1-59593-002-7, pp. 1375-1378, April 2005 (ACM Press, TR2005-024)

Technology Areas:
Sensor and Data Systems
Off the Desktop Interaction and Display

Modification Date:  March 17, 2008