Clifton Forlines

MERL Research / Technical Staff
Research Scientist
Ph.D., University of Toronto, 2008

Phone: (617) 621 7553
Email:

Clifton Forlines is Research Associate at MERL. His research interests include the design and evaluation of novel user interfaces. Current research projects span from three-dimensional presentation of and navigation through recorded digital video, to collaborative tabletop user interfaces, to using hand-held projectors for augmented reality. He is currently leading the evaluation of three projects, MediaFinder, TimeTunnel, and DiamondSpin. Before coming to MERL, Clifton worked on Carnegie Mellon's Alice project, which aimed at teaching programming to children through building interactive 3D worlds.

Publications:

Wigdor, D.; Jian, H.; Forlines, C.; Borkin, M.; Shen, C., "WeSpace: The Design Development and Deployment of a Walk-up and Share Multi-surface Visual Collaboration System", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 978-1-60558-246-7, April 2009 (ACM Portal, TR2009-003)

Forlines, C.; Balakrishnan, R., "Improving Visual Search with Image Segmentation", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 978-1-60558-246-7, pp.1093-1102, April 2009 (ACM Portal, TR2009-013)

Jiang, H.; Wigdor, D.; Forlines, C.; Shen, C., "System Design for the WeSpace: Linking Personal Devices to a Table-Centered Multi-User, Multi-Surface Environment", IEEE International Workshop on Horizontal Interactive Human Computer Systems, Tabletop, ISBN: 978-1-4244-2897-7, pp. 97-104, October 2008 (IEEE Explore, TR2008-068)

Forlines, C., "Content Aware Video Presentation on High-Resolution Displays", Advanced Visual Interfaces (AVI), ISBN 0-978-60558-141-5, pp. 57-64, May 2008 (ACM Press, TR2008-020)

Matusik, W.; Forlines, C.; Pfister, H., "Multiview User Interfaces with an Automultiscopic Display", Advanced Visual Interfaces, Poster Session, ISBN 0-978-60558-141-5, pp. 363-366, May 2008 (ACM Press, TR2008-018)

Forlines, C.; Lilien, R., "Adapting a Single-user, Single-display Molecular Visualization Application for Use in a Multi-user, Multi-Display Environment", Advanced Visual Interfaces (AVI), Poster Session, ISBN 0-078-60558-141-5, pp. 367-371, May 2008 (ACM Press, TR2008-019)

Brandl, P.; Forlines, C.; Wigdor, D.; Haller, M.; Shen, C., "Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction of Interfaces", International Working Conference on Advanced Visual Interfaces (AVI), ISBN: 0-978-60558-141-5, May 2008 (ACM Press, TR2008-054)

Jiang, H.; Wigdor, D.; Forlines, C.; Borkin, M.; Kauffmann, J.; Shen, C., "LivOlay: Interactive Ad-hoc Registration and Overlapping of Applications for Collaborative Visual Exploration", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 978-1-60558-011-1, pp. 1357-1360, April 2008 (ACM Press, TR2008-040)

Forlines, C.; Balakrishnan, R., "Evaluating Tactile Feedback and Direct vs. Indirect Stylus Input in Pointing and Crossing Selection Tasks", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 978-1-60558-011-1, pp.1563-1572, April 2008 (ACM Press, TR2008-039)

Schmidt-Nielsen, B.; Harsham, B.; Raj, B.; Forlines, C., "Speech-Based UI Design for the Automobile", Handbook of Research on User Interface Design and Evaluation for Mobile Technology, ISBN: 978-1-59904-871-0, Vol. 1, Chapter XV, pp. 237-252, February 2008 (Information Science Reference, TR2008-006)

Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Multi-view Video Compression for 3D Displays", Asilomar Conference on Signals, Systems and Computers (ACSSC), ISSN: 1058-6393, pp. 1506-1510, November 2007 (IEEE Xplore, TR2007-080)

Wigdor, D.; Forlines, C.; Baudisch, P.; Barnwell, J.; Shen, C., "Lucid Touch: A See-through Mobile Device", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 978-1-59593-679-2, pp. 269-278, October 2007 (ACM Press, TR2007-075)

Cao, X.; Forlines, C.; Balakrishnan, R., "Multi-user Interaction Using Handheld Projectors", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 978-1-59593-679-2, pp. 43-52, October 2007 (ACM Press, TR2007-104)

Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Display Pre-filtering for Multi-view Video Compression", International Conference on Multimedia (ACM Multimedia), ISBN: 978-1-59593-702-5, Session: Systems 4 - Coding Support - pp. 1046-1053, September 2007 (ACM Press, TR2007-073)

Wigdor, D.; Shen, C.; Forlines, C.; Balakrishnan, R., "Perception of Elementary Graphical Elements in Tabletop and Multi-Surface Environments", Conference on Human Factors In Computing Systems (SIGCHI), ISBN: 978-1-59593-593-9, Apirl 2007 (ACM Press, TR2007-054)

Tse, E.; Shen, C.; Greenberg, S.; Forlines, C., "How Pairs Interact Over a Multimodal Digital Table", Conference on Human Factors In Computing Systems (SIGCHI), ISBN: 978-1-59593-593-9, pp. 215-218, April 2007 (ACM Press, TR2007-055)

Forlines, C.; Wigdor, D.; Shen, C.; Balakrishnan, R., "Direct-touch vs. Mouse Input for Tabletop Displays", ACM Conference on Human Factors in Computer Systems, ISBN: 978-1-50503-503-9, pp. 647-656, April 2007 (ACM Press, TR2007-053)

Forlines, C.; Shen, C.; Wigdor, D.; Balakrishnan, R., "Exploring the Effects of Group Size and Display Configuration on Visual Search", ACM Conference on Computer Supported Cooperative Work (CSCW), ISBN: 1-59593-249-6, pp. 11-20, November 2006 (ACM Press, TR2006-082)

Forlines, C.; Esenther, A.; Shen, C.; Wigdor, D.; Ryall, K., "Multi-User, Multi-Display Interaction with a Single-User, Single-Display Geospatial Application", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-313-1, pp. 273-276, October 2006 (ACM Press, TR2006-083)

Forlines, C.; Vogel, D.; Balakrishnan, R., "HybridPointing: Fluid Switching between Absolute and Relative Pointing with a Direct Input Device", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-313-1, pp. 211-220, October 2006 (ACM Press, TR2006-090)

Wigdor, D.; Leigh, D.; Forlines, C.; Shipman, S.; Barnwell, J.; Balakrishnan, R.; Shen, C., "Under the Table Interaction", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-313-1, pp. 259-268, October 2006 (ACM Press, TR2006-076)

Shen, C.; Ryall, K.; Forlines, C.; Esenther, A.; Vernier, F.D.; Everitt, K.; Wu, M.; Wigdor, D.; Morris, M.R.; Hancock, M.; Tse, E., "Informing the Design of Direct-Touch Tabletops", IEEE Computer Graphics and Applications, ISSN: 0272-1716, Vol. 26, Issue 5, pp. 36-46, September 2006 (IEEE Xplore, TR2006-086)

Ryall, K.; Esenther, A.; Forlines, C.; Shen, C.; Shipman, S.; Morris, M.R.; Everitt, K.; Vernier, F.D., "Identity-Differentiating Widgets for Multiuser Interactive Surfaces", IEEE Computer Graphics and Applications, ISSN: 0272-1716, Vol. 26, Issue 5, pp. 56-64, September 2006 (IEEE Xplore)

Raskar, R.; van Baar, J.; Beardsley, P.; Willwacher, T.; Rao, S.; Forlines, C., "iLamps: Geometrically Aware and Self-configuring Projectors", ACM SIGGRAPH, ISBN: 1-59593-364-6, Article 7, July 2006 (ACM Press, TR2006-103)

Tse, E.; Shen, C.; Greenberg, S.; Forlines, C., "Enabling Interaction with Single User Applications through Speech and Gestures on a Multi-User Tabletop", Advanced Visual Interfaces (AVI), May 2006 (AVI 2006, TR2005-130)

Wigdor, D.; Shen, C.; Forlines, C.; Balakrishnan, R., "Table-Centric Interactive Spaces for Real-Time Collaboration", Advanced Visual Interfaces (AVI), To appear May 2006 (AVI 2006, TR2006-012)

Tse, E.; Greenberg, S.; Shen, C.; Forlines, C., "Multimodal Multiplayer Tabletop Gaming", International Workshop on Pervasive Gaming Applications (PerGames), May 2006 (PerGames 2006, TR2006-009)

Shen, C.; Esenther, A.; Forlines, C.; Ryall, K., "Three Modes of Multi-Surface Interaction and Visualization", ACM Conference on Human Factors in Computing Systems (CHI), April 2006 (CHI 2006, TR2006-025)

Wigdor, D.; Shen, C.; Forlines, C.; Balakrishnan, R., "Effects of Display Position and Control Space Orientation on User Preference and Performance", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 1-59593-372-7, pp. 309-318, April 2006 (ACM Press, TR2006-015)

Sidner, C.L.; Lee, C.; Morency, L-P; Forlines, C., "The Effect of Head-Nod Recognition in Human-Robot Conversation", ACM SIGCHI/SIGART Conference on Human-Robot Interaction (HRI), ISBN: 1-59593-294-1, pp. 290-296, March 2006 (ACM Press, TR2005-129)

Forlines, C.; Peker, K.A.; Divakaran, A., "Subjective Assessment of Consumer Video Summarization", SPIE Conference Multimedia Content Analysis, Management and Retrieval, Vol. 6073, pp. 170-177, January 2006 (SPIE Proceedings, TR2006-002)

Everitt, K.; Shen, C.; Ryall, K.; Forlines, C., "MultiSpace: Enabling Electronic Document Micro-mobility in Table-Centric, Multi-Device Environments", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 27-34, January 2006 (IEEE Xplore, TR2005-110)

Wu, M.; Shen, C.; Ryall, K.; Forlines, C.; Balakrishnan, R., "Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 185-192, January 2006 (IEEE Xplore, TR2005-109)

Ryall, K.; Ringel Morris, M.; Everitt, K.; Forlines, C.; Shen, C., "Experiences With and Observations of Direct-Touch Tables", IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TableTop), pp. 89-96, January 2006 (IEEE Xplore, TR2005-108)

Dietz, P.H.; Harsham, B.; Forlines, C.; Leigh, D; Yerazunis, W.; Shipman, S.; Schmidt-Nielsen, B.; Ryall, K., "DT Controls: Adding Indentity to Physical Interfaces", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-271-2, pp. 245-252, October 2005 (ACM Press, TR2005-069)

Forlines, C.; Shen, C., "DTLens: Multi-user Tabletop Spatial Data Exploration", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-59593-271-2, pp. 119-122, October 2005 (ACM Press, TR2005-096)

Forlines, C.; Balakrishnan, R.; Beardsley, P.; van Baar, J.; Raskar, R., "Zoom-and-Pick: Facilitating Visual Zooming and Precision Pointing with Interactive Handheld Projectors", ACM Symposium on User Interface Software and Technology (UIST), ISNB: 1-59593-271-2, pp. 73-82, October 2005 (ACM Press, TR2005-095)

Forlines, C.; Shen, C.; Vernier, F., "Under My Finger: Human Factors in Pushing and Rotating Documents Across the Table", IFIP TC13 International Conference on Human-Computer Interaction (INTERACT), September 2005 (INTERACT 2005, TR2005-070)

Forlines, C.; Schmidt-Nielsen, B.; Raj, B.; Wittenburg, K.; Wolf, P., "A Comparison between Spoken Queries and Menu-based Interfaces for In-Car Digital Music Selection", IFIP TC13 International Conference on Human-Computer Interaction (INTERACT), September 2005 (INTERACT 2005, TR2005-020)

Everitt, K.; Shen, C.; Ryall, K.; Forlines, C., "DocuBits and Containers: Providing e-Document Micro-Mobility in a Walk-up Interactive Tabletop Environment", IFIP TC13 International Conference on Human-Computer Interaction (INTERACT), September 2005 (INTERACT 2005, TR2005-053)

Ryall, K.; Esenther, A.; Everitt, K.; Forlines, C.; Ringel Morris, M.; Shen, C.; Shipman, S.; Vernier, F., "iDwidgets: Parameterizing Widgets by User Identity", IFIP TC13 International Conference on Human-Computer Interaction (INTERACT), September 2005 (INTERACT 2005, TR2005-055)

Beardsley, P.; Forlines, C.; Raskar, R.; van Baar, J., "Handheld Projectors for Mixing Physical and Digital Textures", IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), ISSN: 1063-6919, Vol. 3, pp. 112, June 2005 (IEEE Xplore)

Hancock, M.S.; Shen, C.; Forlines, C.; Ryall, K., "Exploring Non-Speech Auditory Feedback at an Interactive Multi-User Tabletop", Conference on Graphics Interface (GI), ISBN: 0713-5424, pp. 41-50, May 2005 (Canadian Human-Computer Communications Society, TR2005-054)

Forlines, C.; Shen, C.; Buxton, B., "Glimpse: A Novel Input Model for Multi-Level Devices", ACM Conference on Human Factors in Computing Systems (CHI) Short Paper, ISBN: 1-59593-002-7, pp. 1375-1378, April 2005 (ACM Press, TR2005-024)

Everitt, K.; Shen, C.; Ryall, K.; Forlines, C., "Modal Spaces: Spatial Multiplexing to Mediate Direct-Touch Input on Large Displays", ACM Conference on Human Factors in Computing Systems (CHI) Short Paper, April 2005 (CHI 2005, TR2005-002)

Shen, C.; Hancock, M.S.; Forlines, C.; Vernier, F.D., "CoR2Ds: Context-Rooted Rotatable Draggables for Tabletop Interaction", ACM Conference on Human Factors in Computing Systems (CHI) Short Paper, April 2005 (CHI 2005, TR2005-001)

Beardsley, P.; van Baar, J.; Raskar, R.; Forlines, C., "Interaction Using a Handheld Projector", IEEE Computer Graphics and Applications, ISSN: 0272-1716, Vol. 25, Issue 1, pp. 39-43, January 2005 (IEEE Xplore, TR2004-107)

Divakaran, A.; Forlines, C.; Lanning, T.; Shipman, S.; Wittenburg, K., "Augmenting Fast-Forward and Rewind for Personal Digital Video Recorders", IEEE International Conference on Consumer Electronics (ICCE), Digest of Technical Papers, pp. 43-44, January 2005 (IEEE Xplore, TR2004-136)

Ryall, K.; Forlines, C.; Shen, C.; Ringel-Morris, M., "Exploring the Effects of Group Size and Table Size on Interactions with Tabletop Shared-Display Groupware", ACM Conference on Computer Supported Cooperative Work (CSCW), ISBN: 1-58113-810-5, pp. 284-293, November 2004 (ACM Press, TR2004-124)

Ringel-Morris, M.; Ryall, K.; Shen, C.; Forlines, C.; Vernier, F., "Beyond Social Protocols: Multi-User Coordination Policies for Co-located Groupware", ACM Conference on Computer Supported Cooperative Work (CSCW), ISBN: 1-58113-810-5, pp. 262-265, November 2004 (ACM Press, TR2004-123)

Divi, V.; Forlines, C.; van Gemert, J.V.; Raj, B.; Schmidt-Nielsen, B.; Wittenburg, K.; Woelfel, J.; Wolf, P.; Zhang, F., "A Speech-In List-Out Approach to Spoken User Interfaces", Human Language Technology Conference, May 2004 (HLT 2004, TR2004-023)

Shen, C.; Vernier, F.D.; Forlines, C.; Ringel, M., "DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 1-58113-702-8, pp. 167-174, April 2004 (ACM Press, TR2004-005)

Ringel, M.; Ryall, K.; Shen, C.; Forlines, C.; Vernier, F., "Release, Relocate, Reorient, Resize: Fluid Techniques for Document Sharing on Multi-User Interactive Tables", ACM Conference on Human Factors in Computing Systems (CHI), ISBN: 1 58113 703 6, pp. 1441-1444, April 2004 (ACM Press, TR2004-022)

Wittenburg, K.B.; Forlines, C.; Lanning, T.; Esenther, A.W.; Harada, S.; Miyachi, T., "Rapid Serial Visual Presentation Techniques for Consumer Digital Video Devices", ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-58113-636-6, pp. 115-124, November 2003 (ACM Press, TR2003-019)

Raskar, R.; van Baar, J.; Beardsley, P.A.; Forlines, C.; Dietz, P.H.; Esenther, A.W.; Leigh, D.L; Ryall, K.; Shen, C.; Shipman, S.E.; Yerazunis, W.S., "Intelligent Clusters and Collaborative Projector-based Displays", NSF Workshop on Collaborative Virtual Reality and Visualization (CVRV), October 2003 (NSF Workshop on Collaborative Virtual Reality and Visualization, TR2003-086)

Raskar, R.; van Baar, J.; Beardsley, P.A.; Willwacher, T.; Rao, S.; Forlines, C., "iLamps: Geometrically Aware and Self-Configuring Projectors", ACM Transactions on Graphics (TOG), ISSN: 0730-0301, Vol. 22, Issue 3, pp. 809-818, July 2003 (ACM Press, TR2003-023)

Wittenburg, K., Lanning, T., Forlines, C.; Esenther, A., "Rapid Serial Visual Presentation Techniques for Visualizing a 3rd Data Dimension", International Conference on Human-Computer Interaction (HCI), June 2003 (HCI International 2003, TR2003-020)

Shen, C.; Lesh, N.B.; Vernier, F.; Forlines, C.; Frost, J., "Building and Sharing Digital Group Histories", ACM Conference on Computer Supported Cooperative Work (CSCW), pp. 3, November 2002 (ACM Press, TR2002-007)

Esenther, A.; Forlines, C.; Ryall, K.; Shipman, S., "DiamondTouch SDK: Support for Multi-User, Multi-Touch Applications", ACM Conference on Computer Supported Cooperative Work (CSCW), November 2002 (CSCW 2002, TR2002-048)

Sidner, C.L.; Forlines, C., "Subset Languages for Conversing with Collaborative Interface Agents", International Conference on Spoken Language Processing (ICSLP), September 2002 (TR2002-036)

Technical Reports:
TR2006-066	Absolute vs. Relative Direct Pen Input
TR2005-118	Rotation and Translation Mechanisms for Tabletop Interaction
TR2004-126	Observations of a Shared Tabletop User Study
TR2004-125	Conflict Resolution in Paper and Digital Worlds: Two Surveys of User Expectations
TR2002-056	Digi-Koi: A Game for Cell Phones