Ramesh  Raskar

      raskar

Whats New:

Apply for job openings at MERL in Imaging group
New 'Camera Culture' group at Media Lab, MIT
Nov'07: Coded Computational Photography, Slides from keynote at ACCV 2007, Tokyo and VMV2007, Germany
Jan'07: Depth Perception, article in Carolina Alumni Review, the UNC magazine
Oct'06: Slides from Keynote talk at ISMAR 2006 about The Poor Man's Palace: Special Effects in the Real World
Feb'06: Slides from Keynote talk at IMAGINA 2006
Jan'06: Dome Screen Projector wins prestigious 'Best 10 New Products' Prize in Japan given by Nikkan Kogyo Simbun, (Japanese Descr), (Product Link)
Nov'05: Invited talk at ActiveRFIDSummit about RFIG
Nov'05: Invited talk at FID2005 about Pocket projector opportunities
July'05: Computational Photography and Spatial Augmented Reality, Siggraph 2005 course slides + New Book
Sept'04: TR100 Technology Review's 100 Top Young Innovators Under 35, 'Demo' article
Siggraph'04: Course on Advanced Projector Geometry topics
Nov'03: MIT Top 20 Indian researcher award
Oct'03: Slides from ProCams Invited Talk, 'The Large Display Dilemma'
Oct'03: Slides from 'Display Grid via iLamps' talk at Lake Tahoe CVRV workshop
Sep'03: Course Notes from Augmented Reality course at Eurographics03
Jul'03: Slides and video from SIGGRAPH (iLamps)

  Summer 2006 Graduate Level Course on Computational Photography, Tufts University.
    Fall 2005 Graduate Level Course on Computational Photography, Northeastern University.
  New Book: Spatial Augmented Reality (July 2005)
  I was co-organizer for PROCAMS05, Projector-Camera Workshop, San Diego, June'05.

  Mitsubishi Electric unveils pocket projector, at CES, January 2005, The DLP LED Pocket Projector available December 2005 

Projects

Home

Brief Biography

Media Coverage

A light projector is a 3D perspective projection device. However, traditionally, a light projector is treated like any other two-dimensional display device, e.g. a CRT monitor or a LCD screen, to create flat and usually rectangular images. Our work exploits the notion of projector as the dual of a camera. The analytical projection model, e.g. a pin-hole model, along with geometric representation of the display surface provides a conceptual framework for all projector-based applications. This is a fundamentally different approach for classic common applications but has greater freedom and flexibility. In addition, it enables an interesting class of rendering and visualization methods. The conceptual framework has resulted in new research directions in Computer Vision and Image-based Rendering. Previous related work

 

Disclosed Product Impact:
Acute Angle Seamless Multiprojector Display
MPC Polgyonal 3D scene display
Multiprojector quadric curved immersive display
Six Projector 3D rendering on curved display (A detailed press release)

Computational Photography

Enhancing digital camera sensing by actively modifying exposure/aperture/illumination and processing via gradient domain operations. Related work

Coded Illumination	Coded Exposure	Coded Aperture	Optical Heterodyning		Gradient Processing
2004	2006	2007	2007		2005

We bring RFID and wireless tags into the realm of computer vision, graphics and HCI by supporting precise geometric analysis of tagged objects and surfaces using a composite RF and optical communication. Related work

Features such as silhouette edges, ridges, valleys and intersections of geometric primitives are useful in conveying shape in illustrations and art. We have developed a proactive imaging method to capture such features in real world scenes of various scales. One area of focus is shape clarifying multi-flash imaging for endscopes. For polygonal scenes, our focus has been real-time rendering of these features without requiring the connectivity information. Previous related work

Image-based rendering attempts to solve the problem of generating near-photorealistic novel views. The goal is to reconstruct realistic animation using image-sequences.

Intelligent user interfaces

We are developing user interaction methods with novels gadgets and sensors. We have also exploited variational implicit surfaces for free form sketching and manipulation. Previous related work

Publications

2005

2004

Course: Advanced Projector Geometry topics

2003

2002

2000

Courses

Patents and Applications

Issued (25+)
1 7,218,792  Stylized imaging using variable controlled illumination 
2 7,206,449  Detecting silhouette edges in images 
3 7,154,395  Interactive wireless tag location and identification system 
4 7,137,707  Projector-camera system with laser pointers 
5 7,103,227  Enhancing low quality images of naturally illuminated scenes 
6 7,102,638  Reducing texture details in images 
7 7,068,274  System and method for animating real objects with projected images 
8 7,038,185  Camera for directly generating a gradient image 
9 7,019,748  Simulating motion of static objects in scenes 
10 7,001,023  Method and system for calibrating projectors to arbitrarily shaped surfaces with discrete optical sensors mounted at the surfaces 
11 6,930,681  System and method for registering multiple images with three-dimensional objects 
12 6,834,965  Self-configurable ad-hoc projector cluster 
13 6,811,264  Geometrically aware projector 
14 6,795,069  Free-form modeling of objects with variational implicit surfaces 
15 6,793,350  Projecting warped images onto curved surfaces 
16 6,781,591  Blending multiple images using local and global information 
17 6,764,185  Projector as an input and output device 
18 6,755,537  Method for globally aligning multiple projected images 
19 6,741,248  Rendering geometric features of scenes and models by individual polygons 
20 6,733,138  Multi-projector mosaic with automatic registration 
21 6,729,733  Method for determining a largest inscribed rectangular image within a union of projected quadrilateral images 
22 6,715,888  Method and system for displaying images on curved surfaces 
23 6,709,116  Shape-adaptive projector system 
24 6,677,956  Method for cross-fading intensities of multiple images of a scene for seamless reconstruction 
25 6,527,395  Method for calibrating a projector with a camera 
26 6,520,647  Automatic keystone correction for projectors with arbitrary orientation 

Public (USPTO link for before last 18 months,    36+)
Pending (   12+)

Press

Recent Media Coverage

Books

  Spatial Augmented Reality

Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors

Presentations and Talks

Keynote Addresses & Invited Presentations

ProCams October 2003, Nice, France, 'The Large Display Dilemma: Projectors are Dead' (Slides)

Symposium on Virtual Reality October 2004, Sao Paulo, Brazil, (Slides)

Graphics Interface May 2005, Victoria, Canada, 'Spatial Augmented Reality: New Problems in Human Interface' (Slides [17MB])
Ciencia and Arte April 2005, Caxias do Sul, Brazil, (Slides)
Flat Information Display November 2005, San Francisco, CA, 'Pocket Projector: All-in-one Solution for Mobility, Augmentation, Communication' (Slides)
Active RFID Summit November 2005, San Antonio, TX, 'R F I G : RFID + Geometry' (Slides)

Imagina February 2006, Monaco (Slides)
International Symposium on Mixed and Augmented Reality October 2006, San Diego, 'The Poor Man's Palace: Special Effects in the Real World' (Slides)

Vision Modeling and Visualization Conference, November 2007, 'Coded Imaging', (Slides)
Asian Conference on Computer Vision, November 2007, 'Less is More: Coded Computational Photography', (Slides)

Sping Conference on Computer Graphics, April 2008, 'Can Computer Graphics Impact Our Daily Life'

Universities and Research Laboratories

2007
Microsoft Research, Seattle (May, Host: Sing Bing Kang)  Video
MIT Media Lab, Cambridge (June)  Video
U of Pennsylvania, Philadelphia (Oct, Host: Jianbo Shi and Kostas Daniilidis)
U of Delaware, Newark (Oct, Host: Jingyi Yu)
Boston U., Boston (Nov, Host: Stan Sclaroff)

2006
Technical University Graz, Graz, Austria (May, Host: Dieter Schmalstieg)
New York University (NYU), New York City (March, Host: Prof Ken Perlin)

2005
Harvard University, Cambridge, MA (February, Host: Ramakrishna C)
Osaka University, Osaka, Japan (August, Host: Prof Yoshifumi Kitamura)
Trinity College, Dublin, Ireland (April, Host. Prof. Carol O'Sullivan)
University of Illinois at Urbana Champaign, IL (March, Host. Prof. Yizhou Yu and Narendra Ahuja)
Northwestern University, Chicago, IL (March, Host: Prof. Bruce Gooch and Jack Tumblin)
Purdue University, IN (March, Host: Prof. Dan Aliaga)
SENAC, Sao Paulo (April, Host: Prof. Romero Tori)
University of Kentucky, Lexington, KY (November, Computer Vision for Interactive Intelligent Environments Link)

2004
University of Maryland at College Park, MD (Host: Prof Amitabh Varshaney)
Brown University, Providence, RI (Host. Prof. Gabriel Taubin)
North Eastern University, Boston, MA (Host: Prof. Ravi Sundaram)
Georgia Institute of Technology, Atlanta, GA (Host: Prof. Irfan Essa)
University of North Carolina at Chapel Hill, NC (Host: Prof. Greg Welch)
Indian Institute of Technology, Mumbai, India (Host: Prof. Sharat Chandran)
International Institute of Information Technology, Hyderabad (Host: Prof. P. J. Narayanan)
U of Washington, Seattle, WA (Host: Prof. Steve Seitz)
Woods Hole Oceanographic Institution , Cape Cod, MA (Host: Prof. Hanumant Singh)

2003
Stanford University, CA (Host: Prof Terry Winograd ) Video
University of California at Berkeley, Berkeley (Host: Prof Carlo H. Séquin)
Honda Labs, Mountain View CA (Host: James Davis)
SRI International, Menlo Park, CA (Host: Motilal Agrawal)
nVidia , Santa Clara HQ, CA (Host: Wei-chao Chen)
University of California at Irvine, Irvine (Host: Prof Gopi Meenakshisundaram)
Siggraph Boston Chapter, Boston

2002
Siggraph Boston Chapter, Boston

2001
MIT Media Lab, Cambridge
Siggraph Boston Chapter, Boston
U of Tokyo, Tokyo (Host: Prof Tomoyuki Nishita)
Sony Computer Science Lab, Tokyo (Host: Frank Nielsen)
Mitsubishi Electric VIL (UK Research Lab), London (Host: Miroslaw Bober)

2000
IBM Research, T. J. Watson, New York (Host: Gabriel Taubin)
AT&T Labs, New Jersey (Host: Shankar Krishnan)
Bell Labs, Murray Hill, New Jersey (Host: Dan Aliaga and Ingrid Carlbom)
Stanford University, Palo Alto, California (Host: Prof Pat Hanrahan and Prof Marc Levoy)
U of California at Berkeley, California
Intel Research, Santa Clara, California (Host: Jean-Yves Bouguet)
Princeton University, New Jersey

1999
Brown University, Providence, Rhode Island

1998
California Institute of Technology (CalTech), Pasadena, California (Host: Prof Peter Schröder)
U of Utah, Salt Lake City, Utah

Panels

Symposium on Computational Photography and Video at MIT, What Will a Camera Look Like in 20 Years ? May 2005 (Organizer)
Siggraph 2005, The Ultimate Display: What Will It Be?, August 2005

Papers Committee: Siggraph 2007, Siggraph 2008

Papers Committee: Eurographics ( EG) 2005, Eurographics 2008

Program Committee: International Conference on Computer Vision (IEEE ICCV) 2005, 2007
Program Committee: Computer Vision and Pattern Recognition (IEEE CVPR) 2005, 2006, 2007, 2008
Program Committee: European Conference on Computer Vision (ECCV) 2006, 2008
Program Committee: Computer Graphics International ( CGI) 2005
Program Committee: Computer Vision and Pattern Recognition (IEEE CVPR) 2004, 2005, 2006
Program Committee: Non-photorealistic Animation and Rendering (ACM NPAR) 2004, 2006
Program Committee: High Performance Computing - Virtual Reality (HPC) 2004
Program Committee: Sketch-based Interfaces (with Eurographics) 2004

Judging panel member for Global Indus Technovator Awards at MIT, 2004

Reviewer: SIGGRAPH(1999-2004-), Eurographics(2001-2003), EGRW/EGRS, I3D(2001,2003), IEEE Visualization(1999,2000,2002,2003), ISMAR (Mixed and Augmented Reality, 2003,2004), ACM Multimedia, NPAR (2002,2004), UIST(2001,2002), ACM TOG, IEEE CG&A, IEEE TVCG

• Mitsubishi Electric Valuable Invention Award, 2006 (For Photosensing Tags, RFIG)
  
• Mitsubishi Electric Valuable Invention Award, 2006 (For Dome Screen Projector Display)
• Dome Screen Projector for prestigious 'Best 10 New Products' Prize in Japan given by Nikkan Kogyo Simbun
• Technology Review's 100 Top Young Innovators Under 35 (TR100), 2004 (More links)
  
• Mitsubishi Electric Valuable Invention Award, 2004
  
• MIT Global Indus Technovator Awards (Top 20 Indian Researcher), 2003
  
• Mitsubishi Electric Information Technology R&D Award, 2003
  
• Link Fellowship Award, 1998-99
  
• The undergraduate degree project in robotics awarded "Best Project of the University" prize by IEEE chapter of Pune Institute of Computer Technology , 1991
  
• Best student paper, "Incremental Curve Generation" at state level technical paper contest, 1991
  
• Ranked First among 500,000 students appearing for entrance exam (HSC Merit List) for the bachelor's program in the state of Maharashtra, India, 1987
  
• Selected among TOP 20 to represent India at the International Mathematics Olympiad, 1987
  

2007
Prakash: Lighting Aware Motion Capture for Dynamic Virtual Sets, Emerging Tech, SIGGRAPH, Aug 2007, San Diego

2006
Instant Replay Air Hockey , Emerging Tech, SIGGRAPH, Aug 2006, Boston

2005
Contours with Multi-flash , CVPR 2005, June 2005, San Diego
 
2004
Camera Non-photo , COLLISION Senses Show, Nov 2004, Cambridge
Stylized Images with NPR Camera , Emerging Tech, SIGGRAPH, Aug 2004, Los Angeles
Interacting With Projections Using iLamp Projectors , Emerging Tech, SIGGRAPH, Aug 2004, Los Angeles

2001
Contra Inertia , superCOLLISION Show, Oct 2001, Cambridge

2002
CEATEC (Image, Information and Communications: Consumer Trade Show), Tokyo Japan
InfoComm, Las Vegas

2001
DaimlerChrysler HQ, Detroit