Microsoft Research,

1 Microsoft Way, Redmond WA 98052, USA


YouTube Channel:

About me

I am a senior researcher in at Microsoft Research. My research interests include computer vision for human-computer interaction and Augmented Reality. My Interests include augmented and virtual teality, camera based interaction, modeling from images, haptics and  interactive projection mapping.

During 2011-2014, I managed a group of researchers at MSR's eXtream Computing Group (XCG) in the areas of Augmented Reality and Graphics. Prior to that, I have founded the Virtual Earth Research Lab, later named Bing Mapping and Mobile Research Lab. The lab developed and shipped new innovations to Microsoft Virtual Earth and Bing service, such as the first Street View Technical Preview (Feb. 2006), Street View Privacy, automatic matching of user images, text recovery in the wild and more.

During 2004-2005 I was a researcher at Microsoft Research Asia (MSRA), working on issues such as video completion, reconstruction of hair from images, and camera based interaction.

Before joining Microsoft, I have founded a couple of companies in the area of computer graphics, including the design & development of the successful Photon-Paint drawing and image retouching application for the Amiga computer, and managing the software R&D at 3DV Systems LTD, developing active real-time depth cameras for motion controlled gaming, later bought by Microsoft in 2008.

I obtained my BA, MS and PhD at the Hebrew University of Jerusalem.

I have co-chaired the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL GIS 2011), program comittee and reviewer to different leading conferences. I Helded a visiting lecture position at the school of computer science, Interdisciplinary Center, Herzelia, Israel.

On artistic side, I have a background as a book cover illustrator and a comics strip artist.

This page was last edited on April 2017.  

Research Highlight

Augmented Reality/Virtual Reality

I am interesting in the way that AR & VR effect and being effected by the real environment, and ways in which AR &VR can influence new experiences, for example social interaction. 

SnapToReality (2016) FovrAR (2015) Spatial Consistency AR (2015)



The Known Stranger (2015) FLARE (2014) Conversation AR (2013)


While visual display and 3D audio are progressing at a fast pase, Haptics is still and mostly untapped sense. Many times, due to the severe limitations of haptic rendering capability, there is a need to manipulate our senses to generate a convincing AR & VR experience of touch.  

Sparse Haptics (2017) Normal Touch & Texture Touch (2016) Haptic Retargeting (2016)

Interactive Projection Mapping

The use of projector enable large area augmentation that can be shared by multiple users. 

Room2Room Life-sized teleconferencing RoomAlive RoomAlive
Room2Room (2015-2016) 
The Other Resident (2014) RoomAlive (2014-2016)
SurroundWeb: Microsoft's Plan To Cloak Your Living Room With Internet
Illumiroom(2013) SurroundWeb (2015)

Camera Based Interaction

Cameras are cheep and powerful sensors. I am looking in ways that we can leverage of cameras capabilities to compensate for the physical limitations of existing displays and input techniques.

GlassHands (2016) Mouse 2.0 (2009)  Camera based avatars (2006)
DirectPointer (2006) Presentation Control (2005)

Computer Vision

Depth Extension (2015) DCSH (2013) Geo Position Photographs (2010) Annotate Videos (2010)

Stroke Witch Transform


Image Based Facade Modeling


Video Completion for Video Stabilization (2005-2006)

Modeling Hair from Images (2005)

Computer Graphics



Seamless Montage texturing (2010) Integrated Videos & Maps (2009)

Factoring Repeated content (2008)

Geo relevance (2010)
Description: Description: Description: Description: Description: Description: girl

Interactive deformation of light fields


Depth Key (2003)

Interactive Curved Reflections (1998)

Textures from Image Sequences (1997)

 Selected past Industrial projects  

Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\ZCam.jpg



L.-P. ChengE. OfekC. Holz, H. Benko and A. D. Wilson

Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop

CHI 2017


Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\Patent.jpg New
    Block View For Geographic Navigation (2016)
Professional service 

Invited Talks