Microsoft Research,

1 Microsoft Way, Redmond WA 98052, USA

Email: eyalofek@microsoft.com

LinkedIn:                     https://www.linkedin.com/in/eyalofek
Facebook:                    https://www.facebook.com/eyal.ofek2
YouTube Channel:     https://www.youtube.com/user/eyalofek/featured

 

About me

I am a senior researcher in at Microsoft Research. My research interests include computer vision for human-computer interaction, Augmented Reality (AR)/Virtual Reality (VR), Haptics and  interactive projection mapping.

I obtained my PhD at the Hebrew University of Jerusalem, and founded a couple of companies in the area of computer graphics, including the successful Photon-Paint for the Amiga computer, and managing the software R&D at 3DV Systems, developing the world first active real-time depth cameras, later bought by Microsoft in 2008.

During 2004-2005 I was a researcher at Microsoft Research Asia (MSRA), working on issues such as video completion, reconstruction of hair from images, and camera based interaction, following by founding the Virtual Earth Research Lab, (A.K.A. Bing Mapping and Mobile Research Lab). The lab developed and shipped new innovations to Microsoft Virtual Earth and Bing, such as the first Street-View Site (2006), Image Privacy, automatic geo-positioning user images, text detection in images and more. 

During 2011-2014, I managed a group of researchers at MSR's eXtream Computing Group (XCG) in the areas of AR and Graphics.

I have co-chaired the 19th ACM SIGSPATIAL 2011, being in program committee and reviewer for different leading conferences. I Held a visiting lecture position at the school of computer science, Interdisciplinary Center, Herzelia, Israel.


On artistic side, I have a background as a book cover illustrator and a comics strip artist.


This page was last edited on Apr. 2018.  

Research Highlight

Augmented Reality/Virtual Reality

I am interesting in the way that AR & VR effect and being effected by the real environment, and ways in which AR &VR can influence new experiences, for example social interaction. 

  
 
SnapToReality (2016) FovrAR (2015) Spatial Consistency AR (2015)

Hand Representations for

Typing in VR (2018)

 

 

    
The Known Stranger (2015) FLARE (2014) Conversation AR (2013)

Text Entry in VR using

Standard Keyboards (2018)

Haptics

While visual display and 3D audio are progressing at a fast pase, Haptics is still and mostly untapped sense. Many times, due to the severe limitations of haptic rendering capability, there is a need to manipulate our senses to generate a convincing AR & VR experience of touch.  

 
  
Sparse Haptics (2017) Normal Touch & Texture Touch (2016)

Haptic Retargeting (2016)

 Uncanny Valley of Haptics (2018)  

Haptic Links (2018)   Claw (2018) Haptic Revolver (2018)

    

Interactive Projection Mapping

The use of projector enable large area augmentation that can be shared by multiple users. 

Room2Room Life-sized teleconferencing RoomAlive RoomAlive   IllumiRoom    SurroundWeb: Microsoft's Plan To Cloak Your Living Room With Internet
Room2Room (2015-2016) 
The Other Resident (2014) RoomAlive (2014-2016)
Illumiroom (2013)
SurroundWeb (2015)

  

Camera Based Interaction

Cameras are cheep and powerful sensors. I am looking in ways that we can leverage of cameras capabilities to compensate for the physical limitations of existing displays and input techniques.

GlassHands (2016) Mouse 2.0 (2009)  Camera based avatars (2006) DirectPointer (2006) Presentation Control (2005)

     

Computer Vision

Analysis by synthesis, Text detection, 2D and 3D completion

Depth Extension (2015) DCSH (2013) Geo Position Photographs (2010) Annotate Videos (2010)

Stroke Width Transform

(2010)

Image Based Facade Modeling

(2008)

Video Completion for Video Stabilization (2005-2006)

Modeling Hair from Images (2005)

Computer Graphics

 

 

Seamless Montage texturing (2010) Integrated Videos & Maps (2009)

Factoring Repeated content (2008)

Geo relevance (2010)
Description: Description: Description: Description: Description: Description: girl

Interactive deformation of light fields

(2005)

Depth Key (2003)

Interactive Curved Reflections (1998)

Textures from Image Sequences (1997)

 Selected past Industrial projects  

Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\ZCam.jpg

Publications

New:


 


I, Choi, E.Ofek, H. Benko & M. Sinclair and C. Holz

                      

  C. C. Berger, M. Goznalez-Franco, E. Eyal and K. Hinckley 

  The Uncanny Valley of Haptics 

  Science Robotics 18 Apr 2018: Vol. 3, Issue 17, eaar7010

 

 Professional service          

Awards:

 

Invited Talks:

  

            SIGGRAPH 2013 Emerging Technologies Demo

          Some coverage (in Hebrew):

               Ynet, Globes, Mako, The President Official Channel (YouTube)

 

                                  

 

 

Patents:

      

                                      Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\Patent.jpg

PAT. NO.

Title

9,916,003 3D haptics for interactive computer systems

9,805,514

Full-Text

Dynamic haptic retargeting

9,679,144

Full-Text

Protecting privacy in web-based immersive augmented reality

9,641,644

Full-Text

Optimized image delivery over limited bandwidth communication channels

9,594,960

Full-Text

Visualizing video within existing still images

9,480,907

Full-Text

Immersive display with peripheral illusions

9,436,276

Full-Text

Second-person avatars

9,424,676

Full-Text

Transitioning between top-down maps and local navigation of reconstructed 3-D scenes

9,355,268

Full-Text

Managing access by applications to perceptual information

9,298,345

Full-Text

Block view for geographic navigation

9,235,759

Full-Text

Detecting text using stroke width based text detection

9,183,465

Full-Text

Data difference guided image capturing

9,171,403

Full-Text

Contour completion for augmenting surface reconstructions

9,167,290

Full-Text

City scene video sharing on digital maps

9,146,119

Full-Text

Scrubbing variable content paths

9,123,159

Full-Text

Interactive geo-positioning of imagery

9,110,921

Full-Text

Map editing with little user input

9,100,402

Full-Text

Cognitive agent

9,032,042

Full-Text

Audio presentation of condensed spatial contextual information

9,008,859

Full-Text

Navigation instructions using low-bandwidth signaling

8,971,641

Full-Text

Spatial image index and associated updating functionality

8,970,691

Full-Text

Removal of rayleigh scattering from images

8,958,569

Full-Text

Selective spatial audio communication

8,954,266

Full-Text

Providing routes through information collection and retrieval

8,941,641

Full-Text

Annotating or editing three dimensional space

8,917,935

Full-Text

Detecting text using stroke width based text detection

8,831,380

Full-Text

Viewing media in the context of street-level images

8,823,797

Full-Text

Simulated video with extra viewpoints and enhanced resolution for traffic cameras

8,817,049

Full-Text

Automated fitting of interior maps to general maps

8,774,520

Full-Text

Geo-relevance for images

8,773,424

Full-Text

User interfaces for interacting with top-down maps of reconstructed 3-D scences

8,769,396

Full-Text

Calibration and annotation of video content

8,694,383

Full-Text

Path queries

8,688,368

Full-Text

Image-based localization for addresses

8,675,018

Full-Text

Electromechanical surface of rotational elements for motion compensation of a moving object

8,645,230

Full-Text

Virtual closet for storing and accessing virtual representations of items

8,640,020

Full-Text

Adjustable and progressive mobile device street view

8,633,942

Full-Text

View generation using interpolated values

8,624,902

Full-Text

Transitioning between top-down maps and local navigation of reconstructed 3-D scenes

8,611,643

Full-Text

Spatially registering user photographs

8,581,900

Full-Text

Computing transitions between captured driving runs

8,577,170

Full-Text

Shadow detection in a single image

8,570,325

Full-Text

Filter and surfacing virtual content in virtual worlds

8,560,515

Full-Text

Automatic generation of markers based on social interaction

8,550,909

Full-Text

Geographic data acquisition by user motivation

8,549,627

Full-Text

Detection of objectionable videos

8,548,725

Full-Text

Visual assessment of landmarks

8,503,794

Full-Text

Data difference guided image capturing

8,494,566

Full-Text

Hybrid mobile phone geopositioning

8,494,284

Full-Text

Methods and apparatuses for facilitating detection of text within an image

8,488,040

Full-Text

Mobile and server-side computational photography

8,487,927

Full-Text

Validating user generated three-dimensional models

8,463,289

Full-Text

Depersonalizing location traces

8,453,060

Full-Text

Panoramic ring user interface

8,447,136

Full-Text

Viewing media in the context of street-level images

8,447,105

Full-Text

Data driven interpolation using geodesic affinity

8,446,367

Full-Text

Camera-based multi-touch mouse

8,442,716

Full-Text

Identifying physical locations of entities

8,433,136

Full-Text

Tagging video using character recognition and propagation

8,428,908

Full-Text

Cognitive agent

8,340,416

Full-Text

Techniques for robust color transfer

8,326,048

Full-Text

Geo-relevance for images

8,319,796

Full-Text

Generating a texture from multiple images

8,311,287

Full-Text

Validation and correction of map data using oblique images

8,301,996

Full-Text

Annotating images with instructions

8,296,194

Full-Text

Method, medium, and system for ranking dishes at eating establishments

8,295,589

Full-Text

Spatially registering user photographs

8,266,132

Full-Text

Map aggregation

8,237,791

Full-Text

Visualizing camera feeds on a map

8,204,338

Full-Text

Factoring repeated content within and among images

8,200,037

Full-Text

Importance guided image transformation

8,195,430

Full-Text

Cognitive agent

8,189,925

Full-Text

Geocoding by image matching

8,184,911

Full-Text

Flexible matching with combinational similarity

8,125,493

Full-Text

Generating a texture from multiple images

8,103,445

Full-Text

Dynamic map rendering as a function of a user parameter

8,098,245

Full-Text

Smart navigation for 3D maps

8,085,990

Full-Text

Hybrid maps with embedded street-side images

8,060,302

Full-Text

Visual assessment of landmarks

8,059,888

Full-Text

Semi-automatic plane extrusion for 3D modeling

8,009,178

Full-Text

Augmenting images for panoramic display

7,991,283

Full-Text

Geotagging photographs using annotations

7,967,451

Full-Text

Multi-directional image displaying device

7,957,596

Full-Text

Flexible matching with combinational similarity

7,946,921

Full-Text

Camera based orientation for mobile devices

7,941,271

Full-Text

Displaying images related to a requested path

7,912,637

Full-Text

Landmark-based routing

7,889,947

Full-Text

Image completion

7,886,978

Full-Text

Techniques for decoding images of barcodes

7,852,315

Full-Text

Camera and acceleration based interface for presentations

7,840,032

Full-Text

Street-side maps and paths

7,831,089

Full-Text

Modeling and texturing digital surface models in a mapping application

7,805,066

Full-Text

System for guided photography based on image capturing device rendered user recommendations according to embodiments

7,777,648

Full-Text

Mode information displayed in a mapping application

7,548,659

Full-Text

Video enhancement

7,477,236

Full-Text

Remote control of on-screen interactions