Microsoft Research,

1 Microsoft Way, Redmond WA 98052, USA

Email: eyalofek@microsoft.com

LinkedIn:                     https://www.linkedin.com/in/eyalofek
Facebook:                    https://www.facebook.com/eyal.ofek2
YouTube Channel:     https://www.youtube.com/user/eyalofek/featured

 

About me

 

I am a senior researcher in at Microsoft Research. My research interests include computer vision for human-computer interaction, Augmented Reality (AR)/Virtual Reality (VR), Haptics and  interactive projection mapping.

I obtained my PhD at the Hebrew University of Jerusalem, and founded a couple of companies in the area of computer graphics, including the successful Photon-Paint for the Amiga computer, and managing the software R&D at 3DV Systems, developing the world first active real-time depth cameras, later bought by Microsoft in 2008.

During 2004-2005 I was a researcher at Microsoft Research Asia (MSRA), working on issues such as video completion, reconstruction of hair from images, and camera based interaction, following by founding the Virtual Earth Research Lab, (A.K.A. Bing Mapping and Mobile Research Lab). The lab developed and shipped new innovations to Microsoft Virtual Earth and Bing, such as the first Street-View Site (2006), Image Privacy, automatic geo-positioning user images, text detection in images and more. 

During 2011-2014, I managed a group of researchers at MSR's eXtream Computing Group (XCG) in the areas of AR and Graphics.

I have co-chaired the 19th ACM SIGSPATIAL 2011, being in program committee and reviewer for different leading conferences. I Held a visiting lecture position at the school of computer science, Interdisciplinary Center, Herzelia, Israel.


On artistic side, I have a background as a book cover illustrator and a comics strip artist.


This page was last edited on Jan. 2018.  

Research Highlight

 

Augmented Reality/Virtual Reality

I am interesting in the way that AR & VR effect and being effected by the real environment, and ways in which AR &VR can influence new experiences, for example social interaction. 

 
 
SnapToReality (2016) FovrAR (2015) Spatial Consistency AR (2015)

 

 

The Known Stranger (2015) FLARE (2014) Conversation AR (2013)

Haptics

While visual display and 3D audio are progressing at a fast pase, Haptics is still and mostly untapped sense. Many times, due to the severe limitations of haptic rendering capability, there is a need to manipulate our senses to generate a convincing AR & VR experience of touch.  

 
 
Sparse Haptics (2017) Normal Touch & Texture Touch (2016) Haptic Retargeting (2016)

    

Interactive Projection Mapping

The use of projector enable large area augmentation that can be shared by multiple users. 

Room2Room Life-sized teleconferencing RoomAlive RoomAlive   IllumiRoom    SurroundWeb: Microsoft's Plan To Cloak Your Living Room With Internet
Room2Room (2015-2016) 
The Other Resident (2014) RoomAlive (2014-2016)
Illumiroom (2013)
SurroundWeb (2015)

  

Camera Based Interaction

Cameras are cheep and powerful sensors. I am looking in ways that we can leverage of cameras capabilities to compensate for the physical limitations of existing displays and input techniques.

GlassHands (2016) Mouse 2.0 (2009)  Camera based avatars (2006) DirectPointer (2006) Presentation Control (2005)

     

Computer Vision

Analysis by synthesis, Text detection, 2D and 3D completion

Depth Extension (2015) DCSH (2013) Geo Position Photographs (2010) Annotate Videos (2010)

Stroke Witch Transform

(2010)

Image Based Facade Modeling

(2008)

Video Completion for Video Stabilization (2005-2006)

Modeling Hair from Images (2005)

Computer Graphics

 

 

Seamless Montage texturing (2010) Integrated Videos & Maps (2009)

Factoring Repeated content (2008)

Geo relevance (2010)
Description: Description: Description: Description: Description: Description: girl

Interactive deformation of light fields

(2005)

Depth Key (2003)

Interactive Curved Reflections (1998)

Textures from Image Sequences (1997)

 Selected past Industrial projects  

 

Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\ZCam.jpg

 

Publications

New:



 

C. Hurter, N. Henry Riche, M. Pahud, E. Ofek, S. Drucker, B. Lee, D. Brown, C. Wong

Into the mixed reality data sphere: mapping user’s movements to data
exploration tools

#Immersive2017 Workshop on Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics

Workshop at IEEE VIS, 1st October, Phoenix.

                      

 

 Professional service          

Awards:

 

Invited Talks:

  

      

                                      Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\Patent.jpg

Patents:

PAT. NO.

Title

1

9,805,514

Full-Text

Dynamic haptic retargeting

2

9,679,144

Full-Text

Protecting privacy in web-based immersive augmented reality

3

9,641,644

Full-Text

Optimized image delivery over limited bandwidth communication channels

4

9,594,960

Full-Text

Visualizing video within existing still images

5

9,480,907

Full-Text

Immersive display with peripheral illusions

6

9,436,276

Full-Text

Second-person avatars

7

9,424,676

Full-Text

Transitioning between top-down maps and local navigation of reconstructed 3-D scenes

8

9,355,268

Full-Text

Managing access by applications to perceptual information

9

9,298,345

Full-Text

Block view for geographic navigation

10

9,235,759

Full-Text

Detecting text using stroke width based text detection

11

9,183,465

Full-Text

Data difference guided image capturing

12

9,171,403

Full-Text

Contour completion for augmenting surface reconstructions

13

9,167,290

Full-Text

City scene video sharing on digital maps

14

9,146,119

Full-Text

Scrubbing variable content paths

15

9,123,159

Full-Text

Interactive geo-positioning of imagery

16

9,110,921

Full-Text

Map editing with little user input

17

9,100,402

Full-Text

Cognitive agent

18

9,032,042

Full-Text

Audio presentation of condensed spatial contextual information

19

9,008,859

Full-Text

Navigation instructions using low-bandwidth signaling

20

8,971,641

Full-Text

Spatial image index and associated updating functionality

21

8,970,691

Full-Text

Removal of rayleigh scattering from images

22

8,958,569

Full-Text

Selective spatial audio communication

23

8,954,266

Full-Text

Providing routes through information collection and retrieval

24

8,941,641

Full-Text

Annotating or editing three dimensional space

25

8,917,935

Full-Text

Detecting text using stroke width based text detection

26

8,831,380

Full-Text

Viewing media in the context of street-level images

27

8,823,797

Full-Text

Simulated video with extra viewpoints and enhanced resolution for traffic cameras

28

8,817,049

Full-Text

Automated fitting of interior maps to general maps

29

8,774,520

Full-Text

Geo-relevance for images

30

8,773,424

Full-Text

User interfaces for interacting with top-down maps of reconstructed 3-D scences

31

8,769,396

Full-Text

Calibration and annotation of video content

32

8,694,383

Full-Text

Path queries

33

8,688,368

Full-Text

Image-based localization for addresses

34

8,675,018

Full-Text

Electromechanical surface of rotational elements for motion compensation of a moving object

35

8,645,230

Full-Text

Virtual closet for storing and accessing virtual representations of items

36

8,640,020

Full-Text

Adjustable and progressive mobile device street view

37

8,633,942

Full-Text

View generation using interpolated values

38

8,624,902

Full-Text

Transitioning between top-down maps and local navigation of reconstructed 3-D scenes

39

8,611,643

Full-Text

Spatially registering user photographs

40

8,581,900

Full-Text

Computing transitions between captured driving runs

41

8,577,170

Full-Text

Shadow detection in a single image

42

8,570,325

Full-Text

Filter and surfacing virtual content in virtual worlds

43

8,560,515

Full-Text

Automatic generation of markers based on social interaction

44

8,550,909

Full-Text

Geographic data acquisition by user motivation

45

8,549,627

Full-Text

Detection of objectionable videos

46

8,548,725

Full-Text

Visual assessment of landmarks

47

8,503,794

Full-Text

Data difference guided image capturing

48

8,494,566

Full-Text

Hybrid mobile phone geopositioning

49

8,494,284

Full-Text

Methods and apparatuses for facilitating detection of text within an image

50

8,488,040

Full-Text

Mobile and server-side computational photography

51

8,487,927

Full-Text

Validating user generated three-dimensional models

52

8,463,289

Full-Text

Depersonalizing location traces

53

8,453,060

Full-Text

Panoramic ring user interface

54

8,447,136

Full-Text

Viewing media in the context of street-level images

55

8,447,105

Full-Text

Data driven interpolation using geodesic affinity

56

8,446,367

Full-Text

Camera-based multi-touch mouse

57

8,442,716

Full-Text

Identifying physical locations of entities

58

8,433,136

Full-Text

Tagging video using character recognition and propagation

59

8,428,908

Full-Text

Cognitive agent

60

8,340,416

Full-Text

Techniques for robust color transfer

61

8,326,048

Full-Text

Geo-relevance for images

62

8,319,796

Full-Text

Generating a texture from multiple images

63

8,311,287

Full-Text

Validation and correction of map data using oblique images

64

8,301,996

Full-Text

Annotating images with instructions

65

8,296,194

Full-Text

Method, medium, and system for ranking dishes at eating establishments

66

8,295,589

Full-Text

Spatially registering user photographs

67

8,266,132

Full-Text

Map aggregation

68

8,237,791

Full-Text

Visualizing camera feeds on a map

69

8,204,338

Full-Text

Factoring repeated content within and among images

70

8,200,037

Full-Text

Importance guided image transformation

71

8,195,430

Full-Text

Cognitive agent

72

8,189,925

Full-Text

Geocoding by image matching

73

8,184,911

Full-Text

Flexible matching with combinational similarity

74

8,125,493

Full-Text

Generating a texture from multiple images

75

8,103,445

Full-Text

Dynamic map rendering as a function of a user parameter

76

8,098,245

Full-Text

Smart navigation for 3D maps

77

8,085,990

Full-Text

Hybrid maps with embedded street-side images

78

8,060,302

Full-Text

Visual assessment of landmarks

79

8,059,888

Full-Text

Semi-automatic plane extrusion for 3D modeling

80

8,009,178

Full-Text

Augmenting images for panoramic display

81

7,991,283

Full-Text

Geotagging photographs using annotations

82

7,967,451

Full-Text

Multi-directional image displaying device

83

7,957,596

Full-Text

Flexible matching with combinational similarity

84

7,946,921

Full-Text

Camera based orientation for mobile devices

85

7,941,271

Full-Text

Displaying images related to a requested path

86

7,912,637

Full-Text

Landmark-based routing

87

7,889,947

Full-Text

Image completion

88

7,886,978

Full-Text

Techniques for decoding images of barcodes

89

7,852,315

Full-Text

Camera and acceleration based interface for presentations

90

7,840,032

Full-Text

Street-side maps and paths

91

7,831,089

Full-Text

Modeling and texturing digital surface models in a mapping application

92

7,805,066

Full-Text

System for guided photography based on image capturing device rendered user recommendations according to embodiments

93

7,777,648

Full-Text

Mode information displayed in a mapping application

94

7,548,659

Full-Text

Video enhancement

95

7,477,236

Full-Text

Remote control of on-screen interactions