Publications                                        

return to Home page

Journal and Conference Papers

 2019

S. Marwecki (MSR & Hasso Plattner Institute, U. of Potsdam), A. Wilson, E. Ofek, M. Gonzalez Franco and C. Holz

Mise-Unseen: Using Eye Tracking to Hide Virtual Reality Scene Changes in Plain Sight. 

UIST 2019

Paper, Video, Microsoft Research Blog

Upload: "Microsoft Researchers Explore Eye Tracking Uses For VR"

Engadget: "Microsoft's latest VR experiment is a literal walk in the park"

 

J. Yang (Stanford & MSR), C. Holz, E. Ofek and A. Wilson

DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality. 

UIST 2019


Paper, Video, Microsoft Research Blog

ArsTechnica:  "Microsoft’s DreamWalker VR turns your daily commute into a totally different one"

RoadToVR: "Microsoft ‘DreamWalker’ Experiment Takes First Steps into Always-on World-scale VR"

Engadget: "Microsoft's latest VR experiment is a literal walk in the park"

Gizmodo: "Microsoft's Over-the-Top VR Rig Lets You Explore a Virtual World While Walking IRL"

MSN:  "Microsoft DreamWalker project takes VR technology outdoors "

ZDnet: "Dream or nightmare? Microsoft's VR swaps your real walking route for a virtual one"

DailyMail: "Microsoft reveals its DreamWalker VR rig that lets users explore a virtual world while walking around in real life"

 

M. Sinclair, E. Ofek, M. Gonzalez-Franco and C. Holz

CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback.

UIST 2019

UIST 2019 Best Demo: Honorable Mention 

Paper, Video, Microsoft Research Blog

Engadget: "Microsoft's latest VR experiment is a literal walk in the park"

Upload: "Microsoft Shows Off Force Resistance VR Grasping Feature Prototype"

WinBuzzer:| Microsoft Research Reveals CapstanCrunch VR Haptic Control Method

 

D. Schneider1, A. Otte1, T. Gesslein1, P. Gagel1, B. Kuth1, M. S. Damlakhi1, O. Dietz1, E. Ofek2, M. Pahud2, P. O. Kristensson3, J. Muller4 and J. Grubert1  

1 Cuborg University, 2 Microsoft Research 3 Cambridge 4 Bayreuth

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality.  

IEEE Transactions on Visualization and Computer Graphics , Volume: 25 ( Issue: 11 , Nov. 2019

ISMAR 2019, Best Paper Award, Beijing Oct. 2019

Paper, Video

 

M. Mott, E. Cutrell, M. Gonzalez Franco, C. Holz, E. Ofek and M. Ringel Morris

Accessible by Design: An Opportunity for Virtual Reality

ISMAR 2019 Workshop on Mixed Reality and Accessibility | Oct 2019

 

Y. Zhao (Cornell Tech & MSR), E. CutrellC. HolzM. Ringel MorrisE.Ofek and A. Wilson

SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. CHI 2019.

Paper, Video, Microsoft Research Blog,

Engadget: "Microsoft is making VR better for those with vision problems" 

RoadToVR: "Microsoft Aims to Improve VR for Users with Vision Problems"

 

J. Lee (Kaist & MSR), M. Sinclair, M. Gonzalez-Franko, E. Ofek and C. Holz

TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction. CHI 2019.

Paper, Video, Microsoft Research Blog,

VentureBeat: "Microsoft’s TORC will let you feel squeezable objects in AR and VR"

UploadVR: "Microsoft Shows Off Haptic VR Controller, Simulates Grabbing With Thumb & Two Fingers"

 

P. Abtahi (Stanford & MSR), M. Gonzalez-Franco, E. Ofek, A. Steed (UCL)

I’m a Giant: Walking in Large Virtual Environments at High Speed Gains. CHI 2019.

Paper, Video, Microsoft Research Blog

   

J. Hartmann (Waterloo & MSR), C. Holz, E. Ofek, & A. D. Wilson

Reality Check: Blending Virtual Environments with Situated Physical RealityCHI 2019.

Paper, Video

  

L-P. Cheng (HPI), E. Ofek, C. Holz & A.D. Wilson

VRoamer: Generating On-The-Fly VR Experiences While Walking inside Large, Unknown Real-World Building Environments. IEEE VR 2019

Paper, Video, Microsoft Research Blog

  

J. Grubert (Coburg), E. Ofek, M. Pahud, P.O. Kristensson (Cambridge)

The Office of the Future: Virtual, Portable, and Global. IEEE Computer Graphics & Application, Nov/Dec 2018

Paper, Video1, Video2

2018

C. C. Berger (CalTech), M. Goznalez-Franco, E. Eyal and K. Hinckley

The Uncanny Valley of Haptics. Science Robotics 18 Apr 2018: Vol. 3, Issue 17

Paper, Video Microsoft Research Blog

 

 

C. Holz & E. Ofek

Doubling the Signal Quality of Smartphone Camera Pulse Oximetry Using the Display Screen As a Controllable Selective Light Source.IEEE Engineering in Medicine and Biology Society (EMBC'18)  2018 

Paper

 

M. Pahud, E. Ofek, N. H. Riche, M. C. Hurter (ENAC) and J. Grubert (Coburg)

Mobiles as Portals for Interaction with Virtual Data VisualizationsData Visualization on Mobile Devices Workshop 2018

Paper

 

I. Choi (Stanford), E. Ofek, H. Benko, M. Sinclair and C.Holz

CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual RealityCHI 2018

Paper, Video, Microsoft Research Blog,

Engadget ("Microsoft’s mad scientists are making AR more tactile"), Co. Design ("Crazy Microsoft is the best Microsoft"), Gizmodo, Road To VR

 


E. Strasnick (Stanford), C. Holz, E. Ofek, M. Sinclair and Hrvoje Benko

Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation . CHI 2018

Paper, Video,  Microsoft Research Blog,

Engadget ("Microsoft’s mad scientists are making AR more tactile"), Co. Design ("Crazy Microsoft is the best Microsoft"), Gizmodo, Road To VR,  Slashgear, VRScout

        

E. Whitmire (UW), H. Benko, C. Holz, E. Ofek and Mike Sinclair

Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller

Honorable Mentioned paper, CHI 2018

Paper, Video. Microsoft Research Blog,

Engadget ("Microsoft’s mad scientists are making AR more tactile"), Co. Design ("Crazy Microsoft is the best Microsoft"), Gizmodo, Road To VR

 

J. Grubert (Cuborg), L. Witzani, E. Ofek, M. Pahud, M. Kraz and P.O. Kristensson (Cambridge)

Effects of Hand Representations for Typing in Virtual Reality

IEEE VR Mar. 2018

Paper, Video, Microsoft Research Blog

 

J. Grubert (Cuborg), L. Witzani, E. Ofek, M. Pahud, M. Kraz and P.O. Kristensson (Cambridge)

Text Entry in Immersive Head-Mounted Display-based Virtual Reality using Standard KeyboardsIEEE VR Mar. 2018

Paper, Video,  Microsoft Research Blog

 

2017

C. Hurter, N. H. Riche, M. Pahud, E. Ofek, S. Drucker, B. Lee, D. Brown, C. Wong

Into the mixed reality data sphere: mapping user’s movements to data exploration tools

#Immersive2017 Workshop on Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics

at IEEE VIS, 1st October, Phoenix.

  

 

 2016

J. Grubert (Cuborg), E. Ofel, M. Pahud,

GlassHands: Interaction Around Unmodified Mobile Devices Using SunglassesACM ISS 2016

Paper, Video, msPowerUser ("Microsoft’s latest Human Interaction Research will blow your mind") , CMWinBuzzer, IT News

  

H. Benko, C. Holz, M. Sinclair, E. Ofek

NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers

Honorable Mentioned paper, 
UIST 2016

Paper, Video
Wired UK, Digital Thrends, Road to VR, Makezine

B.  Nuernberger, E. Ofek, H. Benko &  A. D. Wilson

SnapToReality: Aligning Augmented Reality to the Real World. CHI 2016
  

M. Azmandian, M. Hancock, H. Benko, E. Ofek, A. D Wilson

Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. 
CHI 2016

Paper, Video (Best of Videos, CHI 2016), Gamasutra, TechSpot, Wearable

  

 

T. Pajsa, H. Benko, A. D. Wilson  & E. Ofek

Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment

Best Paper, 
CSCW 2016
paper, Video, MIT Tech Review, ZDnet

 

2015 

S. Korman, S. Avidan & E. Ofek

Peeking Template Matching for Depth Extension
ICCV 2015

paper, supliment materials, bibtex

  

  


 H. Benko, E. Ofek, Feng Zheng & A. D. Wilson 

FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality 
UIST 2015


paper, video

  

  

B. Ens (Minetoba), E. Ofek, N. Bruce (Minetoba) & P. Irani (Minetoba)

Spatial Constancy of Surface-Embedded Layouts across Multiple Environments

The ACM Symposium on Spatial User Interaction (SUI)  2015

Video

  

  


 

 B. R. Jones, H. Benko, E. Ofek, A. D. Wilson 

IllumiRoom: Immersive Experiences Beyond the TV ScreenCommunications of the ACM, Vol. 58 No. 6, June 2015

Video, Popular Science

  

    

SurroundWeb: Microsoft's Plan To Cloak Your Living Room With Internet

J.Wilk, D. Molnar, E. Ofek, C. Rossbach, B. Livshits, A. Moshchuk, H.J.Wang & R. Gal

SurroundWeb: Mitigating Privacy Concerns in a 3D Web BrowserIEEE Security & Privacy 2015

Video, Tech Report

Selected Media Coverage:
BBC (TV coverage)
Gizmodo
PCWorld

The Telegraph
SlashGear
Daily Mail

T. Nguyen, M. Thaoduyen, S.Iqbal  & E. Ofek

The Known Stranger: Supporting Conversations between Strangers with Personalized Topic Suggestion

CHI 2015

Paper

 

 2014

B.Jones, R. Shdhi, M. Murdock, R. Mehra, H. Benko, A. Wilson, E.Ofek, B. MacIntyre, N. Raghuvanshi& L. Shapira

RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera UnitsUIST 2014

Paper, Video

RoomAlive: The Other Resident

Video

Selected Media Coverage:
Co.Design
The Washington Post
CNET

Engadget

BBC
PCmag
The Gradian
IGN

  

 

  

 2013 

S. Jana, D. Molnar, A. Moshchuk, A. Dunn, B. Livshits, H. J. Wang, & E. Ofek

Enabling Fine-Grained Permissions for Augmented Reality Applications With Recognizers22nd Usenix Security Symposium 2013

  

 Y. Eshet, S. Korman, E. Ofek & S. Avidan

DCSH - Matching Patches in RGBD ImagesIEEE ICCV 2013

Paper
   

  

L. D'Antoni, A. Dunn, S. Jana, T. Kohno, B. Livshits, D. Molnar,
A. Moshchuk, E. Ofek, F. Roesner, S. Saponas, M. Veanes & H. J. Wang

Operating System Support For Augmented Reality Applications

The 14th Workshop on Hot Topics in Operating Systems (HotOS XIV), 2013, New Mexcio, USA

Paper

    

B. Jones, H. Benko, E. Ofek & A. Wilson

IllumiRoomCHI 2013

CHI 2013 Best Paper Award

CHI 2013 Golden Mouse award (Best Video show)

Cited by more than 200 publications.

Selected media coverage: Engadget | The Verge | NBC | CNET | IGN | Kotaku

  

 

E. Ofek, K. Strauss & S.T. Iqbal

Reducing Disruption from Subtle Information Delivery during a Conversation: Mode and Bandwidth InvestigationCHI 2013.

 Paper

 

  2012 

, ,


Highlights from ACM SIGSPATIAL GIS 2011: the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems: (Chicago, Illinois - November 1 - 4, 2011).

SIGSPATIAL Special 4(1): 2-4 ()

  2010 

M. Kroepfl, Y. Wexler & E. Ofek

Efficiently Locating Photographs in Many PanoramasACM SIGSPATIAL 2010 

TED talk by Blaise Aguera y Arcas |  Geek in Disguise |  Search Engine Land | Tech Flash | Bing Blog | Flickr 

    

  

B. Zhang, Q. Li, H. Chao, B. Chen, E. Ofek & Y.Q. Xu

Annotating and Navigating Tourist VideosACM SIGSPATIAL 2010

    

   

B. Epshtein, Y. Wexler & E. Ofek 

Detecting Text in Natural Scenes with Stroke Width TransformIEEE CVPR 2010 (Oral - Top 10%)

Video of the CVPR talk

 Cited by more than 1250 publications.

    

 

R. Gal (Tel Aviv), Y. Wexler, H. Hoppe, E. Ofek & D. Cohen-Or

Seamless Montage for Texturing ModelsEuroGraphics 2010

Paper     Supplimental Materials    Optimization Animation

 

  2009 

 N. Villar, S. Izadi, H. Benko, J. Helmes, D. Rosenfeld, E. Ofek, J. Westhues, A. Butler, X. Cao, B. Chen &  S. Hodges

Mouse 2.0: Multi-Touch Meets the MouseUIST 2009 

Best Paper

Paper      Video     

    

B. Chen, B. Neubert, E. Ofek, O. Deussen & M. F. Cohen

Integrated Videos and Maps for Driving DirectionsUIST 2009

Paper   Video

    

 

T. Yamaguchi, B. Wilburn , Z. Cao & E. Ofek
Video-based modeling of dynamic hair.   
Pacific-Rim Symposium on Image & Video Technology 2009, Tokyo, Japan

Video

 

  2008

P. Mishra, E. Ofek & G. Kimchi
Validation of Vector Data using Oblique Images
ACM SIGGIS 2008, CA USA (Full Paper)

 

 

   

J. Xiao (HKUST), T. Fang (HKUST). P. Tan (HKUST), Z. Peng (HKUST), E. Ofek & L. Quan (HKUST)
Image Based Facade ModelingACM SIGGRAPH Asia 2008
Paper     Video

 

   

 

H. Wang, H. Hoppe, Y. Wexler and E. Ofek

Factoring Repeated Content Within and Among ImagesACM SIGGRAPH 2008

Paper     Supplimental Materials     Data

 

  2007

        

 

B. Epshtein, E. Ofek, Y. Wexler and P. Zhang

Hierarchical photo organization using geo-relevance. ACM GIS 2007 (Full paper)

Paper

 

  2006

 

N.Li, N. Moraveji, H. Kimura and E. Ofek

Improving the Experience of Controlling Avatars in Camera-Based Games Using Physical Input

The 14th ACM International Conference on Multimedia, Santa Barbara, CA, USA 2006

Paper   

Video - Whack-a-mole

Video - Boxing (Note that this is done with a 2D camera and yet, the body motion is recovered in real-time.

 

   

H. Jiang, E. Ofek, N. Moraveji and S. Yuanchun

Direct Pointer: Direct Manipulation for Large Display Interaction using Handheld CamerasACM CHI  2006

Paper    Video

 

   

 

Y. Matsushita, E. Ofek, X. Tang and H. Shum

Full Frame Video Stabilization with Motion InpaintingIEEE PAMI 2006

Paper

Video - Stabilization & compleation of a dynamic scene | Video - Stabilization of a Beach scene | Video - Video Completion

Cited by more than 450 publications.

 

 2005

 

Y. Wei, E. Ofek, L. Quan and H. Shum

Modeling Hair from Multi ViewsACM SIGGRAPH  2005

Paper

 

   

Description: Description: Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\SideBySide.gif

Y. Matsushita, E. Ofek, X. Tang and H. Shum

Video Completion with Motion Inpainting for Video StabilizationIEEE CVPR  2005 (Oral)

Paper

 

   

B. Chen (Stanford), E. Ofek, H. Shum and M. Levoy (Stanford)

Interactive Deformation of Light FieldsACM SIGGRAPH I3D  2005

Paper   Video

 

   

 

 

X. Cao, E. Ofek, and D. Vronay

Evaluation of Alterantive Presentation Control Techniques

ACM CHI 2005

 

 2003 

Description: Description: Description: Description: Description: Description: girl

 

R. Gvili, A. Kaplan, E. Ofek, G. Yahav

 Depth KeyStereoscopic Displays and Applications: The Engineering Reality of Virtual Reality 2003  (Proceedings of SPIE/IS&T Volume 5006)

Video      Video2

 2002 

M. Op de Beeck, P. Wilinski, C. Fehn, P. Kauff, W. A. Ijsselsteijn, M. Pollefeys, Luc J Van Gool, E. Ofek, & I. Sexton

Towards an optimized 3D broadcast chain

TCom 2002: The Convergence of Information Technologies and Communications

Nov. 1, 2002

    

C. Fehn, P. Kauff, M. Op de Beeck, F. Ernst, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek and I. Sexton

An Evolutionary And Optimized Approach On 3D-TVProc. of IBC, Sep.  2002. Vol 2. pp. 357-365

Cited by more than 200 publications.

   

   Description: Description: Description: Description: Description: Description: 3DTV

A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. J. Van Gool, E. Ofek, I. Sexton & P. Surman

ATTEST: Advanced Three-dimensional Television System Technologies3DPVT 2002

Cited by more than 250 publications.

 

 1998 

 

E. Ofek and A. Rappoport

Interactive reflections on curved objectsACM SIGGRAPH 1998

Paper

 1997

 

E. Ofek, E. Shilat, A. Rappoport, and M. Werman.

Multi-resolution Textures from Image SequencesIEEE Computer Graphics and Applications 1997

Book Contributions
Hardcover Collaboration Meets Interactive Spaces : Theory and Practice Book

B. Ens, E. Ofek, N. Bruce, and P. Irani. 2016.

Shared Façades: Surface-embedded layout management for ad-hoc collaboration using head-worn displays.

Collaboration Meets Interactive Surfaces and Spaces (CMISS) – Theory and Practice.

C. Anslow, P. Campos, J. Jorge, (Eds). Springer, in press.

Demos/Posters (Incomplete List)

2019 

Kevin Huang, E. Ofek & R. Gilad-Bachrach

Measuring Sway with Markerless Depth Camera

MSR-TR-2019-22 | September 2019

Published by Microsoft.

An implementation of the methods is available at https://github.com/Microsoft/GaitAndBalanceApp.

Y. Zhao (CornellTech), E. Cutrell, C. Holz, M. Rongel-Morris, E. Ofek & A. Wilson.

Demonstration of SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision

Demo at CHI, CHI Extended Abstracts 2019

J. Herskovitz, E. Ofek, W.S. Lasecki, A. Fourney

Opportunities for In-Home Augmented Reality Guidance

Late Breaking - CHI 2019

 2018

I. Choi (Stanford), E. Ofek, H. Benko, M. Sinclair and C.Holz

Demonstration of CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality

Demo at CHI, CHI Extended Abstracts .

Demo at IEEE VR, 2018.

Image result for haptic revolver

E. Whitmire, H. Benko, C. Holz, E. Ofek, M. Sinclair

Demonstration of Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller

Demo at CHI, CHI Extended Abstracts .

Demo at IEEE VR, 2018.

E. Strasnick, C. Holz, E. Ofek, M. Sinclair, H. Benko

Demonstration of Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation

Demo at CHI, CHI Extended Abstracts .

Demo at IEEE VR, 2018.

, , , , :
A Demonstration of Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experience.

CHI Extended Abstracts : 3647-3650

Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2013). 

IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. 

SIGGRAPH 2013 Emerging Technologies. Anaheim, CA.

 Best Demo invitation to Laval Virtual 2014

Description: Description: Description: Description: \\research\root\web\external\en-us\UM\People\eyalofek\ZCam.jpg

G. Yahav, G. Idan, E. Ofek, S. Felseshtein 

ZCam

Demo at NAB 1999 - Best of Show

Demo at IBC 1999

 Copyrights:

ACM Copyright Notice

Copyright by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or permissions@acm.org. The definitive version of this paper can be found at ACM's Digital Library http://www.acm.org/dl/.

Eurographics Association Copyright Notice

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than Eurographics must be honored.

IEEE Copyright Notice

This material is posted here with permission of the IEEE. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to pubs-permissions@ieee.org.

Springer-Verlag Copyright Notice

The Author may publish his/her contribution on his/her personal Web page provided that he/she creates a link to the above mentioned volume of LNCS at the Springer-Verlag server or to the LNCS series Homepage (URL: http://www.springer.de/comp/lncs/index.html) and that together with this electronic version it is clearly pointed out, by prominently adding "© Springer-Verlag", that the copyright for this contribution is held by Springer.