in MR
Peer-Reviewed Conference Publications
2022
J. Lee, R. Natarrajan, P. Panda, S. Rodriguez & E. Ofek
RemoteLab: Virtual Reality Remote Study ToolKit
UIST 2022
P. Panda, M. Nicholas, M. Gonzalez-Franco, K. Inkpen, E. Ofek, R. Cutler, K. Hinckley and J. Lanier
All Together: Effect of Avatars in Mixed-Modality Conferencing Environments
CHIWORK 2022
M. Volonte, E. Ofek, K. Jakubzak, S. Bruner, and M. Gonzalez-Franco
HeadBox: A Facial Blendshape Animation Toolkit for the Microsoft Rocketbox Library.
2022 IEEE VR Workshop (VRW)
2021
D. Jain (UW), S. Junuzovic, E. Ofek, M. Sinclair, J.R. Porter, C. Yoon, S. Machanavajhala and M. Ringel Morris
D. Jain, S. Junuzovic, E. Ofek, M. Sinclair, J. R. Porter, C. Yoon, S. Machanavajhala, M. Ringel Morris.
A taxonomy of Sounds in Virtual Reality.
Best Paper DIS 2021
DOI: 10.1145/3461778.3462106
Suzuki R., Ofek, E., M. Sinclair, M., Leithinger, D. and Gonzalez-Franco, M.
HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots
UIST 2021
DOI: 10.1145/3472749.3474821
Gonzalez E.J., Ofek, E. Gonzalez-Franco M. and M. Sinclair
X-Rings: A Hand-mounted 360 Degree Shape Display for Grasping in Virtual Reality
Best Paper: Honorable mention, UIST 2021
DOI: 10.1145/3472749.3474782
Marquant, N., Henry Riche, N., Holz, C. Romat, H., Pahud, M., Brudy, F., Ledo, D., Park, C., Nicholas, M.J., Seyed, T., Ofek, E., Lee, B., Buxton, W.A.S. and Hinkley, K.
UIST 2021
Paper, Short_Video, Video
DOI: 10.1145/3472749.3474820
2020
M. Gonzalez-Franco, Z. Egan, M. Peachey, A. Antley(MS), T. Randhavane (MS), P. Panda (NC State U), Y. Zhang, D. F. Reilly (Dalhousie U), T. C Peck (Davidson College), A. Stevenson Won (Cornell), C. Y. Wang (Cornell), A. Steed (UCL) and E. Ofek
MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library
AIVR 2020
B. Cohn, A. Maselli, E. Ofek and M. Gonzalez-Franco
SnapMove: Movement Projection Mapping in Virtual Reality
AIVR 2020
T. Gesslein, V. Biener, P. Gagel, D. Schneider, E. Ofek, M. Pahud, P.O. Kristensson and J. Grubert
Pen-based Interaction with Spreadsheets in Mobile Virtual Reality
ISMAR 2020
arXiv, Video, VentureBeat “Researchers bring Google Sheets and Microsoft Excel into VR“
V. Biener, D. Schneider, T. Gesslein, A. Otte, B. Kuth,, P.O. Kristensson, E. Ofek, M. Pahud, and J. Grubert
ISMAR Nov 2020
arXiv, Video, IEEE ISMAR 2020 presentation, DOI
R. Kovacs, E. Ofek. M. Gonzalez-Franco, S. Marwecki, C. Holz, and M. Sinclair
Haptic PIVOT: On-Demand Handhelds in VR
UIST 2020
UploadVR: “Microsoft’s ‘PIVOT’ Haptics Research Could Make Throwing A Ball In VR More Believable”
Gizmodo: “These Wrist-Worn Hammers Swing Into Your Hands So You Feel Virtual Objects”
Engadget: “Microsoft explores realistic VR haptics with a wrist-mounted gadget”
Yahoo: Microsoft explores realistic VR haptics with a wrist-mounted gadget“
M. Gonzalez Franco, M. Sinclair, and E. Ofek
Asymmetry of Grasp in Haptic Perception
To Appear: ACM Symposium on Applied Perception 2020 (SAP ’20) | September 2020
E. Ofek, J. Grubert (Coburg), M. Pahud, M, Phillips (Coburg), and Per-Ola Kristensson (Cambridge)
Towards a Practical Virtual Office for Mobile Knowledge Workers
Symposium on The New Future of Work 2020 (NFW’20)
M. Gonzalez Franco (MSR), B. Cohn (USC), D. Burin, E. Ofek (MSR), and A. Maselli
The Self-Avatar Follower Effect in Virtual Reality
IEEE VR 2020 Best Paper Candidate.
R. Gruen, E. Ofek, A. Steed (UCL), R. Gal, M. Sinclair & M. Gonzalez Franco
Measuring System Visual Latency through Cognitive Latency on Video See-Through AR devices.
IEEE VR 2020 Honorable Mention paper (Top 5 papers)
M. Gonzalez-Franco (MSR) , A. Steed (UCL), S. Hoogendyk (Microsoft) and E. Ofek (MSR).
Using Facial Animation to Increase the Enfacement Illusion and Avatar Self-Identification.
IEEE VR 2020
D. Schneider (Coburg), A. Otte (Coburg), A. S. Kublin (Coburg), P. O. Kristensson (Cambridge), E. Ofek (MSR), M. Pahud (MSR), A. Martschenko (Coburg) and J. Grubert (Coburg)
Accuracy of Commodity Finger Tracking Systems for Virtual Reality Head-Mounted Displays.
IEEE VR Poster 2020
A. F. Siu (Stanford), M. Sinclair, R. Kovacs, C. Holz, E. Ofek & E. Cutrell.
Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual Worlds.
CHI 2020 Honorable Mention paper
Paper, Video, Project, MSR Blog, CHI 2020 Talk – Alexa F. Sui
Scientific American: “Virtual Reality Has an Accessibility Problem”
2019
S. Marwecki (MSR & Hasso Plattner Institute, U. of Potsdam), A. Wilson, E. Ofek, M. Gonzalez Franco and C. Holz
Mise-Unseen: Using Eye Tracking to Hide Virtual Reality Scene Changes in Plain Sight.
UIST 2019
Paper, Video, Microsoft Research Blog,
Upload: “Microsoft Researchers Explore Eye Tracking Uses For VR”
Engadget: “Microsoft’s latest VR experiment is a literal walk in the park”
J. Yang (Stanford & MSR), C. Holz, E. Ofek and A. Wilson
DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality.
UIST 2019
DOI:10.1145/3332165.3347875
Paper, Video, Microsoft Research Blog,
ArsTechnica: “Microsoft’s DreamWalker VR turns your daily commute into a totally different one”
RoadToVR: “Microsoft ‘DreamWalker’ Experiment Takes First Steps into Always-on World-scale VR”
Engadget: “Microsoft’s latest VR experiment is a literal walk in the park”
Gizmodo: “Microsoft’s Over-the-Top VR Rig Lets You Explore a Virtual World While Walking IRL”
MSN: “Microsoft DreamWalker project takes VR technology outdoors “
ZDnet: “Dream or nightmare? Microsoft’s VR swaps your real walking route for a virtual one”
DailyMail: “Microsoft reveals its DreamWalker VR rig that lets users explore a virtual world while walking around in real life”
M. Sinclair, E. Ofek, M. Gonzalez-Franco and C. Holz
CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback.
UIST 2019 Honorable Mention demo
Paper, Video, Microsoft Research Blog, DOI:10.1145/3332165.3347891
Engadget: “Microsoft’s latest VR experiment is a literal walk in the park”
Upload: “Microsoft Shows Off Force Resistance VR Grasping Feature Prototype”
WinBuzzer: “Microsoft Research Reveals CapstanCrunch VR Haptic Control Method”
D. Schneider1, A. Otte1, T. Gesslein1, P. Gagel1, B. Kuth1, M. S. Damlakhi1, O. Dietz1, E. Ofek2, M. Pahud2, P. O. Kristensson3, J. Muller4 and J. Grubert1
1 Cuborg University, 2 Microsoft Research 3 Cambridge 4 Bayreuth
ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality.
ISMAR 2019, Best Paper Award
Y. Zhao (Cornell Tech & MSR), E. Cutrell, C. Holz, M. Ringel Morris, E.Ofek and A. Wilson
SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision.
CHI 2019.
Paper, Video, Microsoft Research Blog, A Demo at Microsoft Research’s Faculty Summit 2019
Engadget: “Microsoft is making VR better for those with vision problems”
RoadToVR: “Microsoft Aims to Improve VR for Users with Vision Problems”
Scientific American: “Virtual Reality Has an Accessibility Problem”
J. Lee (Kaist & MSR), M. Sinclair, M. Gonzalez-Franko, E. Ofek and C. Holz
TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction.
CHI 2019.
Paper, Video, Microsoft Research Blog,
VentureBeat: “Microsoft’s TORC will let you feel squeezable objects in AR and VR”
UploadVR: “Microsoft Shows Off Haptic VR Controller, Simulates Grabbing With Thumb & Two Fingers”
P. Abtahi (Stanford & MSR), M. Gonzalez-Franco, E. Ofek, A. Steed (UCL)
I’m a Giant: Walking in Large Virtual Environments at High Speed Gains.
CHI 2019.
J. Hartmann (Waterloo & MSR), C. Holz, E. Ofek, & A. D. Wilson
Reality Check: Blending Virtual Environments with Situated Physical Reality.
CHI 2019.
L-P. Cheng (HPI), E. Ofek, C. Holz & A.D. Wilson
IEEE VR 2019
2018
C. Holz & E. Ofek
Doubling the Signal Quality of Smartphone Camera Pulse Oximetry Using the Display Screen As a Controllable Selective Light Source.. IEEE Engineering in Medicine and Biology Society (EMBC’18) 2018
I. Choi (Stanford), E. Ofek, H. Benko, M. Sinclair and C.Holz
CHI 2018
Paper, Video, Microsoft Research Blog,
Cited by more than 150 publications
Engadget (“Microsoft’s mad scientists are making AR more tactile”), Co. Design (“Crazy Microsoft is the best Microsoft”), Gizmodo, Road To VR
VR Times: “The Best Haptic VR Devices and Innovations for the Real Feel in VR Environments”
E. Strasnick (Stanford), C. Holz, E. Ofek, M. Sinclair and Hrvoje Benko
Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation .
CHI 2018
Paper, Video, Microsoft Research Blog,
Engadget (“Microsoft’s mad scientists are making AR more tactile”), Co. Design (“Crazy Microsoft is the best Microsoft”), Gizmodo, Road To VR, Slashgear, VRScout
VR Times: “The Best Haptic VR Devices and Innovations for the Real Feel in VR Environments”
E. Whitmire (UW), H. Benko, C. Holz, E. Ofek and Mike Sinclair
CHI 2018 Best Paper: Honorable Mentioned
Paper, Video. Microsoft Research Blog,
Cited by more than 150 publications
Engadget (“Microsoft’s mad scientists are making AR more tactile”), Co. Design (“Crazy Microsoft is the best Microsoft”), Gizmodo, Road To VR
J. Grubert (Cuborg), L. Witzani, E. Ofek, M. Pahud, M. Kraz and P.O. Kristensson (Cambridge)
Effects of Hand Representations for Typing in Virtual Reality
IEEE VR Mar. 2018
J. Grubert (Cuborg), L. Witzani, E. Ofek, M. Pahud, M. Kraz and P.O. Kristensson (Cambridge)
Text Entry in Immersive Head-Mounted Display-based Virtual Reality using Standard Keyboards.
IEEE VR Mar. 2018
2017
L. P. Cheng (HPI) E. Ofek, C. Holz, H. Benko & A. D. Wilson
Sparse Haptic Proxy: Touch Feedback in Virtual Environment Using a General Passive Prop.
CHI 2017
Cited by more than 130 publications
2016
J. Grubert (Cuborg), E. Ofel, M. Pahud,
GlassHands: Interaction Around Unmodified Mobile Devices Using Sunglasses.
ACM ISS 2016
Paper, Video, msPowerUser (“Microsoft’s latest Human Interaction Research will blow your mind”) , CMWinBuzzer, IT News
H. Benko, C. Holz, M. Sinclair, E. Ofek
NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers
UIST 2016 Honorable Mentioned paper,
Paper, Video
Wired UK, Digital Thrends, Road to VR, Makezine
Cited by more than 200 publications
B. Nuernberger, E. Ofek, H. Benko & A. D. Wilson
SnapToReality: Aligning Augmented Reality to the Real World.
2015
H. Benko, E. Ofek, Feng Zheng & A. D. Wilson
B. Ens (Manitoba), E. Ofek, N. Bruce (Manitoba) & P. Irani (Manitoba)
Spatial Constancy of Surface-Embedded Layouts across Multiple Environments
The ACM Symposium on Spatial User Interaction (SUI) 2015
J.Wilk, D. Molnar, E. Ofek, C. Rossbach, B. Livshits, A. Moshchuk, H.J.Wang & R. Gal
SurroundWeb: Mitigating Privacy Concerns in a 3D Web Browser. IEEE Security & Privacy 2015
Selected media coverage:
BBC (TV coverage), Gizmodo, PCWorld, The Telegraph, SlashGear, Daily Mail
T. Nguyen, M. Thaoduyen, S.Iqbal & E. Ofek
The Known Stranger: Supporting Conversations between Strangers with Personalized Topic Suggestion
CHI 2015
2014
B.Jones, R. Shdhi, M. Murdock, R. Mehra, H. Benko, A. Wilson, E.Ofek, B. MacIntyre, N. Raghuvanshi& L. Shapira
RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. UIST 2014
Cited by more than 300 publications.
RoomAlive: The Other Resident Video
Selected Media Coverage: Co.Design, The Washington Post, CNET, Engadget, BBC, PCmag, The Gradian, IGN
R. Gal, L. Shapira, E. Ofek, & P. Kohli
FLARE: Fast Layout for Augmented Reality Applications.
IEEE ISMAR 2014
2013
S. Jana, D. Molnar, A. Moshchuk, A. Dunn, B. Livshits, H. J. Wang, & E. Ofek
Enabling Fine-Grained Permissions for Augmented Reality Applications With Recognizers.
22nd Usenix Security Symposium 2013
L. D’Antoni, A. Dunn, S. Jana, T. Kohno, B. Livshits, D. Molnar,
A. Moshchuk, E. Ofek, F. Roesner, S. Saponas, M. Veanes & H. J. Wang
Operating System Support For Augmented Reality Applications
The 14th Workshop on Hot Topics in Operating Systems (HotOS XIV), 2013, New Mexcio, USA
2010
M. Kroepfl, Y. Wexler & E. Ofek
Efficiently Locating Photographs in Many Panoramas.
ACM SIGSPATIAL 2010
TED talk by Blaise Aguera y Arcas | Geek in Disguise | Search Engine Land | Tech Flash | Bing Blog | Flickr
B. Zhang, Q. Li, H. Chao, B. Chen, E. Ofek & Y.Q. Xu
Annotating and Navigating Tourist Videos.
ACM SIGSPATIAL 2010
B. Epshtein, Y. Wexler & E. Ofek
Detecting Text in Natural Scenes with Stroke Width Transform.
IEEE CVPR 2010 (Oral – Top 10%)
Video of the CVPR talk ( Cited by more than 1800 publications).
R. Gal (Tel Aviv), Y. Wexler, H. Hoppe, E. Ofek & D. Cohen-Or
Seamless Montage for Texturing Models.
EuroGraphics 2010
Paper Supplimental Materials Optimization Animation
Cited by more than 150 publications
B. Chen, B. Neubert, E. Ofek, O. Deussen & M. F. Cohen
Integrated Videos and Maps for Driving Directions.
UIST 2009
T. Yamaguchi, B. Wilburn , Z. Cao & E. Ofek
Video-based modeling of dynamic hair.
Pacific-Rim Symp. on Image & Video Technology 2009, Tokyo, Japan
2008
P. Mishra, E. Ofek & G. Kimchi
Validation of Vector Data using Oblique Images
ACM SIGGIS 2008, CA USA (Full Paper)
2007
B. Epshtein, E. Ofek, Y. Wexler and P. Zhang
Hierarchical photo organization using geo-relevance. ACM GIS 2007 (Full paper)
2006
N.Li, N. Moraveji, H. Kimura and E. Ofek
Improving the Experience of Controlling Avatars in Camera-Based Games Using Physical Input
The 14th ACM Int. Conf. on Multimedia, Santa Barbara, CA 2006
Paper, Videos – Whack-a-mole, Boxing (RT, using 2D camera).
H. Jiang, E. Ofek, N. Moraveji and S. Yuanchun
Direct Pointer: Direct Manipulation for Large Display Interaction using Handheld Cameras.
ACM CHI 2006
2005
Y. Matsushita, E. Ofek, X. Tang and H. Shum
Video Completion with Motion Inpainting for Video Stabilization. IEEE CVPR 2005 (Oral)
Paper (Cited by more than 180 publications).
B. Chen (Stanford), E. Ofek, H. Shum and M. Levoy (Stanford)
Interactive Deformation of Light Fields.
ACM SIGGRAPH I3D 2005
X. Cao, E. Ofek, and D. Vronay
Evaluation of Alterantive Presentation Control Techniques
ACM CHI 2005
2002
C. Fehn, P. Kauff, M. Op de Beeck, F. Ernst, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek and I. Sexton
An Evolutionary And Optimized Approach On 3D-TV. Proc. of IBC, Sep. 2002. Vol 2. pp. 357-365
Cited by more than 220 publications.
A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. J. Van Gool, E. Ofek, I. Sexton & P. Surman
ATTEST: Advanced Three-dimensional Television System Technologies. 3DPVT 2002
Cited by ~300 publications.
Peer-Reviewed Workshop Papers
2020
J. Grubert (Coburg), E. Ofek, M. Pahud, Per-Ola Kristensson (Cambridge)
Back to the Future: Revisiting Mouse and Keyboard Interaction for HMD-based Immersive Analytics
CHI2020 workshop Immersive Analytics: Envisioning Future Productivity for Immersive Analytics (IA2020), Mar 2020.
2019
M. Mott, E. Cutrell, M. Gonzalez Franco, C. Holz, E. Ofek and M. Ringel Morris
Accessible by Design: An Opportunity for Virtual Reality
ISMAR 2019 Workshop on Mixed Reality and Accessibility | Oct 2019
2018
M. Pahud, E. Ofek, N. H. Riche, M. C. Hurter (ENAC) and J. Grubert (Coburg)
Mobiles as Portals for Interaction with Virtual Data Visualizations.
Data Visualization on Mobile Devices Workshop 2018
2017
C. Hurter, N. H. Riche, M. Pahud, E. Ofek, S. Drucker, B. Lee, D. Brown, C. Wong
Into the mixed reality data sphere: mapping user’s movements to data exploration tools
#Immersive2017 Workshop on Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics
at IEEE VIS, 1st October, Phoenix.
arXiv papers
2021
Yamagami, M., Junuzovic, S., Gonzalez-Franco, M., Ofek, E., Cutrell, E., Porter, J., Wilson, A. and Mott, M.
Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement
arXiv:2108.12390
Book Chapters
2016
B. Ens, E. Ofek, N. Bruce, and P. Irani. 2016.
Shared Façades: Surface-embedded layout management for ad-hoc collaboration using head-worn displays.
Collaboration Meets Interactive Surfaces and Spaces (CMISS) – Theory and Practice.
C. Anslow, P. Campos, J. Jorge, (Eds). Springer, 2016