Hrvoje Benko
HRVOJE BENKO
Director, Research Science
Meta Reality Labs Research
Affiliate Professor at the University of Washington Information School
 
Google Scholar      dblp             LinkedIn
Curriculm Vitae      Bio      ACM DL    
Headshot:low res  high res
How to say my full name? Pronunciation of Hrvoje Benkowav
(FYI, I go with "Benko"!)

Research Highlights
 
Haptics / Augmented Reality / Virtual Reality
I am interested in creating experiences in AR/VR that enable people to be more than simple observers: to touch, play with and experience the world around them. Haptics offer an interesting channel for input and output that provides a visceral and highly realistic experience. Furthermore, I am also fascinated how we can exploit some perceptual illusions to create a better interactive experience.
Tasbi Squeeze Bracelet Pseudo Haptic Weight Claw Controller HapticRevolver
Tasbi Squeeze Bracelet (2019) Pseudo Haptic Weight (2019) Claw Controller (2018) HapticRevolver (2018)CHI 2018 Best Paper Honorable Mention Award
MR Touch NormalTouch Haptic Retargeting Sparse Periphery
MRTouch (2018) NormalTouch & TextureTouch (2016)UIST 2016 Best Paper Honorable Mention Award Haptic Retargetting (2016)CHI 2016 Golden Mouse Award Sparse Peripheral Displays (2016) CHI 2015 Best Paper Honorable Mention Award
   
Interactive Projection Mapping
I am fascinated with the possibility of using cameras and projectors to embue the space with interactivity. Such projector+camera combinations can enable both data visualization and interactivity without requiring the user to wear any additional gear. Our solutions allow for projection mapping view-dependent perspective content on top of dynamically changing background scenes.
Room2Room Life-sized teleconferencing Panorama of the Skies Dyadic SAR RoomAlive
Room2Room (2015-2016) CHI 2013 Best Paper Award A Panorama of the Skies (2015) Dyadic SAR (2014) RoomAlive (2014-2016)
IllumiRoom Beamatron MirageTable LightSpace
IllumiRoom (2013) CHI 2013 Best Paper Award Beamatron (2012) MirageTable (2012) LightSpace (2010)
   
Multitouch & Pen Input Devices
Current computer input devices are well optimized input solutions, but they often offer very limited bandwith for interacting with computers. For example, very few devices really take advantage of the full dexterity of the user's hands. My projects have investigated extending the interaction vocabulary of several standard input devices (e.g., mice, pens, and spartphone touchscreens) through multi-touch sensing embedded on the surface of the device. Not only are such multi-touch devices capable of both standard operation and multi-touch gestures, but they can also implicitly sense a lot of contextual information about their use (e.g., whether the user is right or left handed). One of our ideas about multitouch mice made it from a research concept into a product (Microsoft Touch Mouse).
MultiTouch Pen MultiTouch Pen Microsoft Touch Mouse PocketTouch
Grip + Stylus (2014) UIST 2009 Best Paper Award Multi-Touch Pen (2011) Microsoft Touch Mouse (2011) PocketTouch (2011)
Mouse 2.0 EMG + Surface OmniTouch Sphere
Mouse 2.0 (2009) UIST 2009 Best Paper Award EMG+Surface (2009) OmniTouch (2011) Sphere (2008)
   
   
 
Journal and Conference Papers
2023 RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality Xu, X., Yu, M., Jonker, T.R., Todi, K., Lu, F., Qian, X., Belo, J., Wang, T., Li, M., Mun, A., Wu, T.Y., Shen, J., Zhang, T., Kokhlikyan, N., Wang, F., Sorenson, P., Kim, S.K., and Benko, H. (2023). XAIR: A Framework of Explainable AI in Augmented Reality. In Proceedings of ACM CHI '23.
ACM CHI 2023 Best Paper Honorable Mention
pdf
mp4
Optimizing the Timing of Intelligent Suggestion in Virtual Reality Gupta, A., Sendhilnathan, N., Hartcher-O'Brian, J., Pezent, E., Benko, H., and Jonker, T.R. (2023). Investigating Eyes-away Mid-air Typing in Virtual Reality using Squeeze haptics-based Postural Reinforcement. In Proceedings of ACM CHI '23. pdf
mp4
Fashimpaur, J., Karlson, A., Jonker, T.R., Benko, H., and Gupta, A. (2023). Investigating Wrist Deflection Scrolling Techniques for Extended Reality. In Proceedings of ACM CHI '23. pdf
mp4
Zhao, M., Pierce, A.M., Tan, R., Zhang, T., Wang, T., Jonker, T.R., Benko, H., and Gupta, A. (2023). Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality. In Proceedings of ACM Intelligent User Interfaces (ACM IUI 23). pdf
mp4
2022 RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality Zhang, T., Hu, Z., Gupta, A., Wu, C.-H., Benko, H., and Jonker, T.R. (2022). RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality. In Proceedings of ACM User Interface Software and Technology (ACM UIST '22). pdf
Optimizing the Timing of Intelligent Suggestion in Virtual Reality Yu, D., Desai, R., Zhang, T., Benko, H., Jonker, T.R., and Gupta, A. (2022). Optimizing the Timing of Intelligent Suggestion in Virtual Reality. In Proceedings of ACM User Interface Systems and Technology (ACM UIST '22). pdf
Peacock, C.E., Lafreniere, B., Zhang, T., Santosa, S., Benko, H., and Jonker, T.R. (2022). Gaze as an Indicator of Input Recognition Errors. In Proceedings of the ACM on Human-Computer Interaction. Volume 6. Issue ETRA. pdf
2021 RotoWrist Device Parizi, F. S., Kienzle, W., Whitmire, E., Gupta, A., and Benko, H. (2021). RotoWrist: Continuous Infrared Wrist Angle Tracking using a Wristband. In Proceedings of ACM VRST '21.

pdf
mp4

Toward gaze-based prediction David-John, B., Peacock, C. E., Zhang, T., Mudison, T. S., Benko, H., and Jonker, T. R. (2021). Towards gaze-based prediction of the intent to interact in virtual reality. In Proceedings of ACM Symposium on Eye Tracking Research & Applications (ACM ETRA '21). pdf
False Positive vs. False Negative Errosts Lafreniere, B., Jonker, T. R., Santosa, S., Parent, M., Glueck, M., Grossman, T., Benko, H., and Wigdor, D. (2021). False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input Error Preference. In Proceedings of ACM UIST '21. pdf
mp4
Typing Coactivation Study Foy, C. R., Dudley, J. J., Gupta, A., Benko, H., and Kristensson, P.O. (2021). Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality. In Proceedings of ACM CHI '21.
ACM CHI 2021 Best Paper Honorable Mention
pdf
mp4
ElectroRing Kienzle, W., Whitmire, E., Rittaler, C., and Benko, H. (2021). ElectroRing: Subtle Pinch and Touch Detection with a Ring. In Proceedings of ACM CHI '21. pdf
mp4
Armstrong Li, Z., Chan, J., Walton, J., Benko, H., Wigdor, D., and Gluek, M. (2021). Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality. In Proceedings of ACM CHI '21. pdf
mp4
2020 PredictivePointing Gupta, A., Samad, M., Kin, K., Kristensson, P.O., and Benko, H. (2020). Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality. In Proceedings of IEEE ISMAR '20. pdf
PredictivePointing Gong, J., Gupta, A. and Benko, H. (2020). Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing. In Proceedings of ACM UIST '20. pdf
mp4
PredictivePointing Henrikson, R., Grossman, T., Trowbridge, S., Wigdor, D., and Benko, H. (2020). Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VR. In Proceedings of ACM CHI '20. pdf
mp4
2019 Tasbi Zhang, Y., Kienzle, W., Ma, Y., Ng, S. S., Harrison, C., and Benko, H. (2019). ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proc. of ACM UIST 2019. pdf
mp4
Tasbi Gebhardt, C., Hecox, B, van Opheusden, B., Wigdor, D., Hillis, J., Hilliges, O., and Benko, H. (2019). Learning Cooperative Personalized Policies from Gaze Data. In Proc. of ACM UIST 2019.  pdf
mp4
Tasbi Penzent, E., Israr, A., Samad, M., Robinson, S., Agrawal, P., Benko, H., and Colonnese, N. (2019). Tasbi: Multisensory Squeeze and Vibrotactile Wrist Haptics for Augmented and Virtual Reality. In Proc. of World Haptics Conference (WHC 2019).  pdf
mp4
PerformanceEnvelopesVRTyping Dudley, J., Benko, H., Wigdor, D., and Kristensson, P.O. (2019). Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In Proc. of IEEE ISMAR 2019. pdf
mp4
HapticPhone Maiero, J., Eibich, D., Kruijff, E., Hinkenjann, A., Stuerzlinger, W., Benko, H., Ghinea, G. (2019). Back-of-Device Force Feedback Improves Touch Screen Interaction for Mobile Devices. IEEE Transactions on Haptics (TOH). doi: 10.1109/TOH.2019.2911519 pdf
mp4
PseudoHapticWeight Samad, M., Gatti, E., Hermes, A., Benko, H., and Parise, C. (2019). Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proc. of ACM CHI 2019. pdf 
       
2018 Strasnick, E., Holz, C., Ofek, E., Sinclair, M. and Benko, H. (2018). Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proc. of ACM CHI '18.
pdf
mp4
     
Whitmire, E., Benko, H., Holz, C., Ofek, E. and Sinclair, M. (2018). Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proc. of ACM CHI '18.
ACM CHI 2018 Best Paper Honorable Mention
pdf
mp4
     
CaneController Zhao, Y., Bennett, C., Benko, H., Cutrell, E., Holz, C., Morris, M. and Sinclair, M. (2018). Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proc. of ACM CHI '18. pdf
mp4
     
Choi, I., Ofek, E., Benko, H., Sinclair, M. and Holz, C. (2018). CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proc. of ACM CHI '18. pdf
mp4
Xiao, R., Schwartz, J., Wilson, A.D., and Benko, H. (2018). MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics (TVCG) 24(4). Presented at IEEE VR 2018 Conference. pdf
mp4
2017 MeetAlive Fender, A.R., Benko, H. and Wilson, A.D. (2017). MeetAlive: Room-Scale Omni-Directional Display System for Multi-User Content and Control Sharing. In Proc. of ACM Interactive Surfaces and Spaces (ISS) 2017.
ACM ISS 2017 Best Paper Award
pdf
wmv
     
HybridHFRDepth Lu, J., Benko, H., and Wilson, A.D. (2017). Hybrid HFR Depth: Fusing Commodity Depth and Color Cameras to Achieve High Frame Rate, Low Latency Depth Camera Interactions. In Proc. of ACM CHI 2017.
ACM CHI 2017 Best Paper Honorable Mention
pdf
mp4
     
Sensing Tablet Grasp Cheng, L.-P., Ofek, E., Holz, C., Benko, H., and Wilson, A. (2017). Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proc. of ACM CHI 2017. pdf
mp4
2016 NormalTouch Benko, H., Holz, C., Sinclair, M., and Ofek, E. (2016). NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proc. of ACM UIST 2016.
ACM UIST 2016 Best Paper Honorable Mention
Invited for Reprise Presentation at ACM SIGGRAPH 2017
pdf
mp4
     
Sparse Periphery  Xiao, R. and Benko, H. (2016). Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proc. of ACM CHI 2016.
ACM CHI 2016 Best Paper Honorable Mention
pdf
mp4
     
Haptic Retargeting Azmandian, M., Hancock, M., Benko, H., Ofek, E., and Wilson, A.D. (2016). Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proc. of ACM CHI 2016.
ACM CHI 2016 Golden Mouse Award (best video)
pdf
mp4
     
Snap To Reality Nuernberger, B., Ofek, E., Benko, H., and Wilson, A.D. (2016). SnapToReality: Aligning Augmented Reality to the Real World. In Proc. of ACM CHI 2016. pdf
mp4
     
Pre Touch Hinckley, K., Heo, S., Pahud, M., Holz, C., Benko, H., Sellen, A., Banks, R., O'Hara, K., Smyth, G., and Buxton, W. (2016). Pre-Touch Sensing for Mobile Interaction. In Proc. of ACM CHI 2016. pdf
mp4
     
Room2Room Pejsa, T., Kantor, J., Benko, H., Ofek, E., and Wilson, A.D. (2016). Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proc. of ACM Conference on Computer Supported Cooperative Work (CSCW 2016).
ACM CSCW 2016 Best Paper Award
pdf
mp4
       
2015 FoveAR Benko, H., Ofek, E., Zheng, F., and Wilson, A. D. (2015). FoveAR: Combining an Optically See-Through Near-Eye Display with Spatial Augmented Reality Projections. In Proc. of ACM UIST 2015. pdf
mp4
     
Sensing Tablet Grasp Yoon, D., Hinckley, K., Benko, H., Guimbretiere, F., Irani, P., Pahud, M., and Gavriliu, M. (2015). Sensing Tablet Grasp + Micro-mobility for Active Reading. In Proc. of ACM UIST 2015. pdf
mp4
     
IllumiRoom Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2015). IllumiRoom: Immersive Experiences Beyond the TV Screen.  Communications of the ACM, Vol. 58 No. 6, Pages 93-100. 10.1145/2754391 link
2014 CrossMotion Wilson, A. D. and Benko, H. (2014). CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association. In Proc. of ACM International Conference on Multimodal Interaction (ICMI 2014). pdf
mp4
     
Interacting Above and Beyond the Display

Wilson, A.D. and Benko, H. Special Issue Guest Editors (2014). Interacting Above and Beyond the Display. IEEE Computer Graphics and Applications, 34:3, May-June. 20-21.

link
     
Dyadic Projected Spatial Augmented Reality Benko, H., Wilson, A. D., Zannier, F. (2014). Dyadic Projected Spatial Augmented Reality. In Proc. of ACM UIST 2014. pdf
mp4
     
RoomAlive Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntryre, B., Raghuvanshi, N., Shapira, L. (2014). RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. In Proc. of ACM UIST 2014. pdf
mp4
     
Grip Stylus+Pen Hinckley, K., Pahud, M., Benko, H., Irani, P., Gavriliu, M., Guimbretiere, F., Chen, X., Matulic, F., Buxton, W., Wilson, A. D. (2014). Sensing Techniques for Tablet+Stylus Interaction. In Proc. of ACM UIST 2014.
ACM UIST 2014 Best Paper Award
Invited for Reprise Presentation at ACM SIGGRAPH 2015
pdf
mp4
     
TouchMover Sinclair, M., Pahud, M. and Benko, H. (2014). TouchMover 2.0 - 3D Touchscreen with Haptic Feedback and Haptic Texture. In Proc. of IEEE Haptics Symposium (HAPTICS '14). pdf
mp4
       
2013 TouchMover Sinclair, M., Pahud, M. and Benko, H. (2013). TouchMover: Actuated 3D Touchscreen with Haptic Feedback. In Proc. of ACM Interactive Tabletops and Surfaces (ITS 2013).
ACM ITS 2013 Best Paper Award
pdf
mp4
     
Motion and Context Sensing Techniques for Pen Computing Hinckley, K., Chen, X., and Benko, H. (2013). Motion and Context Sensing Techniques for Pen Computing. In Proc. of Graphics Interface 2013. pdf
mp4
     
Deformable Touch Bacim, F., Sinclair, M., and Benko, H. (2013). Understanding Touch Selection Accuracy on Flat and Hemispherical Deformable Surfaces. In Proc. of Graphics Interface 2013. pdf
     
IllumiRoom Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2013). IllumiRoom: Peripheral Projected Illusions for Interactive Experiences.  In Proc. of ACM CHI 2013.
ACM CHI 2013 Best Paper Award
ACM CHI 2013 Golden Mouse Award (best video)
pdf
wmv
     
Mirage

Holman, D., Girouard, A., Benko, H., and Vertegaal, R. (2013). The Design of Organic User Interfaces: Shape, Sketching and Hypercontext. Interacting with Computers, Oxford Journals. 25(2): 133-142.

pdf
link
     

Steinicke, F., Benko, H., Daiber, F., Keefe, D.F., and de la Rivière, J.-B. Special Issue Guest Editors (2013). Foreword to the special section on touching the 3rd dimension. Computers & Graphics. 37(3).

link
       
2012 Beamatron Wilson, A. D., Benko, H., Izadi, S., and Hilliges, O. (2012). Steerable Augmented Reality with the Beamatron.  In Proc. of ACM UIST 2012. p. 413-422. pdf
wmv
     
MirageTable Benko, H., Jota, R. and Wilson, A. D. (2012). MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proc. of ACM CHI 2012. p. 199-208. pdf
wmv
wmv
     
LightGuide Sodhi, R., Benko, H., and Wilson, A. D. (2012). LightGuide: Projected Visualizations for Hand Movement Guidance. In Proc. of ACM CHI 2012. p. 179-188.
ACM CHI 2012 Best Paper Honorable Mention
pdf
wmv
2011 MultiTouch Pen + Accelerometer Sun, M., Cao, X., Song, H., Izadi, S., Benko, H.,  Guimbretiere, F., Ren, X., and Hinckley, K. (2011). Enhancing Naturalness of Pen-and-Tablet Drawing through Context Sensing. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '11). p. 83-86. pdf
wmv
OmniTouch Harrison, C., Benko, H., Wilson, A. D. (2011). OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of ACM UIST 2011. p. 441-450.
ACM UIST Lasting Impact Award 2022
pdf
wmv
     
PocketTouch Saponas, T.S., Harrison, C., Benko, H. (2011) PocketTouch: Through-Fabric Capacitive Touch Input. In Proceedings of ACM UIST 2011. p. 303-308. pdf
wmv
     
Multi-Touch Pen Song, H., Benko, H., Guimbretiere, F., Izadi, S., Cao, X., and Hinckley, K. (2011). Grips and Gestures on a Multi-Touch Pen. In Proceedings of ACM CHI 2011. p. 1323-1332. pdf
wmv
     
Rock and Rails Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. (2011). Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of ACM CHI 2011. p. 1581-1590. pdf
wmv
       
2010 Pinch-the-Sky Dome Benko, H. and Wilson, A. D. (2010). Multi-Point Interactions with Immersive Omnidirectional Visualizations in a Dome. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '10). p. 19-28. pdf
wmv
     
Pen + Touch = New Tools Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. (2010). Pen + Touch = New Tools. In Proceedings of ACM UIST '10. pp. 27-36. pdf
wmv
LightSpace Wilson, A. and Benko, H. (2010). Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces. In Proceedings of ACM UIST '10. pp. 273-282. pdf
wmv
     
MT Mouse Models Benko, H., Izadi, S., Wilson, A. D., Cao, X., Rosenfeld, D., and Hinckley, K. (2010). Design and Evaluation of Interaction Models for Multi-touch Mice. In Proceedings of Graphics Interface 2010. p. 253-260. pdf
wmv
Manual Dexterity Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. (2010). Manual Deskterity: An Exploration of Simultaneous Pen + Touch Direct Input. ACM CHI 2010 Extended Abstracts (alt.chi). pdf
wmv
     
Pictionaire Hartmann, B., Morris, M., Benko, H., and Wilson, A. D.  (2010). Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. In Proceedings of ACM CSCW '10. p. 421-424. pdf
mov
Three's Company Tang, A., Pahud, M., Inkpen, K., Benko, H., Tang, J., and Buxton, B. (2010). Three's Company: Understanding Communication Channels in Three-way Distributed Collaboration. In Proceedings of ACM CSCW '10. p. 271-280. pdf
       
2009 EMG + Surface Benko, H. Saponas, T.S., Morris, D., and Tan, D. (2009). Enhancing Input On and Above the Interactive Surface with Muscle Sensing. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '09). p. 93-100. pdf
wmv
pptx
     
ShadowGuides Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. (2009). ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '09). p. 165-172. pdf
wmv
     
Dome Benko, H. (2009). Beyond Flat Surface Computing: Challenges of Depth-Aware and Curved Interfaces. In Proceedings of ACM MultiMedia '09. pdf
pptx 
Mouse 2.0 Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S.,  Butler, A., Ofek, E., Cao, X., and Chen, B. (2009). Mouse 2.0: Multi-touch Meets the Mouse. In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 33-42.
ACM UIST 2009 Best Paper Award
pdf
wmv
Mice and Keyboards on the tabletop Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. D. (2009). Augmenting Interactive Tables with Mice & Keyboards. In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 149-152. pdf
wmv
     
Ripples Wigdor, D., Williams, S., Cronin, M., White, K., Levy, R., Mazeev, M., and  Benko, H. (2009). Ripples: Utilizing Per-Contact Visualizations to Improve User Interaction with Touch Displays. In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 3-12. pdf
wmv
     
Separability of Manipulations Nacenta, M., Baudisch, P, Benko, H., and Wilson, A. D. (2009). Separability of Spatial Manipulations in Multi-touch Interfaces. In Proceedings of Graphics Interface '09. Kelowna, BC, Canada, May 2009. p. 175-182. pdf
wmv
       
2008 Sphere Benko, H., Wilson, A. D., and Balakrishnan, R. (2008). Sphere: Multi-Touch Interactions on a Spherical Display. In Proceedings of ACM User Interface Software and Technology (UIST '08). Monterey, CA. p. 77-86. pdf
wmv
pptx
   
2007 Pointer Warping Benko, H. and Feiner, S. (2007). Pointer Warping in Heterogeneous Multi-Monitor Environments. In Proceedings of Graphics Interface '07. Montreal, Canada. May 28-30. p. 111-117. pdf
     
Balloon Selection Benko, H. and Feiner, S. (2007). Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selections. In Proceedings of IEEE Symposium on 3D User Interfaces. Charlotte, North Carolina, USA. March 10-11. p. 79-86. pdf
mov
       
2006 Precise dual finger selection techniques Benko, H., Wilson, A. D., and Baudisch, P. (2006). Precise Selection Techniques for Multi-Touch Screens. In Proceedings of ACM CHI 2006 (CHI'06: Human Factors in Computing Systems). Montreal, Canada. April 24-27. p. 1263-1272. pdf
mov
       
2005 Multi-monitor mouse Benko, H., Feiner, S. (2005). Multi-Monitor Mouse. ACM CHI 2005 (CHI'05: Human Factors in Computing Systems) Extended Abstracts. Portland, Oregon, USA. April 2-7. p. 1208-1211. pdf
mov
     
Cross-Dimensional Gestures Benko, H., Ishak, E.W., Feiner, S. (2005). Cross-Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments. In Proceedings of IEEE Virtual Reality (VR '05). Bonn, Germany. March 10-12. p. 209-116. pdf
mov
       
2004 VITA Benko, H., Ishak, E.W., Feiner, S. (2004). Collaborative Mixed Reality Visualization of an Archaeological Excavation. In Proceedings of  The International Symposium on Mixed and Augmented Reality (ISMAR '04). November 2-5. p. 132-140. pdf
mov
Allen, P., Feiner, S. Troccoli, A., Benko, H., Ishak, E., Smith, B. (2004). Seeing into the Past: Creating a 3D Modeling Pipeline for Archaeological Visualization. In Proceedings of  International Symposium on 3D Data Processing Visualization and Transmission (3DPVT '04). p. 751-758. pdf
Mirage Thorisson, K., Benko, H., Abramov, D., Arnold, A., Maskey, S., and Vaseekaran, A. (2004). Constructionist Design Methodology for Interactive Intelligences. AI Magazine. Vol. 25, No. 4. p. 77-90. pdf
mov
       
2003 MAVEN Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P., Feiner, S. (2003). Mutual Dissambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In Proceedings of The Fifth International Conference on Multimodal Interfaces (ICMI '03). Vancouver, BC. Canada. November 5-7. p. 12-19. pdf
divx
     
SenseShapes Olwal, A., Benko, H., Feiner, S. (2003). SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In Proceedings of  The Second International Symposium on Mixed and Augmented Reality (ISMAR '03). Tokyo, Japan. October 7-10. p. 300-301. pdf
divx
jpg
2001 eIreland Benko, H. (2001). e-Ireland: Europe's New Internet Hub. Perspectives on Business and Economics, Volume 19. Martindale Center for the Study of Private Enterprise, Lehigh University, Bethlehem, PA, USA. p. 39-48. pdf
       
Book Contributions
2011 Virtualna Okruzenja Pandžić, I. S., Pejša, T., Matković, K., Benko, H., Čereković, A., Matijašević, M. (2011). Virtualna Okruženja: Interaktivna 3D grafika i njene primjene. (In Croatian, translated title: Virtual Environments: Interactive 3D graphics and applications). ISBN: 978-953-197-606-0. Element d.o.o., Zagreb, September 2011.   
2010 Benko, H. and Wigdor, D. Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In "Tabletops - Horizontal Interactive Displays". Christian Mueller-Tomfelde (ed.). ISBN: 978-1-84996-112-7. Springer HCI Series, Springer-Verlag London Ltd., April 2010. pdf link
       
       
Technical Reports
       
2015 Juggling Knibbe Knibbe, J., Benko, H., and Wilson, A. (2015). Juggling the Effects of Latency: Motion Prediction Approaches to Reducing Latency in Dynamic Projector-Camera Systems. Microsoft Research Technical Report MSR-TR-2015-35. May, 2015. pdf
mp4
       
2012 Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindbauer, D., Ion, A., Zhao, S., and Koh, J.T.K.V. (2012). Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI. Microsoft Research Technical Report MSR-TR-2012-111. November, 2012. pdf
wmv
       
2009 DepthTouch Benko, H., Wilson, A. (2009). DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface. Microsoft Research Technical Report MSR-TR-2009-23. March, 2009. pdf
wmv
     
Benko, H., Morris, M. R., Brush, A.J.B., Wilson, A.D. (2009). Insights on Interactive Tabletops: A Survey of Researchers and Developers. Microsoft Research Technical Report MSR-TR-2009-22. March, 2009. pdf
 
2004 Cross-Dimensional Gestures Benko, H., Ishak, E.W., Feiner, S. (2004). Cross-Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments. Columbia University, New York. Technical Report. CUCS-029-04, August 2004. pdf
       
       
Demos/Posters (Incomplete List)
       
2015 Juggling Knibbe Knibbe, J., Benko, H., and Wilson, A. (2015). Juggling the Effects of Latency: Motion Prediction Approaches to Reducing Latency in Dynamic Projector-Camera Systems. In Adjunct Proceedings of ACM UIST 2015. pdf
poster
mp4
       
2013 Pinch-the-Sky Dome Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2013). IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. SIGGRAPH 2013 Emerging Technologies. Anaheim, CA. Best Demo invitation to Laval Virtual 2014 pdf
wmv
       
2011 SketchSpace Holman, D. and Benko, H. (2011). SketchSpace: Designing Interactive Behaviors with Passive Materials. CHI 2011 Extended Abstracts, May, 2011. pdf
wmv
StereoBlocks Jota, R. and Benko, H. (2011). Constructing Virtual 3D Models with Physical Building Blocks. CHI 2011 Extended Abstracts, May, 2011. pdf
wmv
       
2010 Pinch-the-Sky Dome Benko, H., Wilson, A. (2010). Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data. CHI 2010 Extended Abstracts, April, 2010. pdf
wmv
       
2008 DepthTouch Benko, H., Wilson, A. (2008). DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface. IEEE Workshop on Tabletops and Interactive Surfaces '08. Amsterdam, the Netherlands, October 1-3, 2008. pdf
wmv
       
2004 VITA Benko, H., Ishak, E.W., Feiner, S. (2004). VITA: Visual Interaction Tool for Archaeology. The International Symposium on Mixed and Augmented Reality (ISMAR 2004). November 2-5, 2004. pdf
     
VITA Benko, H., Ishak, E.W., Feiner, S. (2004). VITA: Visual Interaction Tool for Archaeology (Demo). In Proc. The ACM SIGMM Effective Telepresence Workshop (ACM SIGMM ETP 2004), October 15, 2004. p. 48-49. pdf
     
Monte Polizzo Allen, P., Feiner, S., Meskell, L., Ross, K., Troccoli, A., Smith, B., Benko, H., Ishak, E., and Conlon, J. (2004). Digitally Modeling, Visualizing and Preserving Archaeological Sites. In Proc. Joint Conference on Digital Libraries 2004 (JCDL 2004). Tuscon, AZ. June 7-11. pp. 389. pdf
   
2002 Feiner, S. Bell, B., Benko, H., Blasko, G., Güven, S., Hallaway, D., Höllerer, T., and Lok, S. (2002). Mobile Augmented Reality Systems. Living with the Genie: Governing Scientific and Technological Transformation in the 21st Century. New York, NY. March 5-7.  
       
       
Workshops
2021 Peacock, C. E., David-John, B., Zhang, T., Murdison, T. S., Boring, M. J., Benko, H., & Jonker, T. R. (2021). Gaze signatures decode the onset of working memory encoding. In CHI ‘21 workshop “Eye Movements as an Interface to Cognitive State”. pdf
(link) video
2020 RoleAIinAR Jonker, T. R., Desai, R., Carlberg, K., Hillis, J., Keller, S., and Benko, H. (2020). The Role of AI in Mixed and Augmented Reality Interactions. In CHI '20 workshop "Artificial Intelligence for HCI: A Modern Approach". pdf
2013 Steimle, J., Benko, H., Cassinelli, A., Ishii, H., Leithinger, D., Maes, P., and Poupyrev, I. (2013) Displays take new shape: an agenda for future interactive surfaces. (workshop) CHI Extended Abstracts 2013. p. 3283-3286  pdf
       
2012 Bacim, F., Sinclair, M., and Benko, H. (2012) Challenges of Multitouch Interaction on Deformable Surfaces. Beyond Flat Displays Workshop at ACM ITS 2012.  pdf
     
Steinicke, F., Benko, H., Krüger, A., Keefe, D.F., de la Rivière, J.-B., Anderson, K., Häkkilä, J., Arhippainen, L., and Pakanen, M. (2012) The 3rd dimension of CHI (3DCHI): touching and designing 3D user interfaces. CHI Extended Abstracts 2012: p. 2695-2698. pdf
       
2011 Steinicke, F., Benko, H., Daiber, F., Keefe, D.F., and de la Rivière, J.-B. (2011) Touching the 3rd dimension (T3D workshop).  CHI Extended Abstracts 2011. p. 161-164. pdf
       
2009 Sphere Benko, H. and Wilson, A. (2009). Design Challenges of Interactive Spherical User Interfaces. Programming Reality Workshop at CHI'09. April, 2009. pdf
       
2005 Cross-Dimensional Gestures Ishak, E., Benko, H., and Feiner, S. (2005). Development and Evaluation of Mixed Reality Interaction Techniques. Workshop on 3D User Interfaces (3DUI at IEEE VR'05). Bonn, Germany. March 10-12, 2005. pdf
       
2003 VITA Benko, H., Ishak, E., and Feiner, S. (2003). Collaborative Visualization of an Archaeological Excavation. Workshop on Collaborative Virtual Reality and Visualization (CVRV 2003). Lake Tahoe, CA. October 26-28, 2003. pdf
       
       
Ph.D. Thesis
       
2007 PhD Dissertation Benko, H. (2007). User Interaction in Hybrid Multi-Display Environments. Ph.D. Dissertation. Department of Computer Science, Columbia University, New York, NY. May 2007. pdf
       
       
Keynotes & Invited Talks (incomplete list)
       
2019-2021 Benko, H. The Future of Mixed Reality Interactions.
Keynote at IEEE AIVR 2019. San Diego, California.
Keynote at ACM ISS 2020. Lisbon, Portugal
Stanford HCI Seminar. Oct. 16, 2020.
International XR Workshop - February 12, 2021. Auckland, New Zealand
pdf
+ various updates
       
2018 Benko, H. The ABC of MR Interactions. Keynote at IEEE ISMAR 2018. Munich, Germany. pdf
     
Benko, H. VR Haptic Controllers: Multi-Purpose Handheld Haptics Beyond Vibro-Tactors. Keynote at Haptic Symposium 2018. San Francisco, CA. March 25, 2018. pdf
       
2017 Benko, H. (2017). Perception Equals Reality. Talk given at:
VR World Congress in Bristol, UK on April 12, 2017
University of British Columbia, Lecture Series on February 9, 2017
Simon Fraser University, on February 10, 2017, 2015 
pdf
       
2015 Benko, H. (2015). Interacting with Photons: Creating Interactive Projected Augmented Reality Experiences. Talk given at:
TUX Sander's Distinghished Speaker Series in Toronto, ON on October 13, 2015
Columbia University on October 14, 2015
New York University on October 15, 2015 
pdf
2013 Benko, H. (2013). Istraživanja iz Microsoft Research-a na području proširene stvarnosti. (in Croatian). WinDays Conference. Umag, Croatia, April 24, 2013. pptx
     
Benko, H. (2013). Beyond Flat Displays.  ACM CHI '13 Workshop on Displays Take New Shape. April 28, 2013. pptx
       
2012 Benko, H. (2012). Rich Augmented Reality Interactions Without Goggles, Gloves or 3D Trackers. DUB Research Talk. University of Washington. January 4, 2012. pptx
       
2011 Benko, H. (2011). High-fidelity Augmented Reality Interactions. Microsoft Research Latin American Faculty Summit. May 19, 2011. pptx
     
Benko, H. (2011). Multi-touch Interactions on Small Input Devices. DUB Research Talk. University of Washington. February 2, 2011. pptx
       
2009 Benko, H. (2009). Alternative Form Factors of Surface Computing. Microsoft Research Faculty Summit. July 15, 2009. pptx
     
Wilson, A. D. and Benko, H. (2009). Riffing on Surface. Department of Computer Science, University of California Santa Barbara. March 6, 2009. pptx
       
2008 Benko, H. (2008). Non-Flat Surface Computing. Microsoft Research Cambridge Lab. September 15, 2008. pptx
       
2005 VITA Benko, H. (2005). Collaborative Mixed Reality Visualization of an Archaeological Excavation. MIT Media Lab. January 12, 2005. ppt
       
2004 VITA Benko, H., Troccoli, A. (2004). Creating Telepresence: 3D Modeling and Visualization of an Archaeological Excavation. Ph.D. Seminar, Computer Science, Columbia University. November 23, 2004. ppt