Eye Tracking and Display Prototyping

The work below seeks to improve natural interaction with and usability of XR interfaces, with a focus on gaze based control, eye tracking algorithms, and display prototyping.

Gaze Manipulation

Takahashi, R., Shirai, S., Orlosky, J., Uranishi, Y., & Takemura, H. (2021, October). A Japanese Character Flick-Input Interface for Entering Text in VR. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 251-253). IEEE.

Liu, C., Orlosky, J., & Plopski, A. (2020, October). Eye Gaze-based Object Rotation for Head-mounted Displays. In Symposium on Spatial User Interaction (pp. 1-9). 

Liu, C., Plopski, A., & Orlosky, J. (2020). OrthoGaze: Gaze-based Three-dimensional Object Manipulation using Orthogonal Planes. Computers & Graphics

Optics and Measurement

Hirobe, D., Uranishi, Y., Orlosky, J., Shirai, S., Ratsamee, P., & Takemura, H. (2022, October). Objective Measurements of Background Color Shifts Caused by Optical See-Through Head-Mounted Displays. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 389-390). IEEE.


Sakamoto, K., Shirai, S., Orlosky, J., Nagataki, H., Takemura, N., Alizadeh, M., & Ueda, M. (2020, March). Exploring Pupillometry as a Method to Evaluate Reading Comprehension in VR-based Educational Comics. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 422-426). IEEE. 

Liu, C., Plopski, A., Kiyokawa, K., Ratsamee, P., & Orlosky, J. (2018, October). IntelliPupil: Pupillometric light modulation for optical see-through head-mounted displays. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 98-104). IEEE. 

Eye Tracking

Orlosky, J., Huynh, B., & Hollerer, T. (2019, December). Using eye tracked virtual reality to classify understanding of vocabulary in recall tasks. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 66-667). IEEE Computer Society. 

Plopski, A., Orlosky, J., Itoh, Y., Nitschke, C., Kiyokawa, K., & Klinker, G. (2016, September). Automated spatial calibration of HMD systems with unconstrained eye-cameras. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 94-99). IEEE. 

Display Prototyping

Orlosky, J., Wu, Q., Kiyokawa, K., Takemura, H., & Nitschke, C. (2014, October). Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays. In Proceedings of the 2nd ACM symposium on Spatial user interaction (pp. 54-61). ACM.

Orlosky, J., Toyama, T., Kiyokawa, K., Sonntag, D. (2015, October). ModulAR: Eye-controlled Vision Augmentations for Head Mounted Displays.  In Visualization and Computer Graphics, IEEE Transactions on (Proc. ISMAR) Vol. 21 (11).  (pp. 1259-1268.) IEEE.