Eye Tracking and Display Prototyping

The work below seeks to improve natural interaction with and usability of XR interfaces, with a focus on gaze based control, eye tracking algorithms, and display prototyping.

Gaze Manipulation

Zhao, G., Orlosky, J., Kiyokawa, K., & Uranishi, Y. (2024, October). GlanXR: A Hands-Free Fast Switching System for Virtual Screens. To appear in the Proceedings of the 2024 International Symposium on Mixed and Augmented Reality. IEEE.  [Best Paper Nominee] 

Mansour, A., & Orlosky, J. (2023, October). Approximated Match Swiping: Exploring more Ergonomic Gaze-based Text Input for XR. In 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 141-145). IEEE.

Takahashi, R., Shirai, S., Orlosky, J., Uranishi, Y., & Takemura, H. (2021, October). A Japanese Character Flick-Input Interface for Entering Text in VR. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 251-253). IEEE.

Liu, C., Orlosky, J., & Plopski, A. (2020, October). Eye Gaze-based Object Rotation for Head-mounted Displays. In Symposium on Spatial User Interaction (pp. 1-9). 

Liu, C., Plopski, A., & Orlosky, J. (2020). OrthoGaze: Gaze-based Three-dimensional Object Manipulation using Orthogonal Planes. Computers & Graphics

Optics and Measurement

Boyd, C., Thompson, M., Smith, M., Dorai, G., & Orlosky, J. (2024, March). A Calibration Interface for 3D Gaze Depth Disambiguation in Virtual Environments. In 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 695-696). IEEE.

Hirobe, D., Uranishi, Y., Orlosky, J., Shirai, S., Ratsamee, P., & Takemura, H. (2022, October). Objective Measurements of Background Color Shifts Caused by Optical See-Through Head-Mounted Displays. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 389-390). IEEE.


Pupillometry

Sakamoto, K., Shirai, S., Takemura, N., Orlosky, J., Nagataki, H., Ueda, M., ... & Takemura, H. (2023). Subjective Difficulty Estimation of Educational Comics Using Gaze Features. IEICE TRANSACTIONS on Information and Systems, 106(5), 1038-1048.

Sakamoto, K., Shirai, S., Orlosky, J., Nagataki, H., Takemura, N., Alizadeh, M., & Ueda, M. (2020, March). Exploring Pupillometry as a Method to Evaluate Reading Comprehension in VR-based Educational Comics. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 422-426). IEEE. 

Liu, C., Plopski, A., Kiyokawa, K., Ratsamee, P., & Orlosky, J. (2018, October). IntelliPupil: Pupillometric light modulation for optical see-through head-mounted displays. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 98-104). IEEE. 

Eye Tracking

Zhao, G., Orlosky, J., Gabbard, J., & Kiyokawa, K. (2023). HazARdSnap: gazed-based augmentation delivery for safe information access while cycling. IEEE Transactions on Visualization and Computer Graphics.

Orlosky, J., Huynh, B., & Hollerer, T. (2019, December). Using eye tracked virtual reality to classify understanding of vocabulary in recall tasks. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 66-667). IEEE Computer Society. 

Plopski, A., Orlosky, J., Itoh, Y., Nitschke, C., Kiyokawa, K., & Klinker, G. (2016, September). Automated spatial calibration of HMD systems with unconstrained eye-cameras. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 94-99). IEEE. 

Display Prototyping

Yoshimi, K., Ratsamee, P., & Orlosky, J. (2021, March). AREarthQuakeDrill: Toward increased awareness of personnel during earthquakes via AR evacuation drills. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 446-447). IEEE.

Orlosky, J., Wu, Q., Kiyokawa, K., Takemura, H., & Nitschke, C. (2014, October). Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays. In Proceedings of the 2nd ACM symposium on Spatial user interaction (pp. 54-61). ACM.

Orlosky, J., Toyama, T., Kiyokawa, K., Sonntag, D. (2015, October). ModulAR: Eye-controlled Vision Augmentations for Head Mounted Displays.  In Visualization and Computer Graphics, IEEE Transactions on (Proc. ISMAR) Vol. 21 (11).  (pp. 1259-1268.) IEEE.