Publications

mood.png

Mood-Driven Colorization of Virtual Indoor Scenes

Michael S Solah*, Haikun Huang*, Jiachuan Sheng, Tian Feng, Marc Pomplun, Lap-Fai Yu
*Equal contributors

AR | VR | XR | Training

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022

(Special Issue on IEEE Virtual Reality 2022)

construction.png

Synthesizing Personalized Construction Safety Training Scenarios for VR Training

Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, Lap-Fai Yu

AR | VR | XR | Training

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022

(Special Issue on IEEE Virtual Reality 2022)

teleport.png

Synthesizing Scene-Aware Virtual Reality Teleport Graphs

Changyang Li, Haikun Huang, Jyh-Ming Lien, Lap-Fai Yu

AR | VR | XR | Training

ACM Transactions on Graphics (Proceeding of SIGGRAPH Asia 2021)

workplace.gif

Joint Computational Design of Workspaces and Workplans

Yongqi Zhang, Haikun Huang, Erion Plaku, Lap-Fai Yu

AR | VR | XR | Training

ACM Transactions on Graphics (Proceeding of SIGGRAPH Asia 2021)

icir21.png

Building a Motion-Aware, Networked Do-It-Yourself Holographic Display

Amilcar Gomez Samayoa*, Javier Talavera*, Siem G. Sium, Biao Xie, Haikun Huang, Lap-Fai Yu
*Equal contributors

AR | VR | XR | Training | Holographic

A simple DIY networked holographic display.

IEEE International Conference on Intelligent Reality (ICIR 2021)

survey.jpg

A Review on Virtual Reality Skill Training Applications

Biao Xie, Huimin Liu, Rawan Alghofaili, Yongqi Zhang, Yeling Jiang, Flavio Destri Lobo, Changyang Li, Wanwan Li, Haikun Huang, Mesut Akdere, Christos Mousas, Lap-Fai Yu

AR | VR | XR | Training | Simulation

A Review on Virtual Reality Skill Training Applications.

Frontiers in Virtual Reality, 2021

audio.png

Toward Automatic Audio Description Generation for Accessible Videos

Yujia Wang, Wei Liang, Haikun Huang,Yongqi Zhang, Dingzeyu Li, Lap-Fai Yu

Human-centered computing | Accessibility systems

Audio Description Generation for Accessible Videos and Survey. 

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2020)

gallery.png

Interactive Design of Gallery Walls via Mixed Reality

Haikun Huang,Yuxuan Zhang, Tomer Weiss, Rebecca W Perry, Lap-Fai Yu, Lap-Fai Yu

Design Interfaces | Mixed Reality | Spatial Computing

A novel interactive design tool that allows users to create and visualize gallery walls via a mixed reality device.

IEEE AIVR, 2020 

level3.png

Exertion-Aware Path Generation

*Wanwan Li, *Biao Xie, Yongqi Zhang, Walter Meiss, Haikun Huang, Lap-Fai Yu
*Equal contributors

Procedural Modeling | Level Design | Path Generation | Haptics

Generating exertion-aware paths over 3D terrains for VR exercising.

ACM Transactions on Graphics (Proceeding of SIGGRAPH 2020) 

ambient_optimized.gif

Audible Panorama: Automatic Spatial Audio Generation for Panorama Imagery

*Haikun Huang, *Michael S. Solah, Dingzeyu Li, Lap-Fai Yu
*Equal contributors

Immersive Media | Spatial Audio | Panorama Images | Virtual Reality | Augmented Reality

This work automatically synthesizes realistic spatial sounds for 360° panorama images for delivering immersive VR experiences.

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019) 

vr_lost_optimized.gif

Gaze-driven Adaptive Aid for VR Navigation

Rawan Alghofaili, Yasuhito Sawahata, Haikun Huang, Hsueh-Cheng Wang, Takaaki Shiratori, Lap-Fai Yu

Games/Play | Virtual/Augmented Reality | Eye Tracking 

Feel lost when navigating in a virtual environment (such as when playing a VR game)? This tool helps you get back on track by predicting when you need navigation help and popping up wayfinding aids.

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019) 

vreye.png

Optimizing Visual Element Placement via Visual Attention Analysis

Rawan Alghofaili, Michael Solah, Haikun Huang, Yasuhito Sawahata, Marc Pomplun, Lap-Fai Yu

Computing Methodologies—Computer Graphics—Graphics systems | Interfaces—Virtual Reality 

Populating visual elements (e.g., ads) in 3D virtual environments based on a visual attention predictor trained by eye-gaze data

IEEE Virtual Reality (VR 2019) 

level2_optimized.gif

Pose-Guided Level Design

*Yongqi Zhang, *Biao Xie, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu
*Equal contributors

Level Design | Optimization | Exergaming | Generative Design 

Procedural game level generator for motion/exercise games (e.g., Just Dance, Speed of Light).

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019)

CHI 2019 Honourable Mentions Award

exergame.gif

Exercise Intensity-driven Level Design

Biao Xie*, Yongqi Zhang*, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu
*Equal contributors

Level Design | Optimization | Exergaming | Generative Design 

This work automatically synthesizes realistic spatial sounds for 360° panorama images for delivering immersive VR experiences.

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018 (Special Issue on IEEE Virtual Reality 2018) 
In IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 4, pp. 1661-1670, April 2018.doi: 10.1109/TVCG.2018.2793618 (Special Issue on IEEE Virtual Reality 2018. Acceptance Rate: 15%)

Featured on IEEE Xplore Innovation Spotlight

guidedog.png

Deep Trail-Following Robotic Guide Dog in Pedestrian Environments for People who are Blind and Visually Impaired - Learning from Virtual and Real Worlds

Tzu-Kuan Chuang, Ni-Ching Lin, Jih-Shi Chen, Chen-Hao Hung, Yi-Wei Huang, Chunchih Teng, Haikun Huang, Lap-Fai Yu, Laura Giarre, Hsueh-Cheng Wang

Training a robotic guidedog that can help blind people to navigate in the real world.

IEEE International Conference on Robotics and Automation (ICRA 2018) 

wayfinding.png

Automatic Optimization of Wayfinding Design

Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

Wayfinding | Navigation | Procedural Modeling | Level Design | Spatial Orientation

An automatic tool to help wayfinding designers create better wayfinding designs for architectural spaces, and to help level designers create better game levels.

IEEE International Conference on Robotics and Automation (ICRA 2018) 

vrpr.png

Analyzing Visual Attention via Virtual Environments

Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

VR | Training

Virtual Reality meets Physical Reality Workshop, SIGGRAPH Asia, 2016

Physiological Responses and Enjoyment of Kinect-Based Exergames in Older Adults at Risk for Falls: A Feasibility Study

Ogawa EF, Huang Haikun, Yu Lap-Fai, Gona GN, Fleming RK, Leveille SG, You T

Effects of Exergaming on Cognition and Dual-Task Mobility in Older Adults at Risk for Falling

Ogawa EF, Huang Haikun, Yu Lap-Fai, Gona GN, Fleming RK, Leveille SG, You T