top of page

PUBLICATIONS

locationAR.jpg
Location-Aware Adaptation of Augmented Reality Narratives.

Wanwan Li*, Changyang Li*, Minyoung Kim, Haikun Huang, Lap-Fai Yu
*Equal contributors

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2023)
Project PagePaperSupplementary MaterialVideoBibtex

Adapting AR stories to real-world locations such as a campus.

locationAR.jpg
WFH-VR: TELEOPERATING A ROBOT ARM TO SET A DINING TABLE ACROSS THE GLOBE VIA VIRTUAL REALITY.

Lai Sum Yim, Quang TN Vo, Ching-I Huang, Chi-Ruei Wang, Wren McQueary, Hsueh-Cheng Wang, Haikun Huang, Lap-Fai Yu

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022)

PaperProject Page, Video

VR teleoperation of a robot arm over the globe to set a dining table.​

arstory.gif
INTERACTIVE AUGMENTED REALITY STORYTELLING GUIDED BY SCENE SEMANTICS.

Changyang Li, Wanwan Li, Haikun Huang, Lap-Fai Yu

ACM Transactions on Graphics (Proceeding of SIGGRAPH 2022)
Featured in SIGGRAPH Blog 

Deploying AR stories to different scenes.

Project PagePaperSupplementary MaterialVideo

mood.png
MOOD-DRIVEN COLORIZATION OF VIRTUAL INDOOR SCENES.

Michael S Solah*, Haikun Huang*, Jiachuan Sheng, Tian Feng, Marc Pomplun, Lap-Fai Yu

*Equal contributors

AR | VR | XR | Training

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022

(Special Issue on IEEE Virtual Reality 2022)

Project PagePaperVideo

construction.png
SYNTHESIZING PERSONALIZED CONSTRUCTION SAFETY TRAINING SCENARIOS FOR VR TRAINING.

Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, Lap-Fai Yu

AR | VR | XR | Training

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022

(Special Issue on IEEE Virtual Reality 2022)

Project PagePaperVideo

teleport.png
SYNTHESIZING SCENE-AWARE VIRTUAL REALITY TELEPORT GRAPHS.

Changyang Li, Haikun Huang, Jyh-Ming Lien, Lap-Fai Yu

AR | VR | XR | Training

ACM Transactions on Graphics (Proceeding of SIGGRAPH Asia 2021)

Project PagePaperSupplementary MaterialVideo

workplace.gif
JOINT COMPUTATIONAL DESIGN OF WORKSPACES AND WORKPLANS.

Yongqi Zhang, Haikun Huang, Erion Plaku, Lap-Fai Yu

AR | VR | XR | Training

ACM Transactions on Graphics (Proceeding of SIGGRAPH Asia 2021)

Project PagePaperSupplementary MaterialVideo

icir21.png
BUILDING A MOTION-AWARE, NETWORKED DO-IT-YOURSELF HOLOGRAPHIC DISPLAY.

Amilcar Gomez Samayoa*, Javier Talavera*, Siem G. Sium, Biao Xie, Haikun Huang, Lap-Fai Yu
*Equal contributors

AR | VR | XR | Training | Holographic

A simple DIY networked holographic display.

IEEE International Conference on Intelligent Reality (ICIR 2021)

Second Place Award, Application Competition on Intelligent Reality (Students Track)

PaperVideo

survey.jpg
A REVIEW ON VIRTUAL REALITY SKILL TRAINING APPLICATIONS.

Biao Xie, Huimin Liu, Rawan Alghofaili, Yongqi Zhang, Yeling Jiang, Flavio Destri Lobo, Changyang Li, Wanwan Li, Haikun Huang, Mesut Akdere, Christos Mousas, Lap-Fai Yu

AR | VR | XR | Training | Simulation

A Review on Virtual Reality Skill Training Applications.

Frontiers in Virtual Reality, 2021

Paper

audio.png
TOWARD AUTOMATIC AUDIO DESCRIPTION GENERATION FOR ACCESSIBLE VIDEOS.

Yujia Wang, Wei Liang, Haikun Huang,Yongqi Zhang, Dingzeyu Li, Lap-Fai Yu

Human-centered computing | Accessibility systems

Audio Description Generation for Accessible Videos and Survey. 

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2020)

gallery.png
INTERACTIVE DESIGN OF GALLERY WALLS VIA MIXED REALITY.

Haikun Huang,Yuxuan Zhang, Tomer Weiss, Rebecca W Perry, Lap-Fai Yu, Lap-Fai Yu

Design Interfaces | Mixed Reality | Spatial Computing

A novel interactive design tool that allows users to create and visualize gallery walls via a mixed reality device.

IEEE AIVR, 2020

Project PagePaperVideo

level3.png
EXERTION-AWARE PATH GENERATION.

*Wanwan Li, *Biao Xie, Yongqi Zhang, Walter Meiss, Haikun Huang, Lap-Fai Yu
*Equal contributors

Procedural Modeling | Level Design | Path Generation | Haptics

Generating exertion-aware paths over 3D terrains for VR exercising.

ACM Transactions on Graphics (Proceeding of SIGGRAPH 2020)

Project PagePaperVideo

ambient_optimized.gif
AUDIBLE PANORAMA: AUTOMATIC SPATIAL AUDIO GENERATION FOR PANORAMA IMAGERY.

*Haikun Huang, *Michael S. Solah, Dingzeyu Li, Lap-Fai Yu
*Equal contributors

Immersive Media | Spatial Audio | Panorama Images | Virtual Reality | Augmented Reality

This work automatically synthesizes realistic spatial sounds for 360° panorama images for delivering immersive VR experiences.

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019)

Project PagePaperVideo

vr_lost_optimized.gif
GAZE-DRIVEN ADAPTIVE AID FOR VR NAVIGATION.

Rawan Alghofaili, Yasuhito Sawahata, Haikun Huang, Hsueh-Cheng Wang, Takaaki Shiratori, Lap-Fai Yu

Games/Play | Virtual/Augmented Reality | Eye Tracking 

Feel lost when navigating in a virtual environment (such as when playing a VR game)? This tool helps you get back on track by predicting when you need navigation help and popping up wayfinding aids.

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019)

Project PagePaperVideo

vreye.png
OPTIMIZING VISUAL ELEMENT PLACEMENT VIA VISUAL ATTENTION ANALYSIS.

Rawan Alghofaili, Michael Solah, Haikun Huang, Yasuhito Sawahata, Marc Pomplun, Lap-Fai Yu

Computing Methodologies—Computer Graphics—Graphics systems | Interfaces—Virtual Reality 

Populating visual elements (e.g., ads) in 3D virtual environments based on a visual attention predictor trained by eye-gaze data

IEEE Virtual Reality (VR 2019)

Project PagePaperVideo

level2_optimized.gif
POSE-GUIDED LEVEL DESIGN.

*Yongqi Zhang, *Biao Xie, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu
*Equal contributors

Level Design | Optimization | Exergaming | Generative Design 

Procedural game level generator for motion/exercise games (e.g., Just Dance, Speed of Light).

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019)

CHI 2019 Honourable Mentions Award

Project PagePaperVideo

exergame.gif
EXERCISE INTENSITY-DRIVEN LEVEL DESIGN.

Biao Xie*, Yongqi Zhang*, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu
*Equal contributors

Level Design | Optimization | Exergaming | Generative Design 

This work automatically synthesizes realistic spatial sounds for 360° panorama images for delivering immersive VR experiences.

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018 (Special Issue on IEEE Virtual Reality 2018) 
In IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 4, pp. 1661-1670, April 2018.doi: 10.1109/TVCG.2018.2793618 (Special Issue on IEEE Virtual Reality 2018. Acceptance Rate: 15%)

Featured on IEEE Xplore Innovation Spotlight

Project PagePaperVideo

guidedog.png
DEEP TRAIL-FOLLOWING ROBOTIC GUIDE DOG IN PEDESTRIAN ENVIRONMENTS FOR PEOPLE WHO ARE BLIND AND VISUALLY IMPAIRED - LEARNING FROM VIRTUAL AND REAL WORLDS.

Tzu-Kuan Chuang, Ni-Ching Lin, Jih-Shi Chen, Chen-Hao Hung, Yi-Wei Huang, Chunchih Teng, Haikun Huang, Lap-Fai Yu, Laura Giarre, Hsueh-Cheng Wang

Training a robotic guidedog that can help blind people to navigate in the real world.

IEEE International Conference on Robotics and Automation (ICRA 2018)

PaperVideo

wayfinding.png
AUTOMATIC OPTIMIZATION OF WAYFINDING DESIGN.

Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

Wayfinding | Navigation | Procedural Modeling | Level Design | Spatial Orientation

An automatic tool to help wayfinding designers create better wayfinding designs for architectural spaces, and to help level designers create better game levels.

IEEE International Conference on Robotics and Automation (ICRA 2018)

Project PagePaperSupplementaryVideo

vrpr.png
ANALYZING VISUAL ATTENTION VIA VIRTUAL ENVIRONMENTS.

Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

VR | Training

Virtual Reality meets Physical Reality Workshop, SIGGRAPH Asia, 2016

Paper

圖形形狀
PHYSIOLOGICAL RESPONSES AND ENJOYMENT OF KINECT-BASED EXERGAMES IN OLDER ADULTS AT RISK FOR FALLS: A FEASIBILITY STUDY.

Ogawa EF, Huang Haikun, Yu Lap-Fai, Gona GN, Fleming RK, Leveille SG, You T

圖形形狀
EFFECTS OF EXERGAMING ON COGNITION AND DUAL-TASK MOBILITY IN OLDER ADULTS AT RISK FOR FALLING.

Ogawa EF, Huang Haikun, Yu Lap-Fai, Gona GN, Fleming RK, Leveille SG, You T

bottom of page