Skip to main content

Research

Research at the intersection of XR, AI, and computational design.

I develop human-centered methods and systems for virtual, augmented, and mixed reality. The work spans adaptive training, computational design, spatial interaction and media, visual attention, accessibility, robotics, optimization, and reusable research infrastructure.

Publications

39 research outputs are listed in reverse chronological order.

Showing all 39 research outputs

  1. Animated demonstration of the HieraVisVR interface for analyzing motion-centric VR playtesting data.

    HieraVisVR: Hierarchical Visual Analytics for Motion-Centric VR Playtesting

    Yongqi Zhang, Erdem Murat, Liuchuan Yu, Haikun Huang, Minsoo Choi, Christos Mousas, Lap-Fai Yu

    Conference Paper · ACM CHI 2026, Article 629 · 2026

    A hierarchical visual analytics workflow for reviewing motion-centric VR playtesting data across exploration, grouping, and explanation stages.

    Virtual Reality · Playtesting · Visual Analytics · HCI

    BibTeX 
    @inproceedings{Zhang2026HieraVisVR,
  author = {Zhang, Yongqi and Murat, Erdem and Yu, Liuchuan and Huang, Haikun and Choi, Minsoo and Mousas, Christos and Yu, Lap-Fai},
  title = {{HieraVisVR}: Hierarchical Visual Analytics for Motion-Centric {VR} Playtesting},
  booktitle = {Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '26},
  publisher = {Association for Computing Machinery},
  year = {2026},
  month = {April},
  pages = {1--19},
  articleno = {629},
  numpages = {19},
  doi = {10.1145/3772318.3790591},
  url = {https://doi.org/10.1145/3772318.3790591}
}

  2. Col-Con: A Collaborative and Configurable VR Platform for Construction—A Pipe Installation Case Study

    Liuchuan Yu, Ching-Yu Cheng, William F. Ranc, Joshua Dow, Michael Szilagyi, Haikun Huang, Sungsoo Ray Hong, Behzad Esmaeili, Lap-Fai Yu

    Journal Article · Virtual Reality 30, Article 59 · 2026

    A configurable multi-user VR platform for collaborative construction training, evaluated through a pipe-installation case study.

    Virtual Reality · Construction · Collaboration · Training

    BibTeX 
    @article{Yu2026ColCon,
  author = {Yu, Liuchuan and Cheng, Ching-Yu and Ranc, William F. and Dow, Joshua and Szilagyi, Michael and Huang, Haikun and Hong, Sungsoo Ray and Esmaeili, Behzad and Yu, Lap-Fai},
  title = {{Col-Con}: a collaborative and configurable {VR} platform for construction---a pipe installation case study},
  journal = {Virtual Reality},
  volume = {30},
  number = {2},
  articleno = {59},
  publisher = {Springer Nature},
  year = {2026},
  month = {February},
  doi = {10.1007/s10055-025-01254-6},
  url = {https://doi.org/10.1007/s10055-025-01254-6}
}

  3. Multi-Player VR Marble Run Game for Physics Co-Learning

    William F. Ranc, Thanh Nguyen, Liuchuan Yu, Yongqi Zhang, Minyoung Kim, Haikun Huang, Lap-Fai Yu

    Conference Paper · IEEE ISMAR-Adjunct 2025, pp. 929–930 · 2025

    A collaborative multiplayer VR marble-run experience in which learners assemble and test mechanisms together while exploring physics concepts.

    Virtual Reality · Physics Education · Co-Learning · Collaboration

    BibTeX 
    @inproceedings{Ranc2025MarbleRun,
  author = {Ranc, William F. and Nguyen, Thanh and Yu, Liuchuan and Zhang, Yongqi and Kim, Minyoung and Huang, Haikun and Yu, Lap-Fai},
  title = {Multi-Player {VR} Marble Run Game for Physics Co-Learning},
  booktitle = {2025 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
  publisher = {IEEE},
  year = {2025},
  month = {October},
  pages = {929--930},
  doi = {10.1109/ISMAR-Adjunct68609.2025.00283},
  url = {https://doi.org/10.1109/ISMAR-Adjunct68609.2025.00283}
}
  4. Animated demonstration of adaptive VR workflow training driven by mixed-integer programming.

    Mixed-Integer Programming for Adaptive VR Workflow Training

    Yongqi Zhang, Chuan Yan, Haikun Huang, Simon Su, Lap-Fai Yu

    Conference Paper · HCII 2024 — Virtual, Augmented and Mixed Reality, pp. 325–344 · 2024

    A mixed-integer programming approach that adapts VR workflow training sessions to an individual trainee's strengths and weaknesses.

    Virtual Reality · Training · Optimization · Adaptive Systems

    BibTeX 
    @incollection{Zhang2024MixedInteger,
  author = {Zhang, Yongqi and Yan, Chuan and Huang, Haikun and Su, Simon and Yu, Lap-Fai},
  title = {Mixed-Integer Programming for Adaptive {VR} Workflow Training},
  booktitle = {Virtual, Augmented and Mixed Reality},
  editor = {Chen, Jessie Y. C. and Fragomeni, Gino},
  series = {Lecture Notes in Computer Science},
  volume = {14708},
  pages = {325--344},
  publisher = {Springer Nature Switzerland},
  address = {Cham},
  year = {2024},
  isbn = {978-3-031-61047-9},
  doi = {10.1007/978-3-031-61047-9_21},
  url = {https://doi.org/10.1007/978-3-031-61047-9_21}
}

  5. Association between Self-reported Sleep Quality and Single-task Gait in Young Adults: A Study Using Machine Learning

    Joel Martin, Haikun Huang, Ronald Johnson, Lap-Fai Yu, Erica Jansen, Rebecca Martin, Chelsea Yager, Ali Boolani

    Journal Article · Sleep Science 16(4), e399–e407 · 2023

    A machine-learning study of associations between self-reported sleep quality and single-task gait measures in young adults.

    Machine Learning · Gait · Sleep · Health

    BibTeX 
    @article{Martin2023SleepQuality,
  author = {Martin, Joel and Huang, Haikun and Johnson, Ronald and Yu, Lap-Fai and Jansen, Erica and Martin, Rebecca and Yager, Chelsea and Boolani, Ali},
  title = {Association between Self-reported Sleep Quality and Single-task Gait in Young Adults: A Study Using Machine Learning},
  journal = {Sleep Science},
  volume = {16},
  number = {4},
  pages = {e399--e407},
  publisher = {Georg Thieme Verlag KG},
  year = {2023},
  month = {November},
  doi = {10.1055/s-0043-1776748},
  url = {https://doi.org/10.1055/s-0043-1776748}
}
  6. Augmented-reality narrative content adapted to the geometry of a photographed real-world location.

    Location-Aware Adaptation of Augmented Reality Narratives

    Wanwan Li, Changyang Li, Minyoung Kim, Haikun Huang, Lap-Fai Yu

    Conference Paper · ACM CHI 2023, Article 33 · 2023

    An optimization-based approach for adapting branching augmented-reality narratives to the geometry and navigation constraints of a physical location.

    Augmented Reality · Narrative · Optimization · HCI

    BibTeX 
    @inproceedings{Li2023LocationAware,
  author = {Li, Wanwan and Li, Changyang and Kim, Minyoung and Huang, Haikun and Yu, Lap-Fai},
  title = {Location-Aware Adaptation of Augmented Reality Narratives},
  booktitle = {Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '23},
  publisher = {Association for Computing Machinery},
  year = {2023},
  month = {April},
  pages = {1--15},
  articleno = {33},
  numpages = {15},
  doi = {10.1145/3544548.3580978},
  url = {https://doi.org/10.1145/3544548.3580978}
}

  7. Establishing Design Computing and Extended Reality Facilities for Remote Virtual Reality Training

    Lap-Fai Yu, Changyang Li, Yongqi Zhang, Rawan Alghofaili, Haikun Huang, Liuchuan Yu, Huimin Liu, Minsoo Choi, Brenda Bannan, Christos Mousas

    Workshop Paper · IEEE VRW 2023, pp. 216–220 · 2023

    A report on establishing design-computing and extended-reality facilities that support remote VR training, collaboration, and applied research.

    Virtual Reality · Remote Training · Extended Reality · Research Infrastructure

    BibTeX 
    @inproceedings{Yu2023XRFacilities,
  author = {Yu, Lap-Fai and Li, Changyang and Zhang, Yongqi and Alghofaili, Rawan and Huang, Haikun and Yu, Liuchuan and Liu, Huimin and Choi, Minsoo and Bannan, Brenda and Mousas, Christos},
  title = {Establishing Design Computing and Extended Reality Facilities for Remote Virtual Reality Training},
  booktitle = {2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)},
  publisher = {IEEE},
  year = {2023},
  month = {March},
  pages = {216--220},
  doi = {10.1109/VRW58643.2023.00053},
  url = {https://doi.org/10.1109/VRW58643.2023.00053}
}
  8. Virtual-reality interface used to teleoperate a robot arm for a remote table-setting task.

    WFH-VR: Teleoperating a Robot Arm to Set a Dining Table across the Globe via Virtual Reality

    Lai Sum Yim*, Quang T. N. Vo*, Ching-I Huang, Chi-Ruei Wang, Wren McQueary, Hsueh-Cheng Wang, Haikun Huang, Lap-Fai Yu (*equal contribution)

    Conference Paper · IEEE/RSJ IROS 2022, pp. 4927–4934 · 2022

    A VR interface for remotely teleoperating a robot arm to complete a table-setting task across long-distance network conditions.

    Virtual Reality · Robotics · Teleoperation · Human-Robot Interaction

    BibTeX 
    @inproceedings{Yim2022WFHVR,
  author = {Yim, Lai Sum and Vo, Quang T. N. and Huang, Ching-I and Wang, Chi-Ruei and McQueary, Wren and Wang, Hsueh-Cheng and Huang, Haikun and Yu, Lap-Fai},
  title = {{WFH-VR}: Teleoperating a Robot Arm to Set a Dining Table across the Globe via Virtual Reality},
  booktitle = {2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  publisher = {IEEE},
  year = {2022},
  month = {October},
  pages = {4927--4934},
  doi = {10.1109/IROS47612.2022.9981729},
  url = {https://doi.org/10.1109/IROS47612.2022.9981729}
}

  9. Association between Self-Reported Prior Night’s Sleep and Single-Task Gait in Healthy, Young Adults: A Study Using Machine Learning

    Ali Boolani, Joel Martin, Haikun Huang, Lap-Fai Yu, Maggie Stark, Zachary Grin, Marissa Roy, Chelsea Yager, Seema Teymouri, Dylan Bradley, Rebecca Martin, George Fulk, Rumit Singh Kakar

    Journal Article · Sensors 22(19), Article 7406 · 2022

    A machine-learning analysis of associations between self-reported prior-night sleep and single-task gait characteristics in healthy young adults.

    Machine Learning · Gait · Sleep · Health

    BibTeX 
    @article{Boolani2022PriorNightSleep,
  author = {Boolani, Ali and Martin, Joel and Huang, Haikun and Yu, Lap-Fai and Stark, Maggie and Grin, Zachary and Roy, Marissa and Yager, Chelsea and Teymouri, Seema and Bradley, Dylan and Martin, Rebecca and Fulk, George and Kakar, Rumit Singh},
  title = {Association between Self-Reported Prior Night's Sleep and Single-Task Gait in Healthy, Young Adults: A Study Using Machine Learning},
  journal = {Sensors},
  volume = {22},
  number = {19},
  articleno = {7406},
  publisher = {MDPI},
  year = {2022},
  month = {September},
  doi = {10.3390/s22197406},
  url = {https://doi.org/10.3390/s22197406}
}

  10. Association Between Self-Reported Sleep Quality and Gait in Young Adults: A Study Using Machine Learning

    Ali Boolani, Haikun Huang, Ronald Johnson, Lap-Fai Yu, Erica Jansen, Rebecca Martin, Chelsea C. Yager, Bert Jacobson, Joel Martin

    Conference Abstract · Medicine & Science in Sports & Exercise 54(9S), p. 187 · 2022

    A conference abstract examining associations between self-reported sleep quality and gait in young adults using machine-learning methods.

    Machine Learning · Gait · Sleep · Conference Abstract

    BibTeX 
    @article{Boolani2022SleepQualityGaitAbstract,
  author = {Boolani, Ali and Huang, Haikun and Johnson, Ronald and Yu, Lap-Fai and Jansen, Erica and Martin, Rebecca and Yager, Chelsea C. and Jacobson, Bert and Martin, Joel},
  title = {Association Between Self-Reported Sleep Quality and Gait in Young Adults: A Study Using Machine Learning},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {54},
  number = {9S},
  pages = {187},
  publisher = {Lippincott Williams \& Wilkins},
  year = {2022},
  month = {September},
  doi = {10.1249/01.mss.0000877408.44080.fa},
  url = {https://doi.org/10.1249/01.mss.0000877408.44080.fa}
}

  11. Do Healthy, Young Adults with Current Feelings of Anxiety Have Impaired Balance? An Exploratory Study

    Dalton Dowd, Maggie Stark, Haikun Huang, Lap-Fai Yu, Rebecca Martin, Ryan McCarthy, Emily Locke, Chelsea Yager, Matthew Lee Smith, Bert Jacobson, Ali Boolani

    Conference Abstract · Medicine & Science in Sports & Exercise 54(9S), pp. 413–414 · 2022

    An exploratory conference abstract evaluating whether quiet-balance measures distinguish young adults reporting current feelings of anxiety.

    Balance · Anxiety · Machine Learning · Conference Abstract

    BibTeX 
    @article{Dowd2022AnxietyBalanceAbstract,
  author = {Dowd, Dalton and Stark, Maggie and Huang, Haikun and Yu, Lap-Fai and Martin, Rebecca and McCarthy, Ryan and Locke, Emily and Yager, Chelsea and Smith, Matthew Lee and Jacobson, Bert and Boolani, Ali},
  title = {Do Healthy, Young Adults with Current Feelings of Anxiety Have Impaired Balance? An Exploratory Study},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {54},
  number = {9S},
  pages = {413--414},
  publisher = {Lippincott Williams \& Wilkins},
  year = {2022},
  month = {September},
  doi = {10.1249/01.mss.0000880260.52949.ef},
  url = {https://doi.org/10.1249/01.mss.0000880260.52949.ef}
}

  12. Manifestations of Anxiety in Gait

    Maggie Stark, Haikun Huang, Lap-Fai Yu, Rebecca Martin, Ryan McCarthy, Emily Locke, Chelsea Yager, Matthew Lee Smith, Bert Jacobson, Ali Boolani

    Conference Abstract · Medicine & Science in Sports & Exercise 54(9S), p. 187 · 2022

    A conference abstract investigating gait characteristics associated with current feelings of anxiety.

    Gait · Anxiety · Machine Learning · Conference Abstract

    BibTeX 
    @article{Stark2022AnxietyGaitAbstract,
  author = {Stark, Maggie and Huang, Haikun and Yu, Lap-Fai and Martin, Rebecca and McCarthy, Ryan and Locke, Emily and Yager, Chelsea and Smith, Matthew Lee and Jacobson, Bert and Boolani, Ali},
  title = {Manifestations of Anxiety in Gait},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {54},
  number = {9S},
  pages = {187},
  publisher = {Lippincott Williams \& Wilkins},
  year = {2022},
  month = {September},
  doi = {10.1249/01.mss.0000877404.18087.70},
  url = {https://doi.org/10.1249/01.mss.0000877404.18087.70}
}

  13. Human Vision-Empowered 3D Scene Analysis Tools

    Lap-Fai Yu, Haikun Huang

    Patent · U.S. Patent 11,421,993 · 2022

    A patented computational approach that uses human-vision considerations and agent-based simulation to generate and analyze effective wayfinding designs.

    Computational Design · Computer Vision · Wayfinding · Optimization

    BibTeX 
    @misc{Yu2022SceneAnalysisPatent,
  author = {Yu, Lap-Fai and Huang, Haikun},
  title = {Human Vision-Empowered {3D} Scene Analysis Tools},
  howpublished = {U.S. Patent 11,421,993},
  year = {2022},
  month = {August},
  note = {Issued August 23, 2022},
  url = {https://patents.google.com/patent/US11421993B2/en}
}
  14. Animated augmented-reality story elements adapting to the semantics of an indoor scene.

    Interactive Augmented Reality Storytelling Guided by Scene Semantics

    Changyang Li, Wanwan Li, Haikun Huang, Lap-Fai Yu

    Journal Article · ACM Transactions on Graphics 41(4), Article 91 / SIGGRAPH 2022 · 2022

    A scene-semantics-guided system that adapts interactive augmented-reality stories, characters, and objects to a user's surroundings.

    Augmented Reality · Storytelling · Scene Understanding · Graphics

    BibTeX 
    @article{Li2022ARStorytelling,
  author = {Li, Changyang and Li, Wanwan and Huang, Haikun and Yu, Lap-Fai},
  title = {Interactive Augmented Reality Storytelling Guided by Scene Semantics},
  journal = {ACM Transactions on Graphics},
  volume = {41},
  number = {4},
  pages = {1--15},
  articleno = {91},
  numpages = {15},
  publisher = {Association for Computing Machinery},
  year = {2022},
  month = {July},
  doi = {10.1145/3528223.3530061},
  url = {https://doi.org/10.1145/3528223.3530061}
}
  15. Comparison of virtual indoor scenes recolored to evoke different target moods.

    Mood-Driven Colorization of Virtual Indoor Scenes

    Co-First Author

    Michael S. Solah*, Haikun Huang*, Jiachuan Sheng, Tian Feng, Marc Pomplun, Lap-Fai Yu (*equal contribution)

    Journal Article · IEEE Transactions on Visualization and Computer Graphics 28(5), pp. 2058–2068 / IEEE VR 2022 · 2022

    An automatic method for recoloring textured virtual indoor scenes to evoke target moods while preserving visual coherence.

    Award: Best Journal Paper Nominee

    Virtual Reality · Colorization · Affective Computing · Graphics

    BibTeX 
    @article{Solah2022MoodDriven,
  author = {Solah, Michael S. and Huang, Haikun and Sheng, Jiachuan and Feng, Tian and Pomplun, Marc and Yu, Lap-Fai},
  title = {Mood-Driven Colorization of Virtual Indoor Scenes},
  journal = {IEEE Transactions on Visualization and Computer Graphics},
  volume = {28},
  number = {5},
  pages = {2058--2068},
  publisher = {IEEE},
  year = {2022},
  month = {May},
  doi = {10.1109/TVCG.2022.3150513},
  url = {https://doi.org/10.1109/TVCG.2022.3150513}
}
  16. Personalized virtual-reality construction safety training scenario in a simulated worksite.

    Synthesizing Personalized Construction Safety Training Scenarios for VR Training

    Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, Lap-Fai Yu

    Journal Article · IEEE Transactions on Visualization and Computer Graphics 28(5), pp. 1993–2002 / IEEE VR 2022 · 2022

    An optimization approach for generating personalized VR construction-safety scenarios and routes that target a trainee's learning needs.

    Virtual Reality · Construction Safety · Training · Optimization

    BibTeX 
    @article{Li2022ConstructionSafety,
  author = {Li, Wanwan and Huang, Haikun and Solomon, Tomay and Esmaeili, Behzad and Yu, Lap-Fai},
  title = {Synthesizing Personalized Construction Safety Training Scenarios for {VR} Training},
  journal = {IEEE Transactions on Visualization and Computer Graphics},
  volume = {28},
  number = {5},
  pages = {1993--2002},
  publisher = {IEEE},
  year = {2022},
  month = {May},
  doi = {10.1109/TVCG.2022.3150510},
  url = {https://doi.org/10.1109/TVCG.2022.3150510}
}

  17. Identifying Individuals Who Currently Report Feelings of Anxiety Using Walking Gait and Quiet Balance: An Exploratory Study Using Machine Learning

    Maggie Stark, Haikun Huang, Lap-Fai Yu, Rebecca Martin, Ryan McCarthy, Emily Locke, Chelsea Yager, Ahmed Ali Torad, Ahmed Mahmoud Kadry, Mostafa Ali Elwan, Matthew Lee Smith, Dylan Bradley, Ali Boolani

    Journal Article · Sensors 22(9), Article 3163 · 2022

    An exploratory machine-learning study using walking-gait and quiet-balance measures to identify individuals reporting current feelings of anxiety.

    Machine Learning · Gait · Balance · Anxiety

    BibTeX 
    @article{Stark2022AnxietyGaitBalance,
  author = {Stark, Maggie and Huang, Haikun and Yu, Lap-Fai and Martin, Rebecca and McCarthy, Ryan and Locke, Emily and Yager, Chelsea and Torad, Ahmed Ali and Kadry, Ahmed Mahmoud and Elwan, Mostafa Ali and Smith, Matthew Lee and Bradley, Dylan and Boolani, Ali},
  title = {Identifying Individuals Who Currently Report Feelings of Anxiety Using Walking Gait and Quiet Balance: An Exploratory Study Using Machine Learning},
  journal = {Sensors},
  volume = {22},
  number = {9},
  articleno = {3163},
  publisher = {MDPI},
  year = {2022},
  month = {April},
  doi = {10.3390/s22093163},
  url = {https://doi.org/10.3390/s22093163}
}

  18. Association between Self-Reported Prior Nights’ Sleep and Single-Task Gait in Healthy Young Adults: An Exploratory Study Using Machine Learning

    Billal Siddiq, Ali Boolani, Haikun Huang, Lap-Fai Yu, Maggie Stark, Zachary Grin, Chelsea C. Yager, Seema Teymouri, Dylan Bradley, Rebecca Martin, Joel Martin, Andreas Stamatis

    Conference Abstract · International Journal of Exercise Science: Conference Proceedings 2(14), Article 14 · 2022

    An exploratory conference study applying machine learning to associations between prior-night sleep and single-task gait in healthy young adults.

    Machine Learning · Gait · Sleep · Conference Abstract

    BibTeX 
    @article{Siddiq2022PriorNightsSleepAbstract,
  author = {Siddiq, Billal and Boolani, Ali and Huang, Haikun and Yu, Lap-Fai and Stark, Maggie and Grin, Zachary and Yager, Chelsea C. and Teymouri, Seema and Bradley, Dylan and Martin, Rebecca and Martin, Joel and Stamatis, Andreas},
  title = {Association between Self-Reported Prior Nights' Sleep and Single-Task Gait in Healthy Young Adults: An Exploratory Study Using Machine Learning},
  journal = {International Journal of Exercise Science: Conference Proceedings},
  volume = {2},
  number = {14},
  articleno = {14},
  year = {2022},
  month = {February},
  url = {https://digitalcommons.wku.edu/ijesab/vol2/iss14/14}
}
  19. Animated joint optimization of a workspace layout and the workplan performed within it.

    Joint Computational Design of Workspaces and Workplans

    Yongqi Zhang, Haikun Huang, Erion Plaku, Lap-Fai Yu

    Journal Article · ACM Transactions on Graphics 40(6), Article 228 / SIGGRAPH Asia 2021 · 2021

    A computational framework that jointly optimizes workspace layouts and workplans to improve task efficiency and usability.

    Computational Design · Optimization · Workspace · Graphics

    BibTeX 
    @article{Zhang2021Workspaces,
  author = {Zhang, Yongqi and Huang, Haikun and Plaku, Erion and Yu, Lap-Fai},
  title = {Joint Computational Design of Workspaces and Workplans},
  journal = {ACM Transactions on Graphics},
  volume = {40},
  number = {6},
  pages = {1--16},
  articleno = {228},
  numpages = {16},
  publisher = {Association for Computing Machinery},
  year = {2021},
  month = {December},
  doi = {10.1145/3478513.3480500},
  url = {https://doi.org/10.1145/3478513.3480500}
}
  20. Scene-aware teleport graph connecting meaningful locations inside a virtual environment.

    Synthesizing Scene-Aware Virtual Reality Teleport Graphs

    Changyang Li, Haikun Huang, Jyh-Ming Lien, Lap-Fai Yu

    Journal Article · ACM Transactions on Graphics 40(6), Article 229 / SIGGRAPH Asia 2021 · 2021

    A scene-aware method for constructing teleport graphs that support efficient and semantically meaningful movement through virtual environments.

    Virtual Reality · Locomotion · Scene Understanding · Graphics

    BibTeX 
    @article{Li2021TeleportGraphs,
  author = {Li, Changyang and Huang, Haikun and Lien, Jyh-Ming and Yu, Lap-Fai},
  title = {Synthesizing Scene-Aware Virtual Reality Teleport Graphs},
  journal = {ACM Transactions on Graphics},
  volume = {40},
  number = {6},
  pages = {1--15},
  articleno = {229},
  numpages = {15},
  publisher = {Association for Computing Machinery},
  year = {2021},
  month = {December},
  doi = {10.1145/3478513.3480478},
  url = {https://doi.org/10.1145/3478513.3480478}
}
  21. Motion-aware networked do-it-yourself holographic display prototype arranged on a desk.

    Building a Motion-Aware, Networked Do-It-Yourself Holographic Display

    Amilcar Gomez Samayoa*, Javier Talavera*, Siem G. Sium, Biao Xie, Haikun Huang, Lap-Fai Yu (*equal contribution)

    Conference Paper · IEEE International Conference on Intelligent Reality (ICIR) 2021 · 2021

    A low-cost, networked, motion-aware do-it-yourself holographic display designed for interactive intelligent-reality applications.

    Award: Second Place, Application Competition on Intelligent Reality (Students Track)

    Displays · Holography · Intelligent Reality · Prototyping

    BibTeX 
    @inproceedings{Samayoa2021HolographicDisplay,
  author = {Gomez Samayoa, Amilcar and Talavera, Javier and Sium, Siem G. and Xie, Biao and Huang, Haikun and Yu, Lap-Fai},
  title = {Building a Motion-Aware, Networked Do-It-Yourself Holographic Display},
  booktitle = {2021 IEEE International Conference on Intelligent Reality (ICIR)},
  publisher = {IEEE},
  year = {2021},
  month = {May},
  pages = {39--48},
  doi = {10.1109/ICIR51845.2021.00015},
  url = {https://doi.org/10.1109/ICIR51845.2021.00015}
}
  22. Automatic audio-description generation workflow for making video content more accessible.

    Toward Automatic Audio Description Generation for Accessible Videos

    Yujia Wang, Wei Liang, Haikun Huang, Yongqi Zhang, Dingzeyu Li, Lap-Fai Yu

    Conference Paper · ACM CHI 2021, Article 277 · 2021

    A system that identifies suitable insertion points and generates audio descriptions to make videos more accessible to blind and low-vision audiences.

    Accessibility · Audio Description · Video · HCI

    BibTeX 
    @inproceedings{Wang2021AudioDescription,
  author = {Wang, Yujia and Liang, Wei and Huang, Haikun and Zhang, Yongqi and Li, Dingzeyu and Yu, Lap-Fai},
  title = {Toward Automatic Audio Description Generation for Accessible Videos},
  booktitle = {Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '21},
  publisher = {Association for Computing Machinery},
  year = {2021},
  month = {May},
  pages = {1--12},
  articleno = {277},
  numpages = {12},
  doi = {10.1145/3411764.3445347},
  url = {https://doi.org/10.1145/3411764.3445347}
}
  23. Visual overview of application areas and research themes in virtual-reality skill training.

    A Review on Virtual Reality Skill Training Applications

    Biao Xie, Huimin Liu, Rawan Alghofaili, Yongqi Zhang, Yeling Jiang, Flavio Destri Lobo, Changyang Li, Wanwan Li, Haikun Huang, Mesut Akdere, Christos Mousas, Lap-Fai Yu

    Journal Article · Frontiers in Virtual Reality 2, Article 645153 · 2021

    A review of VR skill-training applications, their design and evaluation practices, application domains, and opportunities for future research.

    Virtual Reality · Training · Review · HCI

    BibTeX 
    @article{Xie2021VRTrainingReview,
  author = {Xie, Biao and Liu, Huimin and Alghofaili, Rawan and Zhang, Yongqi and Jiang, Yeling and Lobo, Flavio Destri and Li, Changyang and Li, Wanwan and Huang, Haikun and Akdere, Mesut and Mousas, Christos and Yu, Lap-Fai},
  title = {A Review on Virtual Reality Skill Training Applications},
  journal = {Frontiers in Virtual Reality},
  volume = {2},
  articleno = {645153},
  publisher = {Frontiers Media SA},
  year = {2021},
  month = {April},
  doi = {10.3389/frvir.2021.645153},
  url = {https://doi.org/10.3389/frvir.2021.645153}
}

  24. AI-Driven Computational Design Tools for Synthesizing Human-Centric Design

    First Author

    Haikun Huang

    Dissertation · University of Massachusetts Boston, Doctoral Dissertation 583 · 2020

    A doctoral dissertation presenting AI-driven computational tools that synthesize human-centric designs across wayfinding, immersive audio, and mixed-reality authoring.

    Award: Graduate Program Award

    Computational Design · Artificial Intelligence · Human-Centered Design · Graphics

    BibTeX 
    @phdthesis{Huang2020ComputationalDesignDissertation,
  author = {Huang, Haikun},
  title = {{AI}-Driven Computational Design Tools for Synthesizing Human-Centric Design},
  school = {University of Massachusetts Boston},
  address = {Boston, Massachusetts},
  year = {2020},
  month = {December},
  url = {https://scholarworks.umb.edu/doctoral_dissertations/583/}
}
  25. Mixed-reality interface for arranging and previewing artworks on a gallery wall.

    Interactive Design of Gallery Walls via Mixed Reality

    First Author

    Haikun Huang, Yuxuan Zhang, Tomer Weiss, Rebecca W. Perry, Lap-Fai Yu

    Conference Paper · IEEE AIVR 2020, pp. 17–26 · 2020

    A mixed-reality design tool that recommends, previews, and places artworks and other elements on gallery walls.

    Mixed Reality · Computational Design · Gallery · HCI

    BibTeX 
    @inproceedings{Huang2020GalleryWalls,
  author = {Huang, Haikun and Zhang, Yuxuan and Weiss, Tomer and Perry, Rebecca W. and Yu, Lap-Fai},
  title = {Interactive Design of Gallery Walls via Mixed Reality},
  booktitle = {2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)},
  publisher = {IEEE},
  year = {2020},
  month = {December},
  pages = {17--26},
  doi = {10.1109/AIVR50618.2020.00013},
  url = {https://doi.org/10.1109/AIVR50618.2020.00013}
}
  26. An exertion-aware route generated across a three-dimensional terrain for active virtual experiences.

    Exertion-Aware Path Generation

    Wanwan Li*, Biao Xie*, Yongqi Zhang, Walter Meiss, Haikun Huang, Lap-Fai Yu (*equal contribution)

    Journal Article · ACM Transactions on Graphics 39(4), Article 115 / SIGGRAPH 2020 · 2020

    An optimization method for generating routes over physical terrain that meet target exertion profiles for active virtual experiences.

    Virtual Reality · Exertion · Path Planning · Optimization

    BibTeX 
    @article{Li2020ExertionAware,
  author = {Li, Wanwan and Xie, Biao and Zhang, Yongqi and Meiss, Walter and Huang, Haikun and Yu, Lap-Fai},
  title = {Exertion-Aware Path Generation},
  journal = {ACM Transactions on Graphics},
  volume = {39},
  number = {4},
  pages = {115:1--115:14},
  articleno = {115},
  numpages = {14},
  publisher = {Association for Computing Machinery},
  year = {2020},
  month = {August},
  doi = {10.1145/3386569.3392393},
  url = {https://doi.org/10.1145/3386569.3392393}
}

  27. Effects of Exergaming on Cognition and Gait in Older Adults at Risk for Falling

    Elisa F. Ogawa, Haikun Huang, Lap-Fai Yu, Philimon N. Gona, Richard K. Fleming, Suzanne G. Leveille, Tongjian You

    Journal Article · Medicine & Science in Sports & Exercise 52(3), pp. 754–761 · 2020

    A pilot study examining the effects of exergaming on cognition and gait among older adults at risk for falling.

    Exergaming · Gait · Cognition · Older Adults

    BibTeX 
    @article{Ogawa2020Exergaming,
  author = {Ogawa, Elisa F. and Huang, Haikun and Yu, Lap-Fai and Gona, Philimon N. and Fleming, Richard K. and Leveille, Suzanne G. and You, Tongjian},
  title = {Effects of Exergaming on Cognition and Gait in Older Adults at Risk for Falling},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {52},
  number = {3},
  pages = {754--761},
  publisher = {Wolters Kluwer Health},
  year = {2020},
  month = {March},
  doi = {10.1249/MSS.0000000000002167},
  url = {https://doi.org/10.1249/MSS.0000000000002167}
}

  28. Feasibility and Acceptability of an Exergaming Intervention for Older Adults at Risk for Falls

    Elisa F. Ogawa, Haikun Huang, Lap-Fai Yu, Philimon N. Gona, Richard K. Fleming, Jonathan F. Bean, Suzanne G. Leveille, Tongjian You

    Conference Abstract · Innovation in Aging 3(Suppl. 1), p. S430 · 2019

    A conference abstract evaluating the feasibility and acceptability of an exergaming intervention for older adults at risk for falls.

    Exergaming · Older Adults · Fall Risk · Conference Abstract

    BibTeX 
    @article{Ogawa2019ExergamingFeasibilityAbstract,
  author = {Ogawa, Elisa F. and Huang, Haikun and Yu, Lap-Fai and Gona, Philimon N. and Fleming, Richard K. and Bean, Jonathan F. and Leveille, Suzanne G. and You, Tongjian},
  title = {Feasibility and Acceptability of an Exergaming Intervention for Older Adults at Risk for Falls},
  journal = {Innovation in Aging},
  volume = {3},
  number = {Supplement 1},
  pages = {S430},
  publisher = {Oxford University Press},
  year = {2019},
  month = {November},
  doi = {10.1093/geroni/igz038.1609},
  url = {https://doi.org/10.1093/geroni/igz038.1609}
}

  29. Physiological Responses and Enjoyment of Kinect-Based Exergames in Older Adults at Risk for Falls: A Feasibility Study

    Elisa Ogawa, Haikun Huang, Lap-Fai Yu, Tongjian You

    Journal Article · Technology and Health Care 27(4), pp. 353–362 · 2019

    A feasibility study measuring physiological responses and enjoyment during Kinect-based exergames among older adults at risk for falls.

    Exergaming · Older Adults · Physiological Response · Fall Risk

    BibTeX 
    @article{Ogawa2019KinectFeasibility,
  author = {Ogawa, Elisa and Huang, Haikun and Yu, Lap-Fai and You, Tongjian},
  title = {Physiological Responses and Enjoyment of Kinect-Based Exergames in Older Adults at Risk for Falls: A Feasibility Study},
  journal = {Technology and Health Care},
  volume = {27},
  number = {4},
  pages = {353--362},
  publisher = {IOS Press},
  year = {2019},
  month = {July},
  doi = {10.3233/THC-191634},
  url = {https://doi.org/10.3233/THC-191634}
}

  30. Effects of Exergaming on Cognition and Dual-Task Mobility in Older Adults at Risk for Falling

    Elisa F. Ogawa, Haikun Huang, Lap-Fai Yu, Philimon N. Gona, Richard K. Fleming, Suzanne G. Leveille, Tongjian You

    Conference Abstract · Medicine & Science in Sports & Exercise 51(6S), p. 618 · 2019

    A conference abstract reporting the effects of exergaming on cognition and dual-task mobility in older adults at risk for falling.

    Exergaming · Cognition · Mobility · Conference Abstract

    BibTeX 
    @article{Ogawa2019ExergamingCognitionAbstract,
  author = {Ogawa, Elisa F. and Huang, Haikun and Yu, Lap-Fai and Gona, Philimon N. and Fleming, Richard K. and Leveille, Suzanne G. and You, Tongjian},
  title = {Effects of Exergaming on Cognition and Dual-Task Mobility in Older Adults at Risk for Falling},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {51},
  number = {6S},
  pages = {618},
  publisher = {Lippincott Williams \& Wilkins},
  year = {2019},
  month = {June},
  doi = {10.1249/01.mss.0000562348.10264.5a},
  url = {https://doi.org/10.1249/01.mss.0000562348.10264.5a}
}
  31. Animated spatial sound sources generated automatically for a panoramic virtual environment.

    Audible Panorama: Automatic Spatial Audio Generation for Panorama Imagery

    First Author

    Haikun Huang*, Michael S. Solah*, Dingzeyu Li, Lap-Fai Yu (*equal contribution)

    Conference Paper · ACM CHI 2019, Article 621 · 2019

    A system that analyzes 360-degree imagery and automatically places spatial sound sources to create an audible panorama.

    Virtual Reality · Spatial Audio · Panorama · Computer Vision

    BibTeX 
    @inproceedings{Huang2019AudiblePanorama,
  author = {Huang, Haikun and Solah, Michael S. and Li, Dingzeyu and Yu, Lap-Fai},
  title = {Audible Panorama: Automatic Spatial Audio Generation for Panorama Imagery},
  booktitle = {Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '19},
  publisher = {Association for Computing Machinery},
  year = {2019},
  month = {May},
  pages = {1--11},
  articleno = {621},
  numpages = {11},
  doi = {10.1145/3290605.3300851},
  url = {https://doi.org/10.1145/3290605.3300851}
}
  32. Animated gaze-driven navigation aid appearing when a user becomes lost in a virtual street scene.

    Lost in Style: Gaze-driven Adaptive Aid for VR Navigation

    Rawan Alghofaili, Yasuhito Sawahata, Haikun Huang, Hsueh-Cheng Wang, Takaaki Shiratori, Lap-Fai Yu

    Conference Paper · ACM CHI 2019, Article 348 · 2019

    A gaze-driven system that predicts when a VR user needs navigational assistance and adaptively presents guidance.

    Virtual Reality · Navigation · Eye Tracking · Adaptive Systems

    BibTeX 
    @inproceedings{Alghofaili2019LostInStyle,
  author = {Alghofaili, Rawan and Sawahata, Yasuhito and Huang, Haikun and Wang, Hsueh-Cheng and Shiratori, Takaaki and Yu, Lap-Fai},
  title = {Lost in Style: Gaze-Driven Adaptive Aid for {VR} Navigation},
  booktitle = {Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '19},
  publisher = {Association for Computing Machinery},
  year = {2019},
  month = {May},
  pages = {1--12},
  articleno = {348},
  numpages = {12},
  doi = {10.1145/3290605.3300578},
  url = {https://doi.org/10.1145/3290605.3300578}
}
  33. Animated virtual-reality level generated around target body poses and movement goals.

    Pose-Guided Level Design

    Yongqi Zhang*, Biao Xie*, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu (*equal contribution)

    Conference Paper · ACM CHI 2019, Article 554 · 2019

    An optimization approach that synthesizes virtual-reality game levels around target body poses and movement goals.

    Award: CHI 2019 Best Paper Honorable Mention

    Virtual Reality · Level Design · Pose · Optimization

    BibTeX 
    @inproceedings{Zhang2019PoseGuided,
  author = {Zhang, Yongqi and Xie, Biao and Huang, Haikun and Ogawa, Elisa F. and You, Tongjian and Yu, Lap-Fai},
  title = {Pose-Guided Level Design},
  booktitle = {Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems},
  series = {CHI '19},
  publisher = {Association for Computing Machinery},
  year = {2019},
  month = {May},
  pages = {1--12},
  articleno = {554},
  numpages = {12},
  doi = {10.1145/3290605.3300784},
  url = {https://doi.org/10.1145/3290605.3300784}
}
  34. Virtual visual elements placed using predictions derived from eye-gaze and visual-attention data.

    Optimizing Visual Element Placement via Visual Attention Analysis

    Rawan Alghofaili, Michael S. Solah, Haikun Huang, Yasuhito Sawahata, Marc Pomplun, Lap-Fai Yu

    Conference Paper · IEEE VR 2019, pp. 464–473 · 2019

    A data-driven optimization method that uses visual-attention evidence to improve the placement of virtual visual elements.

    Virtual Reality · Visual Attention · Eye Tracking · Optimization

    BibTeX 
    @inproceedings{Alghofaili2019VisualPlacement,
  author = {Alghofaili, Rawan and Solah, Michael S. and Huang, Haikun and Sawahata, Yasuhito and Pomplun, Marc and Yu, Lap-Fai},
  title = {Optimizing Visual Element Placement via Visual Attention Analysis},
  booktitle = {2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)},
  publisher = {IEEE},
  year = {2019},
  month = {March},
  pages = {464--473},
  doi = {10.1109/VR.2019.8797816},
  url = {https://doi.org/10.1109/VR.2019.8797816}
}
  35. Optimized directional signs supporting wayfinding through a complex virtual environment.

    Automatic Optimization of Wayfinding Design

    First Author

    Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

    Journal Article · IEEE Transactions on Visualization and Computer Graphics 24(9), pp. 2516–2530 · 2018

    An optimization framework that automatically places and configures wayfinding signs to improve navigation through complex environments.

    Virtual Reality · Wayfinding · Visual Attention · Optimization

    BibTeX 
    @article{Huang2018Wayfinding,
  author = {Huang, Haikun and Lin, Ni-Ching and Barrett, Lorenzo and Springer, Darian and Wang, Hsueh-Cheng and Pomplun, Marc and Yu, Lap-Fai},
  title = {Automatic Optimization of Wayfinding Design},
  journal = {IEEE Transactions on Visualization and Computer Graphics},
  volume = {24},
  number = {9},
  pages = {2516--2530},
  publisher = {IEEE},
  year = {2018},
  month = {September},
  doi = {10.1109/TVCG.2017.2761820},
  url = {https://doi.org/10.1109/TVCG.2017.2761820}
}
  36. Robotic guide dog following a pedestrian trail to support blind and visually impaired travelers.

    Deep Trail-Following Robotic Guide Dog in Pedestrian Environments for People Who Are Blind and Visually Impaired—Learning from Virtual and Real Worlds

    Tzu-Kuan Chuang, Ni-Ching Lin, Jih-Shi Chen, Chen-Hao Hung, Yi-Wei Huang, Chunchih Teng, Haikun Huang, Lap-Fai Yu, Laura Giarré, Hsueh-Cheng Wang

    Conference Paper · IEEE ICRA 2018, pp. 5849–5855 · 2018

    A deep-learning robotic guide-dog system trained with virtual and real-world data to follow pedestrian trails for blind and visually impaired users.

    Robotics · Accessibility · Deep Learning · Navigation

    BibTeX 
    @inproceedings{Chuang2018GuideDog,
  author = {Chuang, Tzu-Kuan and Lin, Ni-Ching and Chen, Jih-Shi and Hung, Chen-Hao and Huang, Yi-Wei and Teng, Chunchih and Huang, Haikun and Yu, Lap-Fai and Giarr{\'e}, Laura and Wang, Hsueh-Cheng},
  title = {Deep Trail-Following Robotic Guide Dog in Pedestrian Environments for People Who Are Blind and Visually Impaired---Learning from Virtual and Real Worlds},
  booktitle = {2018 IEEE International Conference on Robotics and Automation (ICRA)},
  publisher = {IEEE},
  year = {2018},
  month = {May},
  pages = {5849--5855},
  doi = {10.1109/ICRA.2018.8460994},
  url = {https://doi.org/10.1109/ICRA.2018.8460994}
}

  37. Safety, Enjoyment, and Physiological Responses of Kinect-Based Exergames in Older Adults at Risk for Falls

    Elisa F. Ogawa, Haikun Huang, Lap-Fai Yu, Tongjian You

    Conference Abstract · Medicine & Science in Sports & Exercise 50(5S), p. 93 · 2018

    A conference abstract assessing safety, enjoyment, and physiological responses to Kinect-based exergames in older adults at risk for falls.

    Exergaming · Older Adults · Physiological Response · Conference Abstract

    BibTeX 
    @article{Ogawa2018KinectSafetyAbstract,
  author = {Ogawa, Elisa F. and Huang, Haikun and Yu, Lap-Fai and You, Tongjian},
  title = {Safety, Enjoyment, and Physiological Responses of Kinect-Based Exergames in Older Adults at Risk for Falls},
  journal = {Medicine \& Science in Sports \& Exercise},
  volume = {50},
  number = {5S},
  pages = {93},
  publisher = {Lippincott Williams \& Wilkins},
  year = {2018},
  month = {May},
  doi = {10.1249/01.mss.0000535390.95056.36},
  url = {https://doi.org/10.1249/01.mss.0000535390.95056.36}
}
  38. Animated exercise-intensity-driven level design for a motion-based virtual-reality game.

    Exercise Intensity-Driven Level Design

    Biao Xie*, Yongqi Zhang*, Haikun Huang, Elisa Ogawa, Tongjian You, Lap-Fai Yu (*equal contribution)

    Journal Article · IEEE Transactions on Visualization and Computer Graphics 24(4), pp. 1661–1670 · 2018

    A trans-dimensional optimization method that assembles game segments into levels designed to elicit target exercise-intensity profiles.

    Virtual Reality · Exergaming · Level Design · Optimization

    BibTeX 
    @article{Xie2018ExerciseIntensity,
  author = {Xie, Biao and Zhang, Yongqi and Huang, Haikun and Ogawa, Elisa F. and You, Tongjian and Yu, Lap-Fai},
  title = {Exercise Intensity-Driven Level Design},
  journal = {IEEE Transactions on Visualization and Computer Graphics},
  volume = {24},
  number = {4},
  pages = {1661--1670},
  publisher = {IEEE},
  year = {2018},
  month = {April},
  doi = {10.1109/TVCG.2018.2793618},
  url = {https://doi.org/10.1109/TVCG.2018.2793618}
}
  39. Virtual environment used to analyze visual attention to directional wayfinding signs.

    Analyzing Visual Attention via Virtual Environments

    First Author

    Haikun Huang, Ni-Ching Lin, Lorenzo Barrett, Darian Springer, Hsueh-Cheng Wang, Marc Pomplun, Lap-Fai Yu

    Workshop Paper · SIGGRAPH Asia 2016 Workshop on Virtual Reality Meets Physical Reality, Article 8 · 2016

    A virtual-environment platform for analyzing visual attention to directional signage and informing wayfinding design.

    Virtual Reality · Visual Attention · Wayfinding · Eye Tracking

    BibTeX 
    @inproceedings{Huang2016VisualAttention,
  author = {Huang, Haikun and Lin, Ni-Ching and Barrett, Lorenzo and Springer, Darian and Wang, Hsueh-Cheng and Pomplun, Marc and Yu, Lap-Fai},
  title = {Analyzing Visual Attention via Virtual Environments},
  booktitle = {SIGGRAPH Asia 2016 Virtual Reality Meets Physical Reality: Modelling and Simulating Virtual Humans and Environments},
  series = {SA '16},
  publisher = {Association for Computing Machinery},
  year = {2016},
  month = {November},
  pages = {1--2},
  articleno = {8},
  numpages = {2},
  doi = {10.1145/2992138.2992152},
  url = {https://doi.org/10.1145/2992138.2992152}
}