Xingbo Wang
xingbo.wang@connect.ust.hk
+852-46408091
andy-xingbowang.com
RESEARCH INTERESTS
Data Visualization, Human-Computer Interaction, Natural Language Processing
I design and develop interactive systems for human-centered AI, which 1) investigate the multimodality of human
languages in communication; 2) generate relatable and scalable explanations of AI models by aligning model
behavior with human reasoning; and 3) promote natural human-AI communication and feedback for better
decision-making.
EDUCATION
2018-2022 Ph.D. in Computer Science, Hong Kong University of Science and Technology, Hong Kong
Advisor: Prof. Huamin Qu
2014-2018 B.Eng. in Geographic Information System, Wuhan University, Wuhan, China
APPOINTMENTS
2023– Cornell Univerisity
Postdoctoral Fellow, Department of Population Health Sciences,
Institute of AI for Digital Health, Weill Cornell Medicine
2022–23 Hong Kong University of Science and Technology
Postdoctoral Fellow, Department of Computer Science and Engineering
PUBLICATIONS
Undelined indicates students I mentored; (†) indicates equal contribution; (*) indicates corresponding author.
Peer-reviewed Conferen ces and Journ al Papers
2023 P1 Xingbo Wang, Renfei Huang, Zhihua Jin, Tianqing Fnag, Huamin Qu. “CommonsenseVIS:
Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language Models.”
IEEE Transactions on Visualization and Computer Graphics (VIS’ 23).
TVCG 2023, To Appear
2023 P2 Xingbo Wang †, Zhenhui Peng †, Qiushi Han, Junkai Zhu, Xiaojuan Ma, Huamin Qu. “Storyer:
Exploring Vocabulary Learning Support with Text Generation Models.” The 2023 ACM Symposium on
User Interface Software and Technology, pp. 1–16.
UIST 2023
2023 P3 Jianben He, Xingbo Wang*, Kam Kwai Wong, Xijie Huang, Changjian Chen, Zixin Chen, Fengjie
Wang, Min Zhu, Huamin Qu. “VideoPro: A Visual Analytics Approach for Interactive Video
Programming.” IEEE Transactions on Visualization and Computer Graphics (VIS’ 23).
TVCG 2023, To Appear
2023 P4 Yingchaojie Feng, Xingbo Wang, Kam Kwai Wong, Sijia Wang, Yuhong Lu, Minfeng Zhu, Baicheng
Wang, Wei Chen. “PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation.”
IEEE Transactions on Visualization and Computer Graphics (VIS’ 23).
TVCG 2023, To Appear
1
2023 P5
Yuchen Wu, Yuansong Xu, Shenghan Gao, Xingbo Wang, Wenkai Song, Zhiheng Nie, Xiaomeng Fan,
Quan Li. “LiveRetro: Visual Analytics for Strategic Retrospect in Livestream E-Commerce.” IEEE
Transactions on Visualization and Computer Graphics (VIS’ 23).
TVCG 2023, To Appear
2023 P6 Jason K. Wong, Xingbo Wang, Yong Wang, Jianben He, Rong Zhang, Huamin Qu. “Anchorage:
Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events.” IEEE Transactions on
Visualization and Computer Graphics.
TVCG 2023, To Appear
2023 P7
Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe
Morency, Ruslan Salakhutdinov. “MultiViz: An Analysis Benchmark for Visualizing and
Understanding Multimodal Models.” Eleventh International Conference on Learning Representations.
ICLR 2023
2023 P8 Yingchaojie Feng, Xingbo Wang, Bo Pan, Jason K. Wong, Yi Ren, Shi Liu, Zihan Yan, Yuxin Ma,
Huamin Qu, and Wei Chen. “XNLI: Explaining and Diagnosing NLI-Based Visual Data Analysis.”
IEEE Transactions on Visualization and Computer Graphics.
TVCG 2023, To Appear
2023 P9 Zhihua Jin, Xingbo Wang, Furui Cheng, Chunhui Sun, Qun Liu, Huamin Qu. “ShortcutLens: A
Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset.”
IEEE Transactions on Visualization and Computer Graphics.
TVCG 2023, To Appear
2022 P10
Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu, Ting-Chuen Pong, Huamin Qu. “GestureLens:
Visual Analysis of Gestures in Presentation Videos.” IEEE Transactions on Visualization and Computer
Graphics, 29(8), pp. 3685–3697.
TVCG 2023
2022 P11 Meng Xia, Qian Zhu, Xingbo Wang, Fei Nie, Huamin Qu, Xiaojuan Ma. “Persua: A Visual
Interactive System to Enhance the Persuasiveness of Arguments in Online Discussion.” Proceedings of
the ACM on Human-Computer Interaction, 6(CSCW2), pp.1-30. (CSCW’ 22).
CSCW 2022
2021 P12 Xingbo Wang, Jianben He, Zhihua Jin, Muqiao Yang, Yong Wang, Huamin Qu. “M
2
Lens:
Visualizing and Explaining Multimodal Models for Sentiment Analysis.” IEEE Transactions on
Visualization and Computer Graphics, 28(1), pp.802-812. (VIS’ 21).
TVCG 2021 (Best Paper Honorable Mention@VIS’21 3)
2021 P13 Xingbo Wang, Yao Ming, Tongshuang Wu, Haipeng Zeng, Yong Wang, Huamin Qu. “DeHumor:
Visual Analytics for Decomposing Humor.” IEEE Transactions on Visualization and Computer
Graphics, 28(12), pp.4609-4623.
TVCG 2021
2020 P14 Xingbo Wang, Haipeng Zeng, Yong Wang, Aoyu Wu, Zhida Sun, Xiaojuan Ma, Huamin Qu.
“VoiceCoach : Interactive Evidence-based Training for Voice Modulation Skills in Public Speaking.” The
2020 Conference on Human Factors in Computing Systems, pp.1-12.
CHI 2020
2019 P15
Haipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Alex Endert, Huamin Qu. “EmoCo :
Visual Analysis of Emotion Coherence in Presentation Videos.” IEEE Transactions on Visualization
and Computer Graphics, 26(1), pp.927-937. (VIS’ 19).
TVCG 2019
2019 P16 Yahui Liu, Jian Yao, Xiaohu Lu, Menghan Xia, Xingbo Wang, Yuan Liu. “RoadNet: Learning to
Comprehensively Analyze Road Networks in Complex Urban Scenes From High-Resolution Remotely
Sensed Images.” IEEE Transactions on Geoscience and Remote Sensing, 57(4), pp.2043-2056.
TGRS 2019
2
Pre prints and Manuscript s
2023 P17 Xingbo Wang, Furui Cheng, Yong Wang, Ke Xu, Jiang Long, Hong Lu, Huamin Qu. “Interactive
Data Analysis with Next-step Natural Language Query Recommendation.” Submitted to IEEE
Transactions on Visualization and Computer Graphics.
Under review at TVCG
2023 P18 Qiaoyi Chen, Siyu Liu, Kaihui Huang, Zhenhui Peng, Xingbo Wang, Xiaojuan Ma. “RetAssist:
Facilitating Vocabulary Learners with Generative Images and Adaptive Assistance in Story Retelling
Practices.”
Under review
2023 P19 Jianben He, Rui Sheng, Xingbo Wang, Xinhuan Shu, Jason K. Wong, Huamin Qu. “Engager: A
Visual Analytics System for Multi-person and Multimodal Engagement Analysis in Online Teaching
Videos.” Submitted to IEEE Transactions on Visualization and Computer Graphics.
Under review at TVCG
2023 P20 Shiyi Liu, Gongyan Chen, Shiying Ni, Ruofei Ma, Chenyi Zhang, Fei Luo, Xingbo Wang, Quan Li.
“Optimizing Design and Content Marketing Strategies for Fashion Products with FashionCook: A
Visual Analytics Approach.”
Under review
2021 P21 Zhihua Jin
, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu. “NumGPT:
Improving Numeracy Ability of Generative Pre-trained Models.”
arXiv Preprint
Posters , Extended Abstracts, and Workshop Papers
2022 P22
Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe
Morency, Ruslan Salakhutdinov. “MultiViz: Towards User-Centric Visualizations and Interpretable
Multimodal Models.” Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing
Systems.
CHI EA 2023
2022 P23
Ka Yan Fung, Zikai Alex Wen, Haotian Li, Xingbo Wang, Shenghui Song, Huamin Qu. “Designing a
Data Visualization Dashboard for Pre-Screening Hong Kong Students with Specic Learning
Disabilities.” Proceedings of the 24th International ACM SIGACCESS Conference on Computers and
Accessibility.
ASSETS Poster 2022
AWARDS AND HONORS
Awards
2023 Special Recognitions for Outstanding Reviews
ACM CSCW 2023; CHI 2024
2021 Best Paper Honorable Mention Award
IEEE VIS 2021
2021 Silver Award, The 6th China International College Students’ “Internet+” Innovation and
Entrepreneurship Competition
Ministry of Education of China
2020 Silver Award, The 12th “Challenge Cup” National College Student Business Plan Competition
Ministry of Education of China
2017 Role Models of Wuhan University, 4/408 national scholarship winners
Wuhan University
3
Scholarships
2020 SENG Academic Award for Continuing PhD Students
HKUST
2017 National Scholarship
Ministry of Education of China
2015 National Scholarship
Ministry of Education of China
GRANTS
2023– AI-assisted Virtual Reality English Speaking Program for Secondary Students
Co-PI, HKD $30,000,000, Quality Education Fund, Hong Kong
PATENTS
2022 PT1 Jason K. Wong, Xingbo Wang, Yong Wang, Jianben He, Rong Zhang, Huamin Qu. “Method and
System for Visual Analysis and Evaluation of Customer Satisfaction Levels in Service Videos.”
US Provisional Patent, 2022
Under review of China Patent, 2022
PT2 Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu, Ting Chuen Pong, Huamin Qu. “System and
Method for Visual Analysis of Gestures in Videos.”
Filing a US patent, 2022
PT3 Xingbo Wang, Jianben He, Zhihua Jin, Huamin Qu, Rong Zhang. “A System for Visualizing and
Explaining Multimodal Models for Sentiment Analysis.”
US Provisional Patent, 2021
Under review of China Patent, 2022
2021 PT4 Haipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Huamin Qu. “System and Method
for Visual Analysis of Emotional Coherence in Videos.”
EU Patent, 2021
PT5 Xingbo Wang, Ruixing Shi. “System and Method for Stereo-Inertial SLAM for Trajectory Recovery
and 3D Wireframe Reconstruction.”
China Patent, 2021
INVITED TALKS
2023 Unlease the Power of Data-driven AI through Explanations and Interactions
School of Articial Intelligence, Sun Yat-sen University University (June 2023)
ViSeer Lab, School of Information Science and Technology, ShanghaiTech University (May 2023)
Interactive Data Group, State Key Lab of CAD&CG, Zhejiang University (May 2023)
Guest talk at MSBD 5005: Data Visualization, HKUST (May 2023)
Population Health Sciences, Weill Cornell Medicine, Cornell University (Feb. 2023)
2022 Interactive Visual Analytics for Multimodal Human Communication
Ubicomp Lab, National Univerisity of Singapore (Jul. 2022)
4
2021 Visualizing and Explaining Multimodal Models for Sentiment Analysis
ChinaVis 2021, Wuhan, China (Jul., 2021)
IEEE VIS China Pre-conference Sharing, Virtual, China (Oct. 2021)
Intelligent User Interface for Natural Language Analysis
Intelligent Data Group (IDG), Zhejiang University, China (Jul. 2021)
MENTORING EXPERIENCE
Doctoral st udents
2023– Luoxuan Weng (Zhejiang University CST, co-advised with Prof. Wei Chen)
2022– Yingchaojie Feng (Zhejiang University CST, co-advised with Prof. Wei Chen)
2022– Rui Sheng (HKUST CSE, co-advised with Prof. Huamin Qu)
2021– Zhihua Jin (HKUST CSE, co-advised with Prof. Huamin Qu)
2021–2023 Chuhan Shi (HKUST CSE, co-advised with Prof. Xiaojuan Ma)
Now Assistant Professor at Southeast University
2020– Jianben He, (HKUST CSE, co-advised with Prof. Huamin Qu)
Master stud ents
2022 Ayush Gupta (HKUST CSE Mphil)
2020 Winnie Lam (HKUST TLE Mphil)
2019 Xiaoxue Ma (HKUST CSE Msc)
Und ergraudates
2023 Qiaoyi Chen, Siyu Liu, Kaihui Huang (Sun Yat-sen University (SYSU))
PROFESSIONAL SERVICES
Conference reviewing
2021–2023 IEEE VIS
2022–2023 NeurIPS
2021–2024 ACM CHI, CHI LBW (2022)
(Special recognition for outstanding reviews CHI 2024)
2022–2023 ACM UIST
2022–2023 ACM CSCW
(Special recognition for outstanding reviews CSCW 2023)
2021 EuroVIS
2021–2024 PacicVIS
2019–2023 ChinaVIS
5
Journal reviewing
2023 ACM Transactions on Intelligent Systems and Technology (TIST)
2023 International Journal of Human-Computer Interaction (IJHCI)
2021–2022 IEEE Transactions on Visualization and Computer Graphics (TVCG)
2023 Journal of Biomedical Informatics (JBI)
2023 Visual Informatics (VI)
Community Service
2022 Student volunteer captain, IEEE VIS’ 22
2021 Student volunteer, IEEE VIS’ 21
TEACHING EXPERIENCE
Hong Kong University of Science and Technology
Spring 2022 COMP 4451: Game Programming
Fall 2021 Fall 2021 COMP 1021: Introduction to Computer Science
Fall 2020 Fall 2020 COMP 1022Q: Introduction to Computing with Excel VBA
Updated November 2023
6