Xingbo Wang
xingbo.wang@connect.ust.hk
+852-46408091
andy-xingbowang.com
RESEARCH INTERESTS
Data Visualization, Human-Computer Interaction, Natural Language Processing
I design and develop interactive systems for human-centered AI, which 1) investigate the multimodality of human
languages in communication; 2) generate relatable and scalable explanations of AI models by aligning model
behavior with human reasoning; and 3) promote natural human-AI communication and feedback for better
decision-making.
EDUCATION
2018-2022 Ph.D. in Computer Science, Hong Kong University of Science and Technology, Hong Kong
Advisor: Prof. Huamin Qu
2014-2018 B.Eng. in Geographic Information System, Wuhan University, Wuhan, China
APPOINTMENTS
2023– Cornell Univerisity
Postdoctoral Fellow, Department of Population Health Sciences,
Institute of AI for Digital Health, Weill Cornell Medicine
2022–23 Hong Kong University of Science and Technology
Postdoctoral Fellow, Department of Computer Science and Engineering
PUBLICATIONS
Peer-reviewed Conferen ces and Journ al Papers
2023 P1 Jason K. Wong, Xingbo Wang, Yong Wang, Jianben He, Rong Zhang, Huamin Qu. Anchorage:
Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events.” IEEE Transactions on
Visualization and Computer Graphics.
TVCG 2023, To Appear
2023 P2
Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe
Morency, Ruslan Salakhutdinov. “MultiViz: An Analysis Benchmark for Visualizing and
Understanding Multimodal Models.” Eleventh International Conference on Learning Representations.
ICLR 2023
2023 P3 Yingchaojie Feng, Xingbo Wang, Bo Pan, Jason K. Wong, Yi Ren, Shi Liu, Zihan Yan, Yuxin Ma,
Huamin Qu, and Wei Chen. “XNLI: Explaining and Diagnosing NLI-Based Visual Data Analysis.”
IEEE Transactions on Visualization and Computer Graphics.
TVCG 2023, To Appear
2023 P4 Zhihua Jin, Xingbo Wang, Furui Cheng, Chunhui Sun, Qun Liu, Huamin Qu. “ShortcutLens: A
Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset.”
IEEE Transactions on Visualization and Computer Graphics.
TVCG 2023, To Appear
1
2022 P5
Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu, Ting-Chuen Pong, Huamin Qu. “GestureLens:
Visual Analysis of Gestures in Presentation Videos.” IEEE Transactions on Visualization and Computer
Graphics.
TVCG 2023, To Appear
2022 P6 Meng Xia, Qian Zhu, Xingbo Wang, Fei Nie, Huamin Qu, Xiaojuan Ma. “Persua: A Visual
Interactive System to Enhance the Persuasiveness of Arguments in Online Discussion.” The 25th ACM
Conference On Computer Supported Cooperative Work And Social Computing.
CSCW 2022
2021 P7
Xingbo Wang, Jianben He, Zhihua Jin, Muqiao Yang, Yong Wang, Huamin Qu. “M
2
Lens: Visualizing
and Explaining Multimodal Models for Sentiment Analysis.” IEEE Transactions on Visualization and
Computer Graphics (VIS’ 21).
TVCG 2021 (Best Paper Honorable Mention@VIS’21 3)
2021 P8 Xingbo Wang, Yao Ming, Tongshuang Wu, Haipeng Zeng, Yong Wang, Huamin Qu. “DeHumor :
Visual Analytics for Decomposing Humor.” IEEE Transactions on Visualization and Computer
Graphics.
TVCG 2021
2020 P9 Xingbo Wang, Haipeng Zeng, Yong Wang, Aoyu Wu, Zhida Sun, Xiaojuan Ma, Huamin Qu.
“VoiceCoach : Interactive Evidence-based Training for Voice Modulation Skills in Public Speaking.” The
2020 Conference on Human Factors in Computing Systems.
CHI 2020
2019 P10
Haipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Alex Endert, Huamin Qu. “EmoCo :
Visual Analysis of Emotion Coherence in Presentation Videos.” IEEE Transactions on Visualization
and Computer Graphics (VIS 2019).
TVCG 2019
2019 P11 Yahui Liu, Jian Yao, Xiaohu Lu, Menghan Xia, Xingbo Wang, Yuan Liu. “RoadNet: Learning to
Comprehensively Analyze Road Networks in Complex Urban Scenes From High-Resolution Remotely
Sensed Images.” IEEE Transactions on Geoscience and Remote Sensing.
TGRS 2019
Pre prints and Manuscript s
2023 P12 Xingbo Wang, Furui Cheng, Yong Wang, Ke Xu, Jiang Long, Hong Lu, Huamin Qu. “Interactive
Data Analysis with Next-step Natural Language Query Recommendation.” Submitted to IEEE
Transactions on Visualization and Computer Graphics.
Under review at TVCG
2023 P13 Xingbo Wang, Renfei Huang, Zhihua Jin, Tianqing Fang, Huamin Qu. “CommonsenseVIS:
Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language Models.”
Under review
2023 P14 Xingbo Wang, Zhenhui Peng, Qiushi Han, Junkai Zhu, Xiaojuan Ma, Huamin Qu. “Storyer:
Exploring Vocabulary Learning Support with Text Generation Models.”
Under review
2023 P15 Qiaoyi Chen, Siyu Liu, Kaihui Huang, Zhenhui Peng, Xingbo Wang, Xiaojuan Ma. “RetAssist:
Facilitating Vocabulary Learners with Generative Images and Adaptive Assistance in Story Retelling
Practices.”
Under review
2023 P16 Jianben He, Rui Sheng, Xingbo Wang, Xinhuan Shu, Jason K. Wong, Huamin Qu. “Engager: A
Visual Analytics System for Multi-person and Multimodal Engagement Analysis in Online Teaching
Videos.” Submitted to IEEE Transactions on Visualization and Computer Graphics.
Under review at TVCG
2
2023 P17 Shiyi Liu, Gongyan Chen, Shiying Ni, Ruofei Ma, Chenyi Zhang, Fei Luo, Xingbo Wang, Quan Li.
“Optimizing Design and Content Marketing Strategies for Fashion Products with FashionCook: A
Visual Analytics Approach.”
Under review
2021 P18
Zhihua Jin, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu. “NumGPT:
Improving Numeracy Ability of Generative Pre-trained Models.”
arXiv Preprint
Posters , Extended Abstracts, and Workshop Papers
2022 P19
Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe
Morency, Ruslan Salakhutdinov. “MultiViz: Towards User-Centric Visualizations and Interpretable
Multimodal Models.” Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing
Systems.
CHI EA 2023
2022 P20
Ka Yan Fung, Zikai Alex Wen, Haotian Li, Xingbo Wang, Shenghui Song, Huamin Qu. “Designing a
Data Visualization Dashboard for Pre-Screening Hong Kong Students with Specic Learning
Disabilities.” Proceedings of the 24th International ACM SIGACCESS Conference on Computers and
Accessibility.
ASSETS Poster 2022
AWARDS AND HONORS
Awards
2023 Special Recognitions for Outstanding Reviews
ACM CSCW 2023
2021 Best Paper Honorable Mention Award
IEEE VIS 2021
2021 Silver Award, The 6th China International College Students’ “Internet+” Innovation and
Entrepreneurship Competition
Ministry of Education of China
2020 Silver Award, The 12th “Challenge Cup” National College Student Business Plan Competition
Ministry of Education of China
2017 Role Models of Wuhan University, 4/408 national scholarship winners
Wuhan University
Scholarships
2020 SENG Academic Award for Continuing PhD Students
HKUST
2017 National Scholarship
Ministry of Education of China
2015 National Scholarship
Ministry of Education of China
PATENTS
2022 PT1 Jason K. Wong, Xingbo Wang, Yong Wang, Jianben He, Rong Zhang, Huamin Qu. “Method and
System for Visual Analysis and Evaluation of Customer Satisfaction Levels in Service Videos.”
3
US Provisional Patent, 2022
Under review of China Patent, 2022
PT2 Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu, Ting Chuen Pong, Huamin Qu. “System and
Method for Visual Analysis of Gestures in Videos.”
Filing a US patent, 2022
PT3 Xingbo Wang, Jianben He, Zhihua Jin, Huamin Qu, Rong Zhang. A System for Visualizing and
Explaining Multimodal Models for Sentiment Analysis.”
US Provisional Patent, 2021
Under review of China Patent, 2022
2021 PT4 Haipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Huamin Qu. “System and Method
for Visual Analysis of Emotional Coherence in Videos.”
EU Patent, 2021
PT5 Xingbo Wang, Ruixing Shi. “System and Method for Stereo-Inertial SLAM for Trajectory Recovery
and 3D Wireframe Reconstruction.”
China Patent, 2021
INVITED TALKS
2023 Unlease the Power of Data-driven AI through Explanations and Interactions
Guest talk at MSBD 5005: Data Visualization, HKUST (May 2023)
Population Health Sciences, Weill Cornell Medicine, Cornell University (Feb., 2023)
2022 Interactive Visual Analytics for Multimodal Human Communication
Ubicomp Lab, National Univerisity of Singapore (Jul., 2022)
2021 Visualizing and Explaining Multimodal Models for Sentiment Analysis
ChinaVis 2021, Wuhan, China (Jul., 2021)
IEEE VIS China Pre-conference Sharing, Virtual, China (Oct., 2021)
Intelligent User Interface for Natural Language Analysis
Intelligent Data Group (IDG), Zhejiang University, China (Jul., 2021)
MENTORING EXPERIENCE
Doctoral st udents
2022– Yingchaojie Feng, Zhejiang University CSE (Co-advised with Prof. Wei Chen)
2022– Rui Sheng, HKUST CSE (Co-advised with Prof. Huamin Qu)
2021– Zhihua Jin, HKUST CSE (Co-advised with Prof. Huamin Qu)
2021–2023 Chuhan Shi, HKUST CSE (Co-advised with Prof. Xiaojuan Ma)
2020– Jianben He, HKUST CSE (Co-advised with Prof. Huamin Qu)
Master stud ents
2022 Ayush Gupta, HKUST CSE Mphil
2020 Winnie Lam, HKUST TLE Mphil
2019 Xiaoxue Ma, HKUST CSE Msc
4
PROFESSIONAL SERVICES
Conference reviewing
2021–2023 IEEE VIS
2022–2023 NeurIPS
2021–2023 ACM CHI, CHI LBW (2022)
2022–2023 ACM UIST
2022–2023 ACM CSCW
(Special recognition for outstanding reviews CSCW 2023)
2021 EuroVIS
2021–2023 PacicVIS
2019–2023 ChinaVIS
Journal reviewing
2021–2022 IEEE Transactions on Visualization and Computer Graphics (TVCG)
2023 Journal of Biomedical Informatics (JBI)
Community Service
2022 Student volunteer captain, IEEE VIS’ 22
2021 Student volunteer, IEEE VIS’ 21
TEACHING EXPERIENCE
Hong Kong University of Science and Technology
Spring 2022 COMP 4451: Game Programming
Fall 2021 Fall 2021 COMP 1021: Introduction to Computer Science
Fall 2020 Fall 2020 COMP 1022Q Introduction to Computing with Excel VBA
Updated May 2023
5