Ming Yin

I'm an Assistant Professor in the Department of Computer Science, Purdue University. My research broadly connects to the fields of human-computer interaction, applied artificial intelligence and machine learning, computational social science, and behavioral sciences. I use both experimental and computational approaches to examine how to better utilize the wisdom of crowd to enhance machine intelligence (i.e., crowdsourcing and social computing), and how to better design intelligent systems that people can understand, trust and engage with effectively (i.e., human-AI interaction).

Prior to Purdue, I spent a year at Microsoft Research New York City as a postdoctoral researcher in the Computational Social Science group. I completed my Ph.D. in Computer Science at Harvard University, and received my bachelor degree from Tsinghua University, Beijing, China.

Publications

In most cases, my collaborators and I choose to have students as first authors and then determine the authorship alphabetically.

Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations

Zhuoyan Li, Hangxiao Zhu, Zhuoran Lu, and Ming Yin.
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore, December 2023. (Forthcoming)

Strategic Adversarial Attacks in AI-assisted Decision Making to Reduce Human Trust and Reliance

Zhuoran Lu, Zhuoyan Li, Chun-Wei Chiang, and Ming Yin.
The 32nd International Joint Conference on Artificial Intelligence (IJCAI), Macao, China, August 2023.
supplementary materials

The Effects of AI Biases and Explanations on Human Decision Fairness: A Case Study of Bidding in Rental Housing Markets

Xinru Wang, Chen Liang, and Ming Yin.
The 32nd International Joint Conference on Artificial Intelligence (IJCAI), Macao, China, August 2023.
supplementary materials

How Does Value Similarity Affect Human Reliance in AI-Assisted Ethical Decision Making?

Saumik Narayanan, Guanghui Yu, Chien-Ju Ho, and Ming Yin.
The 6th AAAI/ACM Conference on AI, Ethics, and Society (AIES), Montreal, Canada, August 2023.

Interactive Concept Learning for Uncovering Latent Themes in Large Text Collections

Maria Leonor Pacheco, Tunazzina Islam, Lyle Ungar, Ming Yin, and Dan Goldwasser.
Findings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, Canada, July 2023.

Are Two Heads Better Than One in AI-Assisted Decision Making? Comparing the Behavior and Performance of Groups and Individuals in Human-AI Collaborative Recidivism Risk Assessment

Chun-Wei Chiang, Zhuoran Lu, Zhuoyan Li, and Ming Yin
The 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.
supplementary materials

Watch Out for Updates: Understanding the Effects of Model Explanation Updates in AI-Assisted Decision Making

Xinru Wang and Ming Yin
The 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.

Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making

Shuai Ma, Ying Lei, Xinru Wang, Chengbo Zheng, Chuhan Shi, Ming Yin, and Xiaojuan Ma
The 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.

Modeling Human Trust and Reliance in AI-assisted Decision Making: A Markovian Approach

Zhuoyan Li, Zhuoran Lu, and Ming Yin
The 37th AAAI Conference on Artificial Intelligence (AAAI), Washington, DC, February 2023.
supplementary materials
Oral Presentation

Effects of Explanations in AI-Assisted Decision Making: Principles and Comparisons

Xinru Wang and Ming Yin
ACM Transactions on Interactive Intelligent Systems (TiiS), 12(4), December 2022.

(Supersedes the ACM IUI'21 paper below)

The Effects of AI-based Credibility Indicators on the Detection and Spread of Misinformation under Social Influence

Zhuoran Lu, Patrick Li, Weilong Wang, and Ming Yin
The 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW), Online, November 2022.
Best Paper Award

Understanding the Microtask Crowdsourcing Experience for Workers with Disabilities: A Comparative View

Amy Rechkemmer and Ming Yin
The 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW), Online, November 2022.

Understanding Decision Subjects' Fairness Perceptions and Retention in Repeated Interactions with AI-Based Decision Systems

Meric Altug Gemalmaz and Ming Yin
The 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

Towards Better Detection of Biased Language with Scarce, Noisy, and Biased Annotations

Zhuoyan Li, Zhuoran Lu, and Ming Yin
The 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

How Does Predictive Information Affect Human Ethical Preferences?

Saumik Narayanan, Guanghui Yu, Wei Tang, Chien-Ju Ho, and Ming Yin
The 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

A Holistic Framework for Analyzing the COVID-19 Vaccine Debate

Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan, Andrey Shor, Ming Yin, Lyle Ungar, and Dan Goldwasser
The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Seattle, WA, July 2022.

When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models

Amy Rechkemmer and Ming Yin
The 40th ACM Conference on Human Factors in Computing Systems (CHI), New Orleans, LA, April 30 - May 6, 2022.
supplementary materials
Best Paper Award

Will You Accept the AI Recommendation? Predicting Human Behavior in AI-Assisted Decision Making

Xinru Wang, Zhuoran Lu, and Ming Yin
The ACM Web Conference (WWW), Online, April 2022.

The Influences of Task Design on Crowdsourced Judgement: A Case Study of Recidivism Risk Evaluation

Xiaoni Duan, Chien-Ju Ho, and Ming Yin
The ACM Web Conference (WWW), Online, April 2022.

A Computer Vision Approach for Estimating Lifting Load Contributors to Injury Risk

Guoyang Zhou, Vaneet Aggarwal, Ming Yin, and Denny Yu
IEEE Transactions on Human-Machine Systems, 52(2), April 2022.

Exploring the Effects of Machine Learning Literacy Interventions on Laypeople's Reliance on Machine Learning Models

Chun-Wei Chiang and Ming Yin
The 27th ACM Conference on Intelligent User Interfaces (IUI), Online, March 2022.

supplementary materials

Video-based AI Decision Support System for Lifting Risk Assessment

Guoyang Zhou, Vaneet Aggarwal, Ming Yin, and Denny Yu
IEEE International Conference on Systems, Man, and Cybernetics (SMC), Online, October 2021.

Task Complexity Moderates Group Synergy

Abdullah Almaatouq, Mohammed Alsobay, Ming Yin, and Duncan J. Watts.
Proceedings of the National Adademy of Sciences (PNAS), 118(36), September 2021.

Accounting for Confirmation Bias in Crowdsourced Label Aggregation

Meric Altug Gemalmaz and Ming Yin.
The 30th International Joint Conference on Artificial Intelligence (IJCAI), Online, August 2021.

You'd Better Stop! Understanding Human Reliance on Machine Learning Models under Covariate Shift

Chun-Wei Chiang and Ming Yin.
The 13th ACM Web Science Conference (WebSci), Online, June 2021.

Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks

Zhuoran Lu and Ming Yin.
The 39th ACM Conference on Human Factors in Computing Systems (CHI), Yokohama, Japan, May 2021.

supplementary materials

Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-Making

Xinru Wang and Ming Yin.
The 26th ACM International Conference on Intelligent User Interfaces (IUI), College Station, TX, April 2021.

supplementary materials

Motivating Novice Crowd Workers through Goal Setting: An Investigation into the Effects on Complex Crowdsourcing Task Training

Amy Rechkemmer and Ming Yin.
The 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Hilversum, Netherlands, October 2020.
Best Paper Award

Misc

I'm an avid photographer. Check out some of my pictures here.

Publications

Teaching

Misc