Zhuoran Lu, Dakuo Wang, and Ming Yin. Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making. In Proceedings of the ACM on Human-Computer Interaction: Computer-Supported Cooperative Work and Social Computing (CSCW), November 2024. (Forthcoming)

Syed Hasan Amin Mahmood, Zhuoran Lu, and Ming Yin. Designing Behavior-Aware AI to Improve the Human-AI Team Performance in AI-Assisted Decision Making. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI), Jeju, South Korea, August 2024. (Forthcoming)

Jay Barot, Ali Allami, Ming Yin, and Dan Lin. ToneCheck: Unveiling the Impact of Dialects in Privacy Policy. In Proceedings of the 29th ACM Symposium on Access Control Methods and Technologies (SACMAT), San Antonio, TX, May 2024. (Forthcoming)

Zhuoyan Li, Chen Liang, Jing Peng, and Ming Yin. The Value, Benefits, and Concerns of Generative AI-Powered Assistance in Writing. In Proceedings of the 42nd ACM Conference on Human Factors in Computing Systems (CHI), Honolulu, HI, May 2024. (Forthcoming)

Shuai Ma, Xinru Wang, Ying Lei, Chunhan Shi, Ming Yin, and Xiaojuan Ma. "Are You Really Sure?": Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making. In Proceedings of the 42nd ACM Conference on Human Factors in Computing Systems (CHI), Honolulu, HI, May 2024. (Forthcoming)

Abdullah Almaatouq, Mohammed Alsobay, Ming Yin, and Duncan J. Watts. The Effects of Group Composition and Dynamics on Collective Performance. In Topics in Cognitive Science (topiCS), 16(2), April 2024.

Chun-Wei Chiang, Zhuoran Lu, Zhuoyan Li, and Ming Yin. Enhancing AI-Assisted Group Decision Making through LLM-Powered Devil’s Advocate. In Proceedings of the 29th ACM Conference on Intelligent User Interfaces (IUI), Greenville, SC, March 2024. [supplementary materials]

Chowdhury Mohammad Rakin Haider, Chris Clifton, and Ming Yin. Do Crowdsourced Fairness Preferences Correlate with Risk Perceptions?. In Proceedings of the 29th ACM Conference on Intelligent User Interfaces (IUI), Greenville, SC, March 2024.

Zhuoyan Li, Zhuoran Lu, and Ming Yin. Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Making. In Proceedings of the 38th AAAI Conference on Artificial Intelligence (AAAI), Vancouver, Canada, February 2024. [supplementary materials]

Zhuoyan Li, Hangxiao Zhu, Zhuoran Lu, and Ming Yin. Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore, December 2023.

Zhuoran Lu, Zhuoyan Li, Chun-Wei Chiang, and Ming Yin. Strategic Adversarial Attacks in AI-assisted Decision Making to Reduce Human Trust and Reliance. In Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI), Macao, China, August 2023. [supplementary materials]

Xinru Wang, Chen Liang, and Ming Yin. The Effects of AI Biases and Explanations on Human Decision Fairness: A Case Study of Bidding in Rental Housing Markets. In Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI), Macao, China, August 2023. [supplementary materials]

Saumik Narayanan, Guanghui Yu, Chien-Ju Ho, and Ming Yin. How Does Value Similarity Affect Human Reliance in AI-Assisted Ethical Decision Making?. In Proceedings of the 6th AAAI/ACM Conference on AI, Ethics, and Society (AIES), Montreal, Canada, August 2023.

Syed Hasan Amin Mahmood, Zhuoran Lu, and Ming Yin. Give Weight to Human Reactions: Optimizing Complementary AI in Practical Human-AI Teams. In Proceedings of the Workshop on Aritificial Intelligence and Human Computer Interaction at the 4oth Internatinoal Conference on Machine Learning (ICML), Honolulu, Hawaii, July 2023.

Maria Leonor Pacheco, Tunazzina Islam, Lyle Ungar, Ming Yin, and Dan Goldwasser. Interactive Concept Learning for Uncovering Latent Themes in Large Text Collections. In Findings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, Canada, July 2023.

Chun-Wei Chiang, Zhuoran Lu, Zhuoyan Li, and Ming Yin. Are Two Heads Better Than One in AI-Assisted Decision Making? Comparing the Behavior and Performance of Groups and Individuals in Human-AI Collaborative Recidivism Risk Assessment. In Proceedings of the 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023. [supplementary materials]

Xinru Wang and Ming Yin. Watch Out for Updates: Understanding the Effects of Model Explanation Updates in AI-Assisted Decision Making. In Proceedings of the 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.

Shuai Ma, Ying Lei, Xinru Wang, Chengbo Zheng, Chuhan Shi, Ming Yin, and Xiaojuan Ma. Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making. In Proceedings of the 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.

Zhuoran Lu, Dakuo Wang, and Ming Yin. Does More Advice Help? The Effects of Second Opinions from Peers in AI-Assisted Decision Making. In Proceedings of the Workshop on Trust and Reliance in AI-Assisted Tasks at the 41st ACM Conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, April 2023.

Zhuoyan Li, Zhuoran Lu, and Ming Yin. Modeling Human Trust and Reliance in AI-assisted Decision Making: A Markovian Approach. In Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI), Washington, DC, February 2023. [supplementary materials] Oral Presentation

Xinru Wang and Ming Yin. Effects of Explanations in AI-Assisted Decision Making: Principles and Comparisons. ACM Transactions on Interactive Intelligent Systems (TiiS), 12(4), December 2022. (Supersedes the ACM IUI'21 paper below)

Zhuoran Lu, Patrick Li, Weilong Wang, and Ming Yin. The Effects of AI-based Credibility Indicators on the Detection and Spread of Misinformation under Social Influence. In Proceedings of the ACM on Human-Computer Interaction: Computer-Supported Cooperative Work and Social Computing (CSCW), November 2022. Best Paper Award

Amy Rechkemmer and Ming Yin. Understanding the Microtask Crowdsourcing Experience for Workers with Disabilities: A Comparative View. In Proceedings of the ACM on Human-Computer Interaction: Computer-Supported Cooperative Work and Social Computing (CSCW), November 2022.

Meric Altug Gemalmaz and Ming Yin. Understanding Decision Subjects' Fairness Perceptions and Retention in Repeated Interactions with AI-Based Decision Systems. In Proceedings of the 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

Zhuoyan Li, Zhuoran Lu, and Ming Yin. Towards Better Detection of Biased Language with Scarce, Noisy, and Biased Annotations. In Proceedings of the 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

Saumik Narayanan, Guanghui Yu, Wei Tang, Chien-Ju Ho, and Ming Yin. How Does Predictive Information Affect Human Ethical Preferences?. In Proceedings of the 5th AAAI/ACM Conference on AI, Ethics, and Soceity (AIES), Oxford, UK, August 2022.

Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan, Andrey Shor, Ming Yin, Lyle Ungar, and Dan Goldwasser. A Holistic Framework for Analyzing the COVID-19 Vaccine Debate. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Seattle, WA, July 2022.

Amy Rechkemmer and Ming Yin. When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In Proceedings of the 40th ACM Conference on Human Factors in Computing Systems (CHI), New Orleans, LA, April 30 - May 6, 2022. [supplementary materials] Best Paper Award

Xinru Wang, Zhuoran Lu, and Ming Yin. Will You Accept the AI Recommendation? Predicting Human Behavior in AI-Assisted Decision Making. In Proceedings of the ACM Web Conference (WWW), Online, April 2022.

Xiaoni Duan, Chien-Ju Ho, and Ming Yin. The Influences of Task Design on Crowdsourced Judgement: A Case Study of Recidivism Risk Evaluation. In Proceedings of the ACM Web Conference (WWW), Online, April 2022.

Guoyang Zhou, Vaneet Aggarwal, Ming Yin, and Denny Yu. A Computer Vision Approach for Estimating Lifting Load Contributors to Injury Risk. IEEE Transactions on Human-Machine Systems, 52(2), April 2022.

Chun-Wei Chiang and Ming Yin. Exploring the Effects of Machine Learning Literacy Interventions on Laypeople's Reliance on Machine Learning Models. In Proceedings of the 27th ACM Conference on Intelligent User Interfaces (IUI), Online, March 2022. [supplementary materials]

Guoyang Zhou, Vaneet Aggarwal, Ming Yin, and Denny Yu. Video-based AI Decision Support System for Lifting Risk Assessment. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Online, October 2021.

Chien-Ju Ho and Ming Yin. Designing and Optimizing Cognitive Debiasing Strategies for Crowdsourcing Annotation. In Proceedings of the Workshop on Investigating and Mitigating Biases in Crowdsourced Data at the 24th ACM Conference on Computer Supported Cooperative Work (CSCW), Online, October 2021.

Abdullah Almaatouq, Mohammed Alsobay, Ming Yin, and Duncan J. Watts. Task Complexity Moderates Group Synergy. Proceedings of the National Adademy of Sciences (PNAS), 118(36), September 2021.

Meric Altug Gemalmaz and Ming Yin. Accounting for Confirmation Bias in Crowdsourced Label Aggregation. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI), Online, August 2021.

Amy Rechkemmer and Ming Yin. Exploring the Effects of Goal Setting When Training for Complex Crowdsourcing Tasks. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI), Online, August 2021. (Sister Conferences Track)

Chun-Wei Chiang and Ming Yin. You'd Better Stop! Understanding Human Reliance on Machine Learning Models under Covariate Shift. In Proceedings of the 13th ACM Web Science Conference (WebSci), Online, June 2021.

Zhuoran Lu and Ming Yin. Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks. In Proceedings of the 39th ACM Conference on Human Factors in Computing Systems (CHI), Yokohama, Japan, May 2021. [supplementary materials]

Xinru Wang and Ming Yin. Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-Making. In Proceedings of the 26th ACM International Conference on Intelligent User Interfaces (IUI), College Station, TX, April 2021. [supplementary materials]

Amy Rechkemmer and Ming Yin. Motivating Novice Crowd Workers through Goal Setting: An Investigation into the Effects on Complex Crowdsourcing Task Training. In Proceedings of the 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Hilversum, Netherlands, October 2020. Best Paper Award

Xiaoni Duan, Chien-Ju Ho, and Ming Yin. Does Exposure to Diverse Perspectives Mitigate Biases in Crowdwork? An Explorative Study. In Proceedings of the 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Hilversum, Netherlands, October 2020.

Xiao Hu, Haobo Wang, Anirudh Vegesana, Somesh Dube, Kaiwen Yu, Gore Kao, Shuo-Han Chen, Yung-Hsiang Lu, George Thiruvathukal, and Ming Yin. Crowdsourcing Detection of Sampling Biases in Image Datasets. In Proceedings of the Web Conference (WWW), Taipei, April 2020.

Keman Huang, Jinhui Yao, and Ming Yin. Understanding the Skill Provision in Gig Economy from a Network Perspective: A Case Study of Fiverr. In Proceedings of the ACM on Human-Computer Interaction: Computer-Support Cooperative Work and Social Computing (CSCW), Volume 3, November 2019.

Xiao Hu, Haobo Wang, Somesh Dube, Anirudh Vegesana, Kaiwen Yu, Yung-Hsiang Lu, and Ming Yin. Discovering Biases in Image Datasets with the Crowd. In Proceedings of the 7th AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Skamania Lodge, WA, October 2019. (Work in Progress track)

Wei Tang, Chien-Ju Ho, and Ming Yin. Leveraging Peer Communication to Enhance Crowdsourcing. In Proceedings of the Web Conference (WWW), San Francisco, CA, May 2019.

Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. Understanding the Effect of Accuracy on Trust in Machine Learning Models. In Proceedings of the 37th ACM Conference on Human Factors in Computing Systems (CHI), Glasgow, UK, May 2019. Best Paper Honorable Mention

Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. Does Stated Accuracy Affect Trust in Machine Learning?. In Proceedings of the 3rd ICML Workshop on Human Interpretability in Machine Learning (WHI), Stockholm, Sweden, July 2018.

Ming Yin, Siddharth Suri, and Mary L. Gray. Running Out of Time: The Impact and Value of Flexibility in On-Demand Crowdwork. In Proceedings of the 36th ACM Conference on Human Factors in Computing Systems (CHI), Montreal, Canada, April 2018.

Ming Yin. Peeking into the On-Demand Economy: Crowd Behavior and Incentive Design. Ph.D. Dissertation, School of Engineering and Applied Sciences, Harvard University, June 2017.

Ming Yin and Yiling Chen. Predicting Crowd Work Quality under Monetary Interventions. In Proceedings of the 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Austin, TX, October 30 - November 3, 2016. [slides, dataset]

Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael Terry, and Krzysztof Z. Gajos. Curiosity Killed the Cat, but Makes Crowdwork Better. In Proceedings of the 34th ACM Conference on Human Factors in Computing Systems (CHI), San Jose, CA, May 2016. Best Paper Honorable Mention

Ming Yin, Mary L. Gray, Siddharth Suri, and Jennifer Wortman Vaughan. The Communication Network Within the Crowd. In Proceedings of the 25th International World Wide Web Conference (WWW), Montreal, Canada, April 2016. [slides, dataset]

Ming Yin and Yiling Chen. Bonus or Not? Learn to Reward in Crowdsourcing. In Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), Buenos Aires, Argentina, July 2015. [slides, poster]

Ming Yin and Yu-An Sun. Human Behavior Models for Virtual Agents in Repeated Decision Making under Uncertainty. In Proceedings of the 14th International Conference on Autonomous Agents & Multiagent Systems (AAMAS), Istanbul, Turkey, May 2015. [slides]

Ming Yin, Yiling Chen, and Yu-An Sun. Monetary Interventions in Crowdsourcing Task Switching. In Proceedings of the 2nd AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Pittsburgh, PA, November 2014. [slides]

Ming Yin, Yiling Chen, and Yu-An Sun. Task Sequence Design: Evidence on Price and Difficulty. In Proceedings of the 1st AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Palm Springs, CA, November 2013. (Work in Progress track) [slides, poster]

Ming Yin, Yiling Chen, and Yu-An Sun. The Effects of Performance-Contingent Financial Incentives in Online Labor Markets. In Proceedings of the 27th AAAI Conference on Artificial Intelligence (AAAI), Bellevue, WA, July 2013. [slides, poster]