Employment

2022→ Senior Computational Social Scientist in the CSSLab at University of Pennsylvania (U Penn) working with Duncan J. Watts and in affiliation with Computer and Information Science (CIS) in the School of Engineering and Applied Science (SEAS) and Operations Information and Decisions (OID) in the Wharton School
2019–22 Postdoc in CIS at SEAS & OID at Wharton at University of Pennsylvania (U Penn) under Duncan J. Watts
2017–19 Postdoc in the HCI group in computer science at Stanford under Michael S. Bernstein
2012 Visiting scholar in Cultural Technology at KAIST under Meeyoung Cha
2008–12 Design lead at Adaptive Equipment

Education

2013–17 PhD in mechanical engineering at Carnegie Mellon University (CMU) with chairs Jon Cagan & Phil R. Leduc and committee Manuela M. Veloso & Yongjie Jessica Zhang
2009–10 MS in industrial design at Korea Advanced Institute of Science and Technology (KAIST) with advisors Youn-kyung Lim & Tek-jin Nam
2006 Exchange student in industrial design at Zhejiang University (ZJU)
2004–07 BDes in industrial design at Royal Melbourne Institute of Technology (RMIT) with first class honors

Teaching

2019 Stanford Scientific Teaching Summer Institute at SEPAL
2018 Software Instructor Training at The Carpentries
2018–19 Postdoc teaching certificate program at Stanford Office of Postdoctoral Affairs
2013–14 Teaching assistant in Senior design at CMU Mechanical Engineering Nominated for teaching assistance award
2013–17 Future faculty program at CMU Eberly Center for Teaching Excellence
2010 Teaching assistant in Computational design at KAIST Cultural Technology
2009–11 Teaching assistant in Design product system & Emotional design at KAIST Industrial Design

Awards

2021 Special Recognition Award at 7th International Conference on Computational Social Science (IC2S2) How common is common sense?
2021 Best Paper at Asian CHI Together We Learn Better: Leveraging Communities of Practice for MOOC Learners
2020 Best Paper Honorable Mention at Computer Supported Cooperative Work (CSCW) My Team Will Go On: Differentiating High and Low Viability Teams Through Team Interaction
2019 Best Paper Honorable Mention at AAAI Conference on Human Computation and Crowdsourcing (HCOMP) Fair Work: Crowd Work Minimum Wage with One Line of Code
2009 Design award at Red Dot
2007 First class honors at RMIT
2007 Youth delegation at Australian China Business Council Invitee of president Hu Jintau
2006 Design award at Red Dot
2002 First prize alliance in south east region at FIRST Robotics Competition (FRC)

Grants

2020–21 Research grant at Hasso Plattner Institute-Stanford Design Thinking Research Program (HPDTRP) Re-DNA II: Re-designing nonverbal actions in video conferencing — $100,000
2020 Research fund at Summer Institutes in Computational Social Science (SICSS) What we think we think — $7,500
2020 Research grant at Program on Democracy and the Internet (PDI) It should have gone another way: Evaluating Consistency in Democratic Decision-Making via Online Juries — $50,000
2019–20 Research grant at HPDTRP Re-DNA: Re-designing nonverbal actions for design team collaborations — $110,000
2019–21 CONNECT grant at Stanford University Postdoctoral Association (SURPAS) Changing faces: Racial bias in online collaborative groups — $3,500
2018–19 Research grant at HPDTRP Design team fracture — $150,000
2009–10 Full scholarship at KAIST

Service & Community

2021 Panelist at the Changing Nature of Work Workshop at Center for Work Technology and Organization (WTO) at Stanford University
2020 Participant in the Duke chapter at Summer Institute in Computational Social Science (SICSS)
2019→ Doctoral colloquium mentor (DC) at HCOMP’19
2018 Mentor in cohort 6 at Mozilla Open Leaders
2018 Fellow at IDEO CoLab
2017→ Program committee (PC) at WebSci’24, CSCW’24, Scholarship opportunities co-chair at HCOMP+CI’23, HCOMP’21, CSCW’21, CSCW’20, Group’20, CSCW’19, Designing Technologies to Support Human Problem Solving at VL/HCC’18, CSCW’18, Linked Democracy at IJCAI’17
2016–19 President & co-founder at Cultured Fit
2016–19 Team member at Stanford crowd research collective
2015–18 Research mentor at Pitt iSchool inclusion institute (I3)
2015 CFO at National Association of Graduate and Professional Students (NAGPS)
2014–15 VP finance at CMU Graduate Student Assembly (GSA)
2009–12 Founder & director at TEDxKAIST
2009→ Reviewer (R2) at Management Science, NSF, PLOS ONE, Mathematics, AAAI, CHI, CSCW, TOCHI, Collective Intelligence, CC, MobileHCI, IDETC, IASDR, DIS, UIST, TSC, IUI, ICWSM, Behavior & Information Technology

Invited talks

2022 How common is common sense? Microsoft Research, CU Boulder, Virginia Tech, Drexel University, NJIT, Depaul University, Instituto Superior TĂŠcnico at the University of Lisboa
2021 Design for empirical value Toyota Research Institute, Sasahara lab at the Tokyo Institute of Technology, Door3
2020–21 Resetting remote team dynamics at BayCHI, Data Science Group at the Korean Institute for Basic Science, HCI@KAIST, Comm at Seoul National University
2019 Design team fracture at Hasso Plattner design thinking research program workshop
2019 Scaled humanity: computational scaffolds for pro-social interaction at Adobe, Stanford, University California Santa Cruz, Berkley BID seminar, Microsoft (collabratory keynote), George Mason University, Human Computer Interaction Consortium: Futures of Work (HCIC)
2018 How can we make AI more accessible? Stanford AI Salon, jointly with Rachel Thomas

Mentees Submit an update.

2023–20 University of Pennsylvania

Arnab Sircar, Amirhossein Nakhaei (Aachen University), Nitya Kaku (Tesla high school), Huifang Ye, Jason Ren, Bryan Yao, Alan Qiao, Sarah Batta, Kaily Liu, Vincent Cai, Daniel Xue, Sumant Shringari, Vivian Dinh, Arina Paniukhina, Karan Sampath, Henry Ge, Sarika Subramaniam, Andrew Cullen, Ashley(Nicole) Fernandez, Vikram Balasubramanian, Rafael Gehrke, Katelyn R Bottcher, and Paulina Paiz

2021 Princeton

Ryan Gibbons, and Dafna Yavetz

2019–17 Stanford

N'Godjigui Junior Diarrassouba (Texas Tech), Michelle Xing, Ryan Andrew Foulke, Irena Gao, Tonya Nguyen (Berkeley), J.D. Zamfirescu (Berkeley), Yu Jin Lee, Lydia Stone, Emily Hu, Grant Hugh, Laura Fiuza (research scientist), Chloe Barreau, Phoebe Yao, So Yeon Park, Kevin Lin, Alex Huy Nguyen (Minerva), Allie Blaising (Cal Poly-San Luis Obispo), Pheobe Kimm, Nik Marda, Maika Isogawa, Hao Wu, Abhay Kumar Agarwal, Catherine Jiang, and Kristen Law

2016 i3 Inclusion Institute, University of Pittsburgh

Jeremiah Azurin (Harvard), Imauri Motorin (UMBC), Samuel Osei-Afriyie (SUNY Oneonta), Abrere Sophie Kozolan (UMBC), Monique Jeffrey (UMBC), Jose Valderrama (UCF), Laurel Rawley (University of Houston), Simon Smith (University of Wisconsin-Madison), and Alex Selimov (UCF)

2013–16 CMU

Wing Tung Wong

PublicationsPublicationsBibTeX | ORCiD: 0000-0002-6395-7833

2024 Searching of data structures in pre-processing data for a machine learning classifier

Jonathan Cagan, Phil Leduc & Mark Whiting
USPTO, 2024

Beyond Playing 20 Questions with Nature: Integrative Experiment Design in the Social and Behavioral Sciences

Abdullah Almaatouq, Thomas L. Griffiths, Jordan W. Suchow, Mark E. Whiting, James Evans & Duncan J. Watts
Behavioral and Brain Sciences, 2024, 10.1017/S0140525X22002874

Replies to commentaries on Beyond Playing 20 Questions with Nature

Abdullah Almaatouq, Thomas L. Griffiths, Jordan W. Suchow, Mark E. Whiting, James Evans & Duncan J. Watts
Behavioral and Brain Sciences, 2024, 10.1017/S0140525X23002789

A framework for quantifying individual and collective common sense

Mark E. Whiting & Duncan J. Watts
Proceedings of the National Academy of Sciences, 2024, 10.1073/pnas.2309535121

2023
Insights into accuracy of social scientists' forecasts of societal change

Igor Grossmann, Amanda Rotella, Cendri A. Hutcherson, Konstantyn Sharpinskyi, Michael E.W. Varnum, Sebastian Achter, Mandeep K. Dhami, Xinqi Evie Guo, Mane Kara-Yakoubian, David R. Mandel, Louis Raes, Louis Tay, Aymeric Vie, Lisa Wagner, Matus Adamkovic, Arash Arami, Patrícia Arriaga, Kasun Bandara, Gabriel Baník, František Bartoš, Ernest Baskin, Christoph Bergmeir, Michał Białek, Caroline K. Børsting, Dillon T. Browne, Eugene M. Caruso, Rong Chen, Bin-Tzong Chie, William J. Chopik, Robert N. Collins, Chin W. Cong, Lucian G. Conway, Matthew Davis, Martin V. Day, Nathan A. Dhaliwal, Justin D. Durham, Martyna Dziekan, Christian T. Elbaek, Eric Shuman, Marharyta Fabrykant, Mustafa Firat, Geoffrey T. Fong, Jeremy A. Frimer, Jonathan M. Gallegos, Simon B. Goldberg, Anton Gollwitzer, Julia Goyal, Lorenz Graf-Vlachy, Scott D. Gronlund, Sebastian Hafenbrädl, Andree Hartanto, Matthew J. Hirshberg, Matthew J. Hornsey, Piers D.L. Howe, Anoosha Izadi, Bastian Jaeger, Pavol Kačmár, Yeun Joon Kim, Ruslan Krenzler, Daniel G. Lannin, Hung-Wen Lin, Nigel Mantou Lou, Verity Y.Q. Lua, Aaron W. Lukaszewski, Albert L. Ly, Christopher R. Madan, Maximilian Maier, Nadyanna M. Majeed, David S. March, Abigail A. Marsh, Michal Misiak, Kristian Ove R. Myrseth, Jaime M. Napan, Jonathan Nicholas, Konstantinos Nikolopoulos, Jiaqing O, Tobias Otterbring, Mariola Paruzel-Czachura, Shiva Pauer, John Protzko, Quentin Raffaelli, Ivan Ropovik, Robert M. Ross, Yefim Roth, Espen Røysamb, Landon Schnabel, Astrid Schütz, Matthias Seifert, A. Timur Sevincer, Garrick T. Sherman, Otto Simonsson, Ming-Chien Sung, Chung-Ching Tai, Thomas Talhelm, Bethany A. Teachman, Philip E. Tetlock, Dimitrios Thomakos, Dwight C.K. Tse, Oliver J. Twardus, Joshua M. Tybur, Lyle Ungar, Daan Vandermeulen, Leighton Vaughan Williams, Hrag A. Vosgerichian, Qi Wang, Ke Wang, Mark E. Whiting, Conny E. Wollbrant, Tao Yang, Kumar Yogeeswaran, Sangsuk Yoon, Ventura r. Alves, Jessica R. Andrews-Hanna, Paul A. Bloom, Anthony Boyles, Loo Charis, Mingyeong Choi, Sean Darling-Hammond, Zoe E. Ferguson, Cheryl R. Kaiser, Simon T. Karg, Alberto López Ortega, Lori Mahoney, Melvin S. Marsh, Marcellin F.R.C. Martinie, Eli K. Michaels, Philip Millroth, Jeanean B. Naqvi, Weiting Ng, Robb B. Rutledge, Peter Slattery, Adam H. Smiley, Oliver Strijbis, Daniel Sznycer, Eli Tsukayama, Austin van Loon, Jan G. Voelkel, Margaux N.A. Wienk, Tom Wilkening & The Forecasting Collaborative
Nature Human Behavior, 2023, 10.1038/s41562-022-01517-1

COVID-19 non-pharmaceutical interventions: data annotation for rapidly changing local policy information

Benjamin Hurt, Oishee Bintey Hoque, Finn Mokrzycki, Anjali Mathew, Maryann Xue, Luka Gabitsinashvili, Haile Mokrzycki, Ranya Fischer, Nicholas Telesca, Lauren Aurelia Xue, Jacob Ritchie, JD Zamfirescu-Pereira, Michael S Bernstein, Mark E Whiting & Madhav Marathe
Scientific Data, 2023, 10.1038/s41597-023-01979-6

2022
Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal Implications

Dilrukshi Gamage, Piyush Ghasiya, Vamshi Bonagiri, Mark E. Whiting & Kazutoshi Sasahara
CHI, 2022, 10.1145/3491102.3517446

Inducing Vascular Grammars for Anomaly Classification in Brain Angiograms

Mark E. Whiting, Joseph Mettenburg, Enrico M. Novelli, Tales Santini, Tiago Martins, Tamer S. Ibrahim, Philip R. LeDuc & Jonathan Cagan
Journal of Engineering and Science in Medical Diagnostics and Therapy, 2022, 10.1115/1.4053424

Dancing with Ambiguity Online: When Our Online Actions Cause Confusion

So Yeon Park, Mark E Whiting & Michael Shanks
Design Thinking Research, 2022, 10.1007/978-3-031-09297-8_3

2021
Empirica: a virtual lab for high-throughput macro-level experiments

Abdullah Almaatouq, Joshua Becker, James P Houghton, Nicolas Paton, Duncan J Watts & Mark E Whiting
Behavior Research Methods, 2021, 10.3758/s13428-020-01535-9

🏅My Team Will Go On: Differentiating High and Low Viability Teams through Team Interaction

Hancheng Cao, Vivian Yang, Victor Chen, Yu Jin Lee, Lydia Stone, N'Godjigui Junior Diarrassouba, Mark E Whiting & Michael S Bernstein
Proceedings of the ACM on Human-Computer Interaction, 2021, 10.1145/3432929 Honorable mention

Can Online Juries Make Consistent, Repeatable Decisions?

Xinlan Emily Hu, Mark E Whiting & Michael S Bernstein
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, 10.1145/3411764.3445433

Peer assessment in MOOCs: Systematic literature review

Dilrukshi Gamage, Thomas Staubitz & Mark E Whiting
Distance Education, 2021, 10.1080/01587919.2021.1911626

🏆Together We Learn Better: Leveraging Communities of Practice for MOOC Learners

Dilrukshi Gamage & Mark E Whiting
Asian CHI, 2021 Best paper award

Scaling up experimental social, behavioral, and economic science

Abdullah Almaatouq, Joshua A Becker, Michael S Bernstein, Robert Botto, Eric Bradlow, Ekaterina Damer, Angela L Duckworth, Tom Griffiths, Joshua K Hartshorne, David Lazer, Edith Law, Min Liu, J. N Matias, David G Rand, Matthew J Salganik, Emma Satlof-Bedrick, Maurice Schweitzer, Hirokazu Shirado, Jordan W Suchow, Siddharth Suri, Milena Tsvetkova, Duncan J Watts, Mark E Whiting & Ming Yin
OSF, 2021, 10.17605/OSF.IO/KNVJS

Decoding Nonverbal Online Actions: How They Are Used and Interpreted

So Yeon Park, Mark E Whiting & Michael Shanks
Design Thinking Research, 2021, 10.1007/978-3-030-76324-4_5

2020
Parallel Worlds: Repeated Initializations of the Same Team To Improve Team Viability

Mark E Whiting, Irena Gao, Michelle Xing, N’Godjigui Junior Diarrassouba, Tonya Nguyen & Michael S Bernstein
Proceedings of the ACM on Human-Computer Interaction, 2020, 10.1145/3392877

2019 🏅Fair work: Crowd work minimum wage with one line of code

Mark E Whiting, Grant Hugh & Michael S Bernstein
Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 2019 Honorable mention

Did It Have To End This Way? Understanding the Consistency of Team Fracture

Mark E. Whiting, Allie Blaising, Chloe Barreau, Laura Fiuza, Nik Marda, Melissa Valentine & Michael S. Bernstein
Proceedings of the ACM Human-Computer Interaction, 2019, 10.1145/3359311

2018
Efficient probabilistic grammar induction for design

Mark E Whiting, Jonathan Cagan & Philip LeDuc
Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AI EDAM, 2018, 10.1017/S0890060417000464

Tasker: Safely Serving Verifiable Micro-tasks for Researchers

Monique Jeffrey, Mark E Whiting, Abrere S Kozolan, Imauri Motorin & Osei-Afriyie Samuel
iConference 2018 Proceedings, 2018

Improving Feedback and Discussion in MOOC Peer Assessment Using Introduced Peers

Dilrukshi Gamage, Mark E Whiting, Indika Perera & Shantha Fernando
2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 2018

2017
Crowd guilds: Worker-led reputation and feedback on crowdsourcing platforms

Mark E. Whiting, Dilrukshi Gamage, Snehalkumar S. Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, Tejas Seshadri Sarma, Varshine Chandrakanthan, Teogenes Moura, Mohamed Hashim Salih, Gabriel Bayomi Tinoco Kalejaiye, Adam Ginzberg, Catherine A. Mullings, Yoni Dayan, Kristy Milland, Henrique Orefice, Jeff Regino, Sayna Parsi, Kunz Mainali, Vibhor Sehgal, Sekandar Matin, Akshansh Sinha, Rajan Vaish & Michael S. Bernstein
Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing, 2017, 10.1145/2998181.2998234

Automated Induction of General Grammars for Design

Mark E Whiting, Jonathan Cagan & Philip LeDuc
Design Computing and Cognition, 2017, 10.1007/978-3-319-44989-0_15

The daemo crowdsourcing marketplace

Snehalkumar (Neil) S Gaikwad, Mark E Whiting, Dilrukshi Gamage, Catherine A Mullings, Dinesh Majeti, Shirish Goyal, Aaron Gilbee, Nalin Chhibber, Adam Ginzberg & Angela Richmond-Fuller
Companion of the ACM conference on computer supported cooperative work and social computing, 2017, 10.1145/3022198.3023270

Designing A Constitution for a Self-Governing Crowdsourcing Marketplace

Mark E Whiting, Dilrukshi Gamage, Shirish Goyal, Aaron Gilbee, Dinesh Majeti, Angela Richmond-Fuller, Mohamed Hashim Salih, Tejas Seshadri Sarma, Vinayak Mathur, Manoj Pandey, Snehalkumar Gaikwad, Rajan Vaish & Michael S Bernstein
Collective Intelligence Conference, Brooklyn, NY, USA, 2017

Improving assessment on MOOCs through peer identification and aligned incentives

Dilrukshi Gamage, Mark E Whiting, Thejan Rajapakshe, Haritha Thilakarathne, Indika Perera & Shantha Fernando
Proceedings of the Fourth ACM Conference on Learning@ Scale, 2017, 10.1145/3051457.3054013

Efficient Automatic Induction of Rules in Biological Systems

Mark E Whiting, Phil R Leduc & Jon Cagan
The FASEB Journal, 2017

Prototype tasks: improving crowdsourcing results through rapid, iterative task design

Snehalkumar Gaikwad, Nalin Chhibber, Vibhor Sehgal, Alipta Ballav, Catherine Mullings, Ahmed Nasser, Angela Richmond-Fuller, Aaron Gilbee, Dilrukshi Gamage & Mark Whiting
arXiv preprint arXiv:1707.05645, 2017

Anomaly Classification Through Automated Shape Grammar Representation

Mark E Whiting
2017

2016
Boomerang: Rebounding the Consequences of Reputation Feedback on Crowdsourcing Platforms

Snehalkumar Gaikwad, Durim Morina, Adam Ginzberg, Catherine Mullings, Shirish Goyal, Dilrukshi Gamage, Christopher Diemert, Mathias Burton, Sharon Zhou, Mark Whiting, Karolina Ziulkoski, Alpina Ballav, Aaron Gilbee, Senadhipathige S Niranga, Vibhor Sehgal, Jasmine Lin, Leonardy Kristianson, Angela Richmond-Fuller, Jeff Regino, Nalin Chhibber, Dinesh Majeti, Sachin Sharma, Kamila Mananova, Dinesh Dhakal, William Dai, Victoria Purynova, Samarth Sandeep, Varshine Chandrakanthan, Tejas Sharma, Sekandar Matin, Ahmed Nasser, Rohit Nistala, Alexander Stolzoff, Kristy Milland, Vinayak Mathur, Rajan Vaish & Michael S Bernstein
29th Annual Symposium on User Interface Software and Technology, 2016, 10.1145/2984511.2984542

The customer is always right: analyzing existing market feedback to improve TVs

Jose Valderrama, Laure Rawley, Simon Smith & Mark Whiting
IConference 2016 Proceedings, 2016

2010 A formal approach for the interpretation of cultural content(s): Evolution of a Korean traditional pattern, Bosangwhamun

Ji-Hyun Lee, Hyoung-June Park, Sungwoo Lim, Sun-Joong Kim, Haelee Jung & Mark E Whiting
15th International Conference on Computer-Aided Architectural Design in Asia, CAADRIA, 2010

2009 Early exploration of cloud computing for design practice and education

Mark E Whiting & Soumitri Varadarajan
Internat. Assoc Societies Design Res. Coex, Seoul Korea, 2009