22117: Transformative AI: Lessons from Using Experiments to Study How AI is Transforming Organizations

This Professional Development Workshop (PDW) explores how management scholars can leverage field experiments to study the impact of Generative AI (GenAI) on organizations. With some notable exceptions, the first wave of studies on GenAI has primarily used laboratory experiments to learn how humans interact with GenAI to solve tasks. These experiments allowed researchers to quantify the impact of GenAI on the time it takes to complete a task and changes in the output quality, as well as how these results vary across individuals with different levels of experience and other characteristics. However, while such laboratory experiments have been instrumental in understanding the initial dynamics of human-GenAI interaction, this PDW will explore the next wave of studies that leverage advanced experimental design techniques within organizations to draw broader theories about how the adoption of GenAI could affect the fundamental ways companies organize to create value. Our goal is to discuss how to connect the use of experimentation to occupational and organizational effects of GenAI adoption, by bringing together experts with extensive experience in developing and using experimental methods in organizations to reflect on and chart a research agenda for future studies.

-