31 Jul 2024

IASS Webinar 42: Leveraging AI for Survey Research

Date 31 Jul 2024
Time 12:00 GMT+02:00 - 13:30 GMT+02:00
Level of instruction Intermediate
Frauke Kreuter
Registration fee

Abstract: This presentation scrutinises the transformative potential of Large Language Models (LLMs) in survey research, focusing on three critical areas: questionnaire design, synthetic data creation, and the role of LLMs as qualitative interviewers. In the domain of questionnaire design, the lecture delves into if and how LLMs can construct contextually accurate and highly effective survey items. However, there are valid concerns about the model’s understanding and potential biases, which we will critically evaluate. She also discusses LLMs’ ability to fabricate synthetic data, preserving core statistical properties whilst ensuring privacy. Here too, the ethical implications and the potential for misuse of this capability pose challenges that need to be addressed. Lastly, the lecture explores how LLMs, with their human-like conversational ability, can act as qualitative interviewers, allowing in-depth information gathering at scale. Yet, questions about their ability to fully capture the complexity and subtleties of human interaction and response also remain. The underlying theme of this talk is the question on how research in this space should be structured.



Frauke Kreuter
Frauke Kreuter

About the instructor

Frauke Kreuter is a professor in the Joint Program in Survey Methodology (JPSM), Co-director of the Social Data Science Center (SoDa) at the University of Maryland, and chair of Statistics and Data Science at LMU Munich. Currently she serves as president of the American Association for Public Opinion Research. In addition to her academic work, Professor Kreuter is the Founder of the International Program for Survey and Data Science (IPSDS), developed in response to the increasing demand from researchers and practitioners for the
appropriate methods and right tools to face a changing data environment, and Co-Founder of the Coleridge Initiative, whose goal is to accelerate data-driven research and policy around human beings and their interactions for program management, policy development, and scholarly purposes by enabling efficient,
effective, and secure access to sensitive data about society and the economy.