Lecture Series (Recording), Indira Sen (University of Mannheim) - At the Intersection of NLP and Survey Methodology: Potentials, Challenges, and Provocations
Date : October 17, 2025 Abstract: Recent advances in generative AI, particularly Large Language Models (LLMs), have renewed interest in Natural Language Processing (NLP) across many disciplines. One such field is survey methodology, which increasingly applies NLP methods (e.g., simulating survey respondents with LLMs) and, in turn, offers valuable insights back to NLP (e.g., improving annotation task design and evaluation). In this talk, I argue for stronger synergies between NLP and survey methodology, outlining both the opportunities and the obstacles at their intersection. I will focus on two use cases where we see both synergies and tensions: (1) reusing survey questions developed for humans to probe political biases in LLMs, and (2) assessing which people LLMs can simulate and provide personalized assistance to. Beyond these use cases, I highlight broader challenges that interdisciplinary researchers and practitioners must grapple with — from evaluating the social competencies of ...