I2SC Lecture Series (Recording): Tanise Ceron (NLP, Bocconi University) Evaluating Political Bias: Insights into Robustness and Multilinguality

 Date: June 6, 2025

Abstract:

Due to the widespread use of large language models (LLMs), it is crucial to understand whether they embed a specific "worldview" and what these views reflect. In this talk, I will discuss the challenges in performing a robust evaluation of political bias in LLMs both from a monolingual and a multilingual perspective. I will present the results of two studies: the first involves developing a framework for systematically evaluating political bias in LLMs, with a detailed look at biases in specific policy issues and the importance of a robust evaluation when probing LLMs. The second study examines to what extent political biases are carried over across languages. Results suggest that biases are similar across European languages. I will conclude by discussing relevant open research questions regarding political biases in LLMs.

You can watch the recording of the talk below.


And, sign up to our mailing list if you don't want to miss these talks.










Popular posts from this blog

Job: Student Research Assistant (m/w/d) for AI & Misinformation detection

Image
Join Us in Fighting Misinformation! We are seeking a passionate and skilled Research Assistant to contribute to cutting-edge projects at the intersection of AI, digital literacy, and societal impact. Be part of a team dedicated to developing AI-powered tools to help young people combat misinformation. If you are interested, submit your CV and a brief cover letter detailing your relevant experience and interest in combating misinformation through AI to Katja Raak - kraak@cs.uni-saarland.de .
Read more

Blog: The Importance of Good Data in Satellite Imagery Analysis

Introduction The phrase "Garbage-In-Garbage-Out" is well-known in data science, but it takes on new meaning in real-world projects, especially those involving satellite imagery. In these contexts where ground truth labels are often sparse, preprocessing becomes not just a step, but a cornerstone of success. Reflecting on my project, I have realized that understanding and preparing data account for about 70% (if not more) of the work and determines the quality of the results. Data preprocessing ensures that the inputs to your model are clean, structured, and tailored to the problem at hand. This is true for all kinds of data, whether tabular data, text, or images. However, the proper preprocessing steps come from initially "looking" at the data. That means preprocessing is dependent on the data and the task at hand.   Understanding Satellite Images Satellite images are far more than just pictures; they encode a wealth of information about the spectral signature of a ...
Read more

Job: Student Research Assistants (m/w/d)

Image
The Interdisciplinary Institute for Societal Computing (I2SC) is looking to hire 1-2 student research assistants to work on interesting projects contributing to the Society. Interested applicants are kindly requested to email their complete application (short cover letter, CV, summary of academic achievements in one PDF-file) to Katja Raak - kraak@cs.uni-saarland.de
Read more