Layered Bias: Interpreting Bias in Pretrained Large Language Models

Abstract

Large language models (LLMs) like GPT and PALM have excelled in numerous natural language processing (NLP) tasks such as text generation, question answering, and translation.However, they are also found to have inherent social biases.To address this, recent studies have proposed debiasing techniques like iterative nullspace projection (INLP) and Counterfactual Data Augmentation (CDA).Additionally, there's growing interest in understanding the intricacies of these models.Some researchers focus on individual neural units, while others examine specific layers.In our study, we benchmark newly released models, assess the impact of debiasing methods, and investigate how biases are linked to different transformer layers using a method called Logit Lens.Specifically, we evaluate three modern LLMs: OPT, LLaMA, and LLaMA2, and their debiased versions.Our experiments are based on two popular bias evaluation datasets, Stere-oSet and CrowS-Pairs, and we perform a layerby-layer analysis using the Logit Lens.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 11 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.