Title
Gender Bias in Contextualized Word Embeddings.
Abstract
In this paper, we quantify, analyze and mitigate gender bias exhibited in ELMou0027s contextualized word vectors. First, we conduct several intrinsic analyses and find that (1) training data for ELMo contains significantly more male than female entities, (2) the trained ELMo embeddings systematically encode gender information and (3) ELMo unequally encodes gender information about male and female entities. Then, we show that a state-of-the-art coreference system that depends on ELMo inherits its bias and demonstrates significant bias on the WinoBias probing corpus. Finally, we explore two methods to mitigate such gender bias and show that the bias demonstrated on WinoBias can be eliminated.
Year
Venue
Field
2019
arXiv: Computation and Language
Computer science,Cognitive psychology,Gender bias,Artificial intelligence,Natural language processing
DocType
Volume
Citations 
Journal
abs/1904.03310
2
PageRank 
References 
Authors
0.39
0
6
Name
Order
Citations
PageRank
Jieyu Zhao1505.89
Tianlu Wang2384.68
Mark Yatskar317611.14
Ryan Cotterell48513.66
Vicente Ordonez5141869.65
Kai-Wei Chang64735276.81