Talking Heads: Understanding Inter-layer Communication in Transformer Language Models
Jack Merullo, Carsten Eickhoff, Ellie Pavlick
Nuerips, 2024
Publications
Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting
Suraj Anand, Michael A. Lepori, Jack Merullo, Ellie Pavlick
preprint, 2024
Language Models Implement Simple Word2Vec-style Vector Arithmetic
Jack Merullo, Carsten Eickhoff, Ellie Pavlick
NAACL, 2024
Circuit Component Reuse Across Tasks in Transformer Language Models
Jack Merullo, Carsten Eickhoff, Ellie Pavlick
ICLR (Spotlight), 2024
Characterizing Mechanisms for Factual Recall in Language Models
Qinan Yu, Jack Merullo, Ellie Pavlick
EMNLP, 2023
Linearly Mapping from Image to Text Space
Jack Merullo, Louis Castricato, Carsten Eickhoff, Ellie Pavlick
ICLR, 2023
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution
Ankita Gupta, Marzena Karpinska, Wenlong Zhao, Kalpesh Krishna, Jack Merullo, Luke Yeh, Mohit Iyyer, Brendan O'Connor
EACL Findings, 2023
Does CLIP Bind Concepts? Probing Compositionality in Large Image Models
Martha Lewis, Nihal V. Nayak, Peilin Yu, Qinan Yu, Jack Merullo, Stephen H. Bach, Ellie Pavlick
preprint, 2022
ACQuA: Anomaly Classification with Quasi-Attractors
William Rudman, Jack Merullo, Laura Mercurio, Carsten Eickhoff
CinC, 2022
Pretraining on Interactions for Learning Grounded Affordance Representations
Jack Merullo, Dylan Ebert, Carsten Eickhoff, Ellie Pavlick
*SEM, 2022
Investigating Sports Commentator Bias within a Large Corpus of American Football Broadcasts
Jack Merullo*, Luke Yeh*, Abram Handler, Alvin Grissom II, Brendan O’Connor, Mohit Iyyer
EMNLP, 2019