Josh Barua.

Josh Barua

Hey there! I'm a research fellow at the Cambridge-Boston Alignment Initiative, working with Aaron Mueller. Before this, I was a predoctoral researcher at UT Austin with Kyle Mahowald. And even before that, I was an undergrad at UC Berkeley 🐻, where I was fortunate to get my start in research with Alane Suhr. I have also interned at CMU LTI (with Graham Neubig) and the MIT Lincoln Lab.

firstlast [at] berkeley.edu

Research interests

Nowadays, I mostly work on the interpretability of language models, with a focus on explanations rooted in data, learning, and representation. I'm particularly interested in questions and phenomena that have natural implications for our ability to control and align models. I often draw inspiration from more mature fields (e.g., cognitive science, linguistics, physics) that have made progress in understanding by developing simple, but principled, models of more complex systems.

β€œAll models are wrong, but some are useful.”

β€” George Box

Updates

[Oct 2026] New preprint! We find VLM preferences given conflicting information can be well approximated as Bayesian inference.
[May 2026] Started as a research fellow at CBAI, working with Aaron Mueller on interp!
[Jan 2026] Our paper Long Chain-of-Thought Reasoning Across Languages was accepted to ICLR 2026! See you in Brazil πŸ‡§πŸ‡·
[Sep 2025] Spending the next year at UT Austin working with Kyle Mahowald 🀘
[Jul 2025] Our paper Long Chain-of-Thought Reasoning Across Languages was accepted to the ScalR Workshop at COLM! See you in MontrΓ©al πŸ‡¨πŸ‡¦
[May 2025] I started my research internship at CMU LTI working with Graham Neubig!
[Sep 2024] Our paper Using Language Models to Disambiguate Lexical Choices in Translation was accepted to EMNLP 2024! See you in Miami 🌴