Ahmad Beirami
@abeirami.bsky.social
stealth // Gemini RL+inference @ Google DeepMind // Conversational AI @ Meta // RL Agents @ EA // ML+Information Theory @ MIT+Harvard+Duke // Georgia Tech PhD
📍{NYC, SFO, YYZ}
🔗 https://beirami.github.io/
📍{NYC, SFO, YYZ}
🔗 https://beirami.github.io/
Pinned
We are hiring Members of Technical Staff (Research Engineers)!
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Reposted by Ahmad Beirami
We are hiring Members of Technical Staff (Research Engineers)!
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
January 14, 2026 at 4:04 PM
We are hiring Members of Technical Staff (Research Engineers)!
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
We are hiring Members of Technical Staff (Research Engineers)!
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
January 14, 2026 at 4:04 PM
We are hiring Members of Technical Staff (Research Engineers)!
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
Current LLM agents lack reliability, creating a gap between demos and production. We solve this by automating the complex workflow of debugging, evaluation, and iteration required to make agents robust. 👇
- Iran is in a humanitarian crisis.
- Thousands are reported dead in 72 hours.
- We are past the point of solidarity. Empty words do not stop bullets. Action does.
- The world must intervene now.
- Thousands are reported dead in 72 hours.
- We are past the point of solidarity. Empty words do not stop bullets. Action does.
- The world must intervene now.
January 12, 2026 at 2:53 AM
- Iran is in a humanitarian crisis.
- Thousands are reported dead in 72 hours.
- We are past the point of solidarity. Empty words do not stop bullets. Action does.
- The world must intervene now.
- Thousands are reported dead in 72 hours.
- We are past the point of solidarity. Empty words do not stop bullets. Action does.
- The world must intervene now.
For years, Iran’s masked plainclothes regime thugs have abducted and murdered citizens with absolute impunity for wanting prosperity and refusing to fear them. Officials call it law enforcement and smear protesters as paid agents of the state’s enemies.
This must end. Iranian people must prevail!
This must end. Iranian people must prevail!
January 11, 2026 at 2:17 PM
For years, Iran’s masked plainclothes regime thugs have abducted and murdered citizens with absolute impunity for wanting prosperity and refusing to fear them. Officials call it law enforcement and smear protesters as paid agents of the state’s enemies.
This must end. Iranian people must prevail!
This must end. Iranian people must prevail!
Found myself repeating this to several students at NeurIPS:
When you’re choosing an internship or a job, what you work on and who you work with matter way more than the logo. Don’t optimize for brands. Become the brand!
When you’re choosing an internship or a job, what you work on and who you work with matter way more than the logo. Don’t optimize for brands. Become the brand!
December 9, 2025 at 2:17 AM
Found myself repeating this to several students at NeurIPS:
When you’re choosing an internship or a job, what you work on and who you work with matter way more than the logo. Don’t optimize for brands. Become the brand!
When you’re choosing an internship or a job, what you work on and who you work with matter way more than the logo. Don’t optimize for brands. Become the brand!
Hiring researchers & engineers to work on
–building reliable software on top of unreliable LLM primitives
–statistical evaluation of real-world deployments of LLM-based systems
I’m speaking about this on two NeurIPS workshop panels:
🗓️Saturday – Reliable ML Workshop
🗓️Sunday – LLM Evaluation Workshop
–building reliable software on top of unreliable LLM primitives
–statistical evaluation of real-world deployments of LLM-based systems
I’m speaking about this on two NeurIPS workshop panels:
🗓️Saturday – Reliable ML Workshop
🗓️Sunday – LLM Evaluation Workshop
December 2, 2025 at 2:55 PM
Hiring researchers & engineers to work on
–building reliable software on top of unreliable LLM primitives
–statistical evaluation of real-world deployments of LLM-based systems
I’m speaking about this on two NeurIPS workshop panels:
🗓️Saturday – Reliable ML Workshop
🗓️Sunday – LLM Evaluation Workshop
–building reliable software on top of unreliable LLM primitives
–statistical evaluation of real-world deployments of LLM-based systems
I’m speaking about this on two NeurIPS workshop panels:
🗓️Saturday – Reliable ML Workshop
🗓️Sunday – LLM Evaluation Workshop
Woke up to this email this morning
- Wow, I won a NeurIPS award?!
- …runner-up, but I’ll take it.
- Wait, I didn’t submit a paper.
- Ah, I’m chairing the session and I’m supposed to give the award.
Huge congratulations to the actual winners and runners-up!
- Wow, I won a NeurIPS award?!
- …runner-up, but I’ll take it.
- Wait, I didn’t submit a paper.
- Ah, I’m chairing the session and I’m supposed to give the award.
Huge congratulations to the actual winners and runners-up!
December 2, 2025 at 2:54 PM
Woke up to this email this morning
- Wow, I won a NeurIPS award?!
- …runner-up, but I’ll take it.
- Wait, I didn’t submit a paper.
- Ah, I’m chairing the session and I’m supposed to give the award.
Huge congratulations to the actual winners and runners-up!
- Wow, I won a NeurIPS award?!
- …runner-up, but I’ll take it.
- Wait, I didn’t submit a paper.
- Ah, I’m chairing the session and I’m supposed to give the award.
Huge congratulations to the actual winners and runners-up!
Reposted by Ahmad Beirami
If you're at @neuripsconf.bsky.social on Dec 6, don’t miss our panel session at @unireps.bsky.social with Ahmad Beirami, Sara Hooker and more to be announced! 🚀
Will be at NeurIPS Thu Dec 4 to Sun Dec 7, excited to reconnect with old friends and make new ones.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
November 23, 2025 at 9:44 AM
If you're at @neuripsconf.bsky.social on Dec 6, don’t miss our panel session at @unireps.bsky.social with Ahmad Beirami, Sara Hooker and more to be announced! 🚀
Will be at NeurIPS Thu Dec 4 to Sun Dec 7, excited to reconnect with old friends and make new ones.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
November 22, 2025 at 9:12 PM
Will be at NeurIPS Thu Dec 4 to Sun Dec 7, excited to reconnect with old friends and make new ones.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
If you are excited about AI engineering (orchestration, evals, and optimizing scaffolds), we are hiring!
On Saturday I’ll be on panels at the Reliable ML & UniReps workshops.
Once you see a math concept geometrically, it becomes much easier to think about, and it’s hard to go back to any other way of seeing it.
November 5, 2025 at 1:20 PM
Once you see a math concept geometrically, it becomes much easier to think about, and it’s hard to go back to any other way of seeing it.
I am sorry for what many of my excellent former colleagues are going through.
Layoffs can be emotionally challenging for everyone, whether you are directly affected or not.
Layoffs can be emotionally challenging for everyone, whether you are directly affected or not.
October 24, 2025 at 12:25 PM
I am sorry for what many of my excellent former colleagues are going through.
Layoffs can be emotionally challenging for everyone, whether you are directly affected or not.
Layoffs can be emotionally challenging for everyone, whether you are directly affected or not.
The math that LLMs can do today is novel enough to be considered publishable, but it's not the kind of math that would be consequential.
September 24, 2025 at 9:42 PM
The math that LLMs can do today is novel enough to be considered publishable, but it's not the kind of math that would be consequential.
Let's regress from here to AGI!
Kernel regression is the only way to achieve AGI
September 11, 2025 at 2:49 PM
Let's regress from here to AGI!
This is the conclusion slide of a talk I gave more than a year ago on RL/Alignment! It still holds true today.
September 10, 2025 at 1:07 PM
This is the conclusion slide of a talk I gave more than a year ago on RL/Alignment! It still holds true today.
This also applies to telling your story (e.g., in a CV, bio, interview, etc).
Focus on what you have accomplished and what you are excited about doing next; not just where you did it!
Focus on what you have accomplished and what you are excited about doing next; not just where you did it!
I occasionally get messages asking how to follow my path and get into Meta, DeepMind, or similar places. That is the wrong question. Do not focus on the brand! Focus on what you want to work on, then find the opportunity that fits your goals best.
September 9, 2025 at 2:07 PM
This also applies to telling your story (e.g., in a CV, bio, interview, etc).
Focus on what you have accomplished and what you are excited about doing next; not just where you did it!
Focus on what you have accomplished and what you are excited about doing next; not just where you did it!
Reposted by Ahmad Beirami
The actual unpopular opinion is that the notion of senior and junior authors should be abolished. It has completely diluted the notion of scientific authorship and created this entire industry of free-riding, head-in-the-clouds, incompetent PIs/managers. List down exact contributions instead. [+]
Unpopular opinion:
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
September 7, 2025 at 6:49 PM
The actual unpopular opinion is that the notion of senior and junior authors should be abolished. It has completely diluted the notion of scientific authorship and created this entire industry of free-riding, head-in-the-clouds, incompetent PIs/managers. List down exact contributions instead. [+]
I occasionally get messages asking how to follow my path and get into Meta, DeepMind, or similar places. That is the wrong question. Do not focus on the brand! Focus on what you want to work on, then find the opportunity that fits your goals best.
September 9, 2025 at 1:31 PM
I occasionally get messages asking how to follow my path and get into Meta, DeepMind, or similar places. That is the wrong question. Do not focus on the brand! Focus on what you want to work on, then find the opportunity that fits your goals best.
Reposted by Ahmad Beirami
Related to this if a paper turns out to have a major error in it, you’re supposed to throw yourself under the bus not your students.
Unpopular opinion:
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
September 7, 2025 at 5:35 PM
Related to this if a paper turns out to have a major error in it, you’re supposed to throw yourself under the bus not your students.
Corollary: If you lack bandwidth or expertise to act as the verifier, then you shouldn't sign up to be the senior author of a paper!
Unpopular opinion:
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
September 6, 2025 at 9:42 PM
Corollary: If you lack bandwidth or expertise to act as the verifier, then you shouldn't sign up to be the senior author of a paper!
Unpopular opinion:
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
September 6, 2025 at 8:35 PM
Unpopular opinion:
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
When a paper has a senior mentor and a junior mentee, the senior author must make sure the claims are correct and well supported. They must check every claim and gate the submission until it meets that bar.
This is the recipe for many provable claims:
Make enough assumptions and narrow down the claim, then prove a narrow result with caveats. Present it as broad, hide the caveats, and declare “XYZ is provable!”
Make enough assumptions and narrow down the claim, then prove a narrow result with caveats. Present it as broad, hide the caveats, and declare “XYZ is provable!”
September 6, 2025 at 3:27 PM
This is the recipe for many provable claims:
Make enough assumptions and narrow down the claim, then prove a narrow result with caveats. Present it as broad, hide the caveats, and declare “XYZ is provable!”
Make enough assumptions and narrow down the claim, then prove a narrow result with caveats. Present it as broad, hide the caveats, and declare “XYZ is provable!”
Today, Industry research is focused on short term (3-6months) bets. Academics have an opportunity to balance their portfolio with medium term (1-2 years) and long term (5-10 years) bets. Putting all academic efforts in short-term basket is suboptimal!
September 5, 2025 at 1:24 PM
Today, Industry research is focused on short term (3-6months) bets. Academics have an opportunity to balance their portfolio with medium term (1-2 years) and long term (5-10 years) bets. Putting all academic efforts in short-term basket is suboptimal!
When I worked in corporate, I was often first in the office because that routine worked for me. It was a personal preference, not a benchmark for anyone else.
We should not judge commitment by hours, especially in research. We should look for thoughtful work and steady progress.
We should not judge commitment by hours, especially in research. We should look for thoughtful work and steady progress.
September 2, 2025 at 1:39 PM
When I worked in corporate, I was often first in the office because that routine worked for me. It was a personal preference, not a benchmark for anyone else.
We should not judge commitment by hours, especially in research. We should look for thoughtful work and steady progress.
We should not judge commitment by hours, especially in research. We should look for thoughtful work and steady progress.
Common mistake in LLM prompting projects: jumping into full-scale pipelines (datasets and inference) without testing feasibility. Iterating at scale is expensive and time-consuming.
Start with ONE example to validate the hypothesis, verify context, debug the design, then scale.
Start with ONE example to validate the hypothesis, verify context, debug the design, then scale.
September 1, 2025 at 4:33 PM
Common mistake in LLM prompting projects: jumping into full-scale pipelines (datasets and inference) without testing feasibility. Iterating at scale is expensive and time-consuming.
Start with ONE example to validate the hypothesis, verify context, debug the design, then scale.
Start with ONE example to validate the hypothesis, verify context, debug the design, then scale.