Lightnews — Scholar-powered news

Sasha Rush

@srushnlp.bsky.social

7.2K followers 47 following 37 posts

Professor, Programmer in NYC. Cornell, Hugging Face 🤗

Posts Media Videos Starter Packs

Reposted by Sasha Rush

Naomi Saphra @nsaphra.bsky.social · Feb 5

If you're in Berkeley or like a nice streamed talk, I'm about to give a talk at the Simons Institute today: "You Know It Or You Don’t: Compositionality and Phase Transitions in LMs". Tune in at 4PM pacific!

No abstract available.

simons.berkeley.edu

Sasha Rush @srushnlp.bsky.social · Feb 4

I'm hanging around with Theorists 🤓

Sasha Rush @srushnlp.bsky.social · Feb 4

What to know about DeepSeek

youtu.be/0eMzc-WnBfQ?...

In which we attempt to figure out MoE, o1, scaling, tech reporting, modern semiconductors, microeconomics, and international geopolitics.

How DeepSeek Changes the LLM Story

YouTube video by Sasha Rush 🤗

Sasha Rush @srushnlp.bsky.social · Jan 30

These are great recommendations thank you.

Sasha Rush @srushnlp.bsky.social · Jan 30

For reasons, I find myself thinking a lot about the history of US/USSR Cold War science, particularly in applied math. Does anyone have a recommendation for a good book on this topic?

Sasha Rush @srushnlp.bsky.social · Jan 7

Yeah vertical is kind of dumb, but I thought I try it out.

Sasha Rush @srushnlp.bsky.social · Jan 7

😆, I noticed I have trouble saying that word.

however if you listen to your own videos then you will never manage to release anything.

Sasha Rush @srushnlp.bsky.social · Jan 7

10 short videos about LLM infrastructure to help you appreciate Pages 12-18 of the DeepSeek-v3 paper (arxiv.org/abs/2412.19437)

www.youtube.com/watch?v=76gu...

Flash LLMs: Pipeline Parallel

YouTube video by Sasha Rush 🤗

www.youtube.com

Sasha Rush @srushnlp.bsky.social · Jan 7

Thought this "Bill Gates" guy was on the level.

Sasha Rush @srushnlp.bsky.social · Jan 7

I'll try it out. Good to check once a year to see if I'm secretly an existential risk guy.

Sasha Rush @srushnlp.bsky.social · Jan 6

I mean Microsoft under the table bought his company, right?

Luckily there is no indication from the review he read the book.

Sasha Rush @srushnlp.bsky.social · Jan 6

Maybe I'll just use bluesky to rant about topics I'm too scared to talk about on twitter.

Sasha Rush @srushnlp.bsky.social · Jan 6

The casual conflation of AI with gene editing is intellectual malpractice. These two things have nothing to do with each other!

Sasha Rush @srushnlp.bsky.social · Jan 6

Would love to read a good book about this topic if anyone wants to give it a try.

Sasha Rush @srushnlp.bsky.social · Jan 6

I've been listening to too much If Books Could Kill, so now I'm convinced these airport books are actually the only thing that matters.

Sasha Rush @srushnlp.bsky.social · Jan 6

I tried reading this book, and I was just shocked at how little insight it had, and it's sheer inability to focus. The fact that it is being recommended to policy makers...

www.gatesnotes.com/The-Coming-W...

www.gatesnotes.com

Sasha Rush @srushnlp.bsky.social · Dec 27

I'm going to do a live coding stream for the next couple of hours. We'll start by running through some WebGPU tutorials. Can also talk about some AI stuff.

www.youtube.com/watch?v=sqKq...

Python + WebGPU

YouTube video by Sasha Rush 🤗

www.youtube.com

Reposted by Sasha Rush

Lewis Tunstall @lewtun.bsky.social · Dec 16

We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥

How? By combining step-wise reward models with tree search algorithms :)

We're open sourcing the full recipe and sharing a detailed blog post 👇

Sasha Rush @srushnlp.bsky.social · Dec 12

huh, so maybe OCaml should be the target for verifiable generation? I heard you guys have ways to build fast

Sasha Rush @srushnlp.bsky.social · Dec 11

As coding LLMs get faster at inference, iterating verification-in-the-loop tests becomes the bottleneck for coding agents. Probably need quite different programming systems for these settings, or even things like "batchable" runtimes, whatever that means.

Reposted by Sasha Rush

antonio vergari ⚔️ short-circuiting @nolovedeeplearning.bsky.social · Dec 6

We organised a lively poster fest with many students rehearsing for the upcoming @neuripsconf.bsky.social next week and others discussing their cool works!

Thanks to #GAIL, the #Generative #AI lab in #Edinburgh for sponsoring the event!

Sasha Rush @srushnlp.bsky.social · Dec 6

Reposted by Sasha Rush

Andrew Gordon Wilson @andrewgwils.bsky.social · Dec 5

I wanted to make my first post about a project close to my heart. Linear algebra is an underappreciated foundation for machine learning. Our new framework CoLA (Compositional Linear Algebra) exploits algebraic structure arising from modelling assumptions for significant computational savings! 1/4

Reposted by Sasha Rush

Margaret Mitchell @mmitchell.bsky.social · Dec 3

Proud of my amazing colleague @sashamtl.bsky.social for her much deserved recognition on advancing the science of AI energy use.
BBC100: www.bbc.co.uk/news/resourc...
Fast Company: www.fastcompany.com/91233692/why...
Sasha has been working tirelessly moving things fwd--endurance & brilliance in one.

Screenshot of BBC 100 picture of Sasha and blurb; linked in post.

Reposted by Sasha Rush

Kempner Institute at Harvard University @kempnerinstitute.bsky.social · Dec 3

NEW: we have an exciting opportunity for a tenure-track professor at the #KempnerInstitute and the John A. Paulson School of Engineering and Applied Sciences (SEAS). Read the full description & apply today: academicpositions.harvard.edu/postings/14362
#ML #AI