“At the core of Gemma 3n is the MatFormer (🪆Matryoshka Transformer) architecture, a novel nested transformer built for elastic inference. Think of it like Matryoshka dolls: a larger model contains smaller, fully functional versions of itself.”

developers.googleblog.com/en/introduci...

“A pure LLM is essentially a lossy compression of the internet, a snapshot of knowledge from its training data.” www.codelink.io/blog/post/ai...

A great collected summary of @karpathy's Software 3.0 talk at YC AI Startup School.

By the time the video is released in a few weeks, the content will be deprecated.

www.latent.space/p/s3?publica...

Okay, circling back:
actually imo pytorch.orgs whole Learn segment is not that bad:
docs.pytorch.org/tutorials/be...
A Karpathy's whole yt:
www.youtube.com/@AndrejKarpa...
Hands on Machine Learning by Aurelien Geron
(I wouldnt recommend reading 'deck to deck' neither of the books.. ->

They advocates for a paradigm shift in web agent research: rather than forcing web agents to adapt to interfaces designed for humans, we should develop a new interaction paradigm specifically optimized for agents.

"Build the web for agents, not agents for the web"

arxiv.org/abs/2506.10953

“Prompt engineering has evolved dramatically since GPT-3, but I've started considering it as a subset of something broader: context engineering. The idea is to be deliberate about everything given to a model's context”

www.ignorance.ai/p/the-state-...

“Your role as a senior engineer has fundamentally shifted. You’re no longer just writing code—you’re curating knowledge, setting boundaries, and teaching both humans and AI systems how to work effectively.”

diwank.space/field-notes-...

“[Natasha Lyonne] had come to feel it was too late to ‘put the genie back in that bottle.’ ‘It’s better to get your hands dirty than pretend it’s not happening,’ she said.”

www.vulture.com/article/gene...

”This living playbook is based on our experience working with AI tools in the messy trenches of production software, where no one can afford to get away with vibes.”

blog.nilenso.com/blog/2025/05...

“We should be spending our mental cycles on design: designing the structure, the architecture, the user experience. Our skill as experienced full-stack designers and developers is now to direct AI to carry out our design.” - @briancasel.com

panelpodcast.com/11

“This transparency transforms git history from a record of changes into a record of intent, creating a new form of documentation that bridges human reasoning and machine implementation.”

www.maxemitchell.com/writings/i-r...

”LLMs demonstrate a strong bias towards aggressive statistical compression, whereas human conceptual systems appear to prioritize adaptive nuance and contextual richness, even if this results in lower compressional efficiency by our measures.”

arxiv.org/abs/2505.17117

“AI isn’t replacing us. It’s relieving us - of repetition, boilerplate, tedium.

And in their place: space to think bigger.

The next era of software won’t be written by AI. It’ll be written with it." - Sarah Mei

open.substack.com/pub/sarahmei...

“Every AI application is a hybrid application… we’re now programming with two fundamentally different types of computers: one that can write poetry but struggles with basic arithmetic, another that calculates flawlessly but can’t interact easily with humans in our own native languages...”

AI Engineer World Fair livestream is live right now: www.youtube.com/watch?v=z4zX...

Trends – Artificial Intelligence by Mary Meeker and Bond Cap (www.bondcap.com)

www.bondcap.com/report/tai/0