David Marx
@digthatdata.bsky.social
1.5K followers 1.9K following 4.8K posts
Probabilistic ML, Learning Theory, Philosophy of Science, Complex Systems, Nonlinear Dynamics, Disinformation Intervention YIMBY Research MLE, CoreWeave + EleutherAI xStabilityai | xMSFT | xAMZN What I'm reading: https://dmarx.github.io/papers-feed/
Posts Media Videos Starter Packs
Pinned
digthatdata.bsky.social
The problem the democrats need to figure out isn't how to make their ideas/message more relevant to conservative voters, but how to get that message to them uncorrupted.
Reposted by David Marx
organizingpower.bsky.social
The importance of this question cannot be overstated: Trump has been communicating directly with Bondi through Truth Social about indicting his enemies. How this question is resolved is critical.
annabower.bsky.social
Important discovery fight taking shape in Kilmar Abrego Garcia's criminal case.

The question: Can the government assert privilege to avoid handing over documents that may be relevant to a defendant's vindictive prosecution claim?

Abrego's counsel says no.

www.documentcloud.org/documents/26...
www.documentcloud.org
Reposted by David Marx
sungkim.bsky.social
Radical Numerics' RND1

RND1 (Radical Numerics Diffusion) is an experimental open-sourced DLM with 30B params (3B active) with a sparse MoE architecture.

They are releasing weights, training details, and code to catalyze further research on DLM inference and post-training.
digthatdata.bsky.social
they do cite this paper in the related work section. I think they are claiming that this new paper is more general than the earlier one. Both papers came out of google research but have no overlapping authors, which is weird to me. Doesn't really matter.
digthatdata.bsky.social
meanwhile, republicans insist we don't even have enough money to fund critical infrastructure like FEMA.
chadbourn.bsky.social
News from the Authoritarians Club: the US Treasury has finalised a $20 billion currency swap with Argentina and directly bought Argentine pesos to help stabilise the country’s economy.
Reposted by David Marx
digthatdata.bsky.social
that might literally be all you need to do, I think you can probably just start adding content pages after
digthatdata.bsky.social
it means create a github account, then visit github.com/jackyzha0/qu... and press this option in the dropdown on the far right
digthatdata.bsky.social
adopt the perspective that you are training future PIs who will be supervising labs of semi-competent underlings whose work will require heavy scrutiny.
digthatdata.bsky.social
you can do this fairly easily by just creating a github account and following the instructions here. Just add new *.md documents to the contents/ folder and your website will automatically update itself.

quartz.jzhao.xyz/setting-up-y...
Setting up your GitHub repository
First, make sure you have Quartz cloned and setup locally. Then, create a new repository on GitHub.com.
quartz.jzhao.xyz
digthatdata.bsky.social
I thought we already knew ICL worked this way. Anyways, always happy to see corroborating evidence of stuff I thought was already well established.
shahabbakht.bsky.social
Interesting paper suggesting a mechanism for why in-context learning happens in LLMs.

They show that LLMs implicitly apply an internal low-rank weight update adjusted by the context. It’s cheap (due to the low-rank) but effective for adapting the model’s behavior.

#MLSky

arxiv.org/abs/2507.16003
Learning without training: The implicit dynamics of in-context learning
One of the most striking features of Large Language Models (LLM) is their ability to learn in context. Namely at inference time an LLM is able to learn new patterns without any additional weight updat...
arxiv.org
digthatdata.bsky.social
wasn't aware of this (or at least forgot if I was), thanks for the ray of light.
digthatdata.bsky.social
to be clear, that "quote" is ironic and not actually something that was said. I'm hyperbolizing the government's position that they could incite violence and then use that as a valid legal justification, which they *did* say

bsky.app/profile/jons...
jonseidel.bsky.social
Perry asks directly whether the feds started the alleged violence in Chicago.

She asks whether it matters if the inability to execute the law was "caused by the federal agents."

Hamilton: "No, your honor."
Reposted by David Marx
timfduffy.com
"In this book, I aim to convince you that the experts do not know, and you do not know, and society collectively does not and will not know, and all is fog."

Schwitzgebel's thesis is that AI consciousness is non-obvious, and clarity on the issue is not imminent. I've enjoyed what I've read so far.
eschwitz.bsky.social
New book in draft: AI and Consciousness [link in thread]
This book is a skeptical overview of the literature on AI and consciousness.
Anyone who emails me comments on the entire manuscript will be thanked in print and receive an appreciatively signed hard copy.
AI and Consciousness title page
digthatdata.bsky.social
I think there is at least a 30% chance trump will respond to the knowledge he's not getting it by invoking martial law.
digthatdata.bsky.social
> Judge: "If an ICE agent walked in here, grabbed my fist and used it to punch my own face with it: would that qualify as violence against the judiciary by an illinois resident justifying martial law?"
> Hamilton: "Yes it would your honor."
Reposted by David Marx
jonseidel.bsky.social
Perry asks again whether, if the inability to execute the law is b/c of the feds' "own provocation, does that matter under the law?"

Hamilton: "No, if that were true, the fact still remains that we are seeing sustained violence against federal personnel and property in Illinois."
digthatdata.bsky.social
wow.

DOJ lawyer just stated on the record that it is their position that the government can incite violence and then use that as legal justification to invoke martial law.
jonseidel.bsky.social
Perry asks directly whether the feds started the alleged violence in Chicago.

She asks whether it matters if the inability to execute the law was "caused by the federal agents."

Hamilton: "No, your honor."
Reposted by David Marx
jonseidel.bsky.social
Perry: "The president has made statements that could arguably be interpreted as stating that he believes elected state officials are impeding his ability to execute the law, is that a fair characterization?"

Hamilton: "Yes."
digthatdata.bsky.social
Assuming the country hasn't been completely torn to shreds by the time the democrats have had a chance to return to power, I haven't heard any proposals for how we deal with the fact that "trump appointed judge" functionally equates to "decides matters of law pretextually and in bad faith."