Lightnews — Scholar-powered news

Kameron Decker Harris

@kamdh.bsky.social

450 followers 190 following 1.8K posts

Computational neuroscientist and computer science professor Western Washington University Applied mathematics PhD Fan of Nature https://glomerul.us

glomerul.us

Posts Media Videos Starter Packs

Pinned

Kameron Decker Harris @kamdh.bsky.social · Nov 9

New paper! "Learning Stochastic Rainbow Networks"
By Vivian White, Muawiz Chaudhary, Guy Wolf, @glajoie.bsky.social, and me

(to appear at Sci4DL NeurIPS workshop)

openreview.net/forum?id=bvJ...

#deeplearning #machinelearning #mathematics

Learning Stochastic Rainbow Networks

Random feature models are a popular approach for studying network learning that can capture important behaviors while remaining simpler than traditional training. Guth et al. [2024] introduced...

openreview.net

2 2 17

Kameron Decker Harris @kamdh.bsky.social · 1d

Silas sighting!

Cascadia Daily News @cascadiadaily.com · 1d

Turns All Year is an elite group of skiers and snowboarders who seek out any patch of snow they can find to ensure they ride at least one day every month.

Turns all year: The backcountry skiers, snowboarders who ride year-round | Cascadia Daily News

Founder Silas Wild, 77, currently has 336 consecutive months skiing

www.cascadiadaily.com

1 1

Kameron Decker Harris @kamdh.bsky.social · 2d

Here you go: www.jmlr.org/papers/v25/2...
You might also like our work where we showed similar effects (and more) in a related model: openreview.net/pdf?id=bvJ4U...

A Rainbow in Deep Network Black Boxes

www.jmlr.org

1 1

Kameron Decker Harris @kamdh.bsky.social · 2d

What's your policy on AI usage in your class? I'm doing some short form in-class writing assignments where I can be sure they're doing it with just pencil, paper, and brain

Kameron Decker Harris @kamdh.bsky.social · 2d

It's not about contextual modulation, but it makes the argument that the weights you find in standard deep networks for image classification are effectively low-rank and that the same goes for the feature embeddings

1 1

Kameron Decker Harris @kamdh.bsky.social · 2d

😂

Kameron Decker Harris @kamdh.bsky.social · 2d

Neat, I'm mostly aware of the work in earlier models for things like vision, including the so-called "rainbow networks" paper by Guth et al

1 1

Kameron Decker Harris @kamdh.bsky.social · 2d

There have been a couple papers showing that low rank weights are common in deep nets, although I'm not sure of work in that area for LLMs

Kameron Decker Harris @kamdh.bsky.social · 2d

It kinda makes sense if you believe that weights already are fairly low dimensional/rank, so that a lower-D perturbation could have a major impact on the network function

1 2

Kameron Decker Harris @kamdh.bsky.social · 4d

I get that. It was fun for me as a sci-fi epic and academic satire

Kameron Decker Harris @kamdh.bsky.social · 5d

Redwall was formative. Did you check out Anathem by Neal Stephenson?

1 1

Kameron Decker Harris @kamdh.bsky.social · 6d

Dystopia today

Nigel Goldenfeld @nigelgoldenfeld.bsky.social · 7d

"Armed federal agents in military fatigues ... pulling men, women and children from their apartments, some of them naked... Agents approached or entered nearly every apartment in the five-story building, and U.S. citizens were among those detained for hours."

www.wbez.org/immigration/...

Massive immigration raid on Chicago apartment building leaves residents reeling: 'I feel defeated'

The Department of Homeland Security said federal agents with Border Patrol, the FBI and the Bureau of Alcohol, Tobacco, Firearms and Explosives arrested 37 people in the raid.

www.wbez.org

Reposted by Kameron Decker Harris

Nigel Goldenfeld @nigelgoldenfeld.bsky.social · 7d

Massive immigration raid on Chicago apartment building leaves residents reeling: 'I feel defeated'

The Department of Homeland Security said federal agents with Border Patrol, the FBI and the Bureau of Alcohol, Tobacco, Firearms and Explosives arrested 37 people in the raid.

www.wbez.org

1 3 3

Kameron Decker Harris @kamdh.bsky.social · 7d

Very cool! You'll be our neighbor to the north. I'd love to reconnect... perhaps over delicious food in your new city ;-)

All the best

Kameron Decker Harris @kamdh.bsky.social · 7d

Great thread here!

Gaël Varoquaux @gaelvaroquaux.bsky.social · 7d

Normative framework of bigger tech

(aka, me trolling the tech audience)

Gaël Varoquaux @gaelvaroquaux.bsky.social · 7d

Come to my lightning talk
At @pydataparis.bsky.social in a few minutes

Kameron Decker Harris @kamdh.bsky.social · 7d

Jevons paradox! en.wikipedia.org/wiki/Jevons_...

Jevons paradox - Wikipedia

en.wikipedia.org

Reposted by Kameron Decker Harris

Melanie Mitchell @melaniemitchell.bsky.social · 8d

Andrew Ng: "AI is the new electricity!"

Cory Doctorow: "AI is the asbestos we are shoveling into the walls of our society and our descendants will be digging it out for generations."

¯\_(ツ)_/¯

(pluralistic.net/2025/09/27/e...)

8 110 480

Kameron Decker Harris @kamdh.bsky.social · 10d

Very cool, congrats!

1 1

Kameron Decker Harris @kamdh.bsky.social · 12d

I mean, this seems like the way. At some point journals themselves are no longer relevant for spreading info. They become a way to manage the peer review and as prestige stamps. As a small lab at a small uni, we cannot pay extortionate or even small APCs

1 1

Kameron Decker Harris @kamdh.bsky.social · 13d

This is madness

Reposted by Kameron Decker Harris

ascalaphid @ascalaphid.com · 15d

Cylindrocopturus munitus

1 16 94

Kameron Decker Harris @kamdh.bsky.social · 15d

The new view is great

Kameron Decker Harris @kamdh.bsky.social · 15d

Ah man, yeah but the caveat is there is no cooling in the office... because "efficiency." So I gotta keep the door open and a fan blowing in cold air when it's hot

Kameron Decker Harris @kamdh.bsky.social · 15d

Bookshelves could use some filling out

Kameron Decker Harris @kamdh.bsky.social · 15d

Same foundations of monitor ergonomics

1 3

Kameron Decker Harris @kamdh.bsky.social · 15d

New year, new office, same books, same dead plants! (I've gotta get some nice fake plants.)

2 7