Lightnews — Scholar-powered news

SE Gyges @segyges.bsky.social · 1h

gotta square it yeah, my understanding is that the order of growth being square is essential even if we are dividing by some n first

1

SE Gyges @segyges.bsky.social · 1h

honestly leaky relu is much more intuitive to me and i feel like i want to try leaky relu^2 at some point

1 2

SE Gyges @segyges.bsky.social · 1h

this is the first one i am finding but there've been a few of these. any time you a/b test relu^2 against the gated activation family it seems to win arxiv.org/abs/2402.03804

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

Sparse computation offers a compelling solution for the inference of Large Language Models (LLMs) in low-resource scenarios by dynamically skipping the computation of inactive neurons. While tradition...

arxiv.org

3

SE Gyges @segyges.bsky.social · 1h

yeah that seems right

1

SE Gyges @segyges.bsky.social · 3h

i think i made the omission because i wasn't looking at math i was looking at "publicly states agenda-setting ideas" and shannon was a quiet guy by comparison

3 6

SE Gyges @segyges.bsky.social · 3h

like. it wouldn't have happened without Ada, or would have been much harder. but i cannot say Ada defines the field as it currently exists

1 10

SE Gyges @segyges.bsky.social · 3h

i guess: ada constructed one special-case computer program, turing formalized the definition of a computer program, and this means that she invented the thing but when we go to check on "what is a computer program" we hit bedrock at Turing

2 10

SE Gyges @segyges.bsky.social · 3h

so she started the thing, but what the core subject *was* was not established until the mid-20th C when we got the core theory all fleshed out

1 8

SE Gyges @segyges.bsky.social · 3h

she clearly has priority! i basically see Turing as finalizing the core of Ada's line of inquiry, so when i go to back-trace ideas I run to ground at Turing, who mentions Ada but is not using her work, and people post-Turing-JVN-Shannon are all directly using and extending their work

2 10

SE Gyges @segyges.bsky.social · 3h

she is at a minimum a very entertaining train wreck, okay

7

SE Gyges @segyges.bsky.social · 3h

also a solid contender bsky.app/profile/olen...

Peronism with American Characteristics @olenargy.bsky.social · 4h

Fight Club as a nihilism canary

2 22

SE Gyges @segyges.bsky.social · 4h

*would at least

1 9

SE Gyges @segyges.bsky.social · 4h

no you're fucking right i gotta take the L on this one

6

SE Gyges @segyges.bsky.social · 4h

SHIT i stand very much corrected. okay, the male version of this at least be more obviously seen as problematic bsky.app/profile/phas...

binary phase diagram @phasebinary.bsky.social · 4h

the male version of this is andrew tate, and I hate to break it to you...

1 1 35

SE Gyges @segyges.bsky.social · 4h

at the very least the male version of this novel would be fiction and much less easy for a million people to unironically decide was inspirational

3 16

SE Gyges @segyges.bsky.social · 4h

no but it means that a lot of the people we elevate as inspirational will

6

SE Gyges @segyges.bsky.social · 4h

listen i realize this is blaming a woman but let's be real men are barely verbal most of the time. if you're looking at how social commitments work in society women will have talked about it, men will have mostly just done it

1 34

SE Gyges @segyges.bsky.social · 4h

patient zero

3 10 130

Reposted by SE Gyges

Jason Adams @jamnpp.bsky.social · 6h

Sometimes there's so much beauty in the world,... I feel like I can't take it. And my heart is just going to cave in.

170 2.1K 8.4K

SE Gyges @segyges.bsky.social · 4h

like, it's a joke slur that is used in a joking and ironic way, but very clearly a slur as a piece of language and not as a judgement of whether it should be forbidden there. and i think it's a good joke and i like it, actually! and it veers quickly into being an actual regular-ass slur

1 5

SE Gyges @segyges.bsky.social · 4h

clanker is weird in that it's used as in a slur-like manner against fictitious people, but it's also very clearly being used to do actual race commentary and sometimes directly against people, which very clearly puts it on the edge of being an actual and not joke slur

2 9

SE Gyges @segyges.bsky.social · 4h

those are all real words with other use, but when discussing a person's ethnicity they are VERY clearly slurs

1 3

SE Gyges @segyges.bsky.social · 4h

if i start asking which of someone in a room is a mutt or mongrel or mudblood while being the only person who is very clearly one exact race, they would and should correctly understand me to be insulting all of them very badly

2 4

SE Gyges @segyges.bsky.social · 4h

i hard fucking disagree; mudblood has sufficient common use that it has at least two meanings and so it would be insane to always consider it a slur, but in the context of specifically being used about a real person it's very clearly a slur

2 4

SE Gyges @segyges.bsky.social · 4h

yoinking to main part of thread bsky.app/profile/segy...

SE Gyges @segyges.bsky.social · 5h

basically "this is a joke slur and it's kind of problematic" is, on bluesky, actually a scary accusation. it's both true and it's wokeness-shaped. so people went fucking insane and took the untenable position that it's not a slur, when it is, and just fucking lied to defend that position

6