Lightnews — Scholar-powered news

⚡️🌙 @dystopiabreaker.xyz · 1h

who would win, thousands of math/neuro/compsci/cogsci phds, or f(x)=max(0,x)

1 1

⚡️🌙 @dystopiabreaker.xyz · 1h

one of those slight, out-of-distribution tweaks that looks totally obvious in retrospect

1 1

⚡️🌙 @dystopiabreaker.xyz · 1h

it is baffling to me that mcculloch and pitts didn't discover relu

1 1

⚡️🌙 @dystopiabreaker.xyz · 1h

but fr i think that Werbos, Kunihiko Fukushima, and Vapnik + Chervonenkis are criminally unrecognized in defining modern AI or at least basically describing it

1 2

⚡️🌙 @dystopiabreaker.xyz · 2h

and then plato and the classics as well

1 5

⚡️🌙 @dystopiabreaker.xyz · 2h

the first thing i did when i got access to gpt3 in 2020 was generate socratic dialogs between von neumann, turing, gödel, nash, and newton

1 1 5

⚡️🌙 @dystopiabreaker.xyz · 2h

and this hides the reply _for everyone else_!

1

⚡️🌙 @dystopiabreaker.xyz · 2h

too easy to abuse imo and not actually effective at preventing pile-ons

7

⚡️🌙 @dystopiabreaker.xyz · 2h

and erodes the public record

1 23

⚡️🌙 @dystopiabreaker.xyz · 2h

this sets up unfavorable incentives across the entire platform in addition to the problem of interfering with sensemaking

2 24

⚡️🌙 @dystopiabreaker.xyz · 2h

the fact that blocking a user hides their reply for everyone, not just the user who blocked them, seems like an extremely toxic pattern for collective sense-making.

1. user makes [xyz claim]
2. another user corrects them
3. blocked, hidden

it should be explicitly shown as hidden instead

14 12 68

⚡️🌙 @dystopiabreaker.xyz · 3h

it's a lot easier with claude's help :)

1

⚡️🌙 @dystopiabreaker.xyz · 5h

among other feats such as winning gold medals at IOI and IMO

2

⚡️🌙 @dystopiabreaker.xyz · 5h

one of whom is warning everyone about imminent extinction and the other who is leading a company which is using LLMs to find and patch critical security vulnerabilities at and increasing pace

1 4

⚡️🌙 @dystopiabreaker.xyz · 5h

except, uh, the two AI experts who won the physics and chemistry nobel prizes last year

1 3

⚡️🌙 @dystopiabreaker.xyz · 5h

one of the funny things about posting with an anime pfp pseudonymously is that sometimes people make weird assumptions about you, for example that you’re posting about AI because you’re a NEET grok gooner who thinks their AI gf is conscious

4 6 77

⚡️🌙 @dystopiabreaker.xyz · 6h

sgd.fyi hopefully this helps

Built, or grown?

No, it wasn't… we designed the learning algorithm… But we don't really understand exactly how they do those things.

sgd.fyi

1

⚡️🌙 @dystopiabreaker.xyz · 6h

in which claude and i implement naive gradient descent that runs in javascript in your webbed browser

18

⚡️🌙 @dystopiabreaker.xyz · 6h

i made a thing that hopefully makes this clearer or is at least fun to play with: sgd.fyi

5 18 73

⚡️🌙 @dystopiabreaker.xyz · 11h

but i think there’s actually two kinds of determinism here,

- the strict definition (exactly the same prompt, greedy sampling should predict the same logits)
- the informal meaning, i.e. that there should be some deterministic relationship between different prompts