David R. MacIver
@drmaciver.bsky.social
Reposted by David R. MacIver
Many LM applications may be formulated as text generation conditional on some (Boolean) constraint.
Generate a…
- Python program that passes a test suite.
- PDDL plan that satisfies a goal.
- CoT trajectory that yields a positive reward.
The list goes on…
How can we efficiently satisfy these? 🧵👇
Generate a…
- Python program that passes a test suite.
- PDDL plan that satisfies a goal.
- CoT trajectory that yields a positive reward.
The list goes on…
How can we efficiently satisfy these? 🧵👇
May 13, 2025 at 2:22 PM
Many LM applications may be formulated as text generation conditional on some (Boolean) constraint.
Generate a…
- Python program that passes a test suite.
- PDDL plan that satisfies a goal.
- CoT trajectory that yields a positive reward.
The list goes on…
How can we efficiently satisfy these? 🧵👇
Generate a…
- Python program that passes a test suite.
- PDDL plan that satisfies a goal.
- CoT trajectory that yields a positive reward.
The list goes on…
How can we efficiently satisfy these? 🧵👇
Post a photo you took with no context to bring some zen to the timeline
March 10, 2025 at 10:53 AM
Post a photo you took with no context to bring some zen to the timeline
Reposted by David R. MacIver
Shrinkray has very sensible rules that apply well to languages it has no specific knowledge of -- we make a *lot* of use of this and it's brilliant! -- and it scales near-linearly to the number of cores. If you need a reducer, I highly recommend it! Thanks @drmaciver.bsky.social!
March 6, 2025 at 2:24 PM
Shrinkray has very sensible rules that apply well to languages it has no specific knowledge of -- we make a *lot* of use of this and it's brilliant! -- and it scales near-linearly to the number of cores. If you need a reducer, I highly recommend it! Thanks @drmaciver.bsky.social!
I wrote some notes on how LLMs work, aimed at non-programmers, that you might find interesting. notebook.drmaciver.com/posts/2025-0...
Feedback, corrections, and follow-on questions very welcome.
Feedback, corrections, and follow-on questions very welcome.
How do LLMs work?
notebook.drmaciver.com
February 8, 2025 at 3:42 PM
I wrote some notes on how LLMs work, aimed at non-programmers, that you might find interesting. notebook.drmaciver.com/posts/2025-0...
Feedback, corrections, and follow-on questions very welcome.
Feedback, corrections, and follow-on questions very welcome.
Every time you wonder how something in Hypothesis works, you can usually reverse engineer it from the following design logic:
1. What's the obvious, natural, way to do it.
2. What are the problems with that?
3. Can those be fixed? Not without doing something ridiculous and unreasonable.
4. Do that.
1. What's the obvious, natural, way to do it.
2. What are the problems with that?
3. Can those be fixed? Not without doing something ridiculous and unreasonable.
4. Do that.
December 18, 2024 at 10:28 AM
Every time you wonder how something in Hypothesis works, you can usually reverse engineer it from the following design logic:
1. What's the obvious, natural, way to do it.
2. What are the problems with that?
3. Can those be fixed? Not without doing something ridiculous and unreasonable.
4. Do that.
1. What's the obvious, natural, way to do it.
2. What are the problems with that?
3. Can those be fixed? Not without doing something ridiculous and unreasonable.
4. Do that.
@defenderofbasic.bsky.social I think that (possibly in a few minutes) this message is going to show up in your search.
December 17, 2024 at 4:12 PM
@defenderofbasic.bsky.social I think that (possibly in a few minutes) this message is going to show up in your search.
Something I very much enjoy on discord is when one of us memes the others into trying ridiculous exercises.
e.g. a while back we had a conversation about whether it was easy to stand on one leg with your eyes closed (it's not) and we had like a dozen people going "Surely it is..." and trying it.
e.g. a while back we had a conversation about whether it was easy to stand on one leg with your eyes closed (it's not) and we had like a dozen people going "Surely it is..." and trying it.
December 16, 2024 at 1:07 PM
Something I very much enjoy on discord is when one of us memes the others into trying ridiculous exercises.
e.g. a while back we had a conversation about whether it was easy to stand on one leg with your eyes closed (it's not) and we had like a dozen people going "Surely it is..." and trying it.
e.g. a while back we had a conversation about whether it was easy to stand on one leg with your eyes closed (it's not) and we had like a dozen people going "Surely it is..." and trying it.
I enjoyed the last threadapalooza I did, so I think I'll do another one or two in December. They're a good way of drawing out thoughts about topics, and I've got a couple of concepts that I'm trying to figure out how to articulate better.
Current candidate threadapalooza topics:
Current candidate threadapalooza topics:
December 15, 2024 at 11:14 AM
I enjoyed the last threadapalooza I did, so I think I'll do another one or two in December. They're a good way of drawing out thoughts about topics, and I've got a couple of concepts that I'm trying to figure out how to articulate better.
Current candidate threadapalooza topics:
Current candidate threadapalooza topics:
Are there any academics you're completionist about reading their papers?
e.g. you've got a google scholar alert that tells you when they've got a new paper out and always read it when they do.
e.g. you've got a google scholar alert that tells you when they've got a new paper out and always read it when they do.
December 11, 2024 at 11:55 AM
Are there any academics you're completionist about reading their papers?
e.g. you've got a google scholar alert that tells you when they've got a new paper out and always read it when they do.
e.g. you've got a google scholar alert that tells you when they've got a new paper out and always read it when they do.
I thought I was pretty good at self massage, but I'm sortof blown away at how effective this really simple technique that I didn't know is at relaxing me.
www.youtube.com/shorts/3fxEU...
www.youtube.com/shorts/3fxEU...
Quick Relief: Banish Muscle Knots with Sub-Occipital Massage in 45 Seconds
YouTube video by Next Level Physical Therapy
www.youtube.com
December 9, 2024 at 11:32 PM
I thought I was pretty good at self massage, but I'm sortof blown away at how effective this really simple technique that I didn't know is at relaxing me.
www.youtube.com/shorts/3fxEU...
www.youtube.com/shorts/3fxEU...
Absolutely go fuck yourself, duo.
December 6, 2024 at 1:27 PM
Absolutely go fuck yourself, duo.
x.com/DRMacIver/st...
This one isn't my top tweet of all time, it's only my tenth most quoted tweet of all time, but it probably is my best tweet of all time.
This one isn't my top tweet of all time, it's only my tenth most quoted tweet of all time, but it probably is my best tweet of all time.
December 5, 2024 at 1:51 PM
x.com/DRMacIver/st...
This one isn't my top tweet of all time, it's only my tenth most quoted tweet of all time, but it probably is my best tweet of all time.
This one isn't my top tweet of all time, it's only my tenth most quoted tweet of all time, but it probably is my best tweet of all time.
I posted this on discord and now we're all talking about how great animals are and all the animal species we like.
December 4, 2024 at 10:36 PM
I posted this on discord and now we're all talking about how great animals are and all the animal species we like.
Reposted by David R. MacIver
Korea Expert here. I’ll explain what’s going on over there because the Orient can be confusing to Westerners. In Korea, there is a concept known as “the law.” (법) This is a set of rules which are enforced to encourage prosocial behavior and ensure stability which leaders aren’t allowed to break.
December 3, 2024 at 9:24 PM
Korea Expert here. I’ll explain what’s going on over there because the Orient can be confusing to Westerners. In Korea, there is a concept known as “the law.” (법) This is a set of rules which are enforced to encourage prosocial behavior and ensure stability which leaders aren’t allowed to break.
One peril of too much philosophy is that if someone asks "Do you know X?" it's very easy to get into a spiral of "What even is knowledge??"
December 4, 2024 at 9:39 AM
One peril of too much philosophy is that if someone asks "Do you know X?" it's very easy to get into a spiral of "What even is knowledge??"
When an astute observation becomes a named law, it ceases to be a good observation.
December 3, 2024 at 5:27 PM
When an astute observation becomes a named law, it ceases to be a good observation.
If I had a nickel for every time I've invented a genuine improvement to binary search (for a specific application) I'd... Have two nickels. But it's weird that it's happened twice. notebook.drmaciver.com/posts/2024-1...
notebook.drmaciver.com/posts/2019-0...
notebook.drmaciver.com/posts/2019-0...
Filtered sampling from sorted values with incremental binary search
notebook.drmaciver.com
December 3, 2024 at 3:09 PM
If I had a nickel for every time I've invented a genuine improvement to binary search (for a specific application) I'd... Have two nickels. But it's weird that it's happened twice. notebook.drmaciver.com/posts/2024-1...
notebook.drmaciver.com/posts/2019-0...
notebook.drmaciver.com/posts/2019-0...
Bluesky really needs a per-account "turn off reposts from this account" feature like Twitter has. Or does it have one and I'm missing it?
December 3, 2024 at 1:15 PM
Bluesky really needs a per-account "turn off reposts from this account" feature like Twitter has. Or does it have one and I'm missing it?
Right, it's December 1st, and I said I'd do a 100 post thread on here instead of Twitter for Threadapalooza this year... but also it's late and I don't have much energy left, so here's the start of one:
1. This will be a thread about running an Internet community.
1. This will be a thread about running an Internet community.
December 1, 2024 at 9:57 PM
Right, it's December 1st, and I said I'd do a 100 post thread on here instead of Twitter for Threadapalooza this year... but also it's late and I don't have much energy left, so here's the start of one:
1. This will be a thread about running an Internet community.
1. This will be a thread about running an Internet community.
Tentatively I think I will be doing my threadapalooza thread on running communities on the internet.
November 28, 2024 at 2:28 PM
Tentatively I think I will be doing my threadapalooza thread on running communities on the internet.
You've probably seen it in the screenshot internet because everyone has at this point.
My brother was complaining that his friends keep posting it on Facebook. x.com/DRMacIver/st...
My brother was complaining that his friends keep posting it on Facebook. x.com/DRMacIver/st...
November 28, 2024 at 10:52 AM
You've probably seen it in the screenshot internet because everyone has at this point.
My brother was complaining that his friends keep posting it on Facebook. x.com/DRMacIver/st...
My brother was complaining that his friends keep posting it on Facebook. x.com/DRMacIver/st...
Reposted by David R. MacIver
The point is that I'm suspicious of the people who present this as an obvious issue. I tend to think of them as extremists. I particularly don't like the ones who ascribe sinister motivations to people on the other extreme, yet ignore the rest of us entirely.
November 21, 2024 at 5:31 PM
The point is that I'm suspicious of the people who present this as an obvious issue. I tend to think of them as extremists. I particularly don't like the ones who ascribe sinister motivations to people on the other extreme, yet ignore the rest of us entirely.
Reposted by David R. MacIver
I feel conflicted about it. Don't you?
When I'm working from home there's a lot that's gained, and there's a lot that's lost. There are bits of my job that work as well or better remotely, there are bits that suck when done remotely...
When I'm working from home there's a lot that's gained, and there's a lot that's lost. There are bits of my job that work as well or better remotely, there are bits that suck when done remotely...
November 21, 2024 at 5:31 PM
I feel conflicted about it. Don't you?
When I'm working from home there's a lot that's gained, and there's a lot that's lost. There are bits of my job that work as well or better remotely, there are bits that suck when done remotely...
When I'm working from home there's a lot that's gained, and there's a lot that's lost. There are bits of my job that work as well or better remotely, there are bits that suck when done remotely...