Berna Devezer
@devezer.bsky.social
Metascientist @ uidaho. I work at the intersection of behavioral sciences, statistics, and philosophy. Love thinking and talking about science. Post lots of cat and food pics. Allergic to unsolicited advice.
Pinned
Berna Devezer
@devezer.bsky.social
· Nov 5
I'd like to re-up this paper we published last year bec I believe it makes a fundamental contribution to theoretical metascience but it is woefully underappreciated. We address a key challenge in estimating the reproducibility of a result: The distance of a replication study from the original. 1/n
I am even warier than the authors about the broad-brush applications of the QRP label. However, I stand firmly against classifying data dredging/fishing expeditions as responsible research practice and as exploratory research. Science reform has distorted our understanding of scientific exploration.
P-hacking vs Exploratory Analyses
"Reanalyzing data through multiple methods in search of statistically significant results (i.e., p-hacking) is questionable only if concealed; when justified and transparently reported (e.g., exploratory studies), it reflects responsible practice."
"Reanalyzing data through multiple methods in search of statistically significant results (i.e., p-hacking) is questionable only if concealed; when justified and transparently reported (e.g., exploratory studies), it reflects responsible practice."
January 30, 2026 at 4:35 PM
I am even warier than the authors about the broad-brush applications of the QRP label. However, I stand firmly against classifying data dredging/fishing expeditions as responsible research practice and as exploratory research. Science reform has distorted our understanding of scientific exploration.
Did I talk to my students about ICE and immigration policies? Yes. Did it make me feel ultra self-conscious and somewhat apprehensive as an immigrant speaking to many first-gen college students, in rural Idaho, of all places? Yes, it very much did.
January 30, 2026 at 1:22 AM
Did I talk to my students about ICE and immigration policies? Yes. Did it make me feel ultra self-conscious and somewhat apprehensive as an immigrant speaking to many first-gen college students, in rural Idaho, of all places? Yes, it very much did.
Keep thinking about this and the core problem, of course, isn't the use of AI tools for science. It's the fact that we have established such a system of scientific norms and incentives that generated literatures-full of junk science that we're scared of a tech capable of scaling that up real fast.
Just like democracies are being put to the test around the world (and succumbing sooner than we hoped), our ideals of research integrity and scientific rigor are being tested by ever-invasive AI tools. I am not hopeful science will survive this unscathed. We'll need to rethink a lot of what we do.
OpenAI just released Prism, a LaTeX editor with embedded ChatGPT for free.
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
January 29, 2026 at 9:13 PM
Keep thinking about this and the core problem, of course, isn't the use of AI tools for science. It's the fact that we have established such a system of scientific norms and incentives that generated literatures-full of junk science that we're scared of a tech capable of scaling that up real fast.
received an ai-generated cover letter using keywords from all my pubs in one ridiculous paragraph but the student forgets to spell out what it is they're asking from me/what they're applying for. mindless, wasteful use of chatbots is making email even more intolerable. never knew that was possible!
January 29, 2026 at 5:32 PM
received an ai-generated cover letter using keywords from all my pubs in one ridiculous paragraph but the student forgets to spell out what it is they're asking from me/what they're applying for. mindless, wasteful use of chatbots is making email even more intolerable. never knew that was possible!
this is what happens when you get life advice from ChudGPT
Sounds fun!
January 29, 2026 at 5:22 AM
this is what happens when you get life advice from ChudGPT
Reposted by Berna Devezer
I wrote this song on Saturday, recorded it yesterday and released it to you today in response to the state terror being visited on the city of Minneapolis. It’s dedicated to the people of Minneapolis, our innocent immigrant neighbors and in memory of Alex Pretti and Renee Good.
Stay free
Stay free
Bruce Springsteen - Streets Of Minneapolis (Official Audio)
YouTube video by Bruce Springsteen
youtu.be
January 28, 2026 at 5:02 PM
I wrote this song on Saturday, recorded it yesterday and released it to you today in response to the state terror being visited on the city of Minneapolis. It’s dedicated to the people of Minneapolis, our innocent immigrant neighbors and in memory of Alex Pretti and Renee Good.
Stay free
Stay free
Reposted by Berna Devezer
I struggle every day to figure out what my role in this new hellscape is. I’ve dove much harder into teaching, and trying to teach philosophy as lifecraft and world building. But I have no idea whether it will ever feel worthwhile to write again.
January 28, 2026 at 7:16 PM
I struggle every day to figure out what my role in this new hellscape is. I’ve dove much harder into teaching, and trying to teach philosophy as lifecraft and world building. But I have no idea whether it will ever feel worthwhile to write again.
Reposted by Berna Devezer
My colleague Kevin Munger asked me and a bunch of editors to sit and think through AI and peer review. Our take:
osf.io/9sxnc/files/...
We envision an increased (!) involvement of humans in the evaluation of social science.
osf.io/9sxnc/files/...
We envision an increased (!) involvement of humans in the evaluation of social science.
January 28, 2026 at 11:46 PM
Reposted by Berna Devezer
REAKING: A federal judge in Minnesota has barred the Trump administration from arresting / detaining the state's 5,600 refugees while they await lawful permanent resident status. storage.courtlistener.com/recap/gov.us...
January 28, 2026 at 10:55 PM
REAKING: A federal judge in Minnesota has barred the Trump administration from arresting / detaining the state's 5,600 refugees while they await lawful permanent resident status. storage.courtlistener.com/recap/gov.us...
Reposted by Berna Devezer
It turns out that the information economy is just a continuous firesale of everything that made us informed in the first place, from journalism to science.
Just like democracies are being put to the test around the world (and succumbing sooner than we hoped), our ideals of research integrity and scientific rigor are being tested by ever-invasive AI tools. I am not hopeful science will survive this unscathed. We'll need to rethink a lot of what we do.
OpenAI just released Prism, a LaTeX editor with embedded ChatGPT for free.
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
January 28, 2026 at 10:27 PM
It turns out that the information economy is just a continuous firesale of everything that made us informed in the first place, from journalism to science.
some people can be so casually cruel that mere exposure to it leaves me emotionally drained. it's one thing to experience that online or indirectly but witnessing it irl just sucks all life right out of me. i feel so aggravated
January 28, 2026 at 8:26 PM
some people can be so casually cruel that mere exposure to it leaves me emotionally drained. it's one thing to experience that online or indirectly but witnessing it irl just sucks all life right out of me. i feel so aggravated
Just like democracies are being put to the test around the world (and succumbing sooner than we hoped), our ideals of research integrity and scientific rigor are being tested by ever-invasive AI tools. I am not hopeful science will survive this unscathed. We'll need to rethink a lot of what we do.
OpenAI just released Prism, a LaTeX editor with embedded ChatGPT for free.
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
Writing a paper has never been easier.
Clogging the scientific publishing pipeline has never been easier.
It took me 54 seconds to write up an experiment I did not actually conduct.
prism.openai.com
January 28, 2026 at 4:48 PM
Just like democracies are being put to the test around the world (and succumbing sooner than we hoped), our ideals of research integrity and scientific rigor are being tested by ever-invasive AI tools. I am not hopeful science will survive this unscathed. We'll need to rethink a lot of what we do.
Reposted by Berna Devezer
First post of the year, new paper out today: we present possibly the biggest case of systematic Measurement Schmeasurement in tech use. It seems that most studies on gaming (videogame) addiction/disorder haven't measured gaming after all. This research took years, so long 🧵 doi.org/10.1098/rsos...
Confusion in gaming disorder measurement
Abstract. Measurement is important for the scientific programmes of addictive behaviours. In the present study, we investigated the measurement of gaming d
doi.org
January 28, 2026 at 9:56 AM
First post of the year, new paper out today: we present possibly the biggest case of systematic Measurement Schmeasurement in tech use. It seems that most studies on gaming (videogame) addiction/disorder haven't measured gaming after all. This research took years, so long 🧵 doi.org/10.1098/rsos...
Reposted by Berna Devezer
relics from more peaceful online times: several years ago @devezer.bsky.social tweeted about Jazz24 (www.jazz24.org) and to this day it's been improving my work mood :)
Jazz24 Internet Radio
Listen to free jazz radio featuring Miles Davis, John Coltrane, Diana Krall and more. Immerse yourself in jazz classics and contemporary hits, all curated by our DJs.
www.jazz24.org
January 28, 2026 at 1:55 PM
relics from more peaceful online times: several years ago @devezer.bsky.social tweeted about Jazz24 (www.jazz24.org) and to this day it's been improving my work mood :)
Reposted by Berna Devezer
Wittgenstein's hot take on psychological science remains accurate, timely, and unparalleled
January 17, 2025 at 6:11 PM
Wittgenstein's hot take on psychological science remains accurate, timely, and unparalleled
Great thread! Also works as a metaphor for science. This is the reason why overzealous attempts to automate broad processes in science are bound to fail. Scientists need to actively engage with their science to make the right calls at every step.
"Eight minutes?" I asked, hesitantly.
"UNTIL THEY'RE DONE!"
Oh. Right.
Of course.
In my attempt to Do It Correctly, I had forgotten the most important part: actually engaging with the food I was working with.
"UNTIL THEY'RE DONE!"
Oh. Right.
Of course.
In my attempt to Do It Correctly, I had forgotten the most important part: actually engaging with the food I was working with.
January 27, 2026 at 7:41 PM
Great thread! Also works as a metaphor for science. This is the reason why overzealous attempts to automate broad processes in science are bound to fail. Scientists need to actively engage with their science to make the right calls at every step.
at 49, sleeping is an extreme sport. woke up with an inexplicable and excruciating neck pain. now there's no looking toward the left. must have had some wild dreams! advil used to be my friend until it messed up my stomach. today's challenge is to carry this massive head on top of my shoulders.
January 27, 2026 at 4:19 PM
at 49, sleeping is an extreme sport. woke up with an inexplicable and excruciating neck pain. now there's no looking toward the left. must have had some wild dreams! advil used to be my friend until it messed up my stomach. today's challenge is to carry this massive head on top of my shoulders.
Reposted by Berna Devezer
The American Federation of Government Employees, which represents border patrol officers at the National Border Patrol Council, calls on Kristi Noem and Stephen Miller to resign or be fired
January 27, 2026 at 2:07 AM
The American Federation of Government Employees, which represents border patrol officers at the National Border Patrol Council, calls on Kristi Noem and Stephen Miller to resign or be fired
Reposted by Berna Devezer
Reposted by Berna Devezer
"Machine learning research is not serious research & therefore hallucinated references are not necessarily a big deal, agrees prestigious group of ML researchers"
I ❤️ when the titles write themselves
But seriously, I don't think there's much to debate statmodeling.stat.columbia.edu/2026/01/26/m...
I ❤️ when the titles write themselves
But seriously, I don't think there's much to debate statmodeling.stat.columbia.edu/2026/01/26/m...
Machine learning research is not serious research and therefore hallucinated references are not necessarily a big deal, agrees a prestigious group of machine learning researchers | Statistical Modeli...
statmodeling.stat.columbia.edu
January 27, 2026 at 12:31 AM
"Machine learning research is not serious research & therefore hallucinated references are not necessarily a big deal, agrees prestigious group of ML researchers"
I ❤️ when the titles write themselves
But seriously, I don't think there's much to debate statmodeling.stat.columbia.edu/2026/01/26/m...
I ❤️ when the titles write themselves
But seriously, I don't think there's much to debate statmodeling.stat.columbia.edu/2026/01/26/m...
looking at academic bsky, one might get the opposite idea, but out in the wild, many researchers have never heard of or worried about formal causal inference, and they get bewildered to hear that perhaps they shouldn't just freely use causal language when interpreting their correlational results.
January 26, 2026 at 10:09 PM
looking at academic bsky, one might get the opposite idea, but out in the wild, many researchers have never heard of or worried about formal causal inference, and they get bewildered to hear that perhaps they shouldn't just freely use causal language when interpreting their correlational results.
Reposted by Berna Devezer
Hit the paws button on your busy day.
January 26, 2026 at 7:27 PM
Hit the paws button on your busy day.
be curious. embrace awe.
January 26, 2026 at 6:44 PM
be curious. embrace awe.
Reposted by Berna Devezer
lllllloooooonnnnnnngggggg
January 26, 2026 at 12:20 AM
lllllloooooonnnnnnngggggg
lllllloooooonnnnnnngggggg
January 26, 2026 at 12:20 AM
lllllloooooonnnnnnngggggg