@tiddlydump.bsky.social
Data Scientist, #rstats
Might also post pictures of my weirder cat, I guess.
Might also post pictures of my weirder cat, I guess.
If they're familiar with dplyr, you can plug into it using a DBI::dbConnect and hit it that way.
I shudder at the thought of opening a csv that large on its own, even if `data.table::fread` or `arrow::read_csv_arrow` go brrrrr
I shudder at the thought of opening a csv that large on its own, even if `data.table::fread` or `arrow::read_csv_arrow` go brrrrr
January 15, 2026 at 1:21 AM
If they're familiar with dplyr, you can plug into it using a DBI::dbConnect and hit it that way.
I shudder at the thought of opening a csv that large on its own, even if `data.table::fread` or `arrow::read_csv_arrow` go brrrrr
I shudder at the thought of opening a csv that large on its own, even if `data.table::fread` or `arrow::read_csv_arrow` go brrrrr
They couldn't call someone at *any* fast food place?
January 15, 2026 at 12:08 AM
They couldn't call someone at *any* fast food place?
The new face of {tidyr}
January 14, 2026 at 4:03 PM
The new face of {tidyr}
One thing that characterizes "tidy data", and is a reason it's so useful for analytics, is "pivotability".
But! It's hard not to wander into terms that are engineery (and where I lack real expertise). I don't want to accidentally ask for a bunch of OLAP cubes & have them stop listening after that!
But! It's hard not to wander into terms that are engineery (and where I lack real expertise). I don't want to accidentally ask for a bunch of OLAP cubes & have them stop listening after that!
January 14, 2026 at 3:47 PM
One thing that characterizes "tidy data", and is a reason it's so useful for analytics, is "pivotability".
But! It's hard not to wander into terms that are engineery (and where I lack real expertise). I don't want to accidentally ask for a bunch of OLAP cubes & have them stop listening after that!
But! It's hard not to wander into terms that are engineery (and where I lack real expertise). I don't want to accidentally ask for a bunch of OLAP cubes & have them stop listening after that!
When people do think about WWI (and they rarely do), it's already common to read back into the Germany of WWI the true villainy on display in WWII.
They were an enemy, sure, but not an enemy of civilization.
They were an enemy, sure, but not an enemy of civilization.
January 14, 2026 at 5:55 AM
When people do think about WWI (and they rarely do), it's already common to read back into the Germany of WWI the true villainy on display in WWII.
They were an enemy, sure, but not an enemy of civilization.
They were an enemy, sure, but not an enemy of civilization.
It's not easy to have interesting takes on WWI. I'm doing my best!
January 14, 2026 at 2:16 AM
It's not easy to have interesting takes on WWI. I'm doing my best!
Passchendaele was the turning point for the UK, and almost every bad thing that's happened to the UK since then can be traced back to throwing away the lives of ~ 200,000+ young men in a pit of mud.
We should start up some good WWII discourse.
Maybe WWI even.
Maybe WWI even.
January 14, 2026 at 1:33 AM
Passchendaele was the turning point for the UK, and almost every bad thing that's happened to the UK since then can be traced back to throwing away the lives of ~ 200,000+ young men in a pit of mud.
I'm an idiot, but I *am* able to follow directions. In light of that, `rix` is a super easy workflow (we use it within Docker to plug into our MLOps process).
I haven't tried it yet, rix should support those installs!
docs.ropensci.org/rix/articles...
Maybe hit up @brodriguesco.bsky.social!
I haven't tried it yet, rix should support those installs!
docs.ropensci.org/rix/articles...
Maybe hit up @brodriguesco.bsky.social!
d1 - Installing R and Python packages in a Nix environment
docs.ropensci.org
January 14, 2026 at 12:22 AM
I'm an idiot, but I *am* able to follow directions. In light of that, `rix` is a super easy workflow (we use it within Docker to plug into our MLOps process).
I haven't tried it yet, rix should support those installs!
docs.ropensci.org/rix/articles...
Maybe hit up @brodriguesco.bsky.social!
I haven't tried it yet, rix should support those installs!
docs.ropensci.org/rix/articles...
Maybe hit up @brodriguesco.bsky.social!
What's that sound I hear on the wind?
"Use `rix` on Windows via WSL"
docs.ropensci.org/rix/articles...
(Disclaimer: I haven't had to do this because we use AWS EC2)
"Use `rix` on Windows via WSL"
docs.ropensci.org/rix/articles...
(Disclaimer: I haven't had to do this because we use AWS EC2)
b1 - Setting up and using Nix and rix on Linux and Windows
docs.ropensci.org
January 13, 2026 at 11:56 PM
What's that sound I hear on the wind?
"Use `rix` on Windows via WSL"
docs.ropensci.org/rix/articles...
(Disclaimer: I haven't had to do this because we use AWS EC2)
"Use `rix` on Windows via WSL"
docs.ropensci.org/rix/articles...
(Disclaimer: I haven't had to do this because we use AWS EC2)
I might strip out some of the terminology. Melt, gather, long, etc end up being loaded for them such that we sail right past each other.
This is probably the place to start, either way. (And ch 5 of R4DS Ed2)
This is probably the place to start, either way. (And ch 5 of R4DS Ed2)
January 13, 2026 at 5:59 PM
I might strip out some of the terminology. Melt, gather, long, etc end up being loaded for them such that we sail right past each other.
This is probably the place to start, either way. (And ch 5 of R4DS Ed2)
This is probably the place to start, either way. (And ch 5 of R4DS Ed2)
I'm happy to rewrite / translate from R4DS and other sources, but I'm also even happier to stand on the shoulders of those who came before me!
Has anyone else had to work through this with an upstream engineering team and found success?
Has anyone else had to work through this with an upstream engineering team and found success?
January 13, 2026 at 5:05 PM
I'm happy to rewrite / translate from R4DS and other sources, but I'm also even happier to stand on the shoulders of those who came before me!
Has anyone else had to work through this with an upstream engineering team and found success?
Has anyone else had to work through this with an upstream engineering team and found success?
Does anyone have an easy reference guide for how to explain "Tidy Data" to data engineers?
Lots of over-engineered (wide) tables that cost time & money to build, only for my team to immediately turn around & undo all their joins / curation because it gets in the way of analysis!
#rstats
Lots of over-engineered (wide) tables that cost time & money to build, only for my team to immediately turn around & undo all their joins / curation because it gets in the way of analysis!
#rstats
January 13, 2026 at 5:03 PM
Does anyone have an easy reference guide for how to explain "Tidy Data" to data engineers?
Lots of over-engineered (wide) tables that cost time & money to build, only for my team to immediately turn around & undo all their joins / curation because it gets in the way of analysis!
#rstats
Lots of over-engineered (wide) tables that cost time & money to build, only for my team to immediately turn around & undo all their joins / curation because it gets in the way of analysis!
#rstats
"Who will rid me of this meddlesome priest?"
January 13, 2026 at 6:05 AM
"Who will rid me of this meddlesome priest?"
There is no right without a remedy!
End qualified immunity!
End qualified immunity!
January 13, 2026 at 2:16 AM
There is no right without a remedy!
End qualified immunity!
End qualified immunity!
The same amount? So ~ none?
The sad reality is public sector unions have fought QI reform at every level. Colorado's state reform could only get police reform across the line, not others.
To my knowledge, one (1!) state (New Mexico) ended state QI (capped civil liability at $2M) back in 2021.
The sad reality is public sector unions have fought QI reform at every level. Colorado's state reform could only get police reform across the line, not others.
To my knowledge, one (1!) state (New Mexico) ended state QI (capped civil liability at $2M) back in 2021.
It would take a two-word amendment to 42 U.S.C. § 1983 to subject ICE agents and other federal law enforcement officers to the same liability for constitutional violations that local and state officers currently face.
If Congress actually cared about what it's seeing, it could pass that overnight.
If Congress actually cared about what it's seeing, it could pass that overnight.
January 13, 2026 at 2:10 AM
The same amount? So ~ none?
The sad reality is public sector unions have fought QI reform at every level. Colorado's state reform could only get police reform across the line, not others.
To my knowledge, one (1!) state (New Mexico) ended state QI (capped civil liability at $2M) back in 2021.
The sad reality is public sector unions have fought QI reform at every level. Colorado's state reform could only get police reform across the line, not others.
To my knowledge, one (1!) state (New Mexico) ended state QI (capped civil liability at $2M) back in 2021.
After subjecting myself to another year's "IT Security Training", I figured I might as well get ahead of some password resets.
Error: your password has a forbidden string. ____ is not allowed in passwords.
The offending phrase: My company name? A vulgarity? Something political? No!
It was "bird"
Error: your password has a forbidden string. ____ is not allowed in passwords.
The offending phrase: My company name? A vulgarity? Something political? No!
It was "bird"
a blue and white penguin with the words but why above it
ALT: a blue and white penguin with the words but why above it
media.tenor.com
January 12, 2026 at 4:03 PM
After subjecting myself to another year's "IT Security Training", I figured I might as well get ahead of some password resets.
Error: your password has a forbidden string. ____ is not allowed in passwords.
The offending phrase: My company name? A vulgarity? Something political? No!
It was "bird"
Error: your password has a forbidden string. ____ is not allowed in passwords.
The offending phrase: My company name? A vulgarity? Something political? No!
It was "bird"
Makes being a fan in the West difficult because I'm so far down the pipeline as a consumer that my behavior has ~ zero effect on the industry.
January 12, 2026 at 12:55 AM
Makes being a fan in the West difficult because I'm so far down the pipeline as a consumer that my behavior has ~ zero effect on the industry.
>The animation team was working under increasing pressure
Unfortunately, the industry is completely broken, and this is an evergreen sentiment for almost every studio (exceptions being Madhouse, Bones, and maybe Shaft. Science Saru has a lot of non Japanese employees by design, but them in too).
+
Unfortunately, the industry is completely broken, and this is an evergreen sentiment for almost every studio (exceptions being Madhouse, Bones, and maybe Shaft. Science Saru has a lot of non Japanese employees by design, but them in too).
+
January 12, 2026 at 12:54 AM
>The animation team was working under increasing pressure
Unfortunately, the industry is completely broken, and this is an evergreen sentiment for almost every studio (exceptions being Madhouse, Bones, and maybe Shaft. Science Saru has a lot of non Japanese employees by design, but them in too).
+
Unfortunately, the industry is completely broken, and this is an evergreen sentiment for almost every studio (exceptions being Madhouse, Bones, and maybe Shaft. Science Saru has a lot of non Japanese employees by design, but them in too).
+
"Didn't like Mad Men. Too much sexism, it made the male characters unlikeable" energy lol
January 12, 2026 at 12:00 AM
"Didn't like Mad Men. Too much sexism, it made the male characters unlikeable" energy lol
I know this is pointless to highlight, but...
Portland: no flouridation of municipal water
Also Portland:
Portland: no flouridation of municipal water
Also Portland:
January 11, 2026 at 9:38 PM
I know this is pointless to highlight, but...
Portland: no flouridation of municipal water
Also Portland:
Portland: no flouridation of municipal water
Also Portland:
You know it!
Neither of my girls really like the show, but they tolerate the 2 movies and _love_ the toys.
Neither of my girls really like the show, but they tolerate the 2 movies and _love_ the toys.
a cartoon dog wearing star shaped sunglasses is standing in front of a telescope
ALT: a cartoon dog wearing star shaped sunglasses is standing in front of a telescope
media.tenor.com
January 11, 2026 at 9:15 PM
You know it!
Neither of my girls really like the show, but they tolerate the 2 movies and _love_ the toys.
Neither of my girls really like the show, but they tolerate the 2 movies and _love_ the toys.
If my career in data analysis implodes, maybe I have a future in stuffed toy fashion design?
The 5 year old was a difficult client to satisfy, but she finally agreed that I did my best (not that my best is any good)!
The 5 year old was a difficult client to satisfy, but she finally agreed that I did my best (not that my best is any good)!
January 11, 2026 at 9:02 PM
If my career in data analysis implodes, maybe I have a future in stuffed toy fashion design?
The 5 year old was a difficult client to satisfy, but she finally agreed that I did my best (not that my best is any good)!
The 5 year old was a difficult client to satisfy, but she finally agreed that I did my best (not that my best is any good)!
Empty Squire: Polyester Song
Mario Scooter
Super Mario Brunch
January 11, 2026 at 7:59 PM
Empty Squire: Polyester Song
I am once again reminding you that complexity is a subsidy for large, existing players. You know who doesn't care? Walmart. Costco. Meijer. Etc.
Please don't forget this lesson when you're the guys in charge of this stuff, *I beg you*
Please don't forget this lesson when you're the guys in charge of this stuff, *I beg you*
This is effectively a large tax on any store that accepts EBT cards and will make many households’ SNAP benefits unusable.
RFK Jr: "One of the things we're doing is Brooke Rollins is requiring that any facility, and store that accepts food stamps will have to double the amount of whole food that is now available to recipients. So that will change the marketplace around the country."
January 11, 2026 at 7:54 PM
I am once again reminding you that complexity is a subsidy for large, existing players. You know who doesn't care? Walmart. Costco. Meijer. Etc.
Please don't forget this lesson when you're the guys in charge of this stuff, *I beg you*
Please don't forget this lesson when you're the guys in charge of this stuff, *I beg you*