Lightnews — Scholar-powered news

Paul Schaefer @pauschae.bsky.social · Aug 27

Looks amazing!

Grant McDermott @gmcd.bsky.social · Aug 25

To borrow another example, taken from the `dbreg` README: github.com/grantmcdermo...

Here I am running a fixed-effects regression on 180 million(!) row parquet dataset... and it completes **< 2 seconds**... on my laptop 🤯

This is powered by @duckdb.org under the hood.

#rstats #econsky

Running dbreg::dbreg() on a full year of NYC taxi data... and it takes less than 2 seconds.

dbreg(
tip_amount ~ fare_amount + passenger_count | month + vendor_name,
path = "read_parquet('nyc-taxi/**/*.parquet')", ## path to hive-partitioned dataset
vcov = "hc1"
)
#> [dbreg] Estimating compression ratio...
#> [dbreg] Data has 178,544,324 rows and 24 unique FE groups.
#> [dbreg] Using strategy: compress
#> [dbreg] Executing compress strategy SQL
#>
#> Compressed OLS estimation, Dep. Var.: tip_amount
#> Observations.: 178,544,324 (original) | 70,782 (compressed)
#> Standard Errors: Heteroskedasticity-robust
#> Estimate Std. Error t value Pr(>|t|)
#> fare_amount 0.106744 0.000068 1564.742 < 2.2e-16 ***
#> passenger_count -0.029086 0.000106 -273.866 < 2.2e-16 ***
#> ---
#> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

3 5

Paul Schaefer @pauschae.bsky.social · Jul 30

By which you mean uk?

1 1

Paul Schaefer @pauschae.bsky.social · Jul 28

I don't get it

Reposted by Paul Schaefer

Peter Hull @instrumenthull.bsky.social · Jul 25

ICYMI: you can watch the recording here (around the 5h19m mark)

www.youtube.com/watch?v=Rpxf...

1 6 20

Paul Schaefer @pauschae.bsky.social · Jul 22

Ausserdem hilft die verengung von nazis auf Antisemitismus die historischen warnenden Beispiele etwas zu entkräften. Umd die aktuelle israelische regierung ist anschlussfaehig fuer rechtsextreme

Paul Schaefer @pauschae.bsky.social · Jul 22

Hans olaf henkel hat vor so 10 Jahren, bevor er die afd mitgegruendet hat schon gesagt es braucht ein klares Bekenntnis zu israel um rechtsextreme anzuschrecken. Ich denke viele rechtsextremen haben die Strategie umgedreht.

1

Paul Schaefer @pauschae.bsky.social · Jul 21

Probably big compositional changes in non college men. How do all young men look?

Paul Schaefer @pauschae.bsky.social · Jul 17

Ah. Thanks!

Paul Schaefer @pauschae.bsky.social · Jul 17

When did it decline? I know avout the recebt decline due to apprenticeships fornplder workers also being covered by the subsidies. Was there another one?

1

Reposted by Paul Schaefer

Tomaso Duso @tomasoduso.bsky.social · Jul 16

In der neuen ZDF-Doku über #Lebensmittelpreise geht es um Machtverschiebungen in der Versorgungskette – und ich durfte einige Einschätzungen teilen.
🔗 www.zdfheute.de/wirtschaft/s...

Die #Monopolkommission beschäftigt sich seit zwei Jahren mit genau diesen Fragen.

30.000 Kassenzettel zeigen: So teuer sind Lebensmittel bei Rewe, Edeka, Aldi und Lidl wirklich

In Deutschland werden Lebensmittel beim Einkaufen teurer. Wie es zu den hohen Preisen im Supermarkt kommt und was Verbraucher wissen sollten.

www.zdfheute.de

1 1

Reposted by Paul Schaefer

Conrad Hackett @conradhackett.bsky.social · Jul 14

Harmonizing global data is a huge task.

Here's a project we did in 2019 looking at how living arrangements around the world vary by religion: www.pewresearch.org/religion/201...

We focused our analysis at the individual level because doing so best captures the lived experience of most people.

2 4

Reposted by Paul Schaefer

Juan Galeano @juangaleano.bsky.social · Jul 13

Today I'm presenting at #IPC2025 the data infrastructures of the CORESIDENCE project.

National and subnational household indicators 🏡

First Global Database on Living Arrangements from an individual based perspective! 🌐📊📈

Catch all the details today!
📍Meeting room P8
🕥 10:30-12:00 am
#demography

6 25

Paul Schaefer @pauschae.bsky.social · Jul 14

Bad timing for that odea :(

Reposted by Paul Schaefer

Brett Hollenbeck @bretthollenbeck.com · Jul 11

🚨Free data alert!! 🚨 Please share.

Large new dataset of Amazon product reviews, including full text and photos and product characteristics, with individual *reviews labeled as fake reviews*.

I believe this is the first publicly available data of this kind.

github.com/bretthollenb...

1 43 130

Paul Schaefer @pauschae.bsky.social · Jul 11

Did they do anything technocratic? Or do you mean more they are intrinsically technocratic people?

Paul Schaefer @pauschae.bsky.social · Jun 22

Wow! When?

1

Reposted by Paul Schaefer

Nick Jourjine @nickjourjine.bsky.social · Jun 18

Very happy to share the latest from my postdoc‬!

10 yrs of mouse social networks + 1.25 yrs of acoustic data ➡️ insight into vocalization & sociality in a wild population of your favorite lab model 🐁

paper: bit.ly/4n93yyD
data: bit.ly/4lfFBEk
code: bit.ly/4kNnMwx

#bioacoustics #neuroskyence

1/8

Graphical abstract for "Vocal communication is seasonal in social groups of wild, free-living house mice."

The abstract has, from top to bottom, a title, four middle image panels, and two bottom text panels.

Image title: "Vocal communication in social groups of wild-free living house mice"

Middle image panels from left to right: (1) An aerial snap shot of the region where the study site is located, an agricultural landscape in rural Switzerland. (2) An image of the study site, a small barn in the forest inhabited by mice. (3) An image of a radio frequency identification (RFID) box used to track mouse social interactions. A mouse is entering the box from the left while another sits outside. (4) A spectrogram showing example vocalizations - one low frequency squeak and one ultrasonic call - recorded from an RFID box.

Bottom panels:
Left: Data Collection
- 10 years of RFID-based tracking data (from 6,946 mice)
- 15 months of acoustic monitoring (totaling 6,594 hours)
- Machine learning for vocal detection and labeling (CNN)

Right: Key Findings
- Vocalization is seasonal (most in spring and summer)
- Vocalization is associated with the presence of pups
- Vocalization is correlated with social group dynamics

4 47 130

Paul Schaefer @pauschae.bsky.social · Jun 15

If all countries do that where will people go? Mars?

Paul Schaefer @pauschae.bsky.social · May 1

She didn't want to implant it?

1 1

Reposted by Paul Schaefer

Anna Schulze Tilling @annaschulzetilling.bsky.social · Apr 8

In 2022, I partnered with the student canteens of @unibonn.bsky.social to evaluate the effectiveness of carbon labels on their menus. The result: Emission-heavy meat consumption decreased by 5%. Thrilled to see StW Bonn has now permanently installed the labels!

Screenshot of canteen menu showing carbon labels

2 2 10

Paul Schaefer @pauschae.bsky.social · Apr 2

I agree

1

Paul Schaefer @pauschae.bsky.social · Apr 2

It is, since the negative movement indicates that the announcement is unexpectedly negative. The market participants have still been underestimating how bad it is. We are not at the point yet where expectations are bad enough so he can surprise them positively.

1

Paul Schaefer @pauschae.bsky.social · Mar 25

They remembered something was special

1 2

Paul Schaefer @pauschae.bsky.social · Mar 19

Is the 10% true? Or exaggerated

Paul Schaefer @pauschae.bsky.social · Mar 14

The political economy of debt brakes is just like the one of debt except for the debt.

Christian Odendahl @codendahl.bsky.social · Mar 14

I know it's a long thread in German, but it explains very well the political economy of the debt brake.

Achim Truger @achimtruger.bsky.social · Mar 13

Private Beobachtung:
Die Appelle seitens der Union an die staatspolitische Verantwortung der Grünen sind schon witzig:

Staatspolitische Verantwortung scheint immer nur dann ein Argument zu sein, wenn die Union regiert oder gerne regieren will. /1