Lightnews — Scholar-powered news

marcogorelli.bsky.social @marcogorelli.bsky.social · 5d

🌝 The next @astropy.org release will support generic dataframe tables (like @pola.rs )

🌊🦄 Powered by Narwhals

1

marcogorelli.bsky.social @marcogorelli.bsky.social · 20d

oh no!!! 😭

marcogorelli.bsky.social @marcogorelli.bsky.social · 26d

💡 Life-pro-tip: enable inline type hints

🏷️ Your editor will display inferred types for variables you haven't annotated

🕵️ Debugging those red squiggly lines will become much easier

1 1 4

marcogorelli.bsky.social @marcogorelli.bsky.social · Aug 23

polars Series implement __array__, I'd have thought that a lot of the time you can pass Series as then they'll be converted by any `np.asarray` call. at least passing Polars Series to matplotlib works like that

1 2

marcogorelli.bsky.social @marcogorelli.bsky.social · Aug 23

which stats packages are tied to pandas?

1

marcogorelli.bsky.social @marcogorelli.bsky.social · Aug 22

✨🐼 Pandas 3.0 will have `pd.col` syntax

💡 You can use it for clean chaining in `assign` and `loc`

🚀 It's happening, the PR just got merged!

1 4

marcogorelli.bsky.social @marcogorelli.bsky.social · Aug 12

✨ New @pola.rs feature - you can now chain `name` expressions!

🌊🦄 As of Narwhals 2.0 (yes, we've released 2.0 🚀), this feature is available there as well! Little example below with our friend @duckdb.org

Example of `.name` chaining with Narwhals

3

marcogorelli.bsky.social @marcogorelli.bsky.social · Aug 7

💡 "There's nothing for permanent than a temporary fix"

Case in point, this pandas comment which was added [checks git log] ... 12 years ago 🙈

temporary solution added to pandas 12 years ago

2

Reposted

Michael E. Mann @michaelemann.bsky.social · Aug 7

"If the U.S. can't get its greenhouse emissions under control, they need to face real consequences" said the rest of the world.

Canada's National Observer @nationalobserver.com · Aug 6

"If Canada can't get these wildfires under control, they need to face real consequences," said Wisconsin state Rep. Calvin Callahan in a news release Wednesday. "We won't sit back while our air becomes a health hazard."

More Republican lawmakers demand legal action over Canadian wildfire smoke

The Republican lawmakers called for an investigation of Canada's wildfire management practices and for potential remedies under international law, saying Canada must face "real consequences."

www.nationalobserver.com

23 150 490

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 29

💡 Today in open source: a 17-year-old NumPy commit promising that a new feature will be coming soon

Any day now..

Screenshot of 17-year-old commit message in NumPy

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 26

😍 @posit.co have done it again

🧙 gt-extras offers even more functionality for their table renditions of @pola.rs and pandas dataframes!

🌊🦄 Using Narwhals for some dataframe logic

2 10

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 20

solarized light

1

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 18

💡 Solution: use Narwhals for universal dataframe support 🌊🦄

Meme of panicked Astronomer CEO caught on cam with the head of HR, with "When you find a new data science library" and "When you realise it only supports pandas" text overlaid

4

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 15

✨ New Formulaic release (1.2), featuring native support for @pola.rs !

🌊🦄 Powered by Narwhals

Demo of Formulaic with native Polars support

1 2 10

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 9

🎢 When the Q&A goes off-script 🤣

🇯🇵 Japanese math rock, 🅿️ porpoises and unfortunate aliases, and 🎤 Taylor Swift:

🥈All of these unexpectedly came up in this fun session, which is currently the 2nd most viewed of the conference

🙏 Thanks @pydatalondon.bsky.social for inviting me!

Marco Gorelli - How Narwhals brings Polars, DuckDB, PyArrow, & pandas together | PyData London 25

YouTube video by PyData

youtu.be

2 8

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 1

github.com/mlflow/mlflo...

Adopt Narwhals to support multiple eager dataframe · Issue #16518 · mlflow/mlflow

Description Follow up from #10292 (comment) What's Narwhals? Narwhals is a lightweight compatibility layer between dataframe libraries, with negligible overhead. Its API is a subset of the polars o...

github.com

3

marcogorelli.bsky.social @marcogorelli.bsky.social · Jul 1

🥳 The next version of @mlflow.org will support @pola.rs !

😩 Slightly disappointingly, they do so by converting to pandas

🌊🦄 Could Narwhals help make MLFlow gain native support for Polars? Link to the discussion below 👇

MLFlow maintainer announcing that they merged the Polars dataset PR

1 3

marcogorelli.bsky.social @marcogorelli.bsky.social · Jun 21

sure - how do you know

2 1

marcogorelli.bsky.social @marcogorelli.bsky.social · Jun 19

🙀 It's scary to merge a 2,000+ line PR!

😇 But, this one was so thorough that we just had to ship it

🏆 Thanks to an incredible effort by Ryan Whitten, Narwhals supports Ibis!

💡You can now use Narwhals with all of Ibis' backends, plus some extra, whilst keeping @pola.rs expressive API!