Lightnews — Scholar-powered news

Reposted by mdsumner

John Paul Helveston @jhelvy.bsky.social · 5h

#Rstats, #python, #julialang

3 3 16

mdsumner @mdsumner.bsky.social · 4h

lol

mdsumner @mdsumner.bsky.social · 6h

It worked, replaced all saved RasterLayer objects with actively-bound exported names, first use after package load triggers load from tif to SpatRaster

Reposted by mdsumner

Charles Tuise @ctuise.bsky.social · 13h

"a lot like a protection racket for the gambling industry" is a very polite way of describing current state of gov't action.
#Auspol

Australia’s gambling harm is likely underreported – and authorities are still failing to act
theconversation.com/australias-g...

Australia’s gambling harm is likely underreported – and authorities are still failing to act

New research shows Australian gambling harms, including suicide, may have been systematically under reported.

theconversation.com

4 1

mdsumner @mdsumner.bsky.social · 17h

#rstats what do folks do when converting from raster to terra with saved data objects? active bindings is a possibility

github.com/ropensci/gra...

interested in any perspectives, I don't want to change the entire way the package works (I'm not the maintainer, just toying with ideas)

1 2 4

Reposted by mdsumner

Kyle Barron @kylebarron.dev · 1d

New blog post! kylebarron.dev/blog/fast-py...

This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!

1 4 14

mdsumner @mdsumner.bsky.social · 1d

aye to that

Reposted by mdsumner

Elio Campitelli @eliocamp.mastodon.social.ap.brid.gy · 1d

The solution was to not use coord_sf(). I need to remember to not use sf in any project unless absolutely necessary.

1 1

Reposted by mdsumner

Lena📎 @eriksdotter.bsky.social · 1d

in short:
it’s complicated and we’re fucked

#climatecrisis

Bjerknes Center for Climate Research (BCCR) @bjerknes.uib.no · 1d

Rising sea levels are making extreme winter cold events MORE frequent and intense in East Asia. Yes, you read that right. New paper in Nature Communications reveals a fascinating connection. (1/4) 🧪🌊

1 5

Reposted by mdsumner

Ginda @ginda65.bsky.social · 1d

Make the fossil fuel barons pay, not the tax payers
#auspol

Make fossil fuel exporters pay for the damage they are causing, not ordinary Australians

Climate change is making natural disasters like fires, floods, heatwaves and drought worse, costing Australians billions every year. Make fossil fuel producers pay a climate disaster levy to help pay...

nb.australiainstitute.org.au

4 4

Reposted by mdsumner

Peter Fox @peterfox59.bsky.social · 2d

Great story on ABC #4Corners now on how online gambling companies operate, the damage they do to the community & how they keep the major political parties in the pockets.

2 34 88

Reposted by mdsumner

Dewey Dunnington @paleolimbot.bsky.social · 2d

Definitely depends what you're up to! People are definitely experimenting with serving features directly from Parquet files for visualization (e.g., medium.com/center-for-c... )

Optimal GeoParquet Partitioning Strategy

My quest for one-size-fits-all format

medium.com

1 2 2

mdsumner @mdsumner.bsky.social · 2d

is Scott Morrison in jail yet?

Impressive to outdo John Howard for evil

Reposted by mdsumner

Governor JB Pritzker @govpritzker.illinois.gov · 2d

This evening, President Trump is ordering 400 members of the Texas National Guard for deployments to Illinois, Oregon, and other locations within the United States. No officials from the federal government called me directly to discuss or coordinate.

710 4.3K 14K

Reposted by mdsumner

Aaliyah 🇮🇪🇵🇸 ‼️SAVE GAZA‼️ @aaliyahxx.bsky.social · 2d

Watch | Israeli occupation forces have released new drone footage from Gaza, revealing the mass destruction and the erasure of every means of life in the Strip.

2 19 23

Reposted by mdsumner

Sato Juniper @satojuniper.bsky.social · 2d

Amsterdam, we salute you!
#Auspol

Paul Eric Scannell @pauleric70.bsky.social · 2d

They tried to erase Palestine, but the world has become Palestine.

The outrage is global. The world is rising against genocide.

Thank you Amsterdam.

4 9

Reposted by mdsumner

SMT @pp0196.bsky.social · 3d

The claim seems widely overstated because in the end it is about selecting the partitioning in order to push as much computation into storage layer as possible. Selecting the partitioning is mostly about access pattern just like db indexes

1

Reposted by mdsumner

funferall @funferall.bsky.social · 3d

Oh yes I'm using gdalwarp here.

User draws on wmts and it looks at a .vrt file to match which geotiffs it overlays. That way I don't have to display the tifs.

Thinking of adding more crs options for the output and choice between geotiff and jpg2000. Just prototyping this

1 1

mdsumner @mdsumner.bsky.social · 3d

Found a rich seam here: github.com/cloudnativeg...

Why GeoParquet Is A Poor Cloud Native Format · cloudnativegeo cloud-optimized-geospatial-formats-guide · Discussion #82

(Geo)Parquet is an extremely useful column oriented data format. When working with local, massive data sets having many millions of features, the performance of this format is second to none. Plent...

github.com

1 1 3

Reposted by mdsumner

funferall @funferall.bsky.social · 4d

Got the gdal clip working. First time hearing about ALB, security groups, ECS, services, task definitions, cloudfront, a bunch of other bs. I think I can scale this (so says Claude 🤷‍♂️)

funferall @funferall.bsky.social · 5d

So deep in AWS land again. If this eventually works it will be a miracle

1 1 2

Reposted by mdsumner

Dewey Dunnington @paleolimbot.bsky.social · 3d

- FGB is great! Lookups with small ranges work well but full scans are much slower (particularly if zipped!)
- SedonaDB, DuckDB, and pyarrow with fsspec can all do partial Parquet reads from http (give geoarrow.org/data a try!)

Data – GeoArrow

geoarrow.org

1 1 1

mdsumner @mdsumner.bsky.social · 3d

I did a filter on the ibis example

I think you're talking about tooling problems

mdsumner @mdsumner.bsky.social · 3d

Nice! Could use gdalwarp (gdal raster reproject) to clip and write (and resize or change crs) in one step fwiw

(gdal raster reproject has a --bbox-crs arg, and this can be pipelined or written in json as a GDALG virtual dataset)

1 1

Reposted by mdsumner

funferall @funferall.bsky.social · 4d

Hacking together a Clip-Zip-Ship tool: draw custom polygon over wmts imagery service in web mercator, converts to UTM zone 19 coordinates and clips the corresponding geotiff (4band, 15cm, 16bit) and delivers to user.

Next: Select town as clipping boundary, give 100m buffer

draw custom polygon over wmts imagery service in web mercator, converts to UTM zone 19 and clips the corresponding geotiff (4band, 15cm, 16bit) and delivers to user

2 1 4

mdsumner @mdsumner.bsky.social · 3d

(open issue in nanoparquet was the unfinished bit there)