Valerio Marsocci
banner
valeriomarsocci.bsky.social
Valerio Marsocci
@valeriomarsocci.bsky.social
🌏🌱

trying to make Geospatial Foundation Models work

Research Fellow at @ESA PhiLab
Previously at @KULeuven, @Cnam
PhD in Data Science at @Sapienza

website: https://sites.google.com/uniroma1.it/valeriomarsocci

#AI4EO #GeoAI #SSL4EO
uoooo great news, how many are you trying to cover?
January 16, 2025 at 12:51 PM
I start the new challenge this week :)

Also, other very cool personal news is coming out

So stay tuned if interested ✨
January 14, 2025 at 2:35 PM
Did we overlook something? Are you interested in this kind of topic?

We are already considering future updates, so feel free to reach out to give feedbacks and to talk about geospatial foundation models

✨🌏
December 6, 2024 at 2:23 PM
A great team collaborated on it!

Thx @yurujia.bsky.social @lebellig.bsky.social @nshaud.bsky.social and all the others 🤩

🧵
December 6, 2024 at 2:23 PM
We observed interesting insights, such as:

1. generally speaking GFMs don't really excel when compared to supervised baselines

2. for some specific scenarios (e.g. HR data), it makes sense to use them

3. multi-temporal data are still under-estimated

other insights in the paper!

🧵
December 6, 2024 at 2:23 PM
With this benchmark (PANGAEA), we tried to address the following research challenges:

* provide a robust evaluation protocol to benchmark GFMs
* investigate GFMs capabilities, with a focus on a) domain generalization, b) comparison to supervised baselines, c) performance with limited labels

🧵
December 6, 2024 at 2:23 PM
We collected 11 datasets to create an inclusive, diverse benchmarks, based on these criteria:
* application domain
* geographical distribution
* type of task
* modality
* temporality

Spoiler: no patch-level classification tasks are included!

🧵
December 6, 2024 at 2:23 PM
Another paper shows that global models are not always the best choice.

If you are interested in this topic, and in geospatial foundation models in general, next week we will publish an interesting pre-print, connected to our Pangaea repo

Check it here: github.com/yurujaja/pan...
GitHub - yurujaja/pangaea-bench: Towards Robust Evaluation for Geospatial Foundation Models
Towards Robust Evaluation for Geospatial Foundation Models - yurujaja/pangaea-bench
github.com
November 29, 2024 at 3:15 PM
also, in the past I posted about this interesting benchmark paper:

#32 GeoFMs for crop type mapping

it investigates the ability of geoFMs to transfer to new geographic regions in agriculture

⬆️the pivotal topic for real-world applications
⬇️the limited number of geoFMs

arxiv.org/pdf/2409.09451
November 28, 2024 at 2:47 PM
here is the GitHub of PANGAEA code (that we used for the experiments):
github.com/yurujaja/pan...
GitHub - yurujaja/pangaea-bench: Towards Robust Evaluation for Geospatial Foundation Models
Towards Robust Evaluation for Geospatial Foundation Models - yurujaja/pangaea-bench
github.com
November 28, 2024 at 2:47 PM
🚀🌏

If you want to see how geospatial foundation models are working in real-world tasks w.r.t. supervised baselines, stay tuned cause next week we are releasing the pre-print of PANGAEA, showing interesting results on this topic!
November 28, 2024 at 2:44 PM