Lightnews — Scholar-powered news

Reposted by Daniel Vila

Florent Daudens @fdaudens.bsky.social · Jan 28

🚀 The open source community is unstoppable: 4M total downloads for DeepSeek models on @hf.co , with 3.2M coming from the +600 models created by the community. That's 30% more than yesterday!

1 8

Reposted by Daniel Vila

Sara Han @sdiazlor.hf.co · Jan 20

💫 Generate RAG data with the Synthetic Data Generator to improve your RAG system!

1️⃣ Generate from your documents, dataset, or dataset description.
2️⃣ Configure it.
3️⃣ Generate the synthetic dataset.
4️⃣ Fine-tune the retrieval and reranking models.
5️⃣ Build a RAG pipeline.

1 3 12

Reposted by Daniel Vila

Natalia @nataliaelv.hf.co · Jan 17

New chapter in the Hugging Face NLP course! 🤗 🚀

We've added a new chapter about the very basics of Argilla to the Hugging Face NLP course. Learn how to set up an Argilla instance, load & annotate datasets, and export them to the Hub.

Any feedback for improvements welcome!

Screenshot of the Introduction to Argilla in Chapter 10 of the Hugging Face NLP course

1 1 14

Reposted by Daniel Vila

Daniel van Strien @danielvanstrien.bsky.social · Jan 16

🎉 50,000+ annotations reached! The FineWeb2-C community is helping build better language models on annotation at a time.

📊 Current stats:
- 115 languages represented
- 419 amazing contributors
- 24 languages with complete datasets

But we're not done yet! 🧵

Screenshot of this text: Total annotations submitted: 50,035 Languages with annotations: 115 Total contributors: 419

1 6 18

Daniel Vila @dvilasuero.hf.co · Jan 7

You could try to generate one with this tool:

huggingface.co/spaces/argil...

Synthetic Data Generator - a Hugging Face Space by argilla

Build datasets using natural language

huggingface.co

3

Reposted by Daniel Vila

David Berenstein @davidberenstein.bsky.social · Jan 7

High-quality data for fine-tuning language models for free and at the click of a button!

Prompt and wait for your dataset to push to Argilla or the Hub
Evaluate, review and fine-tune a model.

Blog:

Fine-tune a SmolLM on domain-specific synthetic data from a LLM

A Blog post by David Berenstein on Hugging Face

buff.ly

1 2 10

Reposted by Daniel Vila

Daniel van Strien @danielvanstrien.bsky.social · Jan 3

Was 2024 the year of datasets? Is 2025 the year for community-built datasets?

It's exciting to see the progress of many languages in FineWeb-C:
- Total annotations submitted: 41,577
- Languages with annotations: 106
- Total contributors: 363

4 28

Reposted by Daniel Vila

Daniel van Strien @danielvanstrien.bsky.social · Jan 6

The finish line is near! We're building FineWeb-Edu for many languages and need your help 🤗

Many FineWeb-C languages are close to 1,000 annotations!

Assamese is 99.4% done, French needs 64 more annotations, Tamil: 216.

Please help us reach the goal: huggingface.co/spaces/data-...

Progress bars showing remaining annotations needed for 15 languages in FineWeb-C dataset, ranging from 6 to 593 annotations needed

1 5 20

Daniel Vila @dvilasuero.hf.co · Dec 20

Get started:
docs.argilla.io/latest/getti...

Quickstart - Argilla Docs

Get started with Argilla in less 10 minutes

docs.argilla.io

3

Daniel Vila @dvilasuero.hf.co · Dec 20

Release notes:
github.com/argilla-io/a...

1 3

Daniel Vila @dvilasuero.hf.co · Dec 20

💥 Ending 2024: A full data annotation journey on the Hugging Face Hub—from raw data to training-ready datasets!

With Argilla 2.6.0, push your data to the Hub from the UI

Let’s make 2025 the year anyone can build more transparent and accountable AI—no coding or model skills needed.

1 3 20

Reposted by Daniel Vila

José Francisco Calvo @jfcalvo.hf.co · Dec 19

🚀 Argilla v2.6.0 is here! 🎉

Let me show you how EASY it is to export your annotated datasets from Argilla to the Hugging Face Hub. 🤩

Take a look to this quick demo 👇

💁‍♂️ More info about the release at github.com/argilla-io/a...

#AI #MachineLearning #OpenSource #DataScience #HuggingFace #Argilla

5 11

Reposted by Daniel Vila

David Berenstein @davidberenstein.bsky.social · Dec 17

🔥 We got great feedback on this: "Synthetic Data Generator"

A no-code tool to create datasets with LLMs, making it a breeze, allowing ANYONE to create datasets and models in minutes and without any code.

Blog: https://buff.ly/4gybyoT
GitHub: https://buff.ly/49IDSmd
Space: https://buff.ly/3Y1S99z

Introducing the Synthetic Data Generator - Build Datasets with Natural Language

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

buff.ly

1 2 14

Reposted by Daniel Vila

Ashvanth.S @ashvanths.bsky.social · Dec 14

Well, around 10 percent of the initial goal is complete, and so far, it's been quite a one-man army effort. We're still in the hunt for more people to join and contribute to this open-source initiative.

@hf.co

data-is-better-together-fineweb-c.hf.space/share-your-p...

tam - தமிழ் - Tamil

Join and contribute to the dataset tam - தமிழ் - Tamil

data-is-better-together-fineweb-c.hf.space

1 1 4

Reposted by Daniel Vila

Johannes @johko.bsky.social · Dec 13

The sprint for crowd sourced annotations with argilla is in full swing over at data-is-better-together-fineweb-c.hf.space

I've just contributed 100 examples to this dataset:
data-is-better-together-fineweb-c.hf.space/share-your-p...

Big thanks to @dvilasuero.hf.co, @nataliaelv.hf.co and team 🙌

nds - Neddersass’sch - Low German

Join and contribute to the dataset nds - Neddersass’sch - Low German

data-is-better-together-fineweb-c.hf.space

1 12

Reposted by Daniel Vila

Moritz Laurer @moritzlaurer.bsky.social · Dec 12

I've been building a small library for working with prompt templates on the @huggingface.bsky.social Hub: `pip install prompt-templates`. Motivation:

The community currently shares prompt templates in a wide variety of formats: in datasets, in model cards, as strings in .py files, as .txt/... 🧵

1 4 16

Reposted by Daniel Vila

Ben Burtenshaw @benburtenshaw.bsky.social · Dec 12

Desperate to contribute to the development of Scots language AI. I've just contributed 16 examples to this dataset:

data-is-better-together-fineweb-c.hf.space/share-your-p...

sco - Scots - Scots

Join and contribute to the dataset sco - Scots - Scots

data-is-better-together-fineweb-c.hf.space

1 3 10

Daniel Vila @dvilasuero.hf.co · Dec 12

I've just contributed 156 examples to the FineWeb 2 Spanish dataset:

data-is-better-together-fineweb-c.hf.space/share-your-p...

If you want to contribute, sign in with @hf.co and find your language

spa - español - Spanish

Join and contribute to the dataset spa - español - Spanish

data-is-better-together-fineweb-c.hf.space

5 21

Daniel Vila @dvilasuero.hf.co · Dec 10

Join this Space, search for your language, and start contributing:
huggingface.co/spaces/data-...

Don't know how to start, want to discuss? Join:
huggingface.co/spaces/Huggi...

FineWeb-c - Annotation - a Hugging Face Space by data-is-better-together

Discover amazing ML apps made by the community

huggingface.co

1

Daniel Vila @dvilasuero.hf.co · Dec 10

Help shape the future of multilingual Open Source AI!

Join the FineWeb 2 Community Annotation Sprint to create an open training dataset with full transparency and human validation in many languages.

Review datasets in your language and help identify the best sources for training.

1 3 21

Reposted by Daniel Vila

frascuchon.bsky.social @frascuchon.bsky.social · Dec 3

✨ Argilla 2.5.0 is live and it comes with webhook listener support to supercharge your workflows! 🚀

#AI #MachineLearning #Webhooks #TechUpdate

1 2 8

Reposted by Daniel Vila

David Berenstein @davidberenstein.bsky.social · Dec 9

👐 Open Image Preferences is an Apache 2.0 licensed dataset for text-to-image generation by the @hf.co community. This dataset contains 10K text-to-image preference pairs across image generation categories, using different model families and prompt complexities.

Blog: huggingface.co/blog/image-p...

Open Preference Dataset for Text-to-Image Generation by the 🤗 Community

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

1 4 17

Reposted by Daniel Vila

Sara Han @sdiazlor.hf.co · Dec 9

Open Image Preferences released! 🚀

- Open-source dataset for text2image
- 10K samples manually evaluated by the HF community.
- Binarized format for SFT, DPO, or ORPO.

It comes with a nice blog post explaining the steps to pre-process and generate the data, along with the results.

1 1 5

Daniel Vila @dvilasuero.hf.co · Dec 7

Added!!

1 1

Daniel Vila @dvilasuero.hf.co · Dec 6

I'd love to yes!!

1