Lightnews — Scholar-powered news

Caleb Fahlgren @calebfahlgren.hf.co · Dec 4

You can just ask things 🗣️

"show me messages in the coding category that are in the top 10% of reward model scores"

Download really high quality instructions from the Argilla Llama3.1 405B synthetic dataset 🔥

4

Reposted by Caleb Fahlgren

Thomas Wolf @thomwolf.bsky.social · Dec 4

Most liked and most downloaded open-source AI models from 2022 to 2024

Interactive viz: aiworld.eu/embed/model/...
Discussion: huggingface.co/spaces/huggi...

2 20 86

Caleb Fahlgren @calebfahlgren.hf.co · Dec 2

It doesn't get easier than this. Why are you writing SQL by yourself when it's almost 2025

3

Caleb Fahlgren @calebfahlgren.hf.co · Dec 2

The amazing, new Qwen2.5-Coder 32B model can now write SQL for any @hf.co dataset ✨

1 4 19

Caleb Fahlgren @calebfahlgren.hf.co · Nov 29

Here's the space by @reach-vb.hf.co

huggingface.co/spaces/reach...

Github Issue Generator - a Hugging Face Space by reach-vb

Discover amazing ML apps made by the community

huggingface.co

Caleb Fahlgren @calebfahlgren.hf.co · Nov 29

This is insane! Structured generation in the browser with the new @hf.co SmolLM2-1.7B model

• Tiny 1.7B LLM running at 88 tokens / second ⚡
• Powered by MLC/WebLLM on WebGPU 🔥
• JSON Structured Generation entirely in the browser 🤏

1 1 11

Reposted by Caleb Fahlgren

Thomas Wolf @thomwolf.bsky.social · Nov 26

Releasing SmolVLM, a small 2 billion parameters Vision+Language Model (VLM) built for on-device/in-browser inference with images/videos.

Outperforms all models at similar GPU RAM usage and tokens throughputs

Blog post: huggingface.co/blog/smolvlm

4 31 230

Caleb Fahlgren @calebfahlgren.hf.co · Nov 26

I did it via

Settings > Account > Handle > I have my own domain

and it should show there!

1 2

Caleb Fahlgren @calebfahlgren.hf.co · Nov 26

You can literally do the histogram in one line in less than 10 seconds 💨

> from histogram(train, "Average ⬆️")

Caleb Fahlgren @calebfahlgren.hf.co · Nov 26

Here's what the model licenses look like:

Lots of great open licenses in there too! 💪

1

Caleb Fahlgren @calebfahlgren.hf.co · Nov 26

The OpenLLM Leaderboard just passed 2k evals 🥳

Here's a look at the distribution of average scores for all those models!

Great work by the @huggingface.bsky.social team to do these evals!

1 1 15

Caleb Fahlgren @calebfahlgren.hf.co · Nov 25

Let us know what you think or what you want to see :)

cc: @davidberenstein.bsky.social

1 2

Caleb Fahlgren @calebfahlgren.hf.co · Nov 22

Let’s go!

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

** log and get out of the way **

1

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

using supabase theme, @tylerhillery.com would approve

1 6

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

ray.so it's great with lots of themes!

Create beautiful images of your code

Turn your code into beautiful images. Choose from a range of syntax colors, hide or show the background, and toggle between a dark and light window.

ray.so

1 2

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

Automatically tracking all Ollama requests to a dataset with the new observers python library!

With just a few lines of code all your requests can be sent to @huggingface.bsky.social datasets for annotating, analysis and observability 🔭

6

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

Here's the library! Was fun collaborating with
@davidberenstein.bsky.social bringing the datasets and argilla all together!
github.com/cfahlgren1/o...

GitHub - cfahlgren1/observers: Track OpenAI compatible requests to a dataset

Track OpenAI compatible requests to a dataset. Contribute to cfahlgren1/observers development by creating an account on GitHub.

github.com

4

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

The main three stores are:
• DuckDB (local, SQL over traces)
• Hugging Face Datasets (dataset viewer, sql console)
• Argilla - annotation and filtering UI

1 5

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

observers 🔭 - automatically log all OpenAI compatible requests to a dataset 💽

• supports any OpenAI compatible endpoint 💪
• supports @duckdb.org, @huggingface.bsky.social datasets and Argilla as stores

> pip install observers

4 5 13

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

That’s okay, there are lots of incomplete and even snapshots. The UpVoteWeb reddit dataset is one that comes to mind.

Any data that is more accessible is a win :). My hub stats dataset is just a cron script as well haha

huggingface.co/datasets/Ope...

OpenCo7/UpVoteWeb · Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

1

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

+1 and let me know if you need any help with it @tobilg.com would be nice to have the dataset viewer for it!

1

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

We just released a library that makes it pretty seamless to send traces and LLM requests to datasets

github.com/cfahlgren1/o...

Would love to hear what you think is missing for prompts?

GitHub - cfahlgren1/observers: Track OpenAI compatible requests to a dataset

Track OpenAI compatible requests to a dataset. Contribute to cfahlgren1/observers development by creating an account on GitHub.

github.com

Caleb Fahlgren @calebfahlgren.hf.co · Nov 21

SmolTalk is out 🗣️

Over 1M high quality instructions used for training SmolLM2, one of the best small language models in the industry.

huggingface.co/datasets/Hug...

HuggingFaceTB/smoltalk · Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

1 1 10

Reposted by Caleb Fahlgren

David Berenstein @davidberenstein.bsky.social · Nov 21

Observers: A Lightweight SDK for AI Observability

TLDR;
- Track and record interactions with AI models
- Store observations in multiple backends @huggingface.bsky.social, @duckdb.org or Argilla
- Query and analyse your AI interactions with ease

GitHub:
github.com/cfahlgren1/o...

4 7 42