Lightnews — Scholar-powered news

Alonso Silva @alonsosilva.bsky.social · 12d

Here are the starting notebooks I presented at @pydataparis.bsky.social
tinyurl.com/litelines-hf
And here is the documentation of litelines:
tinyurl.com/litelines
#PyDataParis

alonsosilva/litelines-notebooks at main

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

tinyurl.com

1

Alonso Silva @alonsosilva.bsky.social · 13d

Featured in marimo newsletter 🤩
marimo.io/blog/newslet...

Alonso Silva @alonsosilva.bsky.social · 15d

Doing a slightly better documentation than just the README.md
alonsosilvaallende.github.io/litelines/ge...
Feeback?

1 3

Alonso Silva @alonsosilva.bsky.social · 26d

To install it, just do `pip install litelines`.

Here are the docs:
github.com/alonsosilvaa...

Litelines is a lightweight wrapper of `outlines-core` by .txt

GitHub - alonsosilvaallende/litelines: Customize, control, and enhance LLM generation with logits processors, featuring visualization capabilities to inspect and understand state transitions

Customize, control, and enhance LLM generation with logits processors, featuring visualization capabilities to inspect and understand state transitions - alonsosilvaallende/litelines

github.com

4

Alonso Silva @alonsosilva.bsky.social · 26d

Want to visualize the response format constraints on the LLM when working in a Jupyter notebook?
Then you might be interested in my new project `litelines`.
Litelines lets you visualize the selected path by the LLM.
It supports a Pydantic schema as a response format, as well as regular expressions.

1 4 8

Alonso Silva @alonsosilva.bsky.social · Jul 28

The recording of my presentation "Certainty-Guided Reasoning: A Dynamic Thinking Budget Approach" at the Laboratory for Information, Networking and Communication Sciences (LINCS) is now available:
www.youtube.com/watch?v=8a44...

Certainty-Guided Reasoning in Large Language Models: A Dynamic Thinking Budget Approach

YouTube video by Pupusse LINCS

www.youtube.com

2

Alonso Silva @alonsosilva.bsky.social · Jul 23

Here is the Hugging Face space to play with it: huggingface.co/spaces/alons...

Here is a Google Colab with the same information as the post:

nbviewer.org/gist/alonsos...

1

Alonso Silva @alonsosilva.bsky.social · Jul 23

New blog post: Constrain a language model not to use the letter 'e'

alonsosilvaallende.github.io/blog/posts/2...

In this post, I constrain a small language model (0.6B parameters) with a logits processor to accomplish something GPT-4o fails to do (see chatgpt.com/share/687908...).

1 1

Alonso Silva @alonsosilva.bsky.social · Jul 18

TIL how to add notebook cells running on @pyodide.org to Quarto projects, such as my blog:
alonsosilvaallende.github.io/til/posts/20...
It's very easy to change the Pyodide version if needed. Thanks @coatless.bsky.social for this great Quarto extension

2 3

Reposted by Alonso Silva

hailey @hailey.at · Jul 18

tfw u need neo4j to put together the polycule chart

4 4 79

Alonso Silva @alonsosilva.bsky.social · Jul 16

New blog post: Understanding Logits Processors
alonsosilvaallende.github.io/blog/posts/2...
I start with a basic min length example, then force the model to check its answer, followed by making reasoning models stop thinking once they reach a thinking budget & finally force the model to think longer

Alonso Silva @alonsosilva.bsky.social · Jul 11

New blog post: Understanding Structured Outputs
alonsosilvaallende.github.io/blog/posts/2...
This is the power behind structured ouputs libraries such as Instructor and Marvin.
I provide a basic example of extraction, a slightly more complex one, then classification, and finally SO in WebAssembly.

Alonso Silva @alonsosilva.bsky.social · Jul 6

Where is that?

Alonso Silva @alonsosilva.bsky.social · Jul 5

New blog post: Understanding Function Calling

I provide a basic example of FC, then a slightly more complex example by allowing an LM to use Python. I explain the conversational response as a tool trick. Finally, FC in the browser by using WebAssembly
alonsosilvaallende.github.io/blog/posts/2...

Alonso Silva @alonsosilva.bsky.social · Jun 30

So I appear in the Celebration of 100 years of Bell Labs video with our LLM robots (a.k.a. IndustrialGPT) for less than a second :-D
www.youtube.com/watch?v=Fu_I...

Alonso Silva @alonsosilva.bsky.social · Jun 28

New blog post: Understanding LLM Memory

alonsosilvaallende.github.io/blog/posts/2...

Using the Marimo extension for Quarto.

Alonso Silva @alonsosilva.bsky.social · Jun 20

New post: Understanding Chat Templates

alonsosilvaallende.github.io/blog/posts/2...

Understanding Chat Templates – Homepage

alonsosilvaallende.github.io

Alonso Silva @alonsosilva.bsky.social · Jun 17

New post: Understanding Tokenizers
alonsosilvaallende.github.io/blog/posts/2...

Understanding Tokenizers – Homepage

alonsosilvaallende.github.io

1

Alonso Silva @alonsosilva.bsky.social · Jun 17

Celebrating Bell Labs’ 100 years anniversary #NokiaBellLabs100

1

Alonso Silva @alonsosilva.bsky.social · Jun 16

TIL to do quizzes with JupyterQuiz:
alonsosilvaallende.github.io/til/posts/20...
I like this simple way to provide feedback to students. I’m using these quizzes to motivate my kid to learn new things.

1

Alonso Silva @alonsosilva.bsky.social · Jun 15

TIL you can embed a live REPL on a website:
alonsosilvaallende.github.io/til/posts/20...
I think this is a great tool for writing tutorials and blog posts.

Embed live REPL on a website – Homepage

alonsosilvaallende.github.io

1

Alonso Silva @alonsosilva.bsky.social · May 20

Finally meeting @remilouf.bsky.social !

1

Reposted by Alonso Silva

Cameron @cameron.pfiffer.org · Apr 29

this was good

Alonso Silva @alonsosilva.bsky.social · Apr 23

My talk "Building Knowledge Graph-Based Agents with Structured Text Generation" at PyData Global 2024 is now available on YouTube:
www.youtube.com/watch?v=94yu...

#PyData #PyDataGlobal @dottxtai.bsky.social @pydata.bsky.social

Alonso Silva - Building Knowledge Graph-Based Agents with Structured Text Generation

YouTube video by PyData

www.youtube.com

1 3

Alonso Silva @alonsosilva.bsky.social · Apr 27

The new release of logits-processor-zoo supports batch inference of the logits processors with vLLM
`pip install logits-processor-zoo`
Here is the repo: github.com/NVIDIA/logit...
Here is the commit 😊: github.com/NVIDIA/logit...

Alonso Silva @alonsosilva.bsky.social · Apr 23

My talk "Building Knowledge Graph-Based Agents with Structured Text Generation" at PyData Global 2024 is now available on YouTube:
www.youtube.com/watch?v=94yu...

#PyData #PyDataGlobal @dottxtai.bsky.social @pydata.bsky.social

Alonso Silva - Building Knowledge Graph-Based Agents with Structured Text Generation

YouTube video by PyData

www.youtube.com

1 4