Rate limiting LLM chat per-user with `useRateLimit`

const { status } = useRateLimit(api.rl.getRateLimit)

Full code in 🧵

Algorithms:
Sending messages: fixed window
Token usage: token bucket

courtesy of
@​convex-dev/rate-limiter + @​convex-dev/agent
(components)

Recent talk on agents & agentic workflows, as well as my Convex Agent Component. Takes:
• Agentic := prompting + routing
• Prompting is input -> LLM -> output
• Routing has code at every boundary
(...even if an LLM "decides" what to do next)
Full 📺🔗->🧵

Streaming LLM text using websockets + client smoothing - no HTTP necessary!

Agent v0.2.1 is out! Repo & release notes in 🧵
- Streaming text react hook + server fns
- Client-side smoothing hook
- Optimistic update helpers

Agent Playground for @​convex-dev/agent is live!
Investigate threads, messages, tool calls
Dial in context params
Iterate on prompting, etc.
For the @​convex-dev/agent component.
Links in 🧵

Tiago asked about integrating reactflow.dev
with @convex.dev so I made a demo last night.
- realtime syncing flow chart
- authorize reads and writes
- validation of custom data payloads
- optimistic updates for UX 🧑‍🍳💋
I'm proud of it, and thanks Tiago for the help!
github.com/ianmacartney...

Some improvements to the open-source collaborative editor sync component landed this week:

📝 Now supports syncing *BlockNote* & @tiptap.dev
🦾 Server-side editing of documents is now easier & documented, for those of you using AI thingies