CocoIndex
banner
cocoindex.bsky.social
CocoIndex
@cocoindex.bsky.social
#OpenSource Transform data for AI 🥥🌴
https://github.com/cocoindex-io/cocoindex
Pinned
🎉 CocoIndex just hit 1,000 ⭐️ on GitHub!

Huge thanks to everyone who starred, forked, contributed, or shared the love!

We’re just getting started. 🚀

🔗 github.com/cocoindex-io...

#OpenSource #DataInfrastructure #CocoIndex #LLM #Buildinpublic #AIInfrastructure #ETL
AI agents understand codebases 🤖

CocoIndex: real-time semantic code indexing

→ Tree-sitter chunking
→ Incremental
→ Vector search
Use:
• MCP for AI editors
• Semantic search
• AI code review
• Auto docs

Query "Find auth" → instant code chunks

cocoindex.io/docs/examples/code_index

#AI #Rust
December 15, 2025 at 1:36 AM
Tree-sitter powered codebase indexing → real-time semantic search for AI agents 🚀

Index your code with language-aware chunking. Query with vectors in Postgres. Ship context that actually understands your codebase.

cocoindex.io/docs/examples/code_index

#AI #Rust #DevTools
December 13, 2025 at 4:45 AM
Why build in #opensource?

Best infrastructure is transparent, composable, community-driven.

CocoIndex (Rust + Python): data transformation for AI with incremental sync, schema validation, context extraction.

No vendor lock-in. No black boxes. Fast, type-safe pipelines.

#rustlang #python
December 13, 2025 at 1:46 AM
🚀 CocoIndex + DSPy: structured extraction from patient intake forms

LLMs as typed extractors, not black boxes. Production-ready with incremental sync.

No OCR/regex mess. Clean separation between reasoning (DSPy) & data infra (CocoIndex).

💻 github.com/cocoindex-io/cocoindex

#AI #DataEngineering
cocoindex/examples/patient_intake_extraction_dspy at main · cocoindex-io/cocoindex
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
github.com
December 13, 2025 at 1:42 AM
🚀 CocoIndex just hit Rust Trending Again! 🦀

Why Rust?
⚡ Speed - C++ speed + memory safety
🔒 Reliability - No GC pauses or segfaults. Predictable performance always
Speed + Fresh data = Critical infra for AI agents

github.com/cocoindex-io...

#Rust #AI #Opensource
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
github.com
December 12, 2025 at 7:51 AM
Building Knowledge Graphs with LLMs! 🔥

Turn docs into living graphs:
✅ Triple extraction
✅ Real-time entity mapping
✅ Neo4j export with zero pain

CocoIndex handles it all - no manual Cypher ⚡

Perfect for RAG & AI agents!

youtu.be/FKNcv2n4nTg
Property Graph, Triple extraction and Knowledge Graph with LLM in simple words and examples
YouTube video by CocoIndex
youtu.be
December 8, 2025 at 5:53 AM
Tired of fragile LLM prompts? 😤

BAML = typed prompt functions:
✅ Type-safe schemas
✅ Predictable outputs
✅ Production-ready

+ CocoIndex for incremental processing = 🔥

Tutorial: Extract patient data from PDFs
cocoindex.io/blogs/extrac...

#AI #LLM
Extracting Intake Forms with BAML and CocoIndex | CocoIndex
How to use BAML and CocoIndex to extract structured data from patient intake forms in PDF/Word with LLM continuous for production.
cocoindex.io
December 8, 2025 at 5:29 AM
CocoIndex just hit Rust Trending Again! 🚀
github.com/cocoindex-io...

With all the AI agents development, CocoIndex is becoming critical infra for autonomous driving agents.

Star & share this 🥥 if it resonates!

#Opensource #RustLang
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
github.com
December 8, 2025 at 5:18 AM
Why 🦀Rust for CocoIndex Core Engine?
- Memory safety
- Performance
- Reliable from day 0

George wrote a great article on Rust's ownership model:
cocoindex.io/blogs/rust-o...

GitHub: github.com/cocoindex-io...
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
cocoindex.io
December 8, 2025 at 5:15 AM
CocoIndex just hit Rust Trending! 🚀
github.com/cocoindex-io...

Simplest way to connect data sources & keep targets fresh for AI transformations.

Becoming critical infra for autonomous AI agents.

Star & share! 🥥

#Opensource #RustLang
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
github.com
December 6, 2025 at 5:27 AM
🦀 CocoIndex 0.3.10 drops today!

Rust improvements:
• Async runtime fixes (no deadlocks)
• Smarter incremental recomputation
• Optimized embedding batches
• Robust file/streaming handling

Why Rust for data? Memory safety + performance + async = reliable AI infra at scale
CocoIndex Changelog 0.2.21 - 0.3.10 | CocoIndex
Featuring batching support for CocoIndex functions, execution robustness, schema & type system improvements, custom source support, and more.
cocoindex.io
December 5, 2025 at 7:34 AM
Context engineering just got easier 🚀

CocoIndex transforms how you build AI systems:
✨ Incremental processing - only recompute what changed
🔄 Real-time sync - keep context always fresh
🎯 Data lineage built-in
⚡ Rust-powered

Perfect for RAG, knowledge graphs & AI agents

github.com/cocoindex-io/c…
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
github.com
December 5, 2025 at 2:37 AM
Custom Sources in CocoIndex 🚀

Pull data from ANY system - APIs, databases, cloud storage. CocoIndex now ingests incrementally, tracks changes efficiently, and integrates seamlessly.

No longer limited by prebuilt connectors. Use CocoIndex for anything.

#opensource

cocoindex.io/blogs/custom...
Bring your own data: Index any data with Custom Sources | CocoIndex
CocoIndex now officially supports custom sources — giving you the power to read data from any system you want. You can use CocoIndex for anything, and enjoy the robust incremental computing to build f...
cocoindex.io
December 4, 2025 at 8:22 AM
Automatic Batching in CocoIndex 🚀

CocoIndex now supports automatic batching for all functions. ~5× higher throughput when embedding our codebase.

Best part? Adaptive and knob-free - no timers, no tuning. Just set batching=True.

#opensource

cocoindex.io/blogs/batching
Adaptive Batching - 5x throughput on your data pipelines | CocoIndex
Discover how CocoIndex delivers automatic batch processing for GPU workloads and machine learning pipelines. Framework-level batching optimizes performance for text embeddings and other AI operations ...
cocoindex.io
December 4, 2025 at 8:05 AM
CocoIndex v0.3.10 just shipped with automatic batching support! 🚀

~5× faster throughput when embedding our codebase. Best part? Zero tuning needed - it's adaptive and knob-free. Just set batching=True.

Read the benchmarks 👇
December 4, 2025 at 7:36 AM
Reposted by CocoIndex
Keep passwords and other sensitive information out of your inboxes and chat logs
December 4, 2025 at 7:30 AM
Reposted by CocoIndex
CocoIndex made to #1 Github trending global in Rust - data transformation engine. Grateful to the Rust open source community and all the amazing Rustaceans for the support 💛

#rustlang #github #opensource
November 13, 2025 at 1:32 AM
Reposted by CocoIndex
Fast Iterate Your Indexing Strategy 🚀
YouTube video by CocoIndex
www.youtube.com
October 9, 2025 at 5:00 AM
Reposted by CocoIndex
CocoIndex - github.com/cocoindex-io... - Build fresh knowledge for AI made to the top 3 in trending github in #rustlang!

🌟 star if you like it! Let's go Rust 🦀. Data infra project should be on #Rustlang.

#opensource #buildinpublic
August 14, 2025 at 4:22 PM
A mental framework to really understand how Rust’s ownership, borrowing, and memory safety work.

With this - moves, borrows, Send, Sync, and runtime checks become intuitive and predictable tools in your programming toolbox.

cocoindex.io/blogs/rust-o...

#rustlang #opensource #programming
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
cocoindex.io
August 12, 2025 at 6:01 AM
Reposted by CocoIndex
Multi-dimensional vectors? That’s how AI understands everything — text, images, audio, all at once. We broke it down here. cocoindex.io/blogs/multi-...

🌟Star the repo if you like it!
github.com/cocoindex-io...

#opensource #Vision #LLM #AI #buildinpublic
Multi-Dimensional Vector Support in CocoIndex | CocoIndex
CocoIndex natively handles typed multi-dimensional vectors — from simple arrays to multi-vector embeddings, unlocks multimodal AI pipelines at scale.
cocoindex.io
August 12, 2025 at 12:21 AM
Reposted by CocoIndex
August 10, 2025 at 5:02 AM
CocoIndex is officially supporting custom targets - cocoindex.io/docs/custom_.... We believe this work will add more flexibility for using coco / bring your own lego for targets as well beyond the flow ops.

Thanks our community for the great suggestions!
Custom Targets | CocoIndex
Learn how to create custom targets in CocoIndex to export data to any destination including databases, cloud storage, file systems, and APIs. Build target specs and connectors with setup and data meth...
cocoindex.io
July 29, 2025 at 3:25 AM
🚀 Build Your Own Google Photo Search with Face Indexing at Scale. We just dropped a new tutorial on building a scalable face recognition pipeline using CocoIndex and Qdrant.

cocoindex.io/blogs/face-d...

#opensource #faceRecognition #LLM #AI #startup #Qdrant #CocoIndex #ColdPlay
Indexing Faces for Scalable Visual Search - Build your own Google Photo Search | CocoIndex
Build a scalable face detection and recognition pipeline using CocoIndex. This tutorial covers extracting and embedding faces from images, structuring data for visual search, and exporting to a vect...
cocoindex.io
July 27, 2025 at 5:28 AM