To be clear, I believe the interesting areas of modularity that warrant investigation are world modeling, reasoning, planning, and memory, generally. Bring back fuzzy memory modules! [6]

[6] arxiv.org/abs/1410.5401

Ugh, sorry for the gross LinkedIn links on that cross post. I'll do better next time. 🫠

Full disclosure, I'm a bit biased as I've developed a similar proprietary set of protocols recently. Kudos to the communities for recognizing the need for standardization for further scaling!

[1] lnkd.in/eUqVV5SQ
[2] lnkd.in/gf6e6XH6
[3] lnkd.in/gx4EbSFR
[4] lnkd.in/g_42revZ

My intuition is that standardization of message passing protocols, like MCP[3] and A2A[4], will further enable both research and engineering for these kinds of approaches.

One of the reasons I'm happy to see a disaggregation effect in the departure from "one massive model to rule them all" is the modularity and, frankly, accessibility brought forward for those without so much compute available. I hope to see more socratic [2] type approaches in the coming years!

Just FYI: I wrote about this and other issues involving AI benchmarks in this piece for Science: www.science.org/doi/10.1126/...