Bluesky Thread

Cache to Cache: let agents communicate in KV cache latent space

November 04, 2025 View original thread

Cache to Cache: let agents communicate in KV cache latent space

Instead of con concatenating the text from one agent into another, just concatenate their KV cache directly

this is dumb, how do i get it now???

fuvty.github.io/C2C_Project_...

A labeled diagram titled “Cache-to-Cache Architecture.”

It shows two modules on the left: Sharer cache and Receiver cache (both with snowflake icons). These feed into an orange dashed box labeled Fuser, which contains three main steps:
1. Projection
2. Dynamic weighting
3. Feature fusion

The outputs are combined (marked by an × symbol) and then pass through another dashed box labeled Gate (also marked with a small flame icon). The result is summed (+) and directed into the Receiver cache, which outputs reply with a target symbol icon.

Below, a caption reads:
C2C Fuser: “Projects and fuses KV-Caches from Sharer into Receiver through (1) Projection, (2) Dynamic Weighting, and (3) Learnable Gating modules.”

44 2

someone wipe the stupid grin off my face!

honestly this is clever. i hope it actually works (i doubt it)

More like this