KV Cache store is the fastest and most advanced KV Cache platform on the planet. I also run vibecodingagency.com/ products and adversarial.sh/
Texas
- Tweets 1,570
- Following 163
- Followers 47
- Likes 1,075
Pinned Tweet
My way in contributing to Superintelligence advocates is kvcachestore.com/ by pre-computing KV cache on files, you can save a lot on computational costs with data you repeatedly send through an LLM. It uses a cli and has an optional online storage service you can use.
2
217
KVCacheStore LLC retweeted
Sometime soon someone is going to be able to fan out NVIDIA Workstations as L1-L3 cache clusters and it is going to be amazing historically unprecedented compute. For example a 10-node, 80-GPU Vera Rubin cluster with 23 TB HBM4 and 800G InfiniBand scale-out can handle up to 36T trillion parameters in NVFP4 models and train 30B–70B dense foundation models from scratch and it can only get optimized from there. I would never watch TV again if I had this.
@llm_wizard
1
1
36
KVCacheStore LLC retweeted
We release Whistle: speech to text in a 16.9MB file, running on the CPU in the same engine as Needle. It mostly beats Whisper base with 9x less file size and 6x speed. Whistle supports English, German, French, Spanish, Italian, Dutch and Polish.
cactuscompute.com/blog/whist…
97
219
3,515
353,471
KVCacheStore LLC retweeted
And here's Jev playing Tetris
(Btw I am not trying to hype Jev, I am just saying that there are lots of quick Jev clones, but they don't capture what makes Jev so popular/useful).
3
2
4
3,070
KVCacheStore LLC retweeted
Yes, Lev is definitely not Jev level (Jev got 96.5% on the same benchmark for ref)
PS: glad you are liking my book(s)!
2
1
4
3,025
KVCacheStore LLC retweeted
"Code was always just a means to an end."
☝️once you understand this everything becomes clear.
I honestly don’t care at all that I spend 30 years of my life learning syntax and now that knowledge is essentially useless.
Frankly, I’m relieved that I don’t need to care about it anymore. That stuff never really mattered anyways. Code was always just a means to an end.
All I care about is building products that users love. Now I can do that faster. That means I can have bigger impact.
If anything, software engineers should all be celebrating. I don’t understand why you’d “mourn” not needing to write code. The code was never the point.
2
1
44
3,333
KVCacheStore LLC retweeted
Electronics & wiring are the trickiest part of assembling a robot. We’re shipping an entirely new experience for electronics in your @tnkrdotai repository.
Goal is to make it 10x easier to document your electronics system & 10x easier for anyone to assemble.
Every team / builder needs this.
23
127
1,092
49,159
so what we do when there are 500 robots per person? serious question @elonmusk
today at @nianticspatial we're launching the Places Library: 100 real environments to train robots in, with even more coming soon.
warehouse, last mile, residential, and more. every one a simulation-ready USDZ. start here, then capture the sites you actually deploy into.
1
39
jev didn't have time to bake until nvidia cooked contrastive-lm.notion.site/
1
41
here's a complexity test to run for your favoorite LLM: ask it to write its own alternative to wayland or x11 and see what it comes up with for a window manager server.
1
15
I made a rust screensaver for the terminal. its highly customizable including an experimental llm integration to make custom screensavers for whatever you want github.com/awdemos/phosphor
1
1
30