All-in-one Desktop AI assistant. Private RAG, any LLM, Agents, and more. Open source: github.com/Mintplex-Labs/any…

AnythingLLM 1.17.0 is out. We overhauled the Meeting Assistant to run @NVIDIAAI Nemotron 3 Diarization + @moondreamai Parakeet Redux, on your device. 3x smaller download 70-200x real-time on your hardware (GPU or CPU) Integrated into your knowledgebase. anythingllm.com/blog/meeting…
3
2
268
AnythingLLM retweeted
The @AnythingLLM Android app went a year without updates. It was well due for a complete re-work. It's live now and it's amazing, token efficient, and practical. It won't compete for a private jet reservation. It won't get you banned from OpenTable. It just does what you want, right on your phone, without the infrastructure of a small nation. AI for the everyday. RAG, agentic search, reranking, doc gen and recurring tasks. Private, open-source, no vendor lock-in, use an SLM on-device or BYOK. Next up: one connected local-first experience across desktop, mobile and beyond. From desktop, to mobile, to more - all on your hardware and no vendor lock-in. anythingllm.com/mobile
3
1
10
442
Almost every prompt requires web search. We are happy to announce our partnership with @youdotcom for AnythingLLM. Every user now will get accurate, fresh, and rich web-search with ZDR right out of the box. Server, Desktop, & Mobile. Read more: anythingllm.com/blog/you-com…
1
6
10
2,781
AnythingLLM now ships with an OS-wide writing assistant called Magic Tab. Simply clicking on an input can make a contextual suggestion based on what you are looking at as well as contextual typeahead suggestions.
4
2
17
2,152
Tab leverages the memories and activity you already have built up in AnythingLLM - make it a better suggestion engine the more you use it and write. Download today for Mac and Windows: anythingllm.com/desktop
2
434
"Intelligent Dictation" is live in @AnythingLLM. Now your local models clean up your words and paste them at your mouse cursor, but also can even see your open windows and give you better outputs based on what you're doing and what you said.
3
2
9
1,301
Free to use, powered with on-device models and seamlessly works with our tools, agents, memories, and more for Mac and Windows devices. This is a better way to dictate. Download AnythingLLM for desktop today at anythingllm.com/desktop
1
367
Today, we demoed @PrismML's Bonsai 8B model in @AnythingLLM desktop to see if the 1-bit mode arch is the revolution local AI needs. Turns out, this is not an April fools joke. 1.1GB memory footprint for a whole 8B model with high accuracy
6
27
150
13,063
The Bonsai models scale from mobile to Desktop (1.7B, 4B, and 8B) so you can get dense intelligence on any hardware. You can find the full collection (including MLX) here. huggingface.co/collections/p…
1
9
1,529
AnythingLLM is an app layer for local models. We believe that a local model can feel like a cloud model with the right tools and guardrails. We believe we can bring 80% of your daily inference tasks to the computer you are already on. anythingllm.com
1
7
1,162
Over the weeked we passed by 50,000 GitHub stars on AnythingLLM! We are so lucky to have so many people inspired, using, forking, and contributing to our vision of an LLM agnostic tool suite you can run locally or for your organization. ⭐️ github.com/Mintplex-Labs/any…
2
10
2,053
We are a lucky partner to bench the new @NVIDIA DGX Spark before it came out. We build AI tools literally every day, so we were eager to get our hands on this to kick the tires.
1
7
1,462
128GB unified memory, 20-core ARM CPU, 4.1TB of storage, GB10 Blackwell superchip, and more. If you are interested in local AI inference in a single self-contained compute device, our overview video is worth checking out @NVIDIA_AI_PC 👉 piped.video/zs-J9sKxvoM
1
3
4,957
If you have specific models, benchmarks, and other details you want us to try out, let me know, and we can publish those in a follow-up video. GA for these devices is published to be on Wednesday, Oct 15th, so you can let us try out your builds prior to get ideas.
1
919
Turn notes/textbooks into an AI tutor with @AnythingLLM on RTX AI PCs. Flashcards, quizzes, solutions—fast, private, local. 👉 nvda.ws/4gPk4B8
3
10
47
3,555
AnythingLLM + RTX = 🔥 Checkout the latest blog on NVIDIA NIM + AnythingLLM Desktop
Accelerate local LLMs and advanced AI workflows in @AnythingLLM with NVIDIA RTX. 🖥️💬 ⚡ Fast inference w/ NVIDIA NIM Microservices 📁 Local privacy 🔁 Easy to use UI Learn more in the #RTXAIGarage blog 👉 nvda.ws/4kA8J9r
1
1
7
3,007
NVIDIA & Microsoft Advance Development on RTX AI PCs.🤝 TensorRT has been reimagined for RTX. Available via Microsoft’s new inference stack, Windows ML, they streamline development and unlock peak performance. Explore #MSBuild & #COMPUTEX2025 news 👉 nvda.ws/4k2tBWr
26
38
189
60,293
AI at your fingertips. ✨ NVIDIA NIM microservices arrive on RTX AI PCs & workstations making AI tool creation easier than ever. Plus, Project G-Assist System Assistant expands PC AI abilities with a custom plugin builder. #RTXAIGarage: nvda.ws/4iZLlRn
27
58
343
95,780
We ❤️ LanceDB
⚔️ 𝗠𝗲𝗲𝘁 𝘁𝗵𝗲 𝗞𝗻𝗶𝗴𝗵𝘁𝘀 𝗮𝘁 𝗟𝗮𝗻𝗰𝗲𝗹𝗼𝘁 𝗥𝗼𝘂𝗻𝗱 𝗧𝗮𝗯𝗹𝗲 - 𝗧𝗶𝗺 ⚔️ @tcarambat is a fellow @ycombinator alumni, and has never been shy about his enthusiasm for LanceDB. Being a loyal ambassador, his team ships @AnythingLLM with LanceDB as a default for a seamless end-user experience!
1
4
2,213
AnythingLLM retweeted
⚔️ 𝗠𝗲𝗲𝘁 𝘁𝗵𝗲 𝗞𝗻𝗶𝗴𝗵𝘁𝘀 𝗮𝘁 𝗟𝗮𝗻𝗰𝗲𝗹𝗼𝘁 𝗥𝗼𝘂𝗻𝗱 𝗧𝗮𝗯𝗹𝗲 - 𝗧𝗶𝗺 ⚔️ @tcarambat is a fellow @ycombinator alumni, and has never been shy about his enthusiasm for LanceDB. Being a loyal ambassador, his team ships @AnythingLLM with LanceDB as a default for a seamless end-user experience!
1
2
9
4,532