AI infrastructure that developers love 💚 Run inference, sandboxes, batch processing, training, and many other things on Modal

New York City
Pinned Tweet
Registration is live for Runtime. Apply to attend our inaugural conference for engineers running AI in production. October 1st live at The Midway in San Francisco.
11
26
141
39,686
Thanks for the fun panel @modal and @nanli , exciting to discuss AI for science and @achira_ai with great folks and friends from GSK and Anthropic. Our takeaway: there’s so much to do up and down the stack and science is increasingly a core domain for AI and technology innovation
Excited to speak at Runtime tomorrow about AI x Science and @achira_ai with a great group of people modal.com/runtime @modal is such an incredible company serving so many builders, this event is bound to be fun
4
23
2,001
Modal retweeted
Had a lot of fun talking at @modal Runtime yesterday! We released DFlash nine months ago, and now NVIDIA, AMD, Google and Meta are building on it.
Thanks to everyone who joined us at Runtime yesterday. 9 tracks, 30+ speakers, and a room full of engineers running AI in production.
3
12
102
6,602
Thanks to everyone who joined us at Runtime yesterday. 9 tracks, 30+ speakers, and a room full of engineers running AI in production.
4
9
101
10,975
Modal retweeted
We don't do staged demos at Modal. Every box in our viz was a sandbox spinning up in real time :)
All 1.02M boxes http hello’d to the viz server for counting. We filled the cube at 10k/s and it looked too easy, but offstage the dashboard was huffing and puffing.
3
12
130
7,690
Modal retweeted
we’ve been training some big models at decagon 👀 up to a trillion parameters on modal clusters. congrats on the launch!
Replying to @modal
Modal Clusters are now available. Globally available, RDMA-connected nodes available instantly behind a single decorator. modal.com/blog/modal-cluster…
4
9
98
10,683
Modal retweeted
merch @ runtime
7
4
85
3,352
Modal retweeted
If you're in SF, @cognition is hosting Afters at Devin's with @modal tonight. Stop by, incredible music and swag will be had. ⚡ Signups open: luma.com/modal-runtime-after…
also…modal x devin swag @ runtime afters
19
4
161
68,478
Just launched at Modal Runtime: - Multi-node clusters - VM Sandboxes - Sandbox Sidecars - Sticky Sessions And more:
17
17
247
16,437
Sandbox Sidecars are containers that run alongside your main Sandbox on the same host. These make it easier to run custom proxies, credential injection setups, and run harnesses separately from the tool call environment. modal.com/blog/introducing-s…
1
27
1,818
Sticky Sessions for Modal Servers allow WebSocket connections to reconnect to the same container, supporting applications like collaborative editors, gaming, and multi-user rooms for voice and/or video. Keep clients' interactions attached to the same running Modal container, so your application can maintain state across requests. modal.com/docs/guide/sticky-…
2
24
1,484
Runtime kicked off this morning with keynotes from @bernhardsson and @ScottWu46. Stay tuned for product announcements and recordings from the talks.
1
12
118
5,332
Runtime is tomorrow.
3
11
79
12,581
Excited to speak at Runtime tomorrow about AI x Science and @achira_ai with a great group of people modal.com/runtime @modal is such an incredible company serving so many builders, this event is bound to be fun
1
5
25
3,535
Excited to see everyone at Runtime tomorrow! Looking forward to a guest appearance from @1xTech's NEO.
RUNTIME TOMORROW! meet neo & @bernhardsson
2
3
48
4,312
The Harbor team will be at Runtime tomorrow! @alexgshaw will be hosting a Harbor genius bar @ryan_marten will be presenting “Lessons from Terminal-Bench” Come with your questions and feature requests and say hi!
1
6
48
7,868
Modal retweeted
The Manus Flex Inference Partner Program expands the number of inference providers that users can connect through Flex. We are excited to announce @OpenRouter , @FireworksAI_HQ , and @modal as our initial inference partners for Manus Flex, providing a wide range of model selections alongside large language model providers.
4
9
53
20,300
Runtime is happening in two days. Join us to hear speakers from @AnthropicAI, @typesafeai, @nvidia, @tryramp, and more.
4
22
81
13,154