Building everyone's favorite AI infrastructure platform @modal
🇸🇪 → 🗽
- Tweets 13,493
- Following 4,141
- Followers 58,599
- Likes 37,583
we’ve been training some big models at decagon 👀
up to a trillion parameters on modal clusters. congrats on the launch!
Modal Clusters are now available.
Globally available, RDMA-connected nodes available instantly behind a single decorator.
modal.com/blog/modal-cluster…
4
9
98
10,666
Will be a sick event. This is your chance to meet some really cool people and ask them hard questions about infra and AI.
Register here: modal.com/runtime
Runtime is this week at The Midway in San Francisco.
Thanks to our partners for helping us put it together: @nvidia, @pydantic, @radixark, @sgl_project, @temporalio, and @inferact, @vllm_project đź’š
Join us to learn from the engineers behind these tools.
6
10
99
12,912
A lot of the long-running persistent sandbox stuff today feels like lift-and-shift. I suspect sandboxes will evolve from being “devboxes in the cloud” to something much more ephemeral. One environment for every _command_. And snapshotting in between so you can pause/resume/clone.
35
10
270
25,517
idk, if I ran an IPO-ready startup engaged in a capex arms race with a competitor, it would be nice to coordinate and "pace" the arms race a bit
11
4
227
16,855
Erik Bernhardsson retweeted
100% @modal đź‘‘ arming the jevolution with GPUs. Y'all have been the best this week.
If you’re wondering how Jev is scaling to meet insane demand they could not possibly have predicted, the answer appears to be @modal — one of only 4 subprocessors listed on trust.typesafe.ai
2
22
153
36,817
The most valuable knowledge is the one that requires long feedback loops to learn. Like months or years. It’s funny how this was always true but now AI makes this even more true.
8
11
328
12,939
I'm happy for people who sell their startups but personally I have zero interest because I would just go build Modal 2 anyway
13
1
227
23,425
I strongly believe the Federal Reserve should replace the inflation targeting with a direct GPU price target.
Keep jacking up rates until I get get B300s at $4/h again.
7
2
147
9,857
So much of our alpha is in the infra layer anyway. So we’d rather work with open source projects and contribute back. Thanks @sgl_project for building amazing stuff!
which of your favorite token brokers are contributing back to open source ai? shall we count the ways?
a slice of data: number of PRs upstreamed and merged into the most popular oss inference engines, by PR contributor org
2
10
115
19,031
Want to meet some cool people? Want to hear about the future of AI infrastructure? Are you in SF on Oct 1?
👇
Runtime speaker lineup is live!
We're bringing together experts covering AI infrastructure, applications of AI in science and robotics, the future of software engineering, and more.
3
10
51
7,678