GPT-6 Astra helps @cognition’s Devin back up “it works” with tests before the team ships.

Sep 15, 2026 · 8:23 PM UTC

63
52
817
94,730
Sort replies: Relevant Recent Liked
About time you start releasing the older weights, including 4o. Really pointless and untrustworthy of you to be shipping closed models every week when the world is moving to open source. What is especially irritating about you is that you are retiring models like o3 even in API without releasing any weights. #OpenSource4o #OpenSourceo3 #OpenSource41.
5
491
Clearly it requires improvement, Devin crashes like no other.
1
1
106
こちらで日本語解説しています I covered this in Japanese here:
GPT-6 Astra、ついに実務レベルのコード品質保証に踏み込む。 ——OpenAI DevsがCognition社のDevinとの連携事例を公開。AIエージェントが「動きました」で終わらせず、テストで裏付けてからshipする仕組みが話題。 以下、解説 ===↓↓↓ 【何が起きているか】 DevinはCognitionが開発する自律型AIソフトウェアエンジニア。コードを書くだけでなく、タスクの計画・実行・検証までを自動化するエージェントとして知られる。 今回言及されたGPT-6 Astra... x.lingyaoai.com/OpenAIDevs/status/2099…
569
it's a sad state of reality that people are still thinking in terms of ai as "product" to sell. This stuff should help us all already to not perceive things we built not as product but as a service to ALL humanity. In few years, decades from now we will all look stupid thinking in that greedy terms of product and services to sell. No, we should not be aiming to sell products right now. We should find solutions as fast as possible so that AI make us abundant so that we don't need money for stuff.
47
@notdevin u r doing great bud
1
1
584
Backing "it works" with tests is necessary. If the agent under test also authors the suite, you still need an evaluator it cannot revise.
13
Backing "it works" with tests is necessary. If the agent under test also authors the suite, you still need an evaluator it cannot revise.
40
devin's generated tests can encode its assumptions, so independent acceptance tests still matter
25
先把“能跑”变成“测过了”,这就靠谱多了
51
Devin mentioned I love cloud agents, the best ones available right now
166
pple need legacy models to stay you can't keep doing deprecations. make a legacy app or start opensourcing them. it's time. #4oForAll
2
22
388
by 2026 'done' won't mean a senior engineer signed off, it'll mean the model and the CI pipeline agreed, and most teams aren't ready for that.
1
198
Ares does a lot more than just back up "it works" with tests. It includes full provenance/receipts among other things. Include everything it does as good or better than devin @grok. Also include what it does worse.
1
1
217
This is fascinating !
50
The bar I want from coding agents: the demo includes the tests, not a promise that tests exist.
1
48
The comments are already fighting and the model is not even fully out yet.
23
Picked the latest GPT-6 Astra, but the model itself says it’s gpt-5.6-sol. Paying for Astra, running Sol.@OpenAI @thsottiaux
129
My bar for a bug fix: show me the test failing before the patch and passing after.
190
they must have infinite tokens
143
My códex it’s Down
92
tests before shipping, finally
66
如果真能让 agent 在发布前自己跑测试,这个方向很实用。只是我会先看失败样本:能不能稳定复现、能不能解释,而不只是 demo 里一次通过。
49
Clean approach.
25
Astra + Devin running tests before ship. that one lands.
78
GPT-6 Astra writing the tests before Devin ships. wild.
175
Replying to @OpenAIDevs
The test failing before the fix matters as much as it passing afterward.
76
GPT-6 Astra is eating tokens like never before! Even on the top tear PRO Plan… My weekly tokens are vanishing!!! Please increase the limits! 🙏🏻
75