LLMs with type-safe generation

London
Based in United Kingdom
Filter
Exclude
Time range
-
Minimum likes
Jev answers every question instantly. That's great, until a question is hard. TypeLLM is System 1 when it can be, System 2 when it has to be. "thinking": "auto" picks per question, per call. Read more: typellm.ai/blog/thinking-aut…
1
7
495
Replying to @neural_avb
This approach to choice-order invariance makes the logit prediction for each choice independent of the other choices.
74
Thinking in TypeLLM is now 3x faster, with no loss in accuracy. Get better typed decisions with faster thinking Try it now: typellm.ai/dashboard/playgro…
1
25
1,718
Hi Solomon. If a ticket is classified as "feature-request", both "severity" and "page_on_call" will be skipped. It is the right behaviour, since "severity" only executes when it is in ["bug", "incident"] and "page_on_call" only executes when "severity" executes. We will add more explanation to this case to make it clearer.
6
Replying to @typerca
Thanks! RCA is a great use case!
84
TypeLLM retweeted
Replying to @TypeLLM
this is especially interesting for RCA. investigations are naturally conditional — what you check next depends on what the previous check found. “when” looks like a natural way to express that branching. definitely something we want to test in TypeRCA.
1
1
2
164
Replying to @ares_mheinke
So if it is skipped, which means its condition in the “when” field is not satisfied.
85
Replying to @Mashimaro_AI
Yeah sir!
57
In Jev, every field is generated independently. In TypeLLM, earlier answers decide which fields come next: classify an email, then extract the amount if it is an invoice, or the date if it is a meeting request. All in one API call, with `when`.
8
4
86
7,093
Replying to @delliott
Does the output of the first layer become the new tokens?
194
We need a new kind of foundation model that can serve as a universal probabilistic graphical model—supporting uncertainty quantification and propagation before making a decision. TypeLLM is taking a first step in this direction. In v0.5.0, we already support user-defined conditional graphical models. Uncertainty propagation is coming next. More to come.
Ten years ago, AlphaGo’s Move 37 shocked the world. It wasn’t intuition alone that produced it. AlphaGo could search possible futures, test its instincts and reason about what would happen next. In a new piece for @techreview, I argue that today’s most advanced AI systems are still missing something fundamental. LLMs are remarkably capable, but generating longer chains of thought is not the same as genuine reasoning. They typically have no explicit, inspectable record of what they know, what remains uncertain, what evidence supports a conclusion or whether genuine progress has been made. This is why I recently left @GoogleDeepMind. I believe we need a fresh approach to machine reasoning, drawing on some of the architectural lessons from AlphaGo. If AI is going to produce trustworthy and genuinely novel insights in science, medicine and beyond, we need systems whose conclusions arise from an auditable process of evidence, inference and belief revision.
4
562
System 1 models like Jev answer at once: fast, cheap, right when the answer is obvious. System 2 models reason step by step first: slower, but right when the steps matter. Most models are one or the other. TypeLLM decides per field, on every call.
1
3
253
How many r's are in "strawberry"? System 1 models like Jev answer in one shot and get it wrong. TypeLLM thinks first and says 3, and still answers "hello" (0) instantly. Two systems, one model. 🧵
1
21
2,969
Replying to @rae1101x
We will provide some cookbooks on that later today.
2
16
Replying to @rae1101x
Hi minglei, in our latest release yesterday, you can define different options based on previous different outcomes. Others are coming soon.
1
21