This report provides very interesting results, for example: when asked to generate 20,000 training examples instead of 2,000, Claude produced less varied data. Adaption’s dataset generator, Invent, produced more variety.
Ten times more examples doesn’t guarantee ten times more to learn from!
Nice work, Sara and team!
We released invent a dataset.
Today we release the technical report that goes with it.
Huge shoutout to everyone
@singhshiviii @andrijazzz @lekeonilude @sudip_r0y 🔥
This tackles the hardest setting. How do you go from zero data regime to a training set for a capability.