this entire argument is moot. a common mistake people make is trying to define invention through the lens of human process.
for example, a brute force approach to the solution with no “intuitive jump” would be not be classified as an invention. but that makes no sense. we tend to do this because it is the only concrete manner in which we can define invention: by defining the stages of the process and not outcome due to its open-ended nature.
theoretically llms, or the blanket term “ai” (think of world models, jepa etc.) can get us to invention. and so far they seem to have (navier stokes etc). humans and machines have inherent different strengths from first principles and WILL achieve invention through different means suited to their own makeup.
and all knowledge IS continuous in some capacity. there is no “jump” from a combinatorial sense. it might appear like one BECAUSE of the long and complex relationship between concepts but it is all continuous.
again. think from the lens of discovery not from the lens of how humans conduct discovery. machines will probably not and DO NOT have to emulate humans. they should be operating on the substrate which leverages their strengths. now i’m not saying that llms or “ai” is there yet for all facets of discovery. but scaling up might.
will share a deeper write up formalizing these ideas soon.
Oxford researchers argue that LLMs can never invent anything.
It is mathematically impossible.
They published a paper called “Theory Is All You Need" and it argues against the claim that computational models can generate genuine novelty or new knowledge.
They analyzed the limits of generative ai, and the results are a brutal reality check for the idea that ai will replace human decision making under uncertainty.
Here is why AI is stuck and human cognition wins:
backward-looking vs forward-looking.. llms are probability machines that look backward at existing data. human cognition is forward-looking and capable of generating genuine novelty. human cognition operates theoretically "top-down" rather than "bottom-up" from data.
the "data-belief asymmetry".. the researchers use the invention of "heavier-than-air flight" to illustrate this concept. an ai relies on data-based prediction, which is largely imitative. humans, however, use theory-based causal logic that allows them to hold beliefs that go beyond existing data.
the intervention gap.. humans don't just process information; we use theory to practically "intervene" in the world. we engage in directed experimentation to generate entirely new data. ai-based models are theory-free and place primacy on existing data and prediction.
tldr?
AI uses a probability-based approach to knowledge and ia largely imitative. It can process data and make predictions, but human cognition relies on theory-based causal reasoning.
The decades-old analogy comparing human minds and computers to mere "input-output" devices is fundamentally flawed.