Something does not make sense to me. If companies are increasing their AI spend exponentially but do not see ROI / real benefits, then this is the only set of possibilities:
1. Increasing feature velocity does not correlate to increased revenue.
2. Giving engineers more speed to deliver does not make the product better. It is the product improvements that make the product better. The vision/taste around how a feature is used and consumed.
3. Engineering or product efforts are directed toward the wrong things.
4. There is a true delay between engineering improvements and the GTM motion, meaning GTM needs to adopt AI more to proportionally deliver the message.
5. Engineers are replacing the grunt work of coding with AI and are not using that net new time with creative approaches.
6. Speed of delivery does not mean better engineering. A shit idea delivered 10x faster is still a shit idea.
7. This is most likely what is happening, in my opinion. The incentive was set incorrectly, where executives correlate LLM spend to better engineering, which then incentivizes engineers to blindly prompt instead of being slower and more deliberate about AI usage.
8. The limits of AI's benefits are bound by the user's proficiency and intelligence and we are seeing our own limits.
9. Enterprise software is extremely complex, and because of the memory and context limitations that AI has, the benefits it can deliver are greatly reduced. This is why it is easier to deliver an MVP through one-shot, but much harder to deliver a feature improvement against an existing codebase. LLMs are context hungry at a certain point; codebases are massive, not intuitive, and require a lot of guidance.
Some of these points are contradictory on purpose.