AI2025 : Meet your Random Analyst
Would you trust a financial advisor who flips coins to make decisions? 🪙 Of course not! But that’s precisely the way AI behave today.
A groundbreaking study just tested 10+ leading AI models on financial analysis tasks.
The result?
Even the best AI scored under 50% accuracy. That's worse than a coin flip!
Here's what the study revealed:
AI excelled at simple tasks like finding numbers in reports 
> well … thank you but that doesn’t sound so groundbreaking.
AI completely failed at identifying market trends (most models scored 0%)
> Gen AI is not so good at number patterns for now
The best models cost > $3 per question. Yes PER question
> imagine the bill at the end of the month 
Still, best models are 10x better than the previous generating of models.
So may be next year models will score 100% on this … as it’s been the case in every benchmark.
The question is do you want to bet and when ?
Src:
Various AI helped Jean-Paul Paoli draft this post and its visual. Reach out if you believe part of this content infringes on copyrighted material