Is It Real, or Is It Luck?
A few green weeks is not proof. This lesson covers sample size, the false edges that fool traders, and the validation ladder that separates a real edge from a lucky run.
Small Samples Lie
Flip a fair coin ten times and you can easily get seven heads. Nobody would call that a biased coin. Yet a trader with seven wins in ten trades will often call it a proven edge and size up.
Results from a small sample are dominated by chance. As a rough guide, fewer than 30 trades is noise. Around 100 trades per setup is where a pattern starts to mean something. Two hundred to four hundred gives you real confidence. This is not a precise rule, it is a reminder that conviction should scale with sample size, not with the warmth of a recent streak.
The False Edges
Most edges that evaporate were never edges. They were one of these.
- Curve-fitting: tuning a strategy so tightly to past data that it describes history instead of predicting the future.
- P-hacking: testing dozens of variations and keeping the one that looked best by chance.
- Recency bias: trusting the last few trades far more than the full record.
- Small-sample illusion: mistaking a short hot run for a durable advantage.
All four share one fingerprint. They look backward and call it forward. The defense is a validation process that deliberately tests the edge on data it has never seen.
The Validation Ladder
Take an edge from idea to live size one rung at a time. Skipping rungs is how lucky runs get funded.
- Backtest: does it show positive expectancy over a long history?
- Walk-forward, out of sample: does it hold on data the design never touched?
- Forward or paper test: does it survive in current conditions with no money on the line?
- Live, small: does it survive real fills, real costs, and real emotion at minimum size?
- Scale: only once the edge has held through each rung do you grow the size.
At every rung you are asking the same question. Is this still positive when it cannot be the result of fitting the past? An edge that clears all five rungs has earned your size.
Educational only. Trading involves substantial risk of loss and is not suitable for every investor. Nothing in this course predicts or guarantees that you will pass an evaluation or keep a funded account. Past performance is not indicative of future results.