How many trades does a backtest need? The luck in small samples

A backtest needs enough trades for luck to average out. How many depends on the edge and on how much single trades vary, often 100 to 300 trades.

Written by
The EdgeLuma team
Published
Updated
Reading time
8 min
Table of contents
  1. Why does the number of trades matter?
  2. How much can luck move a small backtest?
  3. How many trades do you need?
  4. Why do low win rate strategies need more trades?
  5. Trades or years: which counts?
  6. What if your strategy trades rarely?
  7. How EdgeLuma shows the size of the sample
  8. Frequently asked questions

A backtest needs enough trades for its average result to stand out from luck, and for most strategies that means somewhere between 100 and 300 trades. The exact number depends on how big the edge is compared with how much a single trade’s result varies.

Twenty trades, a steadily rising equity curve, an expectancy of +0.2R a trade. It looks like a strategy. It’s also a result that a strategy with no edge at all produces about one time in four over twenty trades, and from the report alone you can’t tell the two apart.

This guide explains why the number of trades matters so much, with simulations of how far luck can move a small backtest in either direction. Then it gives a rule for the number of trades you need, explains why some strategies need far more than others, and covers what to do when a strategy trades rarely. It ends with how EdgeLuma shows the size of the sample in every report.

Why does the number of trades matter?

Because the numbers in a backtest report are averages, and an average of a few results swings a lot. Expectancy, the average result per trade in R (R is the amount risked on one trade), is the clearest case. Each trade is a draw: a win of some size or a loss. Over a handful of draws, one lucky winner or one bad streak moves the average far from the strategy’s real edge.

As trades add up, the luck starts to cancel out. That’s the law of large numbers: the average of many independent draws settles close to the true value. How close depends on the standard error, the spread of one trade’s result divided by the square root of the number of trades. Four times the trades halves the luck that’s left.

Thirty simulated runs of a strategy that really makes 0.2R a trade, each drawn as its average result per trade as trades add up. Over the first twenty trades the runs are spread from big losses to big gains; by four hundred trades they have closed in around the true edge. A shaded funnel shows where most runs land.+1R+0.5R−0.5R0R20 trades1004001the running expectancy after each trade, trades on a log scaletrue edge+0.2R a tradethis run shows a loss after 20 tradesthe funnel: where95 runs in 100 land
Thirty simulated runs of the same strategy, which really makes +0.2R a trade. Over the first trades their running expectancy is all over the place; by a few hundred trades they have closed in around the true edge.

How much can luck move a small backtest?

More than most traders expect. We simulated 40,000 backtests of each length for a strategy that wins four trades in ten at +2R and loses 1R on the rest, which is worth +0.2R a trade, and for a strategy with no edge at all, which wins four in ten at +1.5R.

Trades in the backtestA real +0.2R edge shows a lossNo edge looks like +0.2R or better
20about 1 in 4about 1 in 4
50about 1 in 6about 1 in 6
100about 1 in 11about 1 in 16
200about 1 in 40about 1 in 80
400about 1 in 300about 1 in 1,250

Over 20 trades, the strategy with a real edge measured anywhere from about −0.4R to +0.8R a trade in 95 runs out of 100. So a single short backtest can bury a good idea, or crown a useless one, and the two mistakes happen about equally often.

A hundred and twenty simulated backtests of a strategy with no edge, each a dot at its measured average result per trade. With 20 trades each the dots spread widely and many look like an edge of 0.2R or more; with 200 trades each they bunch around zero and almost none do.20 trades each120 backtests of a strategy with no edge−0.5R0R+0.5R+0.2R28 of 120 look like an edge of +0.2R or more200 trades each120 backtests of a strategy with no edge−0.5R0R+0.5R+0.2R2 of 120 look like an edge of +0.2R or more
A hundred and twenty simulated backtests of a strategy with no edge, 20 trades each on the left and 200 on the right. Each dot is one backtest’s expectancy; the cyan ones look like an edge of +0.2R or more.

How many trades do you need?

Enough that luck alone would rarely produce your result. A rule of thumb follows from the standard error: the number of trades at which an edge sits about two standard errors away from zero.

Trades needed ≈ (2 × spread of one trade ÷ expectancy)²

The spread is the standard deviation of a single trade’s result in R. Here’s what the rule gives for five common shapes of strategy, all before costs:

StrategyExpectancySpread of one tradeTrades needed
Wins 7 in 10 at +0.6R+0.12R0.73Rabout 140
Wins 1 in 2 at +1.5R+0.25R1.25Rabout 100
Wins 4 in 10 at +2R+0.2R1.47Rabout 210
Wins 3 in 10 at +3R+0.2R1.83Rabout 320
Wins 1 in 4 at +4R+0.25R2.17Rabout 290

Treat the result as a minimum. The rule assumes every trade is independent of the others and that the edge stays the same throughout, and real markets break both assumptions. Bailey and López de Prado work out a more careful version of the question for a track record, which they call the minimum track record length, in The Sharpe Ratio Efficient Frontier. Their version also accounts for skewed results and fat tails, and it asks for more data, not less.

Why do low win rate strategies need more trades?

Because their results vary more. A strategy that wins three trades in ten loses 1R most of the time and makes 3R now and then, so one extra winner or one missing winner moves its average a lot. A strategy that wins seven in ten with small winners produces results that look alike, and its average settles sooner.

That’s why the strategy that wins three in ten needs more than twice as many trades as the one that wins seven in ten in the table above. It also has the longer losing streaks, which our guide to win rate and expectancy measures, and the deeper drawdowns that come with them, simulated in our guide to max drawdown.

Trades or years: which counts?

Trades carry the information, so count them first. A backtest that covers five years and produces 15 trades is still a sample of 15.

Years still matter for a different reason. Trades taken in the same kind of market tend to win and lose together, so 300 trades from one long rally tell you how the strategy did in that rally and not much more. Look for a sample that spans rising, falling and sideways markets, and check the result in each of them separately.

What if your strategy trades rarely?

You have a few honest options:

  • Use more history. On a daily chart, an extra year adds only a handful of trades, so start the backtest as early as the data allows.
  • Test the same rules on more markets. Run the unchanged rules on several pairs and look at each result and at all of them together.
  • Treat a faster version as a new strategy. The same idea on a lower timeframe produces more trades, but it’s a different System with different costs, and it needs its own test.

Avoid loosening the rules just to get more trades. That changes the strategy you’re testing and adds another round of tuning, which is how backtests get overfit. Our guide to backtest overfitting covers the checks.

How EdgeLuma shows the size of the sample

EdgeLuma puts the number of closed trades at the top of every backtest report, right under the total result and next to the expectancy, so you see how much evidence sits behind each number before you read it. Results are counted in R after fees and slippage, the same unit as the rule above.

You can run the same System on other markets and other periods to grow the sample without changing the rules. To check a result, attach the run in the Chat and ask the EdgeLuma AI assistant, for example, whether its number of trades is enough to trust the expectancy. It answers from the run’s own trades. A backtest replays the past: it doesn’t tell you what to trade, and nothing in a report is financial advice.

Key takeaways

  • A backtest’s expectancy is an average, and an average of a few trades is mostly luck. The more trades behind it, the less luck is left in it.
  • Over 20 trades, a strategy with a real edge of +0.2R a trade shows a loss about one time in four, and a strategy with no edge at all looks at least that good about one time in four.
  • The trades you need grow with how much single trades vary and shrink with the size of the edge: roughly (2 × the spread of one trade ÷ the edge) squared.
  • For common strategies that comes to somewhere between 100 and 300 trades. Strategies with a low win rate and big winners need the most.
  • Count trades, not years, and spread them over different kinds of market: 300 trades from one rally are still one rally.

Frequently asked questions

Is 30 trades enough for a backtest?

Rarely. Over 30 trades, a strategy with a modest edge can easily show a loss, and one with no edge can easily look profitable. Thirty trades can tell you that an idea is clearly broken, but not that it works.

How many trades do you need for statistical significance?

Enough that the expectancy sits about two standard errors from zero: roughly (2 × the spread of one trade ÷ the expectancy) squared. For a strategy that wins four trades in ten at +2R, that’s about 200 trades.

Does more historical data make a backtest more reliable?

Only if it adds trades, and the most useful history adds trades from kinds of market the backtest hasn’t seen yet. Five extra years in which the strategy barely trades change little.

How can I tell if my backtest result is luck?

Compare the expectancy with its standard error, the spread of one trade divided by the square root of the number of trades. If the expectancy is less than about twice the standard error, luck alone could have produced it. Then rerun the unchanged rules on data you didn’t use to build them.

Written by the EdgeLuma teamEdgeLuma is a backtesting platform for crypto traders. Describe a trading strategy in plain words: EdgeLuma turns it into rules, replays them on years of real candles with the exchange's real fees and slippage, and shows every trade and every number, even when the strategy loses.

Every article

Keep reading

What took years of chart-watching now takes seconds.