Which MT4 Backtest Report Metrics Should You Use?

Apr 8, 2021

Understanding your backtest report is an essential part of being a successful strategy developer.
Here I explain what the numbers mean, and how you can make use of each metric during strategy development.

Every automated forex trader has combed through an MT4 backtest report at some point. The optimizer reports, in particular, will likely occupy much of your attention.

Do you really need to pay attention to every metric?

My aging eyes say no. Surely some metrics are more important than others.

But before figuring out which metrics we should pay attention to, we first need to know what to look out for.

At the minimum, a good metric should satisfy the following two conditions:

1. It compares return to risk

Risk management is often a central focus of successful trading.

Drawdown is often used to quantify risk, and is defined as a peak-to-trough equity drop. Numerous measures of drawdown exist, the most common of which is the maximum drawdown obtained over the backtest period.

Considering the importance of this metric, MT4 provides the maximum drawdown in both dollar and percentage terms. We’ll go through the differences later. 

2. It is normalized

A normalized metric allows convenient comparison across different markets and strategies.

Such metrics usually contain no units. Examples would be the Sharpe ratio and profit factor. 

MT4 Backtest Performance Metrics

Profit

Net profit fails both of the above conditions.

Although profit and drawdown usually have an inverse relationship, some estimate of the strategy’s historical drawdown is required when evaluating your strategy’s live performance. 

If you enter a prolonged drawdown, what are the chances that your strategy will recover? Is it broken?

If you consider profits in isolation, there is no way of answering these questions in real-time. 

Backtests provide the benefit of hindsight. When you’re trading live, you need to trade through the drawdowns to realize the eventual profits.

Total Trades

While not a performance metric per se, it is crucial for the statistical significance of your backtest. The more trades you have, the more reliable your backtest statistics will be. You can use the standard error to quantify the uncertainty arising from a small number of trades.

When selecting your trading timeframe and backtest period, the number of trades in your backtest should be a key consideration. Longer backtest periods are always favourable since they produce more trades and cover more market conditions.

As a first pass, I consider any backtest containing fewer than 250 trades to be highly suspicious.

Profit Factor

Profit factor is defined as the gross profits divided by gross losses.

The relative balance between profits and losses provides some indication of your strategy’s risk, but tells you nothing about the sequence of losing trades. Having a string of losses in tight succession could decimate your account.

The two equity curves below both have a profit factor of 1.6. The first only has a 10% drawdown, whereas the second has a 30% drawdown due to a losing streak early in the backtest. 

Nonetheless, the profit factor is normalized and is a good choice when doing quick comparisons between strategies. 

Expected Payoff

Also known as the expectancy or the average trade, this is the net profit divided by the number of trades. 

It suffers from the same drawbacks as net profit.

I do pay attention to the expected payoff though; it should comfortably cover transaction costs in the form of spread, slippage and commissions. A common development pitfall is to select short indicator lookback periods, leading to high trading frequency and a low expectancy.

If your backtest expectancy is only 1-2 pips, any unexpected increase in trading costs could turn a profitable strategy into a loser.

Check out the GBPNZD scalping strategy below. The backtest on the left only factors in a 2-pip spread, producing an expectancy of about 2.5 pips.

I then backtested with an additional 2-pip spread and a $7 commission per lot, which effectively destroyed the strategy.

Drawdown ($) and Drawdown (%)

MT4’s backtest report displays the maximum drawdown, taking into account both closed-trade equity and floating profits/losses.

If you have a $500 drawdown from your previously closed trades, and your open positions have another $500 loss, MT4 will take your total drawdown to be $1000.

Sometimes you will see a green line hovering around the blue equity curve when inspecting your MT4 backtest report. That is the open-trade equity curve. 

So should you use dollar or percentage drawdown?

This depends on whether you applied variable position sizing to your backtest. If you backtest with a fixed lot size, use dollar drawdown. If any sort of variable sizing scheme was applied, percentage drawdown will be more appropriate.

If you use percentage drawdown with a fixed lot backtest, your drawdown values will decrease as your account balance grows.

When I develop my strategies, I backtest exclusively with fixed lots, so dollar drawdown is more appropriate. After applying variable position sizing during portfolio composition, I switch over to percentage drawdown.

While maximum drawdown is the most commonly available drawdown metric, it is not necessarily the most reliable, since it captures a single value over your entire backtest.

Alternative drawdown metrics, such as the average drawdown and the Ulcer Index, are discussed here.

What Metrics Should You Use?

None of the above metrics above meet the two conditions when used in isolation.

I will instead recommend using the Profit ($) / Drawdown ($) ratio, because it:

  • Compares returns to risk
  • Is normalized and allows easy comparison across strategies and markets. Volatile markets tend to produce larger profits and drawdowns; the normalization takes care of this.

The easiest way to get this ratio is to export your MT4 backtest report and run the computation in Excel.

Can You Use More Than One Metric?

Of course you can. No metric is perfect, and adding a complementary metric can address some of its pitfalls.

For example, the profit/drawdown ratio is great for measuring risk-adjusted returns, but it doesn’t always paint a complete picture of the strategy’s profitability.

You may be lucky and get a high profit/drawdown because your backtest did not capture a lengthy string of losing trades. For example, the GBPNZD scalping strategy backtest above had a profit/drawdown of 6, but a profit factor of only 1.13.

One way of removing the effects of luck is to run a Monte Carlo simulation to randomize your backtest trade sequence.

You can do this for free by importing your MT4 backtest report into QuantAnalyzer and using its Monte Carlo simulator.

Alternatively, you can create a composite metric consisting of the profit/drawdown and profit factor.

Combining Metrics

Some manipulation is required since the metrics are measuring different quantities.

This can be done by normalizing each metric between the values of 0 and 1. I will illustrate this using the optimizer report above.

  1. For each metric of interest, obtain the minimum and maximum value from the backtests.
  2. The highest metric will be normalized to 1, while the lowest will be normalized to 0, using the formula:
  3. After repeating the above for all metrics of interest, sum up all the normalized values to get your composite metric.

If you use a metric where a smaller value reflects better performance (stagnation is an example), you’ll need to amend the formula above to:

Wrapping Up

MT4 provides a decent selection of performance metrics, but I recommend exporting your report to Excel and computing the profit/drawdown.

This ratio provides a better assessment of your strategy’s risk-adjusted performance. I frequently use this metric during development, along with the number of trades in the backtest.

Once you have finished optimizing your strategy, you can load your MT4 backtest report into QuantAnalyzer. You will have a larger selection of metrics, including stagnation and the Sharpe ratio.

What are your favourite performance metrics? Let me know in the comments below!

Powered By

Development Platform

Forex VPS

FXVM Forex VPS

Popular Posts

Laguerre RSI Trend Following Strategy

The Laguerre RSI attempts to improve the responsiveness of the regular RSI, whilst keeping whipsaw trades to a minimum. Let’s see how well it detects short-term pullbacks for a trend following strategy!

read more

What is Fixed Ratio Money Management?

Have you heard of fixed ratio money management? How does it compare to the popular fixed fractional approach? Here I’ll explain how fixed ratio works, and see how it stacks up against fixed fractional money management.

read more

Build a Diversified Portfolio With QuantAnalyzer

The ability to efficiently trade a diversified portfolio of strategies is one of the biggest advantages of algorithmic trading. Here we will use QuantAnalyzer’s Portfolio Master to build a portfolio consisting of high performing, uncorrelated strategies.

read more

What Is the QQE Indicator?

The QQE is a mysterious indicator that sometimes pops up in trading forums. Does it deserve a place alongside the more traditional momentum indicators like the RSI and CCI? Let’s add it to a trend following strategy to find out!

read more

Make your money work for you!

Get promotions, trading ideas and strategy development tips delivered to your inbox!

Comments

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

Trading Strategies

What’s the Best Time to Trade Forex?

What’s the Best Time to Trade Forex?

The forex markets are open 24/5, but not all hours are created equal. Here I dissect my broker data to determine the best time to trade forex.

Forex Weekend Gaps: Can You Exploit Them?

Forex Weekend Gaps: Can You Exploit Them?

Have you noticed that forex weekend gaps usually reverse within 3 days? Here I’ll program a mean reversion strategy to exploit gaps over the last 18 years!

Money Flow Index: An Improved RSI?

Money Flow Index: An Improved RSI?

The Money Flow Index is sometimes called the volume-weighted RSI. Can it outperform the RSI in this trend following strategy?

Automated Bollinger Bands Squeeze Forex Strategy

Automated Bollinger Bands Squeeze Forex Strategy

StrategyQuant’s BBWR indicator is the perfect tool to detect a Bollinger Bands squeeze. Here I explain how it’s calculated, and use it to program a breakout strategy for the AUDJPY!

Should You Use the Kelly Criterion for Forex Trading?

Should You Use the Kelly Criterion for Forex Trading?

The Kelly criterion is a famous mathematical formula that attempts to maximize your long-term capital growth. In this post, I’ll apply it to a EURUSD breakout strategy and explain some of its potential shortcomings when applied to forex trading.

Can a Trading Pause Improve Your Trend Following Results?

Can a Trading Pause Improve Your Trend Following Results?

A temporary trading pause can improve your win rate if you’re trend following a volatile market. Here I’ll program a trading pause into a simple breakout strategy, and test its effectiveness on the Widow Maker – the GBPJPY.

Laguerre RSI Trend Following Strategy

Laguerre RSI Trend Following Strategy

The Laguerre RSI attempts to improve the responsiveness of the regular RSI, whilst keeping whipsaw trades to a minimum. Let’s see how well it detects short-term pullbacks for a trend following strategy!

How to Use the Supertrend Indicator

How to Use the Supertrend Indicator

Despite its cool name, the Supertrend indicator often seems to slip under the radar. Here I explain how it’s calculated, and combine it with moving averages to produce a simple trend following strategy.

Strategy Development

Do You Know Your System Quality Number?

Do You Know Your System Quality Number?

The System Quality Number measures the profitability & consistency of your trading system. Here’s how to calculate your SQN and use it to improve your trading!

How to Get a Realistic Backtest Spread

How to Get a Realistic Backtest Spread

Your choice of backtest spread can certainly make or break a strategy. This post will show you how to study the intraday spread variations of your market, and suggest several ways to avoid paying ridiculous spreads.

Do You Know Your Strategy’s Optimization Profile?

Do You Know Your Strategy’s Optimization Profile?

Your strategy’s optimization profile often reveals its robustness, helping you select strategies that will remain profitable in live trading. Here I explain why an optimization profile is important, and how you can easily obtain one using StrategyQuant’s optimizer.

Out-of-sample Testing Using Monte Carlo Simulations

Out-of-sample Testing Using Monte Carlo Simulations

Traders often use Monte Carlo simulations to estimate worst-case drawdowns, but did you know they can be used for out-of-sample testing too? This post demonstrates the use of StrategyQuant’s Monte Carlo simulator to randomize historical prices and strategy parameters, helping you select robust strategies for live trading.

How Many Trades Should Your Backtest Have?

How Many Trades Should Your Backtest Have?

We all want a large sample of trades in our backtests, but practical limitations such as data availability often get in the way. Here I’ll explain why 30 trades is insufficient, and how you can use standard error to quantify the uncertainty arising from a small sample size.

Build a Diversified Portfolio With QuantAnalyzer

Build a Diversified Portfolio With QuantAnalyzer

The ability to efficiently trade a diversified portfolio of strategies is one of the biggest advantages of algorithmic trading. Here we will use QuantAnalyzer’s Portfolio Master to build a portfolio consisting of high performing, uncorrelated strategies.

Strategy Optimization Using MT4

Strategy Optimization Using MT4

How do you improve your trading strategy in MT4? This post will show you how to optimize the entry and exit parameters for a moving average crossover strategy. Finally, an intraday time filter will be added to help avoid false breakouts.

Debugging & Backtesting Using MT4

Debugging & Backtesting Using MT4

With a fresh algorithm at your fingertips, how do you verify that it has been programmed correctly? This guide will show you how to use Metatrader 4’s visual backtester to debug and backtest your strategy.

Create Your Trading Algorithm in 15 Minutes (FREE)

Create Your Trading Algorithm in 15 Minutes (FREE)

Converting your trading idea into an algorithm is the first step towards reaping the benefits of automated trading. This guide will cover the creation of a simple moving average crossover algorithm, without any actual programming.

What Is Drawdown in Trading?

What Is Drawdown in Trading?

Are you getting a comprehensive assessment of your strategy’s downside? This post will discuss several methods to measure drawdowns, helping you build and select strategies that better suit your risk appetite.

How to Select the Best Trading Strategy Entry

How to Select the Best Trading Strategy Entry

With an abundance of technical indicators available, selecting your strategy’s entry conditions can be overwhelming. This post will illustrate a method to graphically compare the profitability of different entries.

Live Trading

What’s the Best Time to Trade Forex?

What’s the Best Time to Trade Forex?

The forex markets are open 24/5, but not all hours are created equal. Here I dissect my broker data to determine the best time to trade forex.

How to Find a Real Trading Guru

How to Find a Real Trading Guru

Every day I come across a trading guru offering educational content on the internet. Many of them speak of huge returns with minimal effort. Should these be trusted? Here’s some tips on how to separate the wheat from the chaff.

How to Enjoy Stress-Free Trading

How to Enjoy Stress-Free Trading

Trading is a great way to make some additional income, but not if you’re constantly pulling your hair out. Here I offer 7 tips to help make your trading profitable and stress-free.

How to Select the Best Forex VPS

How to Select the Best Forex VPS

A virtual private server (VPS) is a virtual computer that you can rent and access remotely. It provides a reliable platform on which to execute your forex strategies. This post will help you decide whether you need a VPS, and show you how to select an optimal VPS.

Make your money work for you!

Make your money work for you!

 

Get trading ideas and strategy development tips delivered to your inbox!

Thanks for subscribing!

Pin It on Pinterest

Share This