The Six Run Average (6RA)

Wednesday 19th December 2018
Author: Sean Murray

 

A starting point for getting better at something is to measure where you currently are. If you can measure it, you can improve it. One of our new year resolutions here at EquiRatings is to bring some new 'metrics that matter' to Eventing in 2019. These are metrics that are easy for anyone to measure and understand, and still give real and reliable insight into a horse’s performance. People know all about the power of the FOD now, next stop is the 6RA. 

To calculate your own 6RA, simply take your six previous dressage scores, any level (national or international also works!) add them together and divide by 6 to get your average. That's your current 6RA. 

The science

A 6 Run Average is our new metric for the dressage phase. It is something almost naively simple, but still a great starting point for understanding a horse’s form. In the following analysis the “X Average Previous Runs” is an average of a horse’s previous test scores with the same rider at international events. The average is capped at the last X runs, but where a horse doesn't have X runs, the average is across all of its runs to date. All DR Scores have been adjusted to the 2018 format (i.e. without the multiplier).

6RA Dressage Score Graph

 

6RA Shane Rose and Virgil at WEG 2018
Virgil & Shane Rose at WEG 2018: 6RA of 29.3 (actual score 29.4).  Photo:  Leslie Threlkeld/Eventing Nation
 

So why stop at 6?

For a simple metric like an average of previous tests, there will come a point when averaging over more runs does not yield a better prediction of future performance. This occurs due to a number of factors. The average score smoothens out a horse’s recent form, and after 6 runs the average is pretty stabilised. Also, we know that horses’ DR Scores tend to improve with their number of runs. If we average over too large a number of runs, we may be including tests that occurred a few years ago, and that are not a true representation of a horse’s current ability.

6RA Image 3

A simple method is to look at the standard deviation (SD) of Prediction Error, against the average of the horse’s previous runs, where Prediction Error is Average Previous DR Scores minus Actual DR Score. The SD is a measure of how accurate the prediction is. For example, if the 6RA has a SD of 3.9 marks, then ~68% of all horses’ scores will fall within 3.9 marks of their 6RA coming into a test.

If we limit the analysis to the top levels (3* and 4* competitions), the predictive power of the “Previous Runs Average” is stronger, but the optimal number of runs to use still stabilises around the same figure of 6-7 runs.

6RA examples at WEG 2018 

So how does this look in a real competition? Below is a table of the top 20 6RA DR tests going into WEG 2018 and the horses’ actual DR Score on the day. Here the average difference of 6RA to DR Score is -0.14 marks, and the SD is 2 marks.

Horse
6RA
WEG Dr Score
CHIPMUNK FRH
22.0
19.9
SAP HALE BOB OLD
22.3
23.3
QING DU BRIOT ENE HN
26.0
25.6
WEGA
26.7
25.9
FLETCHA VAN 'T VERAHOF
27.2
27.6
FERNHILL TABASCO
27.3
27.0
COLANI SUNRISE
27.7
30.2
ALLSTAR B
27.9
24.6
HORSEWARE STELLOR REBOUND
27.9
26.3
BYRNESGROVE FIRST DIAMOND
28.0
28.4
OPIUM DE VERRIERES
28.0
30.1
FOXWOOD HIGH
28.5
30.7
BANDERAS
28.6
30.6
QUARRYCREST ECHO
29.0
27.8
PAVAROTTI
29.0
33.0
CEKATINKA
29.0
27.2
WAIKIKI 207
29.1
32.4
VIRGIL
29.3
29.4
CALLE 44
29.4
28.2
MR CHUNKY
29.6
27.2

 

Similarly, if we look at the bottom 20 6RAs at the same competition, we see that the average difference is a full 1.11 marks with an SD of 2.8. This means that at the bottom end of the field, horses scored better than their average coming into the competition. Did these horses save their best performance for the big stage? Did the judges mark this group of higher scoring horses easier than they have done in the past? 

Across the whole competition the average difference between the 6RA and the actual result was 0.14 marks. This is as expected since we are just looking at how much a 7RA is different to a 6RA for the field. The deviation of the error was 2.75 marks, a tighter deviation than we might have expected from a standard CCI4* event.

Horse
6RA
WEG Dr Score
MAGNUM'S MARTINI
42.9
41.4
HONOR ME
39.3
40.2
ZINDANE
39.2
38.8
EUFORIAN
38.8
36.1
CARRIEM VAN COLEN Z
38.7
35.8
NEREO CP
38.3
35.3
WUNDERMASKE
38.2
36.7
IBERON JMEN
37.9
37.9
CRUISING
37.4
35.7
CECELIA
37.3
37.1
BALLYTIGLEA VIVENDI
37.1
42.4
RIOGHAN RUA
36.9
34.0
JOLLYBO
36.0
32.7
MEYER'S HAPPY
35.9
38.2
VALTHO DES PEUPLIERS
35.8
40.8
JANE Z
35.7
29.5
IMPERIAL VAN DE HOLTAKKERS
35.4
32.6
QUEFIRA DE L'ORMEAU
34.9
32.8
SIJ VEUX D'AUTIZE
34.9
33.2
QUEEN MARY
34.8
32.0

 

Conclusion - your 6RA

A horse’s average form is a good starting point for estimating how they might perform at an event, and a maximum of 6 runs is a good range to average over. This number of 6 doesn’t depend on the level a horse is competing at, but a 6RA does lead to a better estimation of future performance for horses that compete at the highest levels.

In addition to your 6RA, learn how to calculate the other Simple Metrics in our toolset.

Don’t forget to share…