Page 1 of 1
Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 8:42 am
by AlanF
I have just completed a comparison of accuracy performance between TR and the 3 F-Classes as the basis of the next version of the MCSI (Multiple Category Score Index) system using statistics from all Australian 2014 Queens events.
If my methods are sound, then it appears that at Queens level, F/TR sits between F-Std and F-Open in terms of accuracy, slightly closer to F-Open in fact. Across all distances, F-Std groups are about 72% of TR, F/TR about 62%, and F-Open 53%. Because of the relatively small fields in F/TR, the stats are less reliable, as seen by its more erratic (blue) line on the graph below. The graph reveals that the best relative performance of TR occurs at around 800m to 900y. This suggests they may be better long range wind readers, but are disadvantaged significantly at 900m and 1000y by ballistically inferior projectiles. I'm puzzled by the fact that F-Std regains some lost ground after 900y. Is it because they run hotter loads?

Note that this comparison uses median scores, so may not reflect what you see with winning scores. The median score from each class at every Queens (not leadup) range in 2014 (there were 82) was input, and processed as follows :
- Scores were converted by adding Vs (or Xs) to points
- A Standard Deviation (in MOA) for each converted score was deduced using a typical shots profile for a given score
- For every one of the 82 ranges, the ratio of each F-Class SD to the TR SD was calculated
- For the graph and the overall figures, the SDs were summarised using some weighting according to the numbers in the classes.
I'll be producing new MCSI tables for 2015 based on these statistics. Until now, due to lack of F/TR data, they have had to be lumped in with F-Std. In hindsight, perhaps they should have been scored exactly halfway between F-Std and F-Open!
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 10:10 am
by BATattack
Very interesting lot of data but I might not be looking at it correctly but it seems that FO is averaging .5moa and TR 1moa? Surly that can't be correct or we would have to somehow have scores better than 60.10 (.5moa?) To average out the ones that are worse than that? Sorry I'm probably not reading it correctly with the MOA scale is set up?
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 10:26 am
by AlanF
Adam,
It isn't specifying any actual group sizes. The 53% figure says that F-Open shooters were on average shooting groups about half the size of TR groups, at all distances in all conditions encountered during 2014 Queens shoots. So if the median (placed midway in the field) TR shooter shot say a 1 minute group, the median F-O shooter could be expected to shoot approx a half minute group. Although if you look at the graph at 800m, the median F-Open group would be approx 60% the size of the median TR group. So the relationship is not quite the same for all distances.
Alan
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 10:38 am
by aaronraad
Yeh, but is you took out Mark Fairbairn's scores where would F/TR be then.

Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 12:02 pm
by williada
Alan, great stats and you might think I am left field with the following comments. I think the answer to your puzzle comes from compensation forces. When Fullbore shooters make the transition to scope, they bring sound wind reading skills to that class, but often they bring a rifle that has a longer whippier barrel than other scoped classes from Fullbore. In many cases, shooters may not use the full weight allowed. So I feel these rifles may be compensating more readily than the other gear at the longer ranges more so than shooters being skilled wind readers.
These rifles can use a fundamental lift in the barrel to tap into to tune; whereas, the heavy setups tend to be limiting tune to secondary and tertiary pulses of the barrel. Tunes in heavy setups tend to be about the mini peaks or troughs in neutral barrels or a harmonic node which mimics the neutral barrel. I have been seeing this in a number of groups sent to me for examination recently.
I noticed that the heavy, shorter and stiffer barrels can be still be compensating positively on a pulse in a neutral barrel in the heavy setups past 500 and indicated just past 600 by your stats (which are a bigger sample). Note the relative dips in three scoped rifles at three hundred, five hundred and 6 ½ in your stats where dispersion was smallest. Anything the other side of positive falls off quickly and you may be seeing this effect about 700 with the latent effect a bit further out for F/Open. I also know Three and Five hundred are common distances to tune which may explain the greater dispersion from 700 in compensation terms. I note the dispersion decreases again at long range. You would not expect this given target dimensions and the forces of wind and could we assume the same load for all distances. If that was the case it would be positive compensation. Or maybe rounder numbers are easier to use in wind calculation? F/Standard does not change the projectile. F/Open may use another calibre which has greater wind bucking ability, but the trends seem to be there.
It would be interesting to see if you did a small sample of the top shooters to see these trends where still evident. Its a big assumption, but it be a way of trying to minimise the wind reading ability of the shooter to determine what the class of rifle is capable of and how it is doing it. Not that this is actually relevant to a handicap system based on the spectrum of shooters and their results.
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 1:43 pm
by AlanF
williada wrote:Alan, great stats and you might think I am left field with the following comments. I think the answer to your puzzle comes from compensation forces. When Fullbore shooters make the transition to scope, they bring sound wind reading skills to that class, but often they bring a rifle that has a longer whippier barrel than other scoped classes from Fullbore. In many cases, shooters may not use the full weight allowed. So I feel these rifles may be compensating more readily than the other gear at the longer ranges more so than shooters being skilled wind readers.
These rifles can use a fundamental lift in the barrel to tap into to tune; whereas, the heavy setups tend to be limiting tune to secondary and tertiary pulses of the barrel. Tunes in heavy setups tend to be about the mini peaks or troughs in neutral barrels or a harmonic node which mimics the neutral barrel. I have been seeing this in a number of groups sent to me for examination recently.
I noticed that the heavy, shorter and stiffer barrels can be still be compensating positively on a pulse in a neutral barrel in the heavy setups past 500 and indicated just past 600 by your stats (which are a bigger sample). Note the relative dips in three scoped rifles at three hundred, five hundred and 6 ½ in your stats where dispersion was smallest. Anything the other side of positive falls off quickly and you may be seeing this effect about 700 with the latent effect a bit further out for F/Open. I also know Three and Five hundred are common distances to tune which may explain the greater dispersion from 700 in compensation terms. I note the dispersion decreases again at long range. You would not expect this given target dimensions and the forces of wind and could we assume the same load for all distances. If that was the case it would be positive compensation. Or maybe rounder numbers are easier to use in wind calculation? F/Standard does not change the projectile. F/Open may use another calibre which has greater wind bucking ability, but the trends seem to be there.
It would be interesting to see if you did a small sample of the top shooters to see these trends where still evident. Its a big assumption, but it be a way of trying to minimise the wind reading ability of the shooter to determine what the class of rifle is capable of and how it is doing it. Not that this is actually relevant to a handicap system based on the spectrum of shooters and their results.
I think you could be onto something there Dave. I've just ordered a 34" barrel 1.1" parallel profile, so you don't need to convince me

.
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 7:45 pm
by BATattack
AlanF wrote:Adam,
It isn't specifying any actual group sizes. The 53% figure says that F-Open shooters were on average shooting groups about half the size of TR groups, at all distances in all conditions encountered during 2014 Queens shoots. So if the median (placed midway in the field) TR shooter shot say a 1 minute group, the median F-O shooter could be expected to shoot approx a half minute group. Although if you look at the graph at 800m, the median F-Open group would be approx 60% the size of the median TR group. So the relationship is not quite the same for all distances.
Alan
Thanks Alan! I think the key word I missed in on the scale was "relative" MOA!
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 9:27 pm
by Norm
Alan, did you use A-Grade, TR scores or all three grades?
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 10:08 pm
by AlanF
Norm wrote:Alan, did you use A-Grade, TR scores or all three grades?
All 3 grades combined. And both grades/divisions of F-Std. And median scores were extracted AFTER adding Vs and Xs.
Re: Some Comparitive Score Statistics
Posted: Mon Nov 24, 2014 11:22 pm
by Daniel Chisholm
What a great graph!
I would also be very interested in seeing what it looked like without normalizing the group sizes; it would be neat to see the actual group size SD for TR/FTR/FS/FO shooters, across the different distances.
Not necessarily of general interest, but I am intensely curious about the details behind "A Standard Deviation (in MOA) ... was deduced using a typical shots profile for a given score". I agree with this approach, am curious whether you modelled it as a round group, and if not, how you figured out how much more to smear it sideways for wind effects.
Re: Some Comparitive Score Statistics
Posted: Tue Nov 25, 2014 12:58 am
by AlanF
Daniel,
The only scores I have used are the median scores for each of the 4 classes at each range. Because conditions vary both within and between meetings, and quality of fields varies also, the absolute SDs of median scores do not really have much meaning until you compare them with the other classes shooting concurrently, which is what the ratios do. However I can make the underlying median scores (converted by adding Vs and Xs) and the SDs "derived" from them available.
To get an SD from a score, I wrote a simulation program that uses an initial guess of MOA SD and iterates until the SD is accurate to less than 0.001 MOA. It can be set to "fire" up to 2000 shots for each iteration. Each shot lands neatly in its own uniformly allocated area under the probability curve and is scored according to the target rings for that distance. The method doesn't differentiate between windage and elevation accuracy - it is only concerned with "distance from middle" in MOA.
If you have a good understanding of Excel (with a couple of VB macros) then I'm happy to send you a copy of the worksheet, which also contains all of the base data used.
Alan
Re: Some Comparitive Score Statistics
Posted: Tue Nov 25, 2014 9:39 am
by Daniel Chisholm
Alan - would love to see the spreadsheet. Not for the formulas (your explanation is complete and tells me everything I was looking for), but I am curious about the raw MOA group sizes being shot by TR etc, even with your cautionary explanations about interpreting it.