Professor Joe Guinness, a statistician and visiting assistant professor at Cornell (@joeguinness) has attempted to reproduce the reported performance results in BG17 for the women's 800m, which we discuss in our letter.
BG17 report an average time of 121.80 seconds with a standard deviation of 5.42 seconds, for 64 times included in the analysis. Prof. Guinness sought to reporduce these numbers by brute force (his code is linked in the Tweet above).Need to remove 2 athletes to get n=64. Assuming I've not made any transcription or coding mistakes, the only way to match the mean & sd in the table is to remove 2011 Semenya and another athlete with a best time near 2:02. https://t.co/iSn4YuyKPl @Scienceofsport @RogerPielkeJr pic.twitter.com/l9AceVnBKH— Joe Guinness (@JoeGuinnesss) May 12, 2018
He has found that he can only come close to reproducing the times by removing Caster Semenya's 2011 time plus that of one other athlete. See his results above. He notes in a Tweet: "There are some caveats here, especially how rounding is dealt with, so this shouldn’t be taken as definitive."
If these numbers are correct then it would mean that Caster Semenya's time was removed while 2 times from Mariya Savinova in 2011 and 2013 would remain. Savinova's times have officially been removed from the IAAF database after she was suspended for doping at both the 2011 and 2013 World Championships.
The inclusion of Savinova alone would call into question the meaningfulness of BG17, and the deletion of Semenya's time would be curious. Of course, we cannot be sure about any of this until IAAF and BG17 release their data.
The longer the stonewall the more questions will be raised as to why the just don't release the data. Are there some things in their work that they are afraid to show?