Tuesday, December 5, 2017

Update on NGB Evaluation Project: SGO Criteria and Next Steps

Earlier posts on this project can be found here and here. Now some updates . . .

We employed 36 criteria from the Sports Governance Observer (2015) framework (available here in PDF), to an initial set of 22 US Olympic national governing bodies to arrive at a preliminary governance scorecard for these organizations. You can find our aggregate rankings here and a detailed breakdown by criteria here.

To facilitate understanding the methods and criteria, below please find a summary set of images with the 36 criteria briefly listed (please consult the full SGO 2015 report for considerably more details on the criteria and their application). Each organization is given a score of 1 (poor) to 5 (state of the art) for each of the criteria, which are then aggregated. Each dimension is equally weighted under the SGO scoring methodology.

To get a sense of the magnitude of the evaluation task, consider that there are 72 US NGBs (39 summer, 8 winter and 25 Paralympic federations). Thus, evaluating all of them requires assigning a score across 72 * 36 categories, or 2,592 individual scores. Our methodology requires that two people independently score an organization, and a third performs a final check.

If that process takes, conservatively, an hour of effort, then creation of our overall scorecard is the result of about 2,600 hours of work - or 1.2 years of people-effort. It is a huge task. In the spring will will roll out a website and a mechanism for people (including NGBs to) contribute to or scoring by proposing scoring changes based on evolution in governance. COnsequently, any such scorecard is a snapshot and governance is fluid. So score will (and should) change over time -- ideally towards better governance.

We've been really encouraged by the positive reactions to our project from across the NBGs. In coming weeks we will be announcing additions to the research team, more scores and the dedicated website.


Post a Comment