tag:blogger.com,1999:blog-2807806767960745481.post9138538018743828480..comments2014-12-14T09:46:13.322-08:00Comments on The Least Thing: Skill of the 2010/2011 PFPO Champions League PredictionRoger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comBlogger23125tag:blogger.com,1999:blog-2807806767960745481.post-91624769882564226132011-09-16T12:42:07.373-07:002011-09-16T12:42:07.373-07:00What fun. Dozens of readers indeed! I'll pon...What fun. Dozens of readers indeed! I'll ponder it, your 'skill' test might be a way in to an idea. Perhaps test what (reasonable) system over the last x years might work best, stopping short of data mining of course. Maybe test for depreciation systems. Thanks. I've done a few guest posts on climate/energy stuff on tAV and Delingpole.<br /><br />This is both displacement therapy and practice for my Masters starting in a very few days at LSE. Do you know Christopher Dougherty, my course director?Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-61842672227624791332011-09-16T09:34:50.148-07:002011-09-16T09:34:50.148-07:00Thanks Roddy, got the email, and it'll be week...Thanks Roddy, got the email, and it'll be weekend reading ... and given the effort you are putting in on this, maybe I could ask you if you'd be interested in a guest post here (guaranteed to reach dozens of faithful readers;-) on the UEFA rankings. They are an obscure topic, but worth highlighting for various reasons ... I'll get back to you via email. Thanks!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-80539892742379626432011-09-16T09:31:59.486-07:002011-09-16T09:31:59.486-07:00The PFPO rankings look designed to solve that thou...The PFPO rankings look designed to solve that thought experiment by focussing on squad ratings (perhaps a proxy for your player value suggestion), squad stability, and the group stage results.<br /><br />Man City are a small example of that thought experiment this year having bought extensively - Aguero, Clichy, Nasri.<br /><br />As I mentioned before, 'complimenting' teams like Spurs on qualifying from the EPL by awarding them 20% of the points is also a rational seeding strategy, an acknowledgement of their likely strength for qualifying at all.<br /><br />But I dare say money might come into it too!<br /><br />The diversity question is interesting. Given certain static or slow-moving features such as fan base, stadium revenues, national TV revenue and the division thereof, it's a classic capitalism inevitably leads to monopoly/oligopoly problem isn't it? With Chelsea back when Abramovich took over and Man City now as the exogenous factors.<br /><br />Did you get my geek UEFA rankings on email, I stripped out the 'complimentary' points from the top 16 seeds.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-77817879728517448002011-09-16T06:16:01.283-07:002011-09-16T06:16:01.283-07:00Hi Roddy, I think that UEFA's interest is both...Hi Roddy, I think that UEFA's interest is both in fairly ranking team strength but also sharing team wealth, a la FFP regulations. So the rankings seem to be a compromise amongst those objectives.<br /><br />Imagine the thought experiment of instantaneously trading every player for Barcelona with, say, Copenhagen. The five-year rankings would still have Barcelona near top, even though they would in this scenario be a much weaker squad.<br /><br />I have started a look at CL diversity with respect to national leagues, building on this:<br /><br />http://www.playthegame.org/news/detailed/champions-league-201112-more-of-the-same-5200.html<br /><br />More on that soon ... Thanks!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-23454260250658876352011-09-15T23:48:13.752-07:002011-09-15T23:48:13.752-07:00I've been musing on the 'unfair' syste...I've been musing on the 'unfair' system of getting 20% of one's compatriot's points, mainly because it puts Man U ahead of Barca when the evidence is other way.<br /><br />But it makes good sense in another way. Both Tottenham last season and Man City this have a reasonable number of points, most gained from the 20% rule, and that's probably right. Any team in the EPL that can qualify for Europe, and I assume something of the same is true across European leagues, is a very decent team.<br /><br />It just feels odd from an EPL perspective given that we have had a few years where the Big Four qualify relentlessly, with an occasional outsider, so we have more than enough data on those four to rank them purely from their own European experience, ditto Real and Barca.<br /><br />The UEFA system can't predict a Schalke either way, with or without the 20% rule, I wonder what the rankings would look like without that rule.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-80522374447962555952011-09-15T16:26:48.905-07:002011-09-15T16:26:48.905-07:00You can't go wrong with Betfair, that would be...You can't go wrong with Betfair, that would be my number one naive baseline, along with the offical seeding method (which, to be pedantic, I think did worse than the PFPO). My instinct would be the UEFA rankings, but depreciate them over time, so a 20% weight for 4 years ago, 40% 3 years ago etc. Something like that. But the bookies will always be able to adjust in a way the rankings can't.<br /><br />The PFPO methodology is instinctively interesting, this year it would (perhaps correctly) promote Man City, who otherwise would start very lowly, and diminish (perhaps correctly) Arsenal with its player focus, but how it handles 25 man squads is beyond me.<br /><br />(I was at Spurs for our demolition by Man City, they were truly awesome, it was like watching an anglicised Barca).Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-63178175901309785002011-09-15T16:02:38.865-07:002011-09-15T16:02:38.865-07:00Roddy, Thanks ... I would actually agree with you ...Roddy, Thanks ... I would actually agree with you about the UEFA coefficients being "best" -- I am actually using them here because I want to understand them better.<br /><br />A "better" naive baseline might simply be the oddsmakers view on the eve of the knock out rounds. Or even team salary or combined player value (as I used for the World Cup predictions).<br /><br />One thing I am doubtful of is how much value added comes with the PFPO methodology ... Thanks!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-6766195286383262202011-09-15T15:40:45.755-07:002011-09-15T15:40:45.755-07:00Yes, Italian teams and English teams both get 20% ...Yes, Italian teams and English teams both get 20% of 4 teams' results, my point was that needs deducting/backing out of the numbers to arrive at a starting point for the round of 16 as well as the specific team's score.<br /><br />I can't agree that the 'best' naive baseline is the single season UEFA coefficient, as a particularly good qualifying group, which is something of a lottery, or indeed a good performance by one's compatriots that season, has a strong influence on the points.<br /><br />I think your original definition of the naive baseline, the official seeding system, is the best available null hypothesis. That is what will be used for the following year's seedings, it's the offical measure of probability. One can take it (the 5 year rolling number) at the start of the season, or perhaps at the start of the round of 16, but common sense tells me that that season's coefficient alone is too volatile.<br /><br />I like the way that the UEFA coefficient is entirely club-based, and the PFPO is player-based, quite different systems of prediction, interesting to contrast them.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-31424427705342019972011-09-15T13:10:27.266-07:002011-09-15T13:10:27.266-07:00Roddy, yes, I am just using the single year number...Roddy, yes, I am just using the single year number. That seems more appropriate as a naive baseline as it refers to the strength of the team in that year.<br /><br />My assumption is that since Serie A and the EPL have the same number of CL slots that the 20% rule applies equally to them (??) ...Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-44405493326866814782011-09-15T11:08:08.510-07:002011-09-15T11:08:08.510-07:00I agree Spurs got one more point that season for g...I agree Spurs got one more point that season for going a round further than ACM, and that at the start of the round of 16 Spurs had got more points *that season* than ACM. That's because we did better in the qualifying round (and because we got 20% of the English clubs' points tally, as did ACM of the Italian, if I understand the system, which I may well not).<br /><br />As an aside I understand your backing out of the one extra point to go back one round, BUT the 20% of your association points will also affect it, so the answer won't be 23.671, but something else. But that's what I used in my spreadsheet, the numbers you posted. One would need to understand the 20% rule, and then back out 20% of the extra points that Man U and Chelsea got, and Inter for beating Bayern too from the ACM score. I think. 'Clubs' coefficients are determined by the sum of all points won in the previous five years, plus 20% of the association coefficient over the same period'.<br /><br />But that's not the UEFA coefficient used for seedings, which was specifically your definition of the naive baseline? The seedings are done on the last five years total, no?<br /><br />'The club coefficient rankings are based on the results of clubs competing in the five previous seasons of the UEFA Champions League and UEFA Europa League. The rankings determine the seeding of each club in all UEFA competition draws.'<br /><br />So I've used your backed-out numbers, which I think are wrong, but not by much probably, and added them to the season end totals from the prior four years. that's the naive baseline at the start of the round of 16. I think.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-39760193268587117692011-09-15T10:40:11.894-07:002011-09-15T10:40:11.894-07:00Roddy, looking at my numbers here is one differenc...Roddy, looking at my numbers here is one difference:<br /><br />ACM/Spurs, I have Spurs, you have ACM<br /><br />Here is how I arrived at the ranking:<br /><br />At the end of 2011 <br /><br />Spurs: 24.671<br />ACM: 18.314<br /><br />But you have to back out the additional point Spur got for advancing to the round of 8 (i.e., subtract 1 point).<br /><br />So at the start of the round of 16 it was Spurs 23.671 and ACM 18.314<br /><br />Score one for the naive baseline.<br /><br />Does this make sense? Thanks!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-30918439734803698592011-09-15T06:37:06.655-07:002011-09-15T06:37:06.655-07:00Thanks Roddy, I'll have a look and get back to...Thanks Roddy, I'll have a look and get back to you a bit later today.Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-71856957034187161142011-09-15T04:07:51.183-07:002011-09-15T04:07:51.183-07:00Roger, I've done a Google docs spreadsheet I&#...Roger, I've done a Google docs spreadsheet I'll link you to by email, but I think the naive baseline did worse, getting four wrong out of fourteen!<br /><br /> Correct<br /><br />Lyon/Real Yes<br />ACM/Spurs No<br />Ars/Barca yes<br />Roma/Shak yes<br />Inter/bayern No<br />valencia/Schalke No<br />Copenhagen/Chelsea Yes<br />marseille/Man u Yes<br /><br />real/Spurs Yes<br />barca/Shak Yes<br />Inter/schalke No<br />Chelsea/Man u Yes<br /><br />real/barca Yes<br />Schalke/Man u YesRoddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-81791827657418297272011-09-15T03:14:57.818-07:002011-09-15T03:14:57.818-07:00That is a difference, I thought they used the aggr...That is a difference, I thought they used the aggregate of five years from the link? So we had some points from the Europa League in prior seasons, and Schalke, for example, had almost none.<br /><br />'The club coefficient rankings are based on the results of clubs competing in the five previous seasons of the UEFA Champions League and UEFA Europa League. The rankings determine the seeding of each club in all UEFA competition draws.'<br /><br />Coefficient calculation<br />Clubs' coefficients are determined by the sum of all points won in the previous five years, plus 20% of the association coefficient over the same period (33% before 2009).<br /><br />These rankings will be updated after each round of UEFA club competition matches.'<br /><br />If that's right your naive baseline, defined as 'In this case, one such naive baseline might be the UEFA club coefficients, calculated during each season and used to seed teams in the Champions and Europa League draws.' would be the five year total in the right hand column, updated to the point of the round of sixteen?<br /><br />(Otherwise, as in your table above, we would have ranked above Inter at that point, who won Serie A and were the holders of the Champions League, and also above Arsenal, even more directly odd, however satisfying, in effect a ranking mainly based on group performance).<br /><br />I note that on the UEFA link they have now updated for the first round group games, and so Man U's total has dropped from 150 to 130 as the whole year five years prior has dropped in favour of this year's running total - they now rank below Marseiile for example.<br /><br />I'll redo the naive baseline test using the four full prior years and your numbers above for the 2010/11 running total just prior to the round of 16.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-81120530830854437722011-09-14T13:13:51.323-07:002011-09-14T13:13:51.323-07:00Roddy, here are the ranks I back out of UEFA, plea...Roddy, here are the ranks I back out of UEFA, please let me know if you see any errors, thanks!<br /><br />33.671 Manchester United<br />33.642 Barcelona<br />31.642 Real Madrid<br />28.133 Schalke 04<br />25.671 Chelsea<br />25.016 Shakhtar<br />24.133 Bayern<br />23.671 Tottenham<br />22.671 Arsenal<br />21.642 Valencia<br />20.314 Inter<br />20.15 Marseille<br />19.15 Lyon<br />18.34 Kobenhavn<br />18.314 AC Milan<br />18.314 AS RomaRoger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-59885929113649700392011-09-14T11:07:41.589-07:002011-09-14T11:07:41.589-07:00Thanks Roddy, I wouldn't be surprised if I had...Thanks Roddy, I wouldn't be surprised if I had made a mistake, given the complexity, but one difference I see in our numbers is that I am using just the 10/11 numbers and nothing from previous years.<br /><br />I'll get back to this in a bit, as my spreadsheet is on my laptop ... More soon, Thx!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-26819003305625406812011-09-14T09:56:32.216-07:002011-09-14T09:56:32.216-07:00Thanks Roger.
Now I'm thoroughly confused. I...Thanks Roger.<br /><br />Now I'm thoroughly confused. I can't see from their description (or Wiki) how we could have started so far behind them, climbed above by the round of 16, and ended below again.<br /><br />On this page http://www.uefa.com/memberassociations/uefarankings/club/season=2011/index.html ACM were 10th with 94 points and THFC were 18th with 78 points - I don't know if that was at the end of the season, beginning, or in between - I guess the end assuming the table is 'live'?<br /><br />The previous season ACM were 9th (100 pts)and THFC 30th (56 pts), 44 points apart.<br /><br />So during the season we climbed 22 points, and ACM rose 6 points.<br /><br />You get points from two sources, your own performance in the two comps (THFC had not taken part hardly, if at all) on the basis of:<br />Group stage participation – 4 points<br />Group stage win – 2 points<br />Group stage draw – 1 point<br />Round of 16 participation – 4 points<br /><br />and 20% of 'the association coefficient', I assume that means your country's teams, in which case THFC would have picked up some more points during the group stages of the two competitions, presumably the same or more than ACM would have done?<br /><br />Since it looks as though we were 44 points behind at the start of the season it seems unreasonable to have managed to get above them just in time to play them in the round of 16, and then slump to 16 points below again by the end of the season.<br /><br />Did you have a link or a press release showing exactly what the rankings were at the start of the round of 16?<br /><br />Don't answer if it's too boring!<br /><br />Regards,<br /><br />RoddyRoddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-91734494577935414312011-09-14T08:58:50.682-07:002011-09-14T08:58:50.682-07:00Roddy, They are described on the right hand side o...Roddy, They are described on the right hand side of this page:<br /><br />http://www.uefa.com/memberassociations/uefarankings/club//index.html<br /><br />Looks like Wikipedia also has a good description:<br />http://en.wikipedia.org/wiki/UEFA_coefficientRoger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-91623640290152131402011-09-14T01:11:50.653-07:002011-09-14T01:11:50.653-07:00Ah, thanks. Where can I find that adjustment, or ...Ah, thanks. Where can I find that adjustment, or how do I do it? I note that the UEFA rankings for this season show Tottenham in 28th, and ACM in 13th - are they really so sensitive that we went from 8 places below them before the group stages last season to above them by the end of the group stages, then back to 15 below them by the end of the season?<br /><br />My instinct would be that rankings that change so fast are a little fickle, and perhaps therefore not the best for a naive benchmark!Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-12678583573653449852011-09-13T12:39:02.671-07:002011-09-13T12:39:02.671-07:00Thanks Roddy, you have to adjust the final 2010/20...Thanks Roddy, you have to adjust the final 2010/2011 numbers to the round of 16 values using the UEFA methodology ... the numbers accumulate through the season. So Spurs were in fact ranked higher than ACM at the round of 16.<br /><br />The time to look at the numbers for 2011/2012 will be on the eve of the round of 16.<br /><br />Thanks!Roger Pielke, Jr.http://www.blogger.com/profile/04711007512915460627noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-28834748014438248392011-09-13T11:18:05.534-07:002011-09-13T11:18:05.534-07:00I have harnessed the power of my brain and sentime...I have harnessed the power of my brain and sentimentality, incorporating UEFA coefficients, anthropogenic climate change and local weather patterns, cultural histories, player injury probabilities and the critical desire/pay grade ratios, and have predicted a 2012 winner: Chelsea FC<br />Take that PFPO!Maxhttp://www.blogger.com/profile/11068680946233164143noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-10479234652139909462011-09-13T11:01:35.697-07:002011-09-13T11:01:35.697-07:00I also note that the UEFA rankings for this season...I also note that the UEFA rankings for this season have Arsenal 5th, an improbable seeding given the absence of Fabregas, Nasri et al.<br /><br />I note that the first three PFPO criteria - ' the experience accumulated by players in Champions League matches, their quality in terms of participation in recent international matches, weighted according to the level of the national team represented, the teams’ squad stability' will take those departures into account, and then balance by group stage performance.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.comtag:blogger.com,1999:blog-2807806767960745481.post-58153047113038465482011-09-13T10:56:27.333-07:002011-09-13T10:56:27.333-07:00Are you sure it's 13/14 correct, only getting ...Are you sure it's 13/14 correct, only getting Inter wrong (I assume their loss to Schalke)? <br /><br />I just checked Tottenham's ranking versus AC Milan on your link, they were 10th and we (Spurs) were 18th - and yet we beat them.<br /><br />That's the only one I checked.<br /><br />PFPO ranking put us higher than Milan btw, and so got that one right.Roddyhttp://www.blogger.com/profile/14104358721079710535noreply@blogger.com