tag:blogger.com,1999:blog-2313427464944392482.post1274394544378295492..comments2023-08-03T19:44:02.200+10:00Comments on HotWhopper: How Anthony Watts gets a bit confused about ocean heat contentSouhttp://www.blogger.com/profile/08818999735123752034noreply@blogger.comBlogger20125tag:blogger.com,1999:blog-2313427464944392482.post-75237029071607677872013-09-16T00:50:57.360+10:002013-09-16T00:50:57.360+10:00please let us know if you receive a replyplease let us know if you receive a replycitizenschallengehttps://www.blogger.com/profile/04559990934735912814noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-31358945045813503702013-09-16T00:41:51.059+10:002013-09-16T00:41:51.059+10:00Thank you for sharing that link.
Excellent infor...Thank you for sharing that link. <br /><br />Excellent informative post that rounded off what I learned over here quite well.<br />My most basic take away message is that we are in good hands with the experts who understanding this stuff - it's a shame the Willis's and Wattzer's have zero ethical standards, they could learn stuff from you folks if they weren't so dogmatically blinded.<br /><br />Cheers,<br />Petercitizenschallengehttps://www.blogger.com/profile/04559990934735912814noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-61223406983568327162013-06-21T11:43:58.915+10:002013-06-21T11:43:58.915+10:00I have put a polite and reasonable comment at the ...I have put a polite and reasonable comment at the post, trying to point out to Willis some of his errors. Reproduced below the line here. Also, is it my memory or has he majorly edited that post to remove some graphs?<br />---<br />Willis, I think you are misusing the Nychka method, and all your calculations are wrong. <br /><br />The Nychka method provides a formula to calculate the degrees of freedom for a t-test or 95% confidence interval, but it is <em>not the effective sample size used in calculating variance</em>. This is not clear in the document you link to, but is clear in the paper by Lee and Lund[1] that Lucia uses to refer to the Nychka article. In this article they state clearly the correction factor for the variance of the OLS estimate of the slope, and then give the Nychka formula for the <em>degrees of freedom</em> of t. <br /><br />In fact, the efficiency of a properly calculated estimator of the slope is challenging to calculate and doesn't rely on an specific estimate of an "effective sample size" (see Lee and Lund), but it has been calculated for specific instances. In your case, a simple approximation of the standard error of the slope would be that it is about sqrt(0.22) times the standard error of an ordinary least squares regression slope, which would mean that the t-statistic is divided by sqrt(0.22), so about probably 3 times bigger. You can use <a href="http://people.stern.nyu.edu/jsimonof/classes/2301/pdf/regtime.pdf" rel="nofollow">this document</a> to estimate efficiency for an AR(1) autocorrelation of 0.8, assuming that the x-axis has no serial dependence (since it is just time). Or you can plug the numbers into the formula from Lee and Lund if you like that sort of detail. But what should happen is that your t statistic from the OLS estimator will become bigger by a factor of about 3, which is equivalent to an effective n of about 20. Not 4 as you suggest. Then you can compare this value against a t statistic with degrees of freedom calculated using the Nychka method - that is the "effective sample size" minus 2 (because it's regression).<br /><br />If you do this I think you will find your p value is much less than 0.08.<br /><br />Note however that Lee and Lund observe that Nychka's method a) is not published in peer-reviewed literature and b) tends to give degrees of freedom below 0 for large autocorrelations, so may not be reliable.<br /><br />You also don't need to use any of this strange Monte Carlo stuff to handle testing in these cases. Every stats package can get you an auto-regression adjusted best linear unbiased estimator for the slope, directly from the data with a couple of lines of code. It's a trivial and well-established task. So rather than using a complex combination of Nychka adjustments and MC runs, just use the standard methods in R.<br /><br />I think you have misunderstood some of the background material for time series analysis. Instead of relying on complex and little-used methods promoted by other bloggers, I recommend you purchase a good textbook and work through the basic parts. I recommend Brockwell and Davis[2]. Until you do, you will continue to make the kind of basic errors that you made here.<br /><br />I hope that helps.<br /><br />---<br />References<br />1. Lee J, Lund R. Revisiting simple linear regression with autocorrelated errors. Biometrika. 2004;91(1):240-245. {available online free if you search}<br />2. Brockwell P, Davis R. Introduction to Time Series and Forecasting. Springer, New York. {I'm sure any edition will be fine}<br />Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-56906661531658575642013-06-21T07:02:35.959+10:002013-06-21T07:02:35.959+10:00Blogged at:
http://davidappell.blogspot.com/2013/0...Blogged at:<br />http://davidappell.blogspot.com/2013/06/wuwt-ocean-misunderstanding-and.htmlDavid Appellhttps://www.blogger.com/profile/03318269033139447591noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-82913721224498492662013-06-21T05:28:23.087+10:002013-06-21T05:28:23.087+10:00@Anonymous, indeed I had ignored his calculation ...@Anonymous, indeed I had ignored his calculation of the trend as it was sufficiently obvious that he didn't really know what he was talking about when he was so surprised that the mean of his calculated values was so much smaller than the downwelling flux (0.5 kW/m^2). As you say, however, his trend is actually the trend of the derivative and so he's shown that there is evidence for acceleration.Wotts Up With That Bloghttp://wottsupwiththatblog.wordpress.comnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-50235524343195085792013-06-21T03:34:45.847+10:002013-06-21T03:34:45.847+10:00Here's the (easy) reasoning that makes Willis&...Here's the (easy) reasoning that makes Willis's error very explicit:<br /><br />http://wattsupwiththat.com/2013/06/19/forcing-the-ocean-to-confess/#comment-1342359Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-74332768244560163242013-06-21T03:32:31.065+10:002013-06-21T03:32:31.065+10:00Willis's work is a lot worse than this. He is ...Willis's work is a lot worse than this. He is calculating the trend of the *derivative* of OHC, not the trend of OHC. <br /><br />He finds this trend slightly positive, i.e that OHC is accelerating.<br /><br />It's not just his statistics; his interpretation of his own data is wrong.<br /><br />Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-90532380396903994022013-06-21T00:51:43.356+10:002013-06-21T00:51:43.356+10:00Sorry, my comment below was meant to be a reply to...Sorry, my comment below was meant to be a reply to Anonymous as it was their comment that made me look at it again.Wotts Up With That Bloghttp://wottsupwiththatblog.wordpress.comnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-61121072061011994962013-06-21T00:50:42.543+10:002013-06-21T00:50:42.543+10:00Okay, I see what he's done now. I've been...Okay, I see what he's done now. I've been looking through his spreadsheet and had thought he was calculating his error from the standard deviation of his error calculation (which he gets from summing the error in the two subsequent heat content measurements in quadrature). But I think your're right, he's taking the standard deviation of the annual "forcings" he's calculated (which does not depend in any way on the reported errors in the measurements) and then done some kind of correction that depends on Sqrt(n) and a factor of 1.96. So, maybe I had misunderstood how he was calculating his error (although the number turns out to be the same) but it doesn't change the conclusion. The error analysis is complete nonsense.Wotts Up With That Bloghttp://wottsupwiththatblog.wordpress.comnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-61386496805410057092013-06-21T00:34:19.535+10:002013-06-21T00:34:19.535+10:00I think I have just found another huge balls-to-th...I think I have just found another huge balls-to-the-wall error in Willis's work. He's currently being torn a new one by some guy called "xymininininm" or something, and as part of his defense he is claiming that in order to adjust for the auto-correlation you need to use a formula from Nychka, D. Rather than using the standard 1/(1-phi) correction for autocorrelation, Willis claims the Nychka method calculates an "effective n," that is then used to estimate the standard error.<br /><br />I found some people using this method on other denialist sites - including that Lucia person. From there I tracked down <a href="http://biomet.oxfordjournals.org/content/91/1/240.full.pdf+html" rel="nofollow">the original paper</a> (pdf; not paywalled) and it turns out that Willis's correction is NOT a correction to the variance. It is a correction to the <em>degrees of freedom</em> of a t-distribution used to calculate the confidence interval for a regression coefficient.<br /><br />Over at WUWT right now Willis is claiming that the effective n for calculating the t statistic of a slope is 1 (reduced from 58 or something by his "Nychka correction"). In fact, all that happens is the t statistic is T(1) distributed instead of T(58). This, instead of reducing the t-statistic by a factor of 50, simply increases the cut-off for significance from 1.97 to 2.2. <br /><br />So, I think his stats are really really wrong. And I think other denialists are making the same mistake of interpreting an effective degrees of freedom for a t distribution as the n used in calculating standard errors. It looks like McIntyre, Willis and Lucia have all made this mistake. Interesting ...Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-7316541096486307972013-06-20T18:30:06.577+10:002013-06-20T18:30:06.577+10:00Indeed, but that's easy to explain. It's ...Indeed, but that's easy to explain. It's because his error calculation is complete nonsense :-)Wotts Up With That Bloghttp://wottsupwiththatblog.wordpress.comnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-11277863291455982302013-06-20T18:13:26.963+10:002013-06-20T18:13:26.963+10:00As far as I can tell, he hasn't even done anyt...As far as I can tell, he hasn't even done anything remotely like consider auto-correlation coefficients. His calculation works in the following way. He takes the difference between the heat content in two successive years and then divides by the number of seconds in a year and by the surface area of the Earth. This gives him what he is calling the "forcing" (but is really just the fraction of the excess flux associated with ocean heating - and which he clearly does not realise).<br /><br />To get the error he adds the errors on the data for the two successive years in quadrature (Sqrt((Delta J1)^2 + (Delta J2)^). He then divides this by the number of seconds in a year and by the surface area of the Earth. This in itself is wrong (I believe) since he should be calculating the range in the gradient from these errors, not summing them in quadrature. Ultimately, he therefore produces an error value for every year which he associates with the error in the forcing (flux). To get the final error he simply take the standard deviation in these errors. Not only is the error calculation wrong (I believe) but what he's presented is the 1 sigma variation in these errors, so - in some sense - the error in the error, not the error in the flux. Wotts Up With That Bloghttp://wottsupwiththatblog.wordpress.comnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-15804247939122195032013-06-20T17:06:42.222+10:002013-06-20T17:06:42.222+10:00Just looking at the "Willis Ocean Heat Conten...Just looking at the "Willis Ocean Heat Contents" graph, it seems very weird that the trend (i.e. the mean of the difference) would not be significant.Lars Karlssonhttps://www.blogger.com/profile/06158469980966810882noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-50374907064724825172013-06-20T15:45:38.408+10:002013-06-20T15:45:38.408+10:00I have not looked into the details of how Bob Tisd...I have not looked into the details of how Bob Tisdale explains his magical ENSO leaps of heat. Do you understand them?<br /><br />Any time I've seen someone asks him about the mechanism he has avoided the question and referred them to his book. He appears to be quite comfortable with a rise in ocean heat content overall while denying global warming, which is weird. (What I understand of Tisdale's approach is along the lines of: "The whole earth is warming but it's not *global* warming!")<br /><br />One of these days when I have the time I may look into it further. He's not all that relevant. His "theories" seem to me to be just one of many slightly crackpot "theories" that conflict with other crackpot "theories" that you read on WUWT, any or all of which may be accepted at one time or other by some or all deniers, despite their conflicting nature.Souhttps://www.blogger.com/profile/08818999735123752034noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-74608810695503327142013-06-20T14:15:50.901+10:002013-06-20T14:15:50.901+10:00Yes, Willis is confused. Autocorrelation in the *...Yes, Willis is confused. Autocorrelation in the *residuals* of a linear fit affects the estimate of the *uncertainty* in the trend. The autocorrelation of the raw data, rather than the residuals, is irrelevant. As you note, any data with a linear trend has a very strong autocorrelation, even if the residuals are completely uncorrelated.<br /><br />The deniers really do have a fundamental problem with the difference between signal and noise.<br />Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-71225657135510286322013-06-20T13:10:00.813+10:002013-06-20T13:10:00.813+10:00Tisdale has to attack OHC. If it is rising signifi...Tisdale has to attack OHC. If it is rising significantly then his entire ocean-forcing mechanism is bunk, yes?Ryannoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-15484915667637697072013-06-20T10:43:25.968+10:002013-06-20T10:43:25.968+10:00I think that once again Willis has miscalculated t...I think that once again Willis has miscalculated the auto-correlation coefficient. There is no way that series has "lag-1 autocorrelation" of 0.92. He has, once again, failed to make the series stationary before calculating the autocorrelation. The ar(1) value he calculates is so high precisely because the series has a positive trend. <br /><br />Willis knows a few mechanical details about calculations, but he really can't understand what he is doing.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-2483929265586734662013-06-20T06:31:03.691+10:002013-06-20T06:31:03.691+10:00I've noticed that after years of ignoring it, ...I've noticed that after years of ignoring it, the deniers are now starting to attack OHC. Not surprising. It is not doing what they want it to. One has only to look at <a href="http://www.nodc.noaa.gov/OC5/3M_HEAT_CONTENT/heat_content2000m.png" rel="nofollow">OHC 0-2000m</a> over the last decade. Especially at the three-month mean (red).<br /><br />Woo. Look at all that not-missing energy piling up. BBDhttps://www.blogger.com/profile/10687930416706386215noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-14964310219858696692013-06-20T06:24:32.439+10:002013-06-20T06:24:32.439+10:00The usual crap. See Lyman et al. (2010) Robust war...The usual crap. See <a href="ftp://psrd.hawaii.edu/coastal/Climate%20Articles/Ocean%20warming%202010.pdf" rel="nofollow">Lyman et al. (2010)</a> <b>Robust warming of the global upper ocean:</b><br /><br /><i>We fit a line using weighted least squares (Supplementary Information) to the mean OHCA curve (Fig. 2, black line), using the overall uncertainty (Fig. 2, red error bars) for each year in the fit. These uncertainties are large enough that interannual variations, such as the 2003–2008 flattening, are statistically meaningless. We estimate a warming rate of 0.6360.28 W/m2 (uncertainties at the 90% confidence level) for 1993–2003, which is slightly (but not significantly) higher than the value of 0.560.18 W/m2 stated in the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. The fit to the entire 16-yr record, including the well-sampled Argo years, yields a more robust warming rate of 0.6460.11 W/m2. The large uncertainties in OHCA introduced by the XBTs would undoubtedly have a similar effect on trends in thermosteric sea level (not shown).</i>BBDhttps://www.blogger.com/profile/10687930416706386215noreply@blogger.comtag:blogger.com,1999:blog-2313427464944392482.post-26131297683907576602013-06-20T05:32:42.406+10:002013-06-20T05:32:42.406+10:00Note the data and graph from Nuccitelli et al. (20...Note the data and graph from Nuccitelli et al. (2012) (which I'm partial to for obvious reasons!) is more up to date.<br />http://www.skepticalscience.com/graphics.php?g=65<br /><br />Levitus OHC data are available here.<br />http://www.nodc.noaa.gov/OC5/3M_HEAT_CONTENT/heat_global.htmldana1981https://www.blogger.com/profile/05282075263730326573noreply@blogger.com