# Nonstationary Statistics

Nonstationary processes have been defined as random processes whose statistical properties vary over time (see Stationary and Nonstationary Random Processes by Michael Haag).

Nonstationary statistics presents a number of problems. For example, the definition of the power spectrum is a problem, as variation in properties is similar to low frequency noise.

The following is the most succinct statement of the problem of analysing non-stationary statistics I have seen. The following is quoted directly from comments by ‘bender’ starting in comment #18 in response to the post More Tangled Webs at Steve McIntyre’s blog ClimateAudit.

A high AR1 coefficient does not necessarily imply a trend+low AR1 coefficient. However a trend+low AR1 coefficient does lead to a high AR1 coefficient. That is the one of the points these guys are making: AR1 models are an improvement over AR0 models, but they are fraught with their own problems.

The problem with these Hockey Stick-shaped series is that they are nonstationary, so AR coeffs do not have a straightforward interpretation. (Split any time-series at the join of the shaft and blade, compute the PACF and you will see what I mean when you compare the two.) You could take out the trend, to give the coeffs a straightforward interpretation, but then youâ€™ve got the problem of interpreting what it is youâ€™ve taken out, and an autocorrelation analysis certainly isnâ€™t going to help you now.

The purpose of autoregression is to figure out how Xt varies as a function of Xt-1. If they are autocorrelated only indirectly, through the action of some other forcing variable, then the autoregressive model is a bad model, and this badness will revealed when the forcing agent fades in and out (as teleconnections are wont to do).

Bender continues in post #20.

1. For a quasi-demonstration of how a PACF changes when a trend is removed, compare the PACFs of the tropical storm count (with 1970-2005 trend) vs. the landfalling hurricane count (without trend) with which it is strongly correlated (r=0.62 before 1930, r=0.49 afterward). See how PACs 1-4 drop in the detrended series?

2. A clarification for anyone who finds it necessary: the purpose of autoregression is to identify endogenous processes that are persistent through time. Exogenous processes that fade in and out tend to inhibit the estimation of the endogenous autoregressive component, because they introduce a complex nonstationary noise structure.

3. Incidentally, the more dominating the low-frequency exogenous component(s), the lower the precision on the ARMA model estimates. This is the real problem with 1/f noise: you increase your sample size over time, and you inevitably uncover some new â€œtrendâ€ caused by some hitherto unknown exogenous forcing agent. Consequently, it is impossible to obtain an â€œout-of-sampleâ€ sample. (Your new samples come from different populations, which thus nullifies the validation test.)

Thanks Bender…

## 0 thoughts on “Nonstationary Statistics”

1. Steve McIntyre says:

David, do you have a script/method for generating series with variance on multiple scales a la Kousoyannis? Thx, Steve

2. Steve McIntyre says:

David, do you have a script/method for generating series with variance on multiple scales a la Kousoyannis? Thx, Steve

3. “Here elaborates the matter not only extensively but also detailly .I support the
write’s unique point.It is useful and benefit to your daily life.You can air jordan 20 go those
sits to know more relate things.They are strongly recommended by friends.Personally

4. “Here elaborates the matter not only extensively but also detailly .I support the write's unique point.It is useful and benefit to your daily life.You can air jordan 20 go those sits to know more relate things.They are strongly recommended by friends.Personally

5. Pingback: steroids online reviews

6. Pingback: livecooking

7. Pingback: see latest indian news

8. Pingback: witryna firmowa

10. Pingback: find out more

11. Pingback: alphan man

12. Pingback: google sniper 3.0 reviews

13. Pingback: mario smith

14. Pingback: strona www

15. Pingback: strona firmy

16. Pingback: link do strony

17. Pingback: polecam link

18. Pingback: anonse kobiet

19. Pingback: filmowanie Lublin

20. Pingback: magnificent