Dickey–Fuller test

In statistics, the Dickey–Fuller test tests the null hypothesis of whether a unit root is present in an autoregressive model. The alternative hypothesis is different depending on which version of the test is used, but is usually stationarity or trend-stationarity. It is named after the statisticians David Dickey and Wayne Fuller, who developed the test in 1979.^[1]

Explanation

A simple AR(1) model is

y_{t}=\rho y_{t-1}+u_{t}\,

where $y_{t}$ is the variable of interest, $t$ is the time index, $\rho$ is a coefficient, and $u_{t}$ is the error term. A unit root is present if $\rho =1$ . The model would be non-stationary in this case.

The regression model can be written as

\nabla y_{{t}}=(\rho -1)y_{{t-1}}+u_{{t}}=\delta y_{{t-1}}+u_{{t}}\,

where $\nabla$ is the first difference operator. This model can be estimated and testing for a unit root is equivalent to testing $\delta = 0$ (where $\delta \equiv \rho - 1$ ). Since the test is done over the residual term rather than raw data, it is not possible to use standard t-distribution to provide critical values. Therefore this statistic $t$ has a specific distribution simply known as the Dickey–Fuller table.

There are three main versions of the test:

1. Test for a unit root:

\nabla y_t =\delta y_{t-1}+u_t \,

2. Test for a unit root with drift:

\nabla y_t =a_0+\delta y_{t-1}+u_t \,

3. Test for a unit root with drift and deterministic time trend:

\nabla y_t = a_0+a_1t+\delta y_{t-1}+u_t \,

Each version of the test has its own critical value which depends on the size of the sample. In each case, the null hypothesis is that there is a unit root, $\delta = 0$ . The tests have low statistical power in that they often cannot distinguish between true unit-root processes ( $\delta = 0$ )and near unit-root processes ( $\delta$ is close to zero). This is called the "near observation equivalence" problem.

The intuition behind the test is as follows. If the series $y$ is stationary (or trend stationary), then it has a tendency to return to a constant (or deterministically trending) mean. Therefore large values will tend to be followed by smaller values (negative changes), and small values by larger values (positive changes). Accordingly, the level of the series will be a significant predictor of next period's change, and will have a negative coefficient. If, on the other hand, the series is integrated, then positive changes and negative changes will occur with probabilities that do not depend on the current level of the series; in a random walk, where you are now does not affect which way you will go next.

It is notable that

\nabla y_t =a_0 + u_t \,

may be rewritten as

y_t = y_0 + \sum_{i=1}^t u_i + a_0t

with a deterministic trend coming from $a_0t$ and a stochastic intercept term coming from $y_0 + \sum_{i=1}^t u_i$ , resulting in what is referred to as a stochastic trend.^[2]

There is also an extension of the Dickey–Fuller (DF) test called the augmented Dickey–Fuller test (ADF), which removes all the structural effects (autocorrelation) in the time series and then tests using the same procedure.

Dealing with uncertainty about including the intercept and deterministic time trend terms

Which of the three main versions of the test should be used is not a minor issue. The decision is important for the size of the unit root test (the probability of rejecting the null hypothesis of a unit root when there is one) and the power of the unit root test (the probability of rejecting the null hypothesis of a unit root when there is not one). Inappropriate exclusion of the intercept or deterministic time trend term leads to bias in the coefficient estimate for δ, leading to the actual size for the unit root test not matching the reported one. If the time trend term is inappropriately excluded with the $a_0$ term estimated, then the power of the unit root test can be substantially reduced as a trend may be captured through the random-walk with drift model.^[3] On the other hand, inappropriate inclusion of the intercept or time trend term reduces the power of the unit root test, and sometimes that reduced power can be substantial.

Use of prior knowledge about whether the intercept and deterministic time trend should be included is of course ideal but not always possible. When such prior knowledge is unavailable, various testing strategies (series of ordered tests) have been suggested, e.g. by Dolado, Jenkinson, and Sosvilla-Rivero (1990)^[4] and by Enders (2004), often with the ADF extension to remove autocorrelation. Elder and Kennedy (2001) present a simple testing strategy that avoids double and triple testing for the unit root that can occur with other testing strategies, and discusses how to use prior knowledge about the existence or not of long-run growth (or shrinkage) in y.^[5] Hacker and Hatemi-J (2010) provide simulation results on these matters,^[6] including simulations covering the Enders (2004) and Elder and Kennedy (2001) unit-root testing strategies. Simulation results are presented in Hacker (2010) which indicate that using an information criterion such as the Schwarz information criterion may be useful in determining unit root and trend status within a Dickey–Fuller framework.^[7]

References

↑ Dickey, D. A.; Fuller, W. A. (1979). "Distribution of the Estimators for Autoregressive Time Series with a Unit Root". Journal of the American Statistical Association. 74 (366): 427–431. doi:10.2307/2286348. JSTOR 2286348.
↑ Enders, W. (2004). Applied Econometric Time Series (Second ed.). Hoboken: John Wiley & Sons. ISBN 0-471-23065-0.
↑ Campbell, J. Y.; Perron, P. (1991). "Pitfalls and Opportunities: What Macroeconomists Should Know about Unit Roots". NBER Macroeconomics Annual. 6 (1): 141–201. doi:10.2307/3585053. JSTOR 3585053.
↑ Dolado, J. J.; Jenkinson, T.; Sosvilla-Rivero, S. (1990). "Cointegration and Unit Roots". Journal of Economic Surveys. 4 (3): 249–273. doi:10.1111/j.1467-6419.1990.tb00088.x.
↑ Elder, J.; Kennedy, P. E. (2001). "Testing for Unit Roots: What Should Students Be Taught?". Journal of Economic Education. 32 (2): 137–146. doi:10.1080/00220480109595179.
↑ Hacker, R. S.; Hatemi-J, A. (2010). "The Properties of Procedures Dealing with Uncertainty about Intercept and Deterministic Trend in Unit Root Testing". CESIS Electronic Working Paper Series, Paper No. 214. Centre of Excellence for Science and Innovation Studies, The Royal Institute of Technology, Stockholm, Sweden.
↑ Hacker, R. S. (2010). "The Effectiveness of Information Criteria in Determining Unit Root and Trend Status" (PDF). CESIS Electronic Working Paper Series, Paper No. 213. Centre of Excellence for Science and Innovation Studies, The Royal Institute of Technology, Stockholm, Sweden.

External links

Statistical tables for unit-root tests – Dickey–Fuller table
How to do a Dickey-Fuller Test Using Excel

Statistics

Descriptive statistics

Continuous data

Center	Mean arithmetic geometric harmonic Median Mode

Dispersion	Variance Standard deviation Coefficient of variation Percentile Range Interquartile range

Shape	Moments Skewness Kurtosis L-moments

Count data

Index of dispersion

Summary tables

Dependence

Graphics

Data collection

Study design	Population Statistic Effect size Statistical power Sample size determination Missing data

Survey methodology	Sampling Standard error stratified cluster Opinion poll Questionnaire

Controlled experiments	Design control optimal Controlled trial Randomized Random assignment Replication Blocking Interaction Factorial experiment

Uncontrolled studies	Observational study Natural experiment Quasi-experiment

Statistical inference

Statistical theory

Frequentist inference

Point estimation	Estimating equations Maximum likelihood Method of moments M-estimator Minimum distance Unbiased estimators Mean-unbiased minimum-variance Rao–Blackwellization Lehmann–Scheffé theorem Median unbiased Plug-in

Interval estimation	Confidence interval Pivot Likelihood interval Prediction interval Tolerance interval Resampling Bootstrap Jackknife

Testing hypotheses	1- & 2-tails Power Uniformly most powerful test Permutation test Randomization test Multiple comparisons

Parametric tests	Likelihood-ratio Wald Score

Specific tests

Z (normal) Student's t-test F

Goodness of fit	Chi-squared Kolmogorov–Smirnov Anderson–Darling Normality (Shapiro–Wilk) Likelihood-ratio test Model selection Cross validation AIC BIC

Rank statistics	Sign Sample median Signed rank (Wilcoxon) Hodges–Lehmann estimator Rank sum (Mann–Whitney) Nonparametric anova 1-way (Kruskal–Wallis) 2-way (Friedman) Ordered alternative (Jonckheere–Terpstra)

Bayesian inference

Correlation	Pearson product–moment Partial correlation Confounding variable Coefficient of determination

Regression analysis	Errors and residuals Regression model validation Mixed effects models Simultaneous equations models Multivariate adaptive regression splines (MARS)

Linear regression	Simple linear regression Ordinary least squares General linear model Bayesian regression

Non-standard predictors	Nonlinear regression Nonparametric Semiparametric Isotonic Robust Heteroscedasticity Homoscedasticity

Generalized linear model	Exponential families Logistic (Bernoulli) / Binomial / Poisson regressions

Partition of variance	Analysis of variance (ANOVA, anova) Analysis of covariance Multivariate ANOVA Degrees of freedom

Categorical / Multivariate / Time-series / Survival analysis

Categorical

Multivariate

Time-series

General	Decomposition Trend Stationarity Seasonal adjustment Exponential smoothing Cointegration Structural break Granger causality

Specific tests	Dickey–Fuller Johansen Q-statistic (Ljung–Box) Durbin–Watson Breusch–Godfrey

Time domain	Autocorrelation (ACF) partial (PACF) Cross-correlation (XCF) ARMA model ARIMA model (Box–Jenkins) Autoregressive conditional heteroskedasticity (ARCH) Vector autoregression (VAR)

Frequency domain	Spectral density estimation Fourier analysis Wavelet

Survival

Survival function	Kaplan–Meier estimator (product limit) Proportional hazards models Accelerated failure time (AFT) model First hitting time

Hazard function	Nelson–Aalen estimator

Test	Log-rank test

Applications

Biostatistics	Bioinformatics Clinical trials / studies Epidemiology Medical statistics

Engineering statistics	Chemometrics Methods engineering Probabilistic design Process / quality control Reliability System identification

Social statistics	Actuarial science Census Crime statistics Demography Econometrics National accounts Official statistics Population statistics Psychometrics

Spatial statistics	Cartography Environmental statistics Geographic information system Geostatistics Kriging

Category
Portal
Commons
WikiProject

This article is issued from Wikipedia - version of the 12/3/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.

Dickey–Fuller test

Explanation

Dealing with uncertainty about including the intercept and deterministic time trend terms

See also

References

Further reading

External links