Econometric Theory/Serial Correlation

There are times, especially in time-series data, that the CLR assumption of is broken. This is known in econometrics as Serial Correlation or Autocorrelation. This means that and there is a pattern across the error terms. The error terms are then not independently distributed across the observations and are not strictly random.

Examples of Autocorrelation edit

 

 
Positive Autocorrelation

 

 
Negative Autocorrelation

Functional Form edit

When the error term is related to the previous error term, it can be written in an algebraic equation.   where ρ is the autocorrelation coefficient between the two disturbance terms, and u is the disturbance term for the autocorrelation. This is known as an Autoregressive Process.   The u is needed within the equation because although the error term is less random, it still has a slight random effect.

Serial Correlation of the Nth Order edit

Autoregressive model edit

  • First order Autoregressive Process, AR(1): 
    • This is known as the first order autoregression, due to the error term only depending on the previous error term.
  • nth order Autoregressive Process, AR(n): 

Moving-average model edit

The notation MA(q) refers to the moving average model of order q:

 

where the θ1, ..., θq are the parameters of the model, μ is the expectation of   (often assumed to equal 0), and the  ,  ,... are again, white noise error terms. The moving-average model is essentially a finite impulse response filter with some additional interpretation placed on it.

Autoregressive–moving-average model edit

The notation ARMA(p, q) refers to the model with p autoregressive terms and q moving-average terms. This model contains the AR(p) and MA(q) models,

 

Causes of Autocorrelation edit

  1. Spatial Autocorrelation

  Spatial Autocorrelation occurs when the two errors are specially and/or geographically related. In simpler terms, they are "next to each." Examples: The city of St. Paul has a spike of crime and so they hire additional police. The following year, they found that the crime rate decreased significantly. Amazingly, the city of Minneapolis, which had not adjusted its police force, finds that they have an increase in the crime rate over the same period.

  • Note: this type of Autocorrelation occurs over cross-sectional samples.
  1. Inertia/Time to Adjust
    1. This often occurs in Macro, time series data. The US interest rate unexpectedly increases and so there is an associated change in exchange rates with other countries. Reaching a new equilibrium could take some time.
  2. Prolonged Influences
    1. This is again a Macro, time series issue dealing with economic shocks. It is now expected that the US interest rate will increase. ##The associated exchange rates will slowly adjust up-until the announcement by the Federal Reserve and may overshoot the equilibrium.
  3. Data Smoothing/Manipulation
    1. Using functions to smooth data will bring autocorrelation into the disturbance terms
  4. Misspecification
    1. A regression will often show signs of autocorrelation when there are omitted variables. Because the missing independent variable now exists in the disturbance term, we get a disturbance term that looks like:   when the correct specification is  

Consequences of Autocorrelation edit

The main problem with autocorrelation is that it may make a model look better than it actually is.

List of consequences edit

  1. Coefficients are still unbiased  
  2. True variance of   is increased, by the presence of autocorrelations.
  3. Estimated variance of   is smaller due to autocorrelation (biased downward).
  4. A decrease in   and an increase of the t-statistics; this results in the estimator looking more accurate than it actually is.
  5. R² becomes inflated.

All of these problems result in hypothesis tests becoming invalid.

 
Autocorrelation in data. 2 runs, but the real OLS, which we would have never found, is somewhere in the middle.

Testing for Autocorrelation edit

  1. While not conclusive, an impression can be gained by viewing a graph of the dependent variable against the error term (namely, a residual scatter-plot).
  2. Durbin-Watson test:
    1. Assume  
    2. Test H(0): ρ = 0 (no AC) against H(1): ρ > 0 (one-tailed test)
    3. Test statistic  
  • Any value under D(L) (in the D-W table) rejects the null hypothesis and AC exists.
  • Any value between D(L) and D(W) leaves us with no conclusion of AC.
  • Any value larger than D(W) accepts the null hypothesis and AC does not exist.

 

  • Note, this is one tail test. To get the other tail. Use 4 - DW as the test stat instead.