Solving Partial Autocorrelation Functions
I've been studying time series through TSA. The book presents a structured approach to time series analysis, and covers the material fairly well; I was impressed with the description of what a partial autocorrelation function (PACF) is, as the book explained it more intuitively than the lecture notes did. I did find the description of how to actually solve for the PACF a bit confusing, so I wrote my own explanation.
Partial Autocorrelation Functions
What are PACFs, and why would one want to use one? As explained in TSA, the PACF is useful as it provides an analog to the autocorrelation function, or ACF, but for autoregressive processes. The ACF is particularly useful as for an , the autocorrelation function has the nice property that
Consequently, by plotting the ACF (as can be done easily in R), we can detect the order of the process.
The property fails for the ACF of an process. However, the PACF is here to step in and save the day. With the PACF defined as
where the are defined as
Then, the PACF exhibits the property that for an process, , and for ; consequently, by calculating the PACF of a process, we can easily detect the order of it if it is autoregressive.
Suppose we have the process
where is a sequence of uncorrelated variables with zero mean and constant variance. What is the PACF for this process? As the AR polynomial has no roots with is a weakly stationary process; consequently, we know that for . Consequently, we only need to figure out . To find it, we must solve
To do so, we take the derivative with respect to and set it equal to zero:
Now, we need to solve for in terms of . To do this, we exploit the Yule-Walker equations: