]>
|
Using this formula for the "d-approximation" to the derivative is much more efficient than using the naive formula .
Why is it better?
The answer is that the "symmetric formula" is exactly right if f is a quadratic function, which means that the error made by it is proportional to or less as decreases. The naive formula is wrong for quadratics and makes an error that is proportional to .
How come?
Suppose is a quadratic: .
Then we get
and
On the other hand, we get
This means that the symmetric approximation is exact for any value of for any quadratic; no need to make small; and this is not true for the asymmetric formula.
In general, if our function being differentiated, , can be expanded in a power series in , the first error in our symmetric formula comes from cubic terms, and will be proportional to .
The reason this happens is that the term in cancels itself out, being the same in both terms. The same things happens for all even power terms, by the way; the errors in this approximation to the derivative all come from odd power terms in the power series expansion of about .
Thus, if we replace d by , the error in the symmetric approximation will decline by a factor of 4, while the asymmetric formula has error which declines only by a factor of 2 when we divide by 2.
And so, the symmetric formula approaches the true answer for the derivative much faster than the naive asymmetric one does, as we decrease .
Now we ask: can we get even faster convergence?
|