Real Analysis/Taylor Polynomials

Real Analysis
Sequences and series

A very solid introductory topic that makes use of sequences and series is the Taylor Series. In this portion, we will cover the Taylor Polynomial, which provides most of the explanations on the behavior of the Taylor Series. A general way to remember the difference is that a Taylor Polynomial is a finite approximation at an interval and the Taylor Series is an infinite representation at an interval. It is important to catch how Taylor Polynomials and Taylor Series are only accurate up around a certain interval. We will explain why in the headings below, but without further ado, the Taylor Polynomial.

This page will only cover Taylor Polynomials. The Taylor Series is covered on a separate page to mirror the similar division between infinite series and finite sequences. However, this page explains the properties better as Taylor Series are an extreme end of a Taylor Polynomial.

Definition

edit
Definition of a Taylor Polynomial of degree   for   at  

Given a natural number  , a function   that is   degree differentiable, and a number   who   outputs a valid number, a Taylor Polynomial of degree   for   at   is defined as a summation of the sequence

 

The Taylor polynomial, in summation form, is expressed as

 

and expressed in big sigma form as

 

Written as  , the function   is often dropped if it can be inferred through context.

This definition, expressed as is, will not offer a background on where it comes from. However, its properties will deliver stunning effects for what is essentially a summation of power functions with very specific multiples. Alternatively, we will also mention these following definitions a little ahead of our theorems. These will be important later.

Definition of a Remainder Term of degree   for   at  

Given a natural number  , a function   that is   degree differentiable, and a number   who   outputs a valid number, a Remainder Term of degree   for   at   is defined as a function such that the property

 

holds.

Written as  , the function   is often, even more so than  , dropped if it can be inferred through context.

Definition of equal up to order   at  

Given a natural number  , two functions   and   to compare, and a number  , the functions   and   are equal up to order   at   when

 

is valid.

Of course, these definitions are difficult to use or make sense of unless some context, in the form of properties given through using theorems, are given. The rest of this section will offer just that; it will prove to you why the Taylor Polynomials work the way they do as estimation tools.

Properties

edit

Basic Properties

edit

The first property we will mention will be a short list of tidbits. Merely note the following:

  no matter what value of   or function is used.
This means that the Taylor polynomial will always estimate the value at a perfectly.
  is a polynomial.
Remember that a polynomial is defined as a sequence of real number values   such that  , which of course can have its input values shifted by some value  , forming  

Uniqueness Property

edit

Of course, it is important for a certain mathematical class to be unique. Taylor polynomials are no exception. However, as you will see in this theorem, we will need to further categorize the a Taylor polynomial in order to do so. Not surprisingly, these more specialized forms will be what we will study. After all, uniqueness is a niffy concept to start the journey of higher mathematics with.

We will prod you further by noting that this theorem is split into two parts. This first half will deal with a very general case of simply two polynomials. The next theorem will deal with Taylor polynomials specifically by modifying this theorem slightly whilst justifying itself anyway.

Taylor Polynomial's are Unique
  1. If there exists two polynomials   and  , written in   form, such that  —their degrees are both less than or equal to some natural number  —and they are both equal up to order   at  , then  
  2. The theorem from (1.) proves uniqueness by substituting the polynomials   and   from the theorem with a polynomial   that is also n-times differentiable and the Taylor polynomial  .

Summary: To prove this directly, we will take the claim that both polynomials are equal up to order   at  . Then, we will use a few properties to wrest out that in order for those two polynomials to be equal up to order   at  , they had to cancel out entirely after subtraction, implying that they're equal.

Also note that this theorem is very closely related to the next theorem. Although the next theorem technically cannot be used for this theorem because the function  , the one that the Taylor polynomial derives from, may not be a polynomial, we will show in the next theorem that this problem can be easily overlooked in this specific instance.

Proof

edit

To begin, we know that these two polynomials are equal up to order   at  . That means that the criterion definition of that can be our starting point. We also know that since they are two polynomials written in the form  , the difference of the polynomials   and   will also be of the form  , albeit with differing   values.

 
Given some set of real numbers  .

Now, an easy way to verify a rational function's limit like this as equaling 0 is to know whether the numerator equals 0. In this case, we know that if a limit of a rational function equals 0, then a rational function with a denominator of a lower degree is also valid, all the way to degree 0, is valid.

 
 

Taking a look at the first statement to check (the one with the 0 degree denominator that effectively equals 1), we note that in order for the limit to equal 0, which is given to be true in our assumptions, we can distribute the limit across every term in the polynomial, creating a string of 0s and leaving out the constant   term. Since the limit as a whole must equal 0, the   variable must equal 0. For the next statement, we see that even with the   denominator, we can in fact cancel it out using every term in the polynomial above, since  , and evaluate the limit over the numerator which still does not affect the next new constant term,  . This variable now assumes the value 0 too. Analyzing the next statement, we can effectively do the same thing. Substitute the variables we have the values of, cancel out the denominator, then declare that the next element in the sequence is 0.

 
 
 

Iteratively doing this, we soon discover that every coefficient of each term of the polynomial is 0. This implies that the difference between the two polynomials   and   must be 0, which we know will only be true if they were the same polynomial to begin with. QED.

 
 
 

 

Part 2 is shown using the next theorem.

Best Power Approximate Theorem

edit

Continuing from the previous theorem, we will provide a concrete method to show how the structure of the first theorem can be co-opted for a general function   and a Taylor polynomial  . The theorem can be interpreted to mean that the Taylor polynomial is better at approximating the function   than any power function of the degree   or below. Mathematically speaking,

Theorem

If a function is a valid Taylor Polynomial  , then it must be equal up to order   at  ;  

Summary: To prove this directly, we will rewrite this in a format that is friendly to repeated uses of l'Hôpital's Rule, remembering that a power function is infinitely differentiable and the first few properties of a Taylor Polynomial mentioned above to one's benefit.

Proof

edit

First, we will find a way to re-express the problem. We know that the last term of a Taylor Polynomial contains the power function represented in the denominator. Including the fact that a Taylor Polynomial is a summation, we can remove one term from the summation and rewrite the expression so that we will have a free term hanging out as so.

 

Since we can distribute a limit across subtraction (we are implicitly assuming that both terms in the limit are valid numbers, as the equation suggests they will), we will do just that. Note that since a Taylor Polynomial is continuous, we can compute the limit easily through a mere variable swap.

 

We will assess whether the equation is indeed equal to each other by taking a look at the limit statement on the left of the equation. Aiming for fulfilling the criteria for l'Hôpital's Rule, we will test whether the limit of the numerator and the limit of the denominator are both equal to a matching pair of infinity or 0. The denominator, a power function, is a valid continuous function. Thus, the limit can simply swap out the   input variable and computed to equal 0. The numerator's first term,  , is continuous as a consequence of being n-degree differentiable. The numerator's second term,  , is continuous as a result of its definition. Thus, both limits can be equated to essentially  , which is 0. Thus, l'Hôpital's Rule does apply.

 
 

Since we know that both numerator and denominator are n-times differentiable with l'Hôpital's Rule working for its entirety, we will choose to differentiate only   times before doing it for the nth time. Here, we know that  , which is a constant. So, that means that one more iteration of l'Hôpital's Rule will have us left with a function subtracted by 0 over a denominator of simply n factorial. On the nth derivation, we finally calculate the limit normally to reveal that the equation holds. QED.

 
 

 

Integral Form of the Remainder

edit

This following theorem is not commonly used, although it is a major step in order to derive the much more used version—the Lagrange form. Typically in first year calculus, the Lagrange form will be utilized.

The obvious fact about Taylor polynomials is that, barring special circumstances, they are not equal to the function   that they relate to. Although we have defined the remainder term as being a function that corrects this error given any input  , this does not rigorously guarantee this behavior. The following theorem seeks to define, and thus justify, the claim that the remainder term of a Taylor polynomial exists and is also a function.

Theorem

If a function is a valid Taylor Polynomial   and it's also   times differentiable, then its remainder form can be written as  

Summary: To prove this, we will use the Fundamental Theorem of Calculus, some sneaky algebraic manipulations, and mathematical explanation for the first 3 iterations in order to create a pattern that is, in the second half, justified using mathematical induction.

Proof

edit

Lagrange Form of the Remainder

edit

This version, although derived from the previous theorem, is the more used version due to its many properties this form presents, namely its inductive-like appearance.

Theorem

If a function is a valid Taylor Polynomial   and it's also   times differentiable, then there exists some   such that its remainder form can be written as  

Proof

edit

Overview

edit

The previous two theorems titled Uniqueness Property and Best Power Approximate Theorem readily makes use of the assumption that the function   must be differentiable to the nth degree in order to assure uniqueness. On the next chapter, Taylor Series, this caveat will be taken to its extreme when we will assume infinite differentiability.