Real Analysis
Limits

The challenge in understanding limits is not in its definition, but rather in its execution. Successfully completing a limit proof, using the epsilon-delta definition, involves learning many different concepts at once—most of which will be unfamiliar coming out from earlier mathematics. This chapter will serve as a guide in navigating these proofs, as the skills here will serve you well in higher mathematics.

Definition edit

The definition of a limit, in ordinary real analysis, is notated as:

 

One way to conceptualize the definition of a limit, and one which you may have been taught, is this:   means that we can make f(x) as close as we like to L by making x close to c. However, in real analysis, you will need to be rigorous with your definition—and we have a standard definition for a limit.

The notation of a limit is actually a shorthand for this expression:

Definition of "ƒ approaches the limit L near c"
Given a function ƒ; a limit L; and an approaching value c, ∀ε > 0, ∃δ > 0 such that ∀x,  .

This definition gives a lot of people a lot of trouble, but since it is so fundamental to higher mathematics, there are many ways to help solidify the definition down. This chapter will be a guide in solidifying the behavior of this definition and provide necessary insight into working with the definition, whereas the Exercises will help unravel the puzzle, solidify the concept, and enable you to execute this definition properly.

Corollaries of Limits edit

 
A graphical example of a function converging to a limit as it approaches infinity

It is very common, given limits, to work with the concept of infinity. However, the concept of infinity has yet to be well defined. Intuitively, we know that infinity represents endlessness and it is represented as . Yet, infinity itself is not a number. The current limit definition will fail if we use infinity like a number. If you suppose some limit where c = ∞ and we use our original definition, it would mean that

   means that   

Which is clearly nonsense!

  1. You cannot "subtract by infinity" - infinity isn't a number nor is it really a variable.
  2. Infinity cannot be bounded, yet by putting infinity in a   format, it implies boundedness.

So, the definition needs to be rewritten, which is done in the following chart. The definitions for when either the limit as x approaches positive or negative infinity; or the limit as ƒ(x) converges to positive or negative infinity are as follows:

Note
Yes, the approaching and converging distinction is important. You can look at it as either referencing the delta or the epsilon, respectively.
Variations of the Epsilon-Delta Definition
Notation Formulation
   
   
   
   
   
   
   
   

Take a note of the following variables:

  1. N usually notates a limit with infinity and is analogous to ε.
  2. M usually notates a limit with infinity and is analogous to δ.

We only use big N and M because the connotation associated with ε and δ is that they are small numbers. Big N and M has the opposite connotation.

Conceptualization edit

 
The concept of a limit: Whenever a point x is within δ units of c, f(x) is within ε units of L.
  1. For all ε, only it, the ε variable, will be used to derive a δ.

    This powerful statement basically states that δ is related to ε. To excuse mathematically rigorous language for a moment, δ can be imagined of like a function which outputs ε. This is actually important, as neither δ or ε are allowed to have variables, such as x, be part of their formulation.

  2. ε and δ are supposed to represent bounds.

    Hence the absolute value signs. They are mathematically equivalent to writing   and  , which exemplifies their bound-like nature a lot more.

  3. This limit definition is designed to ignore the value of f(c) and whether or not c is even in the domain of ƒ.

    The requirement   provides the appeal in studying calculus, by removing the technicality of having to analyze the behavior at the point (which is usually undefined to begin with). It is the mathematical implementation of the idea that the behavior of a function near a point shouldn't be affected by its behavior at the point. Thus, f(x) need not be defined at c to have a limit there.

Properties edit

Given that limits are such a fundamental concept of calculus, it should be reasonable to expect that limits should have some intriguing properties to both warrant analysis as well as be a staple mathematical topic in both elementary, applied, and higher mathematics.

Uniqueness edit

A limit is unique, in that there is always one and only one answer if the input is the same. This is commonly rephrased as "a function cannot approach two different limits at c". Limits having unique answers is very important, since if they don't, the use of limits will grow so complex that it will simply become unusable.

Theorem


Suppose a function ƒ such that the limit as x approaches c converges to L. If the limit of ƒ as it approaches c also converges to M, then L = M

Algebraic Operations edit

If  , and  , then:

List of Algebraic Operations for Limits
Name Meaning
Addition  
Subtraction  
Multiple  
Multiplication  
Reciprocal   assuming   and   are both non-zero.
Division   assuming   and   are both non-zero.

By applying the corresponding theorems for sequential limits, we find that functional limits are both unique—they preserve algebraic operations and ordering—and that a corresponding "Squeeze Theorem" holds.

  • If  , then  .
  •  
  • If L = 0 and h(x) is bounded, then  .

Proof edit

For the various operations, the following proofs may require more or less knowledge of algebraic inequality manipulation.

Addition edit

Of the operations, the proof for addition is the most simple, as it relies on the least amount of inequality algebra.

Proof of Limit Addition
Suppose the limit of two functions ƒ and g as x approaches c. The equations will be as follows.  

 

Since both epsilon-delta descriptions reference the same variables x and c in |x - c|, we can combine both equations by ensuring the smallest bound is used in both inequalities (since the bound range will be true for both), through the min function.  

 

Because, due to the constraints placed on δ, it is the case that the previous expression, by definition because of our statement that it is a limit, must imply the epsilon expression. However, since the previous expression encompasses both epsilons, it now implies both epsilons simultaneously.  

 

It should also be the case that, given that the entire delta expression is shared, that the epsilon value bounding both functions ƒ and g can also be bounded using the same epsilon. Specifically, an epsilon half as small as what you think of.  

 

We cannot force the epsilon inequalities together like we did for the delta inequalities because the variables in the absolute sign are not the same and thus do not represent the same variable. However, we know that a + c < b + d (Problem 1.II) and that |x + y| ≤ |x| + |y| (Problem 1.I), so we can combine those two epsilon inequalities to form  

 

The final statement can be expressed, using limit notation, as  

 

 
Subtraction edit

Subtraction follows from the addition proof by imagining a function h that is the negation of the function g beforehand. In other words, imagine the function g in the proof as a variable for a negated function.

 

Multiplication edit

Of the operations, the proof for multiplication is the most complex, as it relies on the greatest amount of inequality algebra. It also requires a seemingly contrived lemma to operate. We will start by proving the lemma, which is simply an algebraic relationship between inequalities, similar to that of the binomial theorem relates a summation of terms and a product.

Lemma Proof
The lemma states that  

 , for any number a, b, c, and d; and x > 0.

The first part is to break the min function into two cases.   and  
Then, rephrase the main function so that it will allow substitution.  
 

As you can see, the lemma itself describes a simple to prove and valid, yet very contrived and unnatural-looking relationship between numbers. But, this relationship is very attractive to be applied blindly for limits, because any value of a, b, c, and d inputted (even 0's) works, and that x > 0 is a condition that matches the ε variable.

As you will see below, we will apply this lemma for multiplication.

Proof of Limit Multiplication
Suppose the limit of two functions ƒ and g as x approaches c. The equations will be as follows.  

 

Since both epsilon-delta descriptions reference the same variables x and c in |x - c|, we can combine both equations by ensuring the smallest bound is used in both inequalities (since the bound range will be true for both), through the min function.  

 

Now, supposing that ε's equate to the following formulas, you can see that the epsilons are numerical in nature, so that the original function bears no relationship (which is good), and that they now are of the same form and condition of the lemma previously proved above (As a reminder, the epsilon value for the limit of ƒ and g individually need not equal epsilon, but the end result should).  

   

Therefore, you can apply the lemma to state that the relationship has been proven.  

   

 
Multiple edit

The proof for multiples of some function ƒ follow from the proof on multiplication. It however relies on the limit of a constant proof. Because of the proofs reliance on two previous proofs and that those proofs this one relies on are robust (they account for things like 0's), this proof is just as robust, even working when a = 0.

Proof of Limit Multiple
Given a function ƒ and a constant a, the limit can be simplified first using the multiple of the limit, then using the limit of a constant function.  
 
Reciprocal edit

Of the operations, the proof for the reciprocal is similar to that of multiplication. It too requires a seemingly contrived relationship between some mathematical statements in order to function, and relies on the argument that the formula or concepts attached to assuring that epsilon and delta's boundedness is maintained is what defines a valid limit. Anyways, let us begin with the "contrived relationship".

Lemma Proof
The lemma states that  

 , for any number a, and b.

The first part is to break the min function into two cases. The first case can be simplified in this manner.  
Asserting that a will not equal 0 (a ≠ 0), the reciprocal definition can be asserted for the inequality  
Focusing back onto the end goal inequality statement, we will now apply both the second case and the fact we have just derived to reach our conclusion.  
 

As you can see, the lemma itself describes a simple to prove and valid, yet very contrived and unnatural-looking relationship between numbers. But, this relationship is very attractive to be applied blindly for limits, because any value of a, and b inputted (not including 0's) works, and that x > 0 is a condition that matches the ε variable.

As you will see below, we will apply this lemma for the reciprocal. Note that the proof is a simple assertion statement.

Proof of Limit for Reciprocals
Given a limit of the reciprocal of the function ƒ, we can assert that epsilon's relationship is like the lemma proven in the previous table. From there, you can draw the same conclusion.  

 

 

 
Division edit

The proof for division of the function ƒ by g is a corollary based on the proof done for limits of multiplication and limits of reciprocals.

Proof of Limit Division
Given a function ƒ and g, the limit can be expressed as a multiplication between the denominator and the reciprocal of the numerator. From there, the result is as depicted.  
 

As always, this proof has the obvious restriction that M cannot be 0.

Limits of Functions edit

Here, we will prove the answers to many of the functions you may commonly see. As always, the following chart for quick recall is provided below.

List of Algebraic Operations for Limits
Name Meaning
Constant  
Linear  

Note that for the linear function, we used z instead of the usual x because the variable name x is already defined and is being used by the limit notation.

Limits of Sequences edit

Note
The following heading requires knowledge of Sequences.

Consider the sequences  . Each converges to zero, but   and  , and these have different limits as  . Thus the limit does not exist.

Limits of Discontinuity edit

Note
The following heading requires knowledge of Continuity.

We'll be giving many more examples in the section on continuity. Although discontinuity is more sensibly important using continuity (which is covered in the next chapter), the definition of discontinuity is actually defined in regards to limits.

Point Discontinuity edit

An example of point discontinuity would be the functions

Example 1
 
Example 2
 

For the following functions,

Example 1
 
Example 2
 

The proof of which is the following:

Jump Discontinuity edit

  • Let  . Then   does not exist.

Asymptotic Discontinuity edit

Limits of Unusual Functions edit

Many of the examples here may seem a bit contrived and appear quite nasty, with even more nastier proofs, but if done correctly, these examples (and the associating exercises) will solidify not only the methodology of a limit proof, but of how mathematics can, using verified theorems and behaviors, solve some seemingly unsolvable problems.

Our first example, often given as a demonstration of just how nasty functions can get (and how far a definition can take you), is

 

For the function ƒ,   for all numbers in the domain. Yes, really.

The first step in understanding the proof of this statement is to stop imagining limits and continuity as the same - that is, if the first step of this problem is to imagine the graph of this function and in a sense, zoom in until an answer can be deduced graphically. Do not be saddened if this is how you thought about how to work out this problem; this method is a simplified explanation of limits commonly taught in elementary mathematics and would thus be ingrained in you anyways.

This proof demonstrates a method of mathematical proof through manipulating theorems instead of manipulating numbers or variables to form the epsilon-delta model, which in turn implies the limit's validity; the existence of a limit. It also shows how a limit proof is actually an exercise in trying to relate two easily malleable inequalities together using valid theorems.

Proof that the limit equals 0
Assert the definition of a limit is valid by validating (through derivation) of each aspect. First, we can assume ε > 0 as it is also assumed in the limit definition. We can also use the approaching number c, the limit l, and the function ƒ. From here, we will assign another variable n in relation to epsilon, as depicted in the adjacent column.  
  1. Now, suppose the set S composing of every rational number greater than 0, less than 1, and whose denominator cannot exceed n. These requirements are commonly depicted as the set represented to the left (although this particular depiction is more-so used as an example of a set whose elements cannot equal one another).
  2. Plus, we will add the clause that if c is a rational number, it won't be in this set either. The explanation of this clause will come later.
 
From here, the property that this set is finite is apparent through the set S's enumeration definition (it is mathematically shown because the set is bounded through the numerator, denominator, and combination of numerator and denominator). This set, as it is a set, also contains a unique list of numbers. From here, you can find some number k with the following property. In other words, you can find the smallest distance.  
  1. We will define the variable δ as the following. This implies the following relationship.
  2. From here, you can see why the set cannot have the variable c in it. If it is in there, the delta relationship will be broken and thus our proof. Thus, we removed it from play, and in effect, we will always have some non-zero δ.
 
The consequence of this definition is not just that x must be less than k. If x is irrational, then the method of deriving a delta from an epsilon value though a proxy variable n is valid and that the following limit interpretation is also valid.  

and  

Likewise, if x is rational, then x cannot be a member of the set S by definition and therefore means that the method of deriving a delta from an epsilon value though a proxy variable n is valid and that the following limit interpretation is also valid.  

and  

 

The next example, of a similar vein, is

Note
This function is also not continuous at any point of its domain.
 

For the function g,   does not exist for any  .

Given  , let   be any rational number in the interval  , and let   be any irrational number in the same interval (  and   are guaranteed to exist by density of the rationals and irrationals). Given any   and  , so  . However, (g(x_n)) = 1 and (g(y_n)) = 0, so their limits are 1 and 0. Since these are not equal,   does not exist.

Appendix edit

Here, we will expose more topics in regards to limits. First, we will give a review on the nature of functions. Recall that a function from a set X to a set Y is a mapping   such that f(x) is a unique element of Y for every  . In analysis, we tend to talk about functions from subsets   to  .

The definition for the limit of a function is much the same as the definition for a sequence. In fact, as we will see later, it is possible to define functional limits in terms of sequential limits. For the moment, however, let us reevaluate the definition of a limit for a function ƒ given a generalized-enabled function:

Given a subset   and a function  , we say   if  

Sequential Limits edit

One curious result of thinking about real numbers as built upon natural numbers and the like (as we have structured our section on numbers in this wikibook) is that the definition of a limit, which we have used the real number version for real functions all this time, can be derived using sequential limits instead of axiomatically, as so:

Given a subset   and a function  , we say   if   such that  , and  

Note that the requirement   corresponds with the requirement  .

As an exercise to test your understanding, prove that these two definitions are equivelant. Note that taking the contrapositive gives a good criterion for determining whether or not a function diverges:

If  , and  , then   does not exist.

Definition on an Arbitrary Metric Space edit

Let  , and   be metric spaces. And let  

The limit as   approaches   of   is equal to   if  

This is denoted