View source for Mathematical Methods in Physics/Introduction to 2nd order differential equations

{{lecture}}
{{75%done}}

==Introduction==
What are differential equations? Why are they so important in physics? The answer to these questions will become more apparent as the course goes on, but to provide motivation, for now we will say that a differential equation is ''an equation where derivatives of a function appear'' (we will provide a more formal definition in the following section), and from which we'd like to know what this function is. Finding a function such that the differential equation is satisfied is known as ''finding a solution to the differential equation''.

Why should physical scientists study differential equations? The answer to this question is rather easy if the student has taken any more or less advanced physics course. It will become apparent to them that the basic laws of nature can be expressed in the language of differential equations, both ''ordinary'' as well as ''partial'' differential equations.

As canonical examples, we consider the equation of the ''harmonic oscillator'' (ordinary),

:<math>\frac{d^2x}{dt^2} = -\omega^2 x</math>

the ''wave equation'' (partial),

:<math>\frac {\partial^2 u}{\partial t^2} = c^2 \left({\frac {\partial ^{2}u}{\partial x^{2}}}+{\frac {\partial ^{2}u}{\partial y^{2}}}+{\frac {\partial ^{2}u}{\partial z^{2}}}\right)</math>

the equation of an ''RLC circuit'' (ordinary),

:<math>L\frac{d^2I}{dt^2} + R \frac{dI}{dt} + \frac{I}{C} = \frac{dV}{dt}</math>

and finally, ''Laguerre's equation'' (ordinary),

:<math>x \frac{d^2y}{dx^2} + (1-x)\frac{dy}{dx} + ny = 0</math>

an equation that shows up in quantum mechanics.

There are many alternative notations for the derivative; we may use primes (Lagrange's notation) (<math>y'</math>, <math>y''</math>, etc.), numbers enclosed within parentheses (<math>y^{(1)}</math>, <math>y^{(5)}</math>, etc.), Leibniz's notation (<math>\frac{d^3y}{dx^3}</math>), or Newton's dot notation, when we discuss derivatives with respect to time (<math>\frac{dx}{dt} = \dot{x}, \frac{d^2x}{dt^2} = \ddot{x}</math>). In what follows, we will try to use consistent notation, but the reader should be aware that notation is mostly a matter of preference and one notation is as good as any other. 

==Basic definitions==

A '''differential equation''' is an equation that relates a function with its derivative. Given a function <math>f</math>, independent variable <math>x</math> and dependent variable <math>y</math>, an (ordinary) differential equation's most general expression is

:<math>f\left(x, y, y'', \ldots, y^{(n)}\right) = 0</math>

A ''solution'' to this differential equation is a function <math>y = g(x)</math> such that 

:<math>f\left(x, g(x), g''(x), \ldots, g^{(n)}(x)\right) = 0</math>

We say that a differential equation is of ''order <math>n</math>'' if the highest derivative that appears in the differential equation is the <math>n</math>-th derivative.

An ''autonomous differential equation'' is one where there is no explicit dependence on the independent variable <math>x</math>:

:<math>f\left(y, y'', \ldots, y^{(n)}\right) = 0</math>

A ''linear ordinary differential equation'' only involves the dependent variable and its derivatives in a linear fashion (multiplied by a non-zero function of <math>x</math>, which may or may not be constant). For example,

:<math>\cos(y') + \sin x + y = 0</math>

:<math>e^{y} + y'^2 + 3x = 0</math>

are examples of nonlinear differential equations, whereas 

:<math>3 y'' + 2y - y = \cos x</math>

:<math>y^{(4)} - 5 y''  + y = x^2</math>

:<math>x^2 y'' - 3 x y' + y = \sin x</math>

are linear differential equations.

We say that a linear differential equation is ''homogeneous'' if any potential term(s) involving solely the independent variable <math>x</math> are identically vanishing. Thus,

:<math>3 y'' + y' - 5y = 0</math>

is homogeneous, whereas 

:<math>y''' - 5 y''  + y' + 2y = x^2 + \cos x</math>

is ''inhomogeneous'' or ''nonhomogeneous'', due to the <math>x^2 + \cos x</math> term that depends solely on <math>x</math>.

It is customary, but by no means necessary, to move all the nonhomogeneous terms to the right-hand side of the differential equation; this practice is done to clearly distinguish these inhomogeneous terms as well as make some solutions method easier to implement.

==Linear ordinary differential equations==

We focus now on linear ordinary differential equations, as these appear pervasively in the physical sciences, in particular those of second-order.

A '''linear ordinary differential equation''' is an equation of the form

:<math>a_n(x)y^{(n)} + a_{n-1}(x)y^{(n-1)} + \ldots + a_1(x)y' + a_0(x)y = f(x)</math>

As we have seen before, if <math>f(x) \neq 0</math> the equation is ''nonhomogeneous'' or ''inhomogeneous'', and if all the coefficients, that is, all the <math>a_i(x)</math> factors are constant and not functions of <math>x</math>, we say that the equation is of ''constant coefficients''.

===Linear dependence of functions===

====Vectors====

From linear algebra, we intuitively know what it means for two vectors to be ''linearly independent''. The vectors <math>\mathbf{u} = -3\mathbf{i} + 5\mathbf{j}</math> and <math>\mathbf{v} = -6\mathbf{i} + 10\mathbf{j}</math> are linearly dependent because <math>\mathbf{u}</math> can be expressed as a ''linear combination'' of <math>\mathbf{v}</math>, or vice versa: <math>\mathbf{v} = 2 \mathbf{u}</math> or equivalently, <math>\mathbf{u} = \frac{1}{2} \mathbf{v}</math>.

More formally, given the set of vectors <math>S=\{\mathbf{v}_1,\mathbf{v}_2,\dots,\mathbf{v}_n\}</math>, we say that these vectors are linearly dependent if the equation

:<math>a_1\mathbf{v}_1+a_2\mathbf{v}_2+\cdots+a_k\mathbf{v}_k= \mathbf{0},</math>

has a nontrivial (nonzero) solution in the scalar coefficients <math>a_i</math> (<math>a_1</math>, <math>a_2</math>, etc.), that is to say, that at least one of the coefficients doesn't vanish, and where <math>k\leq n</math>. If, for example, <math>a_1 \neq 0</math>, then

:<math>\mathbf{v}_1 = -\frac{a_2}{a_1} \mathbf{v}_2 - \cdots - \frac{a_k}{a_1} \mathbf{v}_k,</math>

and we can see that <math>\mathbf{v}_1</math> is a linear combination of the rest of the vectors.

This means that the vectors of the set <math>S=\{\mathbf{v}_1,\mathbf{v}_2,\dots,\mathbf{v}_n\}</math> are ''linearly independent'' if the equation 

:<math>a_1\mathbf{v}_1+a_2\mathbf{v}_2+\cdots+a_n\mathbf{v}_n= \mathbf{0},</math>

can only be satisfied if the scalar coefficients <math>a_i</math> are all <math>0</math>.

====Functions====

We can now extend our definition of linear independence to functions.

We say that the functions <math>g_1(x)</math>, <math>g_2(x),\ldots,g_n(x)</math>
are ''linearly independent'' in an interval <math>I</math> if the equation

:<math>a_1 g_1(x) + a_2 g_2(x) + \cdots + a_n g_n(x) = 0</math>

can only be satisfied if all the coefficients <math>a_i</math> are vanishing, for all <math>x</math> in the interval <math>I</math>. If the equation can be satisfied without all the coefficients being <math>0</math>, as before, we say that the functions are ''linearly dependent''.

We now define the ''Wronskian'' of the <math>n-1</math> times differentiable functions <math>g_1(x)</math>, <math>g_2(x),\ldots,g_n(x)</math>:

:<math>W(x) = \begin{vmatrix}

g_1(x) & g_2(x) & \cdots & g_n(x)\\

g'_1(x) & g'_2(x) & \cdots & g'_n(x)\\

g''_1(x) & g''_2(x) & \cdots & g''_n(x)\\

\vdots & \vdots & \ddots & \vdots \\

g^{(n-1)}_1(x) & g^{(n-1)}_2(x) & \cdots & g^{(n-1)}_n(x)\\

\end{vmatrix}</math>

This functional determinant is important to study the linear independence of a given set of functions. We will make this more explicit in the next section.

===Theorems for linear differential equations===

====Principle of superposition====

:''If <math>y_1</math> and <math>y_2</math> are two solutions of a linear homogeneous ordinary differential equation, then so is <math>ay_1 + by_2</math>, where <math>a</math> and <math>b</math> are any two real numbers.''

====A theorem for complex solutions====

:''If <math>y(x) = u(x) + i v(x)</math> is the complex solution to a linear homogeneous differential equation with continuous coefficients, then <math>u(x)</math> and <math>v(x)</math> are also solutions to the differential equation.''

====Number of general solutions for linear homogeneous differential equation====

:''The maximum number of linearly independent solutions to a linear homogeneous differential equation is equal to its order.''

====General solutions for a linear differential equation====

====Linear independence and the Wronskian====

We now make use of the Wronskian determinant (defined earlier) to give a sufficient, but not necessary, condition of linear independence of the <math>n-1</math> times differentiable functions <math>g_1(x)</math>, <math>g_2(x),\ldots,g_n(x)</math>.

:''If the Wronskian of the <math>n-1</math> times differentiable functions <math>g_1(x)</math>, <math>g_2(x),\ldots,g_n(x)</math> does not vanish over an open interval <math>I</math>, then the functions are linearly independent. That is'',

:<math> W \neq 0 \Rightarrow \text{linearly independent functions}</math>

It is important to note that this is a sufficient '''but not''' necessary condition. It is not true that if the Wronskian does vanish, then the functions are linearly dependent.

For example, the functions <math>x</math>, <math>x^2</math> and <math>x^3</math> are linearly independent in any closed interval of the reals, as their Wronskian doesn't vanish identically (for all <math>x</math>) in any such closed interval.

However, if we consider the functions <math>|x^3|</math> and <math>x^3</math> on the interval <math>I = (-1, 1)</math>, we can see that <math>W = 0</math> for all <math>x</math> in the interval <math>I</math>. But these functions '''are not''' linearly dependent on the whole interval <math>I</math>.

====The Ostrogradski-Liouville formula====

If we solve for the <math>n</math>-th derivative in a linear differential equation, we have

:<math>y^{(n)} = - p_1(x) y^{(n-1)}(x) - \ldots - p_{n-1}(x) y'(x) - p_n(x)y(x)</math>

The following equality then holds:

:<math>W(x) = W(x_0) e^{\displaystyle-\int_{x_0}^{x}p_1(t) dt}</math>

where <math>x_0</math> is any point belonging to any closed interval <math>[a, b]</math> where the coefficients of the differential equation are continuous.

===Second-order ordinary linear differential equations===

We now turn to arguably the most important topic of this part of the course.

A '''second-order ordinary linear differential equation''' is an equation of the form

:<math>a_2(x)y''(x) + a_1(x)y'(x) + a_0(x)y(x) = f(x)</math>

Why are these equations so important in the physical sciences? There are at least three reasons.

First of all, in many occasions, Newton's second law, when applied to a specific system, yields such an equation. Canonical examples of this include the damped and driven oscillator:

:<math> \frac{d^2x}{dt^2} + 2\zeta\omega_0\frac{dx}{dt} + \omega_0^2 x = \frac{F(t)}{m}, </math>

and a particle under uniform gravitational acceleration,

:<math> \frac{d^2x}{dt^2} = -g.</math>

Secondly, when applying certain methods of solution to linear ''partial'' differential equations, we obtain as intermediate steps these sorts of second-order linear ''ordinary'' differential equations. An example is the aforementioned Laguerre equation. Another example is the Cauchy-Euler equation,

:<math>a_{n} x^n y^{(n)}(x) + a_{n-1} x^{n-1} y^{(n-1)}(x) + \cdots + a_0 y(x) = 0</math>

where all the <math>a_i</math> terms are constants.

Lastly, the importance of linear equations lies in the fact that, most of the time, a ''nonlinear'' equation can be approximated by a linear one in the vicinity of a specific point (called the equilibrium point). For example, the equation that governs the dynamics of a pendulum can be written as

:<math>\frac{d^2\theta}{dt^2}+\frac{g}{\ell} \sin\theta=0</math>

If <math>\theta = 0</math> is taken as the equilibrium point, we expand <math>\sin \theta</math> using its Taylor series

:<math>\sin \theta = \theta - \frac{\theta^3}{3!} + \cdots</math>

and if all terms except the first one are considered negligible (<math>\theta \ll 1</math>), then the equation of the pendulum is now

:<math>\frac{d^2\theta}{dt^2}+\frac{g}{\ell} \theta=0</math>

and the equation is now linear. It should be noted that, thus, the solution obtained from this linear equation will only be valid under the hypothesis the linearization was done in the first place, namely <math>\theta \ll 1</math>.

== See Also ==
* [[Differential Equations]]
* [[Wikipedia: Differential equation]]
* [[Wikibooks: Ordinary Differential Equations/Second Order]]

[[Category:Differential equations]]