b b b
SOLUTIONS
,Table of Contents b b
Acknowledgments ............................................................................................................................. iii
Table of Contents ................................................................................................................................iv
b b
CHAPTER 1. INTRODUCTION ........................................................................................................ 1
b b
1.2 Analytical Versus Numerical Analysis ....................................................................................... 1
b b b
1.4 Applications ............................................................................................................................... 1
Computer Programs.......................................................................................................................... 6
b
CHAPTER 2. MATRICES .................................................................................................................. 9
b b
2.1 Introduction ................................................................................................................................ 9
2.2 Matrix Operations..................................................................................................................... 11
b
2.3 Vectors ..................................................................................................................................... 14
2.4 Determinants. ........................................................................................................................... 17
2.5 Rank of a Matrix ....................................................................................................................... 18
b b b
2.6 Applications ............................................................................................................................. 19
CHAPTER 3. INTRODUCTION TO NUMERICAL METHODS. .................................................... 20
b b b b b
3.1 Introduction .............................................................................................................................. 20
3.2 Accuracy, Precision, and Bias ................................................................................................... 20
b b b
3.3 Significant Figures ................................................................................................................... 22
b
3.4 Analysis of Numerical Errors .................................................................................................... 23
b b b
CHAPTER 4. ROOTS OF EQUATIONS ........................................................................................... 27
b b b b
4.1 Introduction .............................................................................................................................. 27
4.2 Eigenvalue Analysis ................................................................................................................. 30
b
4.3 Direct-Search Method .............................................................................................................. 30
b
4.4 Bisection Method. .................................................................................................................... 32
b
4.5 Newton-Raphson Iteration. ...................................................................................................... 35
b
4.6 Secant Method .......................................................................................................................... 50
b
4.8 Synthetic Division .................................................................................................................... 55
b
4.9 Multiple Roots.......................................................................................................................... 70
b
4.10 Systems of Nonlinear Equations ............................................................................................. 70
b b b
CHAPTER 5. SIMULTANEOUS LINEAR EQUATIONS. .............................................................. 72
b b b b
5.2 Gaussian Elimination. .............................................................................................................. 72
b
5.3 Gauss-Jordan Elimination ........................................................................................................ 74
b
5.5 LU Decomposition ................................................................................................................... 76
b
5.6 Iterative Equation-Solving Methods. ........................................................................................ 81
b b
5.6.1 Jacobi Iteration ................................................................................................................................................ 81
b
5.6.2 Gaussian-Seidel Iteration................................................................................................................................. 85
b
5.6.3 Convergence Consideration of the Iterative Methods ....................................................................................... 90
b b b b b
5.7 Use of Determinants ................................................................................................................. 94
b b
5.8 Matrix Inversion ....................................................................................................................... 99
b
5.9 Applications ........................................................................................................................... 101
Computer Programs...................................................................................................................... 103
b
CHAPTER 6. NUMERICAL INTERPOLATION ........................................................................... 105
b b b
6.2 Method of Undetermined Coefficients .................................................................................... 105
b b b
6.3 Gregory-Newton Interpolation Method................................................................................... 109
b b
6.4 Finite Difference Interpolation ............................................................................................... 112
b b
6.5 Newton’s Method ................................................................................................................... 114
b
6.6 Lagrange Polynomials ............................................................................................................ 119
b
6.7 Interpolation Using Splines .................................................................................................... 124
b b
6.9 Multi-Dimensional Interpolation ............................................................................................ 133
b b
CHAPTER 7. DIFFERENTIATION AND IN b b @@T
SeSE
ie G
simiciR
sm
iisoA
cisloaltT
aiotinI
oOn N ........................................................... 135 b b
b
iv
, 7.1 Numerical Differentiation ...................................................................................................... 135
b
7.2. Numerical Integration............................................................................................................ 142
b
CHAPTER 8. Differential Equations ............................................................................................... 150
b b b
8.1 Introduction ............................................................................................................................ 150
8.2 Taylor Series Expansion ......................................................................................................... 150
b b
8.3 Euler’s Method ....................................................................................................................... 154
b
8.4 Modified Euler’s Method ........................................................................................................ 157
b b
8.5 Runge-Kuta Methods ............................................................................................................. 159
b
8.6 Predictor-Corrector Methods.................................................................................................. 164
b
8.7 Least-Squares Method ............................................................................................................ 167
b
8.8 Garlekin Method .................................................................................................................... 170
b
8.9 Higher-Order Differential Equations ...................................................................................... 172
b b
8.10 Boundary Value Problems .................................................................................................... 172
b b
8.11 Integral Equations ................................................................................................................ 176
b
CHAPTER 9. Data Description and Treatment ................................................................................. 177
b b b b b
9.2 Classification of Data ............................................................................................................. 177
b b
9.3 Graphical Description of Data................................................................................................. 177
b b b
9.5 Histograms and Frequency Diagrams ..................................................................................... 185
b b b
9.6 Descriptive Measures ............................................................................................................. 187
b
CHAPTER 10. Curve Fitting and Regression Analysis .................................................................... 190
b b b b b b
10.1 Introduction .......................................................................................................................... 190
10.2 Correlation Analysis ............................................................................................................. 190
b
10.3 Introduction to Regression .................................................................................................... 200
b b
10.4 Principle of Least Squares ..................................................................................................... 201
b b b
10.5 Reliability of the Regression Equation .................................................................................. 204
b b b b
10.8 Correlation Versus Regression.............................................................................................. 207
b b
10.9 Application of Bivariate Regression Analysis ....................................................................... 209
b b b b
10.8 Multiple Regression Analysis ............................................................................................... 213
b b
10.9 Regression Analysis of Nonlinear Models ............................................................................ 220
b b b b
CHAPTER 11. Numerical Optimization .......................................................................................... 238
b b b
11.1 Introduction .......................................................................................................................... 238
11.2 The Response Surface Analysis ............................................................................................ 238
b b b
11.3 Numerical Least Squares ...................................................................................................... 239
b b
11.4 Steepest Descent Method ...................................................................................................... 247
b b
@@
SeSiesim
smiciii csiosloaltaiotinon
v
, CHAPTER 1. INTRODUCTION b b
1.2 Analytical Versus Numerical Analysis b b b
Problem 1-1. b
Solution not provided.b b
Problem 1-2. b
The two methods differ on the basis of their respective algorithms. The analytical method is based on
b b b b b b b b b b b b b b b b
analytical calculus while the numerical method is based on finite differences arithmetic.
b b b b b b b b b b b b
Analytical approaches provide direct solutions and will result in exact solutions if they exist.
b b b b b b b b b b b b b
Analytical methods usually require less time to find a solution. Analytical solution procedure
b b b b b b b b b b b b b
becomes considerably more complex when constraints are involved. Numerical analysis, on the other
b b b b b b b b b b b b b
hand, can be used to find solutions of moderately complex problems, and it is quite easy to include
b b b b b b b b b b b b b b b b b b
constraints on the unknowns in the solutions. However, numerical methods most often require a
b b b b b b b b b b b b b b
considerable number of iterations in order to find a solution with a reasonable accuracy. The solution
b b b b b b b b b b b b b b b b
provided by the numerical methods is usually not exact. Therefore, error analysis and error estimations
b b b b b b b b b b b b b b b
are required.
b b
1.4 Applications
Problem 1-3. b
2 4
cos(x) = 1− x + x −.......
b b b b
b b
2! 4!
For h = 0.1 b b b
x = x0 + h = 0 + 0.1 = 0.1
b b b b b b b b b b
cos(0.1) 1.00000000 (one term)
b b b
(0.1)2 b
cos(0.1) 1 − = 0.99500000 (two terms)
b b b b b
22 4
b
(0.1) (0.1)
cos(0.1) 1− + = 0.99500417
b b
(three terms)
b b b b
2 24
True value = 0.99500417 b b b
The following table summarizes the results for h = 0.1 to 1.0 in an increment of 0.1:
b b b b b b b b b b b b b b b b
@@
SeSiesimiciiicsiosloaltaiotinon
sm
1