1 00:00:07 --> 00:00:12 I've been multiplying matrices already, but certainly time for 2 00:00:12 --> 00:00:17 me to discuss the rules for matrix multiplication. 3 00:00:17 --> 00:00:22 And the interesting part is the many ways you can do it, 4 00:00:22 --> 00:00:25 and they all give the same answer. 5 00:00:25 --> 00:00:28 And they're all important. 6 00:00:28 --> 00:00:32 So matrix multiplication, and then, come inverses. 7 00:00:32 --> 00:00:35 So we mentioned the inverse of a matrix. 8 00:00:35 --> 00:00:37 That's a big deal. 9 00:00:37 --> 00:00:40 Lots to do about inverses and how to find them. 10 00:00:40 --> 00:00:45 Okay, so I'll begin with how to multiply two matrices. 11 00:00:45 --> 00:00:52 First way, okay, so suppose I have a matrix A 12 00:00:52 --> 00:01:01 multiplying a matrix B and -- giving me a result -- well, 13 00:01:01 --> 00:01:03 I could call it C. 14 00:01:03 --> 00:01:05 A times B. 15 00:01:05 --> 00:01:06 Okay. 16 00:01:06 --> 00:01:13 So, let me just review the rule for this entry. 17 00:01:13 --> 00:01:20.51 That's the entry in row i and column j. 18 00:01:20.51 --> 00:01:22 So that's the i j entry. 19 00:01:22 --> 00:01:24.74 Right there is C i j. 20 00:01:24.74 --> 00:01:30 We always write the row number and then the column number. 21 00:01:30 --> 00:01:34 So I might -- I might -- maybe I take it C 3 4, 22 00:01:34 --> 00:01:36 just to make it specific. 23 00:01:36 --> 00:01:40.25 So instead of i j, let me use numbers. 24 00:01:40.25 --> 00:01:41 C 3 4. 25 00:01:41 --> 00:01:47.12 So where does that come from, the three four entry? 26 00:01:47.12 --> 00:01:52 It comes from row three, here, row three and column 27 00:01:52 --> 00:01:54 four, as you know. 28 00:01:54 --> 00:01:55 Column four. 29 00:01:55 --> 00:02:01 And can I just write down, or can we write down the 30 00:02:01 --> 00:02:03 formula for it? 31 00:02:03 --> 00:02:08 If we look at the whole row and the whole column, 32 00:02:08 --> 00:02:14 the quick way for me to say it is row three of A -- I could use 33 00:02:14 --> 00:02:16 a dot for dot product. 34 00:02:16 --> 00:02:19 I won't often use that, actually. 35 00:02:19 --> 00:02:21 Dot column four of B. 36 00:02:21 --> 00:02:27 But this gives us a chance to just, like, use a little matrix 37 00:02:27 --> 00:02:29 notation. 38 00:02:29 --> 00:02:31 What are the entries? 39 00:02:31 --> 00:02:35 What's this first entry in row three? 40 00:02:35 --> 00:02:40 That number that's sitting right there is... 41 00:02:40 --> 00:02:46 A, so it's got two indices and what are they? 42 00:02:46 --> 00:02:46 3 1. 43 00:02:46 --> 00:02:50 So there's an a 3 1 there. 44 00:02:50 --> 00:02:56 Now what's the first guy at the top of column four? 45 00:02:56 --> 00:03:00 So what's sitting up there? 46 00:03:00 --> 00:03:01 B 1 4, right. 47 00:03:01 --> 00:03:10.15 So that this dot product starts with A 3 1 times B 1 4. 48 00:03:10.15 --> 00:03:16 And then what's the next -- so this is like I'm accumulating 49 00:03:16 --> 00:03:21 this sum, then comes the next guy, A 3 2, second column, 50 00:03:21 --> 00:03:24 times B 2 4, second row. 51 00:03:24 --> 00:03:27 So it's b A 3 2, B 2 4 and so on. 52 00:03:27 --> 00:03:30 Just practice with indices. 53 00:03:30 --> 00:03:36 Oh, let me even practice with a summation formula. 54 00:03:36 --> 00:03:42 So this is -- most of the course, I use whole vectors. 55 00:03:42 --> 00:03:46 I very seldom, get down to the details of 56 00:03:46 --> 00:03:52 these particular entries, but here we'd better do it. 57 00:03:52 --> 00:03:56 So it's some kind of a sum, right? 58 00:03:56 --> 00:04:01 Of things in row three, column K shall I say? 59 00:04:01 --> 00:04:05 Times things in row K, column four. 60 00:04:05 --> 00:04:09 Do you see that that's what we're seeing here? 61 00:04:09 --> 00:04:13 This is K is one, here K is two, 62 00:04:13 --> 00:04:19 on along -- so the sum goes all the way along the row and down 63 00:04:19 --> 00:04:23 the column, say, one to N. 64 00:04:23 --> 00:04:28 So that's what the C three four entry looks like. 65 00:04:28 --> 00:04:31 A sum of a three K b K four. 66 00:04:31 --> 00:04:35 Just takes a little practice to do that. 67 00:04:35 --> 00:04:35 Okay. 68 00:04:35 --> 00:04:39 And -- well, maybe I should say -- when are 69 00:04:39 --> 00:04:44 we allowed to multiply these matrices? 70 00:04:44 --> 00:04:47 What are the shapes of these things? 71 00:04:47 --> 00:04:52 The shapes are -- if we allow them to be not necessarily 72 00:04:52 --> 00:04:54 square matrices. 73 00:04:54 --> 00:04:58 If they're square, they've got to be the same 74 00:04:58 --> 00:04:58 size. 75 00:04:58 --> 00:05:04 If they're rectangular, they're not the same size. 76 00:05:04 --> 00:05:07.18 If they're rectangular, this might be -- well, 77 00:05:07.18 --> 00:05:10 I always think of A as m by n. m rows, n columns. 78 00:05:10 --> 00:05:11.85 So that sum goes to n. 79 00:05:11.85 --> 00:05:15 Now what's the point -- how many rows does B have to have? 80 00:05:15 --> 00:05:15 n. 81 00:05:15 --> 00:05:19 The number of rows in B, the number of guys that we meet 82 00:05:19 --> 00:05:23 coming down has to match the number of ones across. 83 00:05:23 --> 00:05:26 So B will have to be n by something. 84 00:05:26 --> 00:05:27 Whatever. 85 00:05:27 --> 00:05:27 P. 86 00:05:27 --> 00:05:33 So the number of columns here has to match the number of rows 87 00:05:33 --> 00:05:36 there, and then what's the result? 88 00:05:36 --> 00:05:39 What's the shape of the result? 89 00:05:39 --> 00:05:42 What's the shape of C, the output? 90 00:05:42 --> 00:05:48 Well, it's got these same m rows -- it's got m rows. 91 00:05:48 --> 00:05:51 And how many columns? 92 00:05:51 --> 00:05:51 P. m by P. 93 00:05:51 --> 00:05:52 Okay. 94 00:05:52 --> 00:05:57 So there are m times P little numbers in there, 95 00:05:57 --> 00:06:01 entries, and each one, looks like that. 96 00:06:01 --> 00:06:01 Okay. 97 00:06:01 --> 00:06:04 So that's the standard rule. 98 00:06:04 --> 00:06:11 That's the way people think of multiplying matrices. 99 00:06:11 --> 00:06:12 I do it too. 100 00:06:12 --> 00:06:20 But I want to talk about other ways to look at that same 101 00:06:20 --> 00:06:28 calculation, looking at whole columns and whole rows. 102 00:06:28 --> 00:06:28 Okay. 103 00:06:28 --> 00:06:32 So can I do A B C again? 104 00:06:32 --> 00:06:36 A B equaling C again? 105 00:06:36 --> 00:06:40 But now, tell me about... 106 00:06:40 --> 00:06:43 I'll put it up here. 107 00:06:43 --> 00:06:50 So here goes A, again, times B producing C. 108 00:06:50 --> 00:06:54 And again, this is m by n. 109 00:06:54 --> 00:06:59 This is n by P and this is m by P. 110 00:06:59 --> 00:07:00 Okay. 111 00:07:00 --> 00:07:07.6 Now I want to look at whole columns. 112 00:07:07.6 --> 00:07:12 I want to look at the columns of -- here's the second way to 113 00:07:12 --> 00:07:14 multiply matrices. 114 00:07:14 --> 00:07:18 Because I'm going to build on what I know already. 115 00:07:18 --> 00:07:22 How do I multiply a matrix by a column? 116 00:07:22 --> 00:07:27 I know how to multiply this matrix by that column. 117 00:07:27 --> 00:07:29 Shall I call that column one? 118 00:07:29 --> 00:07:33 That tells me column one of the answer. 119 00:07:33 --> 00:07:37 The matrix times the first column is that first column. 120 00:07:37 --> 00:07:43 Because none of this stuff entered that part of the answer. 121 00:07:43 --> 00:07:48 The matrix times the second column is the second column of 122 00:07:48 --> 00:07:49 the answer. 123 00:07:49 --> 00:07:52 Do you see what I'm saying? 124 00:07:52 --> 00:07:57 That I could think of multiplying a matrix by a 125 00:07:57 --> 00:08:04 vector, which I already knew how to do, and I can think of just P 126 00:08:04 --> 00:08:10 columns sitting side by side, just like resting next to each 127 00:08:10 --> 00:08:11.94 other. 128 00:08:11.94 --> 00:08:14 And I multiply A times each one of those. 129 00:08:14 --> 00:08:17 And I get the P columns of the answer. 130 00:08:17 --> 00:08:21.72 Do you see this as -- this is quite nice, to be able to think, 131 00:08:21.72 --> 00:08:25.76 okay, matrix multiplication works so that I can just think 132 00:08:25.76 --> 00:08:29 of having several columns, multiplying by A and getting 133 00:08:29 --> 00:08:32 the columns of the answer. 134 00:08:32 --> 00:08:41 So, like, here's column one shall I call that column one? 135 00:08:41 --> 00:08:48 And what's going in there is A times column one. 136 00:08:48 --> 00:08:49 Okay. 137 00:08:49 --> 00:08:57 So that's the picture a column at a time. 138 00:08:57 --> 00:09:00 So what does that tell me? 139 00:09:00 --> 00:09:06 What does that tell me about these columns? 140 00:09:06 --> 00:09:11.35 These columns of C are combinations, 141 00:09:11.35 --> 00:09:17 because we've seen that before, of columns of A. 142 00:09:17 --> 00:09:26 Every one of these comes from A times this, and A times a vector 143 00:09:26 --> 00:09:32 is a combination of the columns of A. 144 00:09:32 --> 00:09:37 And it makes sense, because the columns of A have 145 00:09:37 --> 00:09:41 length m and the columns of C have length m. 146 00:09:41 --> 00:09:47 And every column of C is some combination of the columns of A. 147 00:09:47 --> 00:09:53 And it's these numbers in here that tell me what combination it 148 00:09:53 --> 00:09:54 is. 149 00:09:54 --> 00:09:56 Do you see that? 150 00:09:56 --> 00:10:01 That in that answer, C, I'm seeing stuff that's 151 00:10:01 --> 00:10:04 combinations of these columns. 152 00:10:04 --> 00:10:09 Now, suppose I look at it -- that's two ways now. 153 00:10:09 --> 00:10:13 The third way is look at it by rows. 154 00:10:13 --> 00:10:17 So now let me change to rows. 155 00:10:17 --> 00:10:18 Okay. 156 00:10:18 --> 00:10:28 So now I can think of a row of A -- a row of A multiplying all 157 00:10:28 --> 00:10:35.55 these rows here and producing a row of the product. 158 00:10:35.55 --> 00:10:44 So this row takes a combination of these rows and that's the 159 00:10:44 --> 00:10:45 answer. 160 00:10:45 --> 00:10:51 So these rows of C are combinations of what? 161 00:10:51 --> 00:10:57 Tell me how to finish that. 162 00:10:57 --> 00:11:00 The rows of C, when I have a matrix B, 163 00:11:00 --> 00:11:04 it's got its rows and I multiply by A, 164 00:11:04 --> 00:11:06 and what does that do? 165 00:11:06 --> 00:11:08 It mixes the rows up. 166 00:11:08 --> 00:11:12 It creates combinations of the rows of B, thanks. 167 00:11:12 --> 00:11:13 Rows of B. 168 00:11:13 --> 00:11:18 That's what I wanted to see, that this answer -- 169 00:11:18 --> 00:11:23 I can see where the pieces are coming from. 170 00:11:23 --> 00:11:29 The rows in the answer are coming as combinations of these 171 00:11:29 --> 00:11:29 rows. 172 00:11:29 --> 00:11:36 The columns in the answer are coming as combinations of those 173 00:11:36 --> 00:11:36 columns. 174 00:11:36 --> 00:11:40 And so that's three ways. 175 00:11:40 --> 00:11:46 Now you can say, okay, what's the fourth way? 176 00:11:46 --> 00:11:52 The fourth way -- so that's -- now we've got, 177 00:11:52 --> 00:11:57 like, the regular way, the column way, 178 00:11:57 --> 00:12:01 the row way and -- what's left? 179 00:12:01 --> 00:12:09 The one that I can -- well, one way is columns times rows. 180 00:12:09 --> 00:12:18 What happens if I multiply -- So this was row times column, 181 00:12:18 --> 00:12:20 it gave a number. 182 00:12:20 --> 00:12:20 Okay. 183 00:12:20 --> 00:12:25 Now I want to ask you about column times row. 184 00:12:25 --> 00:12:30 If I multiply a column of A times a row of B, 185 00:12:30 --> 00:12:33 what shape I ending up with? 186 00:12:33 --> 00:12:40 So if I take a column times a row, that's definitely different 187 00:12:40 --> 00:12:45 from taking a row times a column. 188 00:12:45 --> 00:12:53 So a column of A was -- what's the shape of a column of A? 189 00:12:53 --> 00:12:54 n by one. 190 00:12:54 --> 00:12:57 A column of A is a column. 191 00:12:57 --> 00:13:01 It's got m entries and one column. 192 00:13:01 --> 00:13:04 And what's a row of B? 193 00:13:04 --> 00:13:08 It's got one row and P columns. 194 00:13:08 --> 00:13:16 So what's the shape -- what do I get if I multiply a 195 00:13:16 --> 00:13:18 column by a row? 196 00:13:18 --> 00:13:20 I get a big matrix. 197 00:13:20 --> 00:13:23 I get a full-sized matrix. 198 00:13:23 --> 00:13:30 If I multiply a column by a row -- should we just do one? 199 00:13:30 --> 00:13:37 Let me take the column two three four times the row one 200 00:13:37 --> 00:13:38 six. 201 00:13:38 --> 00:13:44 That product there -- I mean, when I'm just following 202 00:13:44 --> 00:13:46 the rules of matrix multiplication, 203 00:13:46 --> 00:13:49 those rules are just looking like -- kind of petite, 204 00:13:49 --> 00:13:52 kind of small, because the rows here are so 205 00:13:52 --> 00:13:56 short and the columns there are so short, but they're the same 206 00:13:56 --> 00:13:57 length, one entry. 207 00:13:57 --> 00:13:59 So what's the answer? 208 00:13:59 --> 00:14:05.35 What's the answer if I do two three four times one six, 209 00:14:05.35 --> 00:14:07 just for practice? 210 00:14:07 --> 00:14:11 Well, what's the first row of the answer? 211 00:14:11 --> 00:14:12 Two twelve. 212 00:14:12 --> 00:14:17 And the second row of the answer is three eighteen. 213 00:14:17 --> 00:14:24 And the third row of the answer is four twenty four. 214 00:14:24 --> 00:14:27 That's a very special matrix, there. 215 00:14:27 --> 00:14:29 Very special matrix. 216 00:14:29 --> 00:14:34 What can you tell me about its columns, the columns of that 217 00:14:34 --> 00:14:35 matrix? 218 00:14:35 --> 00:14:38 They're multiples of this guy, right? 219 00:14:38 --> 00:14:41 They're multiples of that one. 220 00:14:41 --> 00:14:44 Which follows our rule. 221 00:14:44 --> 00:14:49.15 We said that the columns of the answer were combinations, 222 00:14:49.15 --> 00:14:53 but there's only -- to take a combination of one guy, 223 00:14:53 --> 00:14:54 it's just a multiple. 224 00:14:54 --> 00:14:58 The rows of the answer, what can you tell me about 225 00:14:58 --> 00:15:00 those three rows? 226 00:15:00 --> 00:15:03 They're all multiples of this row. 227 00:15:03 --> 00:15:11.05 They're all multiples of one six, as we expected. 228 00:15:11.05 --> 00:15:16 But I'm getting a full-sized matrix. 229 00:15:16 --> 00:15:25 And now, just to complete this thought, if I have -- let me 230 00:15:25 --> 00:15:29.6 write down the fourth way. 231 00:15:29.6 --> 00:15:37 A B is a sum of columns of A times rows of B. 232 00:15:37 --> 00:15:43 So that, for example, if my matrix was two three four 233 00:15:43 --> 00:15:48 and then had another column, say, seven eight nine, 234 00:15:48 --> 00:15:54 and my matrix here has -- say, started with one six and then 235 00:15:54 --> 00:16:00 had another column like zero zero, then -- here's the fourth 236 00:16:00 --> 00:16:01 way, okay? 237 00:16:01 --> 00:16:07 I've got two columns there, I've got two rows there. 238 00:16:07 --> 00:16:14 So the beautiful rule is -- see, the whole thing by columns 239 00:16:14 --> 00:16:21 and rows is that I can take the first column times the first row 240 00:16:21 --> 00:16:27 and add the second column times the second row. 241 00:16:27 --> 00:16:33 So that's the fourth way -- that I can take columns times 242 00:16:33 --> 00:16:40 rows, first column times first row, second column times second 243 00:16:40 --> 00:16:43 row and add. 244 00:16:43 --> 00:16:45 Actually, what will I get? 245 00:16:45 --> 00:16:50 What will the answer be for that matrix multiplication? 246 00:16:50 --> 00:16:54 Well, this one it's just going to give us zero, 247 00:16:54 --> 00:16:59 so in fact I'm back to this -- that's the answer, 248 00:16:59 --> 00:17:02.99 for that matrix multiplication. 249 00:17:02.99 --> 00:17:06.69 I'm happy to put up here these facts about matrix 250 00:17:06.69 --> 00:17:10 multiplication, because it gives me a chance to 251 00:17:10 --> 00:17:13 write down special matrices like this. 252 00:17:13 --> 00:17:15 This is a special matrix. 253 00:17:15 --> 00:17:17 All those rows lie on the same line. 254 00:17:17 --> 00:17:22 All those rows lie on the line through one six. 255 00:17:22 --> 00:17:24 If I draw a picture of all these row vectors, 256 00:17:24 --> 00:17:26 they're all the same direction. 257 00:17:26 --> 00:17:30.05 If I draw a picture of these two column vectors, 258 00:17:30.05 --> 00:17:32 they're in the same direction. 259 00:17:32 --> 00:17:34 Later, I would use this language. 260 00:17:34 --> 00:17:35 Not too much later, either. 261 00:17:35 --> 00:17:38 I would say the row space, which is like all the 262 00:17:38 --> 00:17:43 combinations of the rows, is just a line for this matrix. 263 00:17:43 --> 00:17:48 The row space is the line through the vector one six. 264 00:17:48 --> 00:17:51 All the rows lie on that line. 265 00:17:51 --> 00:17:55 And the column space is also a line. 266 00:17:55 --> 00:18:01.82 All the columns lie on the line through the vector two three 267 00:18:01.82 --> 00:18:02 four. 268 00:18:02 --> 00:18:07 So this is like a really minimal matrix. 269 00:18:07 --> 00:18:11 And it's because of these ones. 270 00:18:11 --> 00:18:11 Okay. 271 00:18:11 --> 00:18:14 So that's a third way. 272 00:18:14 --> 00:18:19 Now I want to say one more thing about matrix 273 00:18:19 --> 00:18:24 multiplication while we're on the subject. 274 00:18:24 --> 00:18:26 And it's this. 275 00:18:26 --> 00:18:33 You could also multiply -- You could also cut the matrix 276 00:18:33 --> 00:18:37 into blocks and do the multiplication by blocks. 277 00:18:37 --> 00:18:42 Yet that's actually so, useful that I want to mention 278 00:18:42 --> 00:18:43 it. 279 00:18:43 --> 00:18:45 Block multiplication. 280 00:18:45 --> 00:18:50.06 So I could take my matrix A and I could chop it up, 281 00:18:50.06 --> 00:18:55 like, maybe just for simplicity, let me chop it into 282 00:18:55 --> 00:18:59 two -- into four square blocks. 283 00:18:59 --> 00:19:01.17 Suppose it's square. 284 00:19:01.17 --> 00:19:03.94 Let's just take a nice case. 285 00:19:03.94 --> 00:19:08 And B, suppose it's square also, same size. 286 00:19:08 --> 00:19:12 So these sizes don't have to be the same. 287 00:19:12 --> 00:19:16 What they have to do is match properly. 288 00:19:16 --> 00:19:20.23 Here they certainly will match. 289 00:19:20.23 --> 00:19:25 So here's the rule for block multiplication, 290 00:19:25 --> 00:19:30 that if this has blocks like, A -- so maybe A1, 291 00:19:30 --> 00:19:36 A2, A3, A4 are the blocks here, and these blocks are B1, 292 00:19:36 --> 00:19:37.98 B2,3 and B4? 293 00:19:37.98 --> 00:19:42 Then the answer I can find block. 294 00:19:42 --> 00:19:46 And if you tell me what's in that block, then I'm going to be 295 00:19:46 --> 00:19:48 quiet about matrix multiplication for the rest of 296 00:19:48 --> 00:19:49 the day. 297 00:19:49 --> 00:19:50 What goes into that block? 298 00:19:50 --> 00:19:53 You see, these might be -- this matrix might be -- these 299 00:19:53 --> 00:19:55 matrices might be, like, twenty by twenty with 300 00:19:55 --> 00:19:59.17 blocks that are ten by ten, to take the easy case where all 301 00:19:59.17 --> 00:20:01 the blocks are the same shape. 302 00:20:01 --> 00:20:08 And the point is that I could multiply those by blocks. 303 00:20:08 --> 00:20:11.47 And what goes in here? 304 00:20:11.47 --> 00:20:15 What's that block in the answer? 305 00:20:15 --> 00:20:23.12 A1 B1, that's a matrix times a matrix, it's the right size, 306 00:20:23.12 --> 00:20:25 ten by ten. 307 00:20:25 --> 00:20:26 Any more? 308 00:20:26 --> 00:20:30 Plus, what else goes in there? 309 00:20:30 --> 00:20:32 A2 B3, right? 310 00:20:32 --> 00:20:37 It's just like block rows times block columns. 311 00:20:37 --> 00:20:42 Nobody, I think, not even Gauss could see 312 00:20:42 --> 00:20:46 instantly that it works. 313 00:20:46 --> 00:20:50.29 But somehow, if we check it through, 314 00:20:50.29 --> 00:20:55 all five ways we're doing the same multiplications. 315 00:20:55 --> 00:21:01 So this familiar multiplication is what we're really doing when 316 00:21:01 --> 00:21:06.33 we do it by columns, by rows by columns times rows 317 00:21:06.33 --> 00:21:08 and by blocks. 318 00:21:08 --> 00:21:09 Okay. 319 00:21:09 --> 00:21:15 I just have to, like, get the rules straight 320 00:21:15 --> 00:21:19 for matrix multiplication. 321 00:21:19 --> 00:21:20.24 Okay. 322 00:21:20.24 --> 00:21:26 All right, I'm ready for the second topic, 323 00:21:26 --> 00:21:28 which is inverses. 324 00:21:28 --> 00:21:29 Okay. 325 00:21:29 --> 00:21:32 Ready for inverses. 326 00:21:32 --> 00:21:40 And let me do it for square matrices first. 327 00:21:40 --> 00:21:40 Okay. 328 00:21:40 --> 00:21:43 So I've got a square matrix A. 329 00:21:43 --> 00:21:47 And it may or may not have an inverse, right? 330 00:21:47 --> 00:21:50.52 Not all matrices have inverses. 331 00:21:50.52 --> 00:21:55 In fact, that's the most important question you can ask 332 00:21:55 --> 00:21:59 about the matrix, is if it's -- if you know it's 333 00:21:59 --> 00:22:03 square, is it invertible or not? 334 00:22:03 --> 00:22:10 If it is invertible, then there is some other 335 00:22:10 --> 00:22:14 matrix, shall I call it A inverse? 336 00:22:14 --> 00:22:23 And what's the -- if A inverse exists -- there's a big "if" 337 00:22:23 --> 00:22:25 here. 338 00:22:25 --> 00:22:31 If this matrix exists, and it'll be really central to 339 00:22:31 --> 00:22:34 figure out when does it exist? 340 00:22:34 --> 00:22:40.3 And then if it does exist, how would you find it? 341 00:22:40.3 --> 00:22:47 But what's the equation here that I haven't -- that I have to 342 00:22:47 --> 00:22:49 finish now? 343 00:22:49 --> 00:23:00 This matrix, if it exists multiplies A and 344 00:23:00 --> 00:23:10 produces, I think, the identity. 345 00:23:10 --> 00:23:17 But a real -- an inverse for a square matrix could be on the 346 00:23:17 --> 00:23:24 right as well -- this is true, too, that it's -- if I have a 347 00:23:24 --> 00:23:30.28 -- yeah in fact, this is not -- this is probably 348 00:23:30.28 --> 00:23:34 the -- this is something that's not 349 00:23:34 --> 00:23:36 easy to prove, but it works. 350 00:23:36 --> 00:23:42 That a left -- square matrices, a left inverse is also a right 351 00:23:42 --> 00:23:42 inverse. 352 00:23:42 --> 00:23:47 If I can find a matrix on the left that gets the identity, 353 00:23:47 --> 00:23:52 then also that matrix on the right will produce that 354 00:23:52 --> 00:23:54 identity. 355 00:23:54 --> 00:23:58 For rectangular matrices, we'll see a left inverse that 356 00:23:58 --> 00:24:00 isn't a right inverse. 357 00:24:00 --> 00:24:03 In fact, the shapes wouldn't allow it. 358 00:24:03 --> 00:24:08 But for square matrices, the shapes allow it and it 359 00:24:08 --> 00:24:10.68 happens, if A has an inverse. 360 00:24:10.68 --> 00:24:15 Okay, so give me some cases -- let's see. 361 00:24:15 --> 00:24:21 I hate to be negative here, but let's talk about the case 362 00:24:21 --> 00:24:23 with no inverse. 363 00:24:23 --> 00:24:30 So -- these matrices are called invertible or non-singular -- 364 00:24:30 --> 00:24:33.27 those are the good ones. 365 00:24:33.27 --> 00:24:39 And we want to be able to identify how -- if we're given a 366 00:24:39 --> 00:24:44 matrix, has it got an inverse? 367 00:24:44 --> 00:24:49 Can I talk about the singular case? 368 00:24:49 --> 00:24:50 No inverse. 369 00:24:50 --> 00:24:51 All right. 370 00:24:51 --> 00:24:56 Best to start with an example. 371 00:24:56 --> 00:25:02 Tell me an example -- let's get an example up here. 372 00:25:02 --> 00:25:10 Let's make it two by two -- of a matrix that has not got an 373 00:25:10 --> 00:25:11 inverse. 374 00:25:11 --> 00:25:14 And let's see why. 375 00:25:14 --> 00:25:18 Let me write one up. 376 00:25:18 --> 00:25:20.69 No inverse. 377 00:25:20.69 --> 00:25:23 Let's see why. 378 00:25:23 --> 00:25:29 Let me write up -- one three two six. 379 00:25:29 --> 00:25:36 Why does that matrix have no inverse? 380 00:25:36 --> 00:25:42 You could answer that various ways. 381 00:25:42 --> 00:25:45 Give me one reason. 382 00:25:45 --> 00:25:54.11 Well, you could -- if you know about determinants, 383 00:25:54.11 --> 00:26:00 which you're not supposed to, you could take its determinant 384 00:26:00 --> 00:26:03 and you would get -- Zero. 385 00:26:03 --> 00:26:03 Okay. 386 00:26:03 --> 00:26:05 Now -- all right. 387 00:26:05 --> 00:26:08 Let me ask you other reasons. 388 00:26:08 --> 00:26:14 I mean, as for other reasons that that matrix isn't 389 00:26:14 --> 00:26:16 invertible. 390 00:26:16 --> 00:26:21 Here, I could use what I'm saying here. 391 00:26:21 --> 00:26:27 Suppose A times other matrix gave the identity. 392 00:26:27 --> 00:26:30 Why is that not possible? 393 00:26:30 --> 00:26:35 Because -- oh, yeah -- I'm thinking about 394 00:26:35 --> 00:26:37 columns here. 395 00:26:37 --> 00:26:43 If I multiply this matrix A by some other matrix, 396 00:26:43 --> 00:26:48 then the -- the result -- what can you tell 397 00:26:48 --> 00:26:50 me about the columns? 398 00:26:50 --> 00:26:54 They're all multiples of those columns, right? 399 00:26:54 --> 00:26:59 If I multiply A by another matrix that -- the product has 400 00:26:59 --> 00:27:02.38 columns that come from those columns. 401 00:27:02.38 --> 00:27:05 So can I get the identity matrix? 402 00:27:05 --> 00:27:06 No way. 403 00:27:06 --> 00:27:10 The columns of the identity matrix, like one zero -- it's 404 00:27:10 --> 00:27:14 not a combination of those columns, because those two 405 00:27:14 --> 00:27:18 columns lie on the -- both lie on the same line. 406 00:27:18 --> 00:27:22 Every combination is just going to be on that line and I can't 407 00:27:22 --> 00:27:24 get one zero. 408 00:27:24 --> 00:27:30 So, do you see that sort of column picture of the matrix not 409 00:27:30 --> 00:27:32 being invertible. 410 00:27:32 --> 00:27:35 In fact, here's another reason. 411 00:27:35 --> 00:27:38 This is even a more important reason. 412 00:27:38 --> 00:27:42 Well, how can I say more important? 413 00:27:42 --> 00:27:44 All those are important. 414 00:27:44 --> 00:27:48 This is another way to see it. 415 00:27:48 --> 00:27:55 A matrix has no inverse -- yeah -- here -- now this is 416 00:27:55 --> 00:27:56 important. 417 00:27:56 --> 00:28:04 A matrix has no -- a square matrix won't have an inverse if 418 00:28:04 --> 00:28:12 there's no inverse because I can solve -- I can find an X of -- a 419 00:28:12 --> 00:28:20 vector X with A times -- this A times X giving zero. 420 00:28:20 --> 00:28:24 This is the reason I like best. 421 00:28:24 --> 00:28:29 That matrix won't have an inverse. 422 00:28:29 --> 00:28:35 Can you -- well, let me change I to U. 423 00:28:35 --> 00:28:42 So tell me a vector X that, solves A X equals zero. 424 00:28:42 --> 00:28:49.88 I mean, this is, like, the key equation. 425 00:28:49.88 --> 00:28:53 In mathematics, all the key equations have zero 426 00:28:53 --> 00:28:55 on the right-hand side. 427 00:28:55 --> 00:28:56 So what's the X? 428 00:28:56 --> 00:29:01 Tell me an X here -- so now I'm going to put -- slip in the X 429 00:29:01 --> 00:29:04 that you tell me and I'm going to get zero. 430 00:29:04 --> 00:29:07 What X would do that job? 431 00:29:07 --> 00:29:09 Three and negative one? 432 00:29:09 --> 00:29:12 Is that the one you picked, or -- yeah. 433 00:29:12 --> 00:29:16 Or another -- well, if you picked zero with zero, 434 00:29:16 --> 00:29:18.2 I'm not so excited, right? 435 00:29:18.2 --> 00:29:20 Because that would always work. 436 00:29:20 --> 00:29:25 So it's really the fact that this vector isn't zero that's 437 00:29:25 --> 00:29:27 important. 438 00:29:27 --> 00:29:32 It's a non-zero vector and three negative one would do it. 439 00:29:32 --> 00:29:37 That just says three of this column minus one of that column 440 00:29:37 --> 00:29:39 is the zero column. 441 00:29:39 --> 00:29:39 Okay. 442 00:29:39 --> 00:29:43 So now I know that A couldn't be invertible. 443 00:29:43 --> 00:29:45 But what's the reasoning? 444 00:29:45 --> 00:29:49 If A X is zero, suppose I multiplied by A 445 00:29:49 --> 00:29:50 inverse. 446 00:29:50 --> 00:29:53 Yeah, well here's the reason. 447 00:29:53 --> 00:29:59 Here -- this is why this spells disaster for an inverse. 448 00:29:59 --> 00:30:04 The matrix can't have an inverse if some combination of 449 00:30:04 --> 00:30:09 the columns gives z- it gives nothing. 450 00:30:09 --> 00:30:12 Because, I could take A X equals zero, I could multiply by 451 00:30:12 --> 00:30:14 A inverse and what would I discover? 452 00:30:14 --> 00:30:18 Suppose I take that equation and I multiply by -- if A 453 00:30:18 --> 00:30:20 inverse existed, which of course I'm going to 454 00:30:20 --> 00:30:24 come to the conclusion it can't because if it existed, 455 00:30:24 --> 00:30:27 if there was an A inverse to this dopey matrix, 456 00:30:27 --> 00:30:30 I would multiply that equation by that inverse and I would 457 00:30:30 --> 00:30:32 discover X is zero. 458 00:30:32 --> 00:30:38 If I multiply A by A inverse on the left, I get X. 459 00:30:38 --> 00:30:45 If I multiply by A inverse on the right, I get zero. 460 00:30:45 --> 00:30:49 So I would discover X was zero. 461 00:30:49 --> 00:30:52 But it -- X is not zero. 462 00:30:52 --> 00:30:54 X -- this guy wasn't zero. 463 00:30:54 --> 00:30:55 There it is. 464 00:30:55 --> 00:30:57 It's three minus one. 465 00:30:57 --> 00:31:01 So, conclusion -- only, it takes us some time to really 466 00:31:01 --> 00:31:05 work with that conclusion -- our conclusion will be that 467 00:31:05 --> 00:31:08 non-invertible matrices, singular matrices, 468 00:31:08 --> 00:31:13 some combinations of their columns gives the zero column. 469 00:31:13 --> 00:31:17 They they take some vector X into zero. 470 00:31:17 --> 00:31:23 And there's no way A inverse can recover, right? 471 00:31:23 --> 00:31:26 That's what this equation says. 472 00:31:26 --> 00:31:33 This equation says I take this vector X and multiplying by A 473 00:31:33 --> 00:31:35 gives zero. 474 00:31:35 --> 00:31:41 But then when I multiply by A inverse, I can never escape from 475 00:31:41 --> 00:31:42 zero. 476 00:31:42 --> 00:31:45 So there couldn't be an A inverse. 477 00:31:45 --> 00:31:49 Where here -- okay, now fix -- all right. 478 00:31:49 --> 00:31:56 Now let me take -- all right, back to the positive side. 479 00:31:56 --> 00:32:00.35 Let's take a matrix that does have an inverse. 480 00:32:00.35 --> 00:32:02 And why not invert it? 481 00:32:02 --> 00:32:02 Okay. 482 00:32:02 --> 00:32:08 Can I -- so let me take on this third board a matrix -- shall I 483 00:32:08 --> 00:32:10 fix that up a little? 484 00:32:10 --> 00:32:14 Tell me a matrix that has got an inverse. 485 00:32:14 --> 00:32:20 Well, let me say one three two -- what shall I put there? 486 00:32:20 --> 00:32:27 Well, don't put six, I guess is -- right? 487 00:32:27 --> 00:32:31 Do I any favorites here? 488 00:32:31 --> 00:32:31 One? 489 00:32:31 --> 00:32:33 Or eight? 490 00:32:33 --> 00:32:35 I don't care. 491 00:32:35 --> 00:32:37 What, seven? 492 00:32:37 --> 00:32:38.61 Seven. 493 00:32:38.61 --> 00:32:39 Okay. 494 00:32:39 --> 00:32:45 Seven is a lucky number. 495 00:32:45 --> 00:32:46 All right, seven, okay. 496 00:32:46 --> 00:32:47 Okay. 497 00:32:47 --> 00:32:48.84 So -- now what's our idea? 498 00:32:48.84 --> 00:32:51 We believe that this matrix is invertible. 499 00:32:51 --> 00:32:55 Those who like determinants have quickly taken its 500 00:32:55 --> 00:32:57 determinant and found it wasn't zero. 501 00:32:57 --> 00:33:01 Those who like columns, and probably that -- 502 00:33:01 --> 00:33:06 that department is not totally popular yet -- but those who 503 00:33:06 --> 00:33:11 like columns will look at those two columns and say, 504 00:33:11 --> 00:33:14 hey, they point in different directions. 505 00:33:14 --> 00:33:16 So I can get anything. 506 00:33:16 --> 00:33:20 Now, let me see, what do I mean? 507 00:33:20 --> 00:33:24 How I going to computer A inverse? 508 00:33:24 --> 00:33:28 So A inverse -- here's A inverse, now, 509 00:33:28 --> 00:33:30 and I have to find it. 510 00:33:30 --> 00:33:35 And what do I get when I do this multiplication? 511 00:33:35 --> 00:33:37.4 The identity. 512 00:33:37.4 --> 00:33:42.31 You know, forgive me for taking two by two-s, 513 00:33:42.31 --> 00:33:46 but -- lt's good to keep the 514 00:33:46 --> 00:33:52 computations manageable and let the ideas come out. 515 00:33:52 --> 00:33:55 Okay, now what's the idea I want? 516 00:33:55 --> 00:34:02 I'm looking for this matrix A inverse, how I going to find it? 517 00:34:02 --> 00:34:07 Right now, I've got four numbers to find. 518 00:34:07 --> 00:34:12 I'm going to look at the first column. 519 00:34:12 --> 00:34:15 Let me take this first column, A B. 520 00:34:15 --> 00:34:17 What's up there? 521 00:34:17 --> 00:34:19 What -- tell me this. 522 00:34:19 --> 00:34:24 What equation does the first column satisfy? 523 00:34:24 --> 00:34:32 The first column satisfies A times that column is one zero. 524 00:34:32 --> 00:34:34 The first column of the answer. 525 00:34:34 --> 00:34:38.97 And the second column, C D, satisfies A times that 526 00:34:38.97 --> 00:34:41.15 second column is zero one. 527 00:34:41.15 --> 00:34:45 You see that finding the inverse is like solving two 528 00:34:45 --> 00:34:46 systems. 529 00:34:46 --> 00:34:51 One system, when the right-hand side is one zero -- I'm just 530 00:34:51 --> 00:34:54 going to split it into two pieces. 531 00:34:54 --> 00:34:59 I don't even need to rewrite it. 532 00:34:59 --> 00:35:07 I can take A times -- so let me put it here. 533 00:35:07 --> 00:35:16 A times column j of A inverse is column j of the identity. 534 00:35:16 --> 00:35:20.2 I've got n equations. 535 00:35:20.2 --> 00:35:27.07 I've got, well, two in this case. 536 00:35:27.07 --> 00:35:30 And they have the same matrix, A, but they have different 537 00:35:30 --> 00:35:32 right-hand sides. 538 00:35:32 --> 00:35:36 The right-hand sides are just the columns of the identity, 539 00:35:36 --> 00:35:37 this guy and this guy. 540 00:35:37 --> 00:35:39 And these are the two solutions. 541 00:35:39 --> 00:35:43 Do you see what I'm going -- I'm looking at that equation by 542 00:35:43 --> 00:35:45 columns. 543 00:35:45 --> 00:35:48 I'm looking at A times this column, giving that guy, 544 00:35:48 --> 00:35:50 and A times that column giving that guy. 545 00:35:50 --> 00:35:54 So -- Essentially -- so this is like the Gauss -- we're back to 546 00:35:54 --> 00:35:55 Gauss. 547 00:35:55 --> 00:35:58 We're back to solving systems of equations, 548 00:35:58 --> 00:36:02 but we're solving -- we've got two right-hand sides instead of 549 00:36:02 --> 00:36:03 one. 550 00:36:03 --> 00:36:08 That's where Jordan comes in. 551 00:36:08 --> 00:36:17 So at the very beginning of the lecture, I mentioned 552 00:36:17 --> 00:36:24 Gauss-Jordan, let me write it up again. 553 00:36:24 --> 00:36:25 Okay. 554 00:36:25 --> 00:36:30 Here's the Gauss-Jordan idea. 555 00:36:30 --> 00:36:39 Gauss-Jordan solve two equations at once. 556 00:36:39 --> 00:36:39 Okay. 557 00:36:39 --> 00:36:44 Let me show you how the mechanics go. 558 00:36:44 --> 00:36:48 How do I solve a single equation? 559 00:36:48 --> 00:36:54 So the two equations are one three two seven, 560 00:36:54 --> 00:36:58.98 multiplying A B gives one zero. 561 00:36:58.98 --> 00:37:06 And the other equation is the same one three two seven 562 00:37:06 --> 00:37:11 multiplying C D gives zero one. 563 00:37:11 --> 00:37:12.21 Okay. 564 00:37:12.21 --> 00:37:16.66 That'll tell me the two columns of the inverse. 565 00:37:16.66 --> 00:37:18 I'll have inverse. 566 00:37:18 --> 00:37:22.85 In other words, if I can solve with this matrix 567 00:37:22.85 --> 00:37:27 A, if I can solve with that right-hand side and that 568 00:37:27 --> 00:37:30 right-hand side, I'm invertible. 569 00:37:30 --> 00:37:31 I've got it. 570 00:37:31 --> 00:37:33 Okay. 571 00:37:33 --> 00:37:38 And Jordan sort of said to Gauss, solve them together, 572 00:37:38 --> 00:37:43 look at the matrix -- if we just solve this one, 573 00:37:43 --> 00:37:49 I would look at one three two seven, and how do I deal with 574 00:37:49 --> 00:37:51 the right-hand side? 575 00:37:51 --> 00:37:54 I stick it on as an extra column, right? 576 00:37:54 --> 00:37:58 That's this augmented matrix. 577 00:37:58 --> 00:38:03 That's the matrix when I'm watching the right-hand side at 578 00:38:03 --> 00:38:06 the same time, doing the same thing to the 579 00:38:06 --> 00:38:09 right side that I do to the left? 580 00:38:09 --> 00:38:12 So I just carry it along as an extra column. 581 00:38:12 --> 00:38:16.71 Now I'm going to carry along two extra columns. 582 00:38:16.71 --> 00:38:21 And I'm going to do whatever Gauss wants, right? 583 00:38:21 --> 00:38:23 I'm going to do elimination. 584 00:38:23 --> 00:38:28 I'm going to get this to be simple and this thing will turn 585 00:38:28 --> 00:38:30 into the inverse. 586 00:38:30 --> 00:38:32 This is what's coming. 587 00:38:32 --> 00:38:36.66 I'm going to do elimination steps to make this into the 588 00:38:36.66 --> 00:38:41 identity, and lo and behold, the inverse will show up here. 589 00:38:41 --> 00:38:43 K--- let's do it. 590 00:38:43 --> 00:38:44 Okay. 591 00:38:44 --> 00:38:46 So what are the elimination steps? 592 00:38:46 --> 00:38:50 So you see -- here's my matrix A and here's the identity, 593 00:38:50 --> 00:38:52 like, stuck on, augmented on. 594 00:38:52 --> 00:38:53 STUDENT: I'm sorry... 595 00:38:53 --> 00:38:54 STRANG: Yeah? 596 00:38:54 --> 00:38:59 STUDENT: -- is the two and the three supposed to be switched? 597 00:38:59 --> 00:39:03 STRANG: Did I -- oh, no, they weren't supposed to be 598 00:39:03 --> 00:39:04 switched. 599 00:39:04 --> 00:39:05 Sorry. 600 00:39:05 --> 00:39:05 Thanks. 601 00:39:05 --> 00:39:06 Okay. 602 00:39:06 --> 00:39:08 Thank you very much. 603 00:39:08 --> 00:39:11 And there -- I've got them right. 604 00:39:11 --> 00:39:12 Okay, thanks. 605 00:39:12 --> 00:39:12 Okay. 606 00:39:12 --> 00:39:15 So let's do elimination. 607 00:39:15 --> 00:39:20 All right, it's going to be simple, right? 608 00:39:20 --> 00:39:23 So I take two of this row away from this row. 609 00:39:23 --> 00:39:27 So this row stays the same and two of those come away from 610 00:39:27 --> 00:39:28 this. 611 00:39:28 --> 00:39:33 That leaves me with a zero and a one and two of these away from 612 00:39:33 --> 00:39:38 this is that what you're getting -- after one elimination step -- 613 00:39:38 --> 00:39:43 Let me sort of separate the -- the left half from the right 614 00:39:43 --> 00:39:44 half. 615 00:39:44 --> 00:39:49 So two of that first row got subtracted from the second row. 616 00:39:49 --> 00:39:52.69 Now this is an upper triangular form. 617 00:39:52.69 --> 00:39:56 Gauss would quit, but Jordan says keeps going. 618 00:39:56 --> 00:39:59 Use elimination upwards. 619 00:39:59 --> 00:40:04 Subtract a multiple of equation two from equation one to get rid 620 00:40:04 --> 00:40:05.24 of the three. 621 00:40:05.24 --> 00:40:07 So let's go the whole way. 622 00:40:07 --> 00:40:11 So now I'm going to -- this guy is fine, but I'm going to -- 623 00:40:11 --> 00:40:12 what do I do now? 624 00:40:12 --> 00:40:16 What's my final step that produces the inverse? 625 00:40:16 --> 00:40:20 I multiply this by the right number to get up to ther to 626 00:40:20 --> 00:40:22 remove that three. 627 00:40:22 --> 00:40:26 So I guess, I -- since this is a one, there's the pivot sitting 628 00:40:26 --> 00:40:27 there. 629 00:40:27 --> 00:40:30 I multiply it by three and subtract from that, 630 00:40:30 --> 00:40:31.46 so what do I get? 631 00:40:31.46 --> 00:40:35 I'll have one zero -- oh, yeah that was my whole point. 632 00:40:35 --> 00:40:38 I'll multiply this by three and subtract from that, 633 00:40:38 --> 00:40:41 which will give me seven. 634 00:40:41 --> 00:40:50 And I multiply this by three and subtract from that, 635 00:40:50 --> 00:40:56 which gives me a minus three. 636 00:40:56 --> 00:41:00 And what's my hope, belief? 637 00:41:00 --> 00:41:11 Here I started with A and the identity, and I ended up with 638 00:41:11 --> 00:41:16 the identity and who? 639 00:41:16 --> 00:41:19 That better be A inverse. 640 00:41:19 --> 00:41:22 That's the Gauss Jordan idea. 641 00:41:22 --> 00:41:28 Start with this long matrix, double-length A I, 642 00:41:28 --> 00:41:33 eliminate, eliminate until this part is down to I, 643 00:41:33 --> 00:41:38 then this one will -- must be for some reason, 644 00:41:38 --> 00:41:44 and we've got to find the reason -- must be A inverse. 645 00:41:44 --> 00:41:49 Shall I just check that it works? 646 00:41:49 --> 00:41:54 Let me just check that -- can I multiply this matrix this part 647 00:41:54 --> 00:41:58 times A, I'll carry A over here and just do that multiplication. 648 00:41:58 --> 00:42:01 You'll see I'll do it the old fashioned way. 649 00:42:01 --> 00:42:03 Seven minus six is a one. 650 00:42:03 --> 00:42:07 Twenty one minus twenty one is a zero, minus two plus two is a 651 00:42:07 --> 00:42:11 zero, minus six plus seven is a one. 652 00:42:11 --> 00:42:11 Check. 653 00:42:11 --> 00:42:14 So that is the inverse. 654 00:42:14 --> 00:42:17 That's the Gauss-Jordan idea. 655 00:42:17 --> 00:42:22 So, you'll -- one of the homework problems or more than 656 00:42:22 --> 00:42:28 one for Wednesday will ask you to go through those steps. 657 00:42:28 --> 00:42:34 I think you just got to go through Gauss-Jordan a couple of 658 00:42:34 --> 00:42:40 times, but I -- yeah -- just to see the 659 00:42:40 --> 00:42:41 mechanics. 660 00:42:41 --> 00:42:47.45 But the, important thing is, why -- is, like, 661 00:42:47.45 --> 00:42:49 what happened? 662 00:42:49 --> 00:42:55 Why did we -- why did we get A inverse there? 663 00:42:55 --> 00:42:57.66 Let me ask you that. 664 00:42:57.66 --> 00:43:04 We got -- so we take -- We do row reduction, 665 00:43:04 --> 00:43:11.19 we do elimination on this long matrix A I until the first half 666 00:43:11.19 --> 00:43:11 is up. 667 00:43:11 --> 00:43:15 Then a second half is A inverse. 668 00:43:15 --> 00:43:18 Well, how do I see that? 669 00:43:18 --> 00:43:22 Let me put up here how I see that. 670 00:43:22 --> 00:43:28.26 So here's my Gauss-Jordan thing, and I'm doing stuff to 671 00:43:28.26 --> 00:43:29 it. 672 00:43:29 --> 00:43:32 So I'm -- well, whole lot of E's. 673 00:43:32 --> 00:43:36 Remember those are those elimination matrices. 674 00:43:36 --> 00:43:41 Those are the -- those are the things that we figured out last 675 00:43:41 --> 00:43:42 time. 676 00:43:42 --> 00:43:47 Yes, that's what an elimination step is it's in matrix form, 677 00:43:47 --> 00:43:50 I'm multiplying by some Es. 678 00:43:50 --> 00:43:54 And the result -- well, so I'm multiplying by a whole 679 00:43:54 --> 00:43:55 bunch of Es. 680 00:43:55 --> 00:43:59 So, I get a -- can I call the overall matrix E? 681 00:43:59 --> 00:44:05 That's the elimination matrix, the product of all those little 682 00:44:05 --> 00:44:05 pieces. 683 00:44:05 --> 00:44:09 What do I mean by little pieces? 684 00:44:09 --> 00:44:14 Well, there was an elimination matrix that subtracted two of 685 00:44:14 --> 00:44:15 that away from that. 686 00:44:15 --> 00:44:20.74 Then there was an elimination matrix that subtracted three of 687 00:44:20.74 --> 00:44:22 that away from that. 688 00:44:22 --> 00:44:25 I guess in this case, that was all. 689 00:44:25 --> 00:44:30 So there were just two Es in this case, one that did this 690 00:44:30 --> 00:44:36 step and one that did this step and together they gave me an E 691 00:44:36 --> 00:44:38 that does both steps. 692 00:44:38 --> 00:44:41 And the net result was to get an I here. 693 00:44:41 --> 00:44:45 And you can tell me what that has to be. 694 00:44:45 --> 00:44:50 This is, like, the picture of what happened. 695 00:44:50 --> 00:44:57 If E multiplied A, whatever that E is -- we never 696 00:44:57 --> 00:45:01 figured it out in this way. 697 00:45:01 --> 00:45:10 But whatever that E times that E is, E times A is -- What's E 698 00:45:10 --> 00:45:11 times A? 699 00:45:11 --> 00:45:14 It's I. 700 00:45:14 --> 00:45:20.25 That E, whatever the heck it was, multiplied A and produced 701 00:45:20.25 --> 00:45:20 I. 702 00:45:20 --> 00:45:25 So E must be -- E A equaling I tells us what E is, 703 00:45:25 --> 00:45:30.67 namely it is -- STUDENT: It's the inverse of A. 704 00:45:30.67 --> 00:45:33 STRANG: It's the inverse of A. 705 00:45:33 --> 00:45:34 Great. 706 00:45:34 --> 00:45:38 And therefore, when the second half, 707 00:45:38 --> 00:45:42 when E multiplies I, it's E -- 708 00:45:42 --> 00:45:44.09 Put this A inverse. 709 00:45:44.09 --> 00:45:46 You see the picture looking that way? 710 00:45:46 --> 00:45:48 E times A is the identity. 711 00:45:48 --> 00:45:50.22 It tells us what E has to be. 712 00:45:50.22 --> 00:45:52 It has to be the inverse, and therefore, 713 00:45:52 --> 00:45:56 on the right-hand side, where E -- where we just 714 00:45:56 --> 00:45:59 smartly tucked on the identity, it's turning in, 715 00:45:59 --> 00:46:04 step by step -- It's turning into A inverse. 716 00:46:04 --> 00:46:09 There is the statement of Gauss-Jordan elimination. 717 00:46:09 --> 00:46:13 That's how you find the inverse. 718 00:46:13 --> 00:46:19 Where we can look at it as elimination, as solving n 719 00:46:19 --> 00:46:26 equations at the same time -- -- and tacking on n columns, 720 00:46:26 --> 00:46:33 solving those equations and up goes the n columns of A inverse 721 00:46:33 --> . 722 . --> 00:46:33.73 723 00:46:33.73 --> 00:46:35 Okay, thanks. 724 00:46:35 --> 00:46:38 See you on Wednesday.