Derivatives: Understanding Change

Your model made a prediction. The prediction was wrong. Not just wrong. You have a number that tells you exactly how wrong. That number is the loss. High loss means bad prediction. Zero loss means perfect. Now what? You need to adjust the model's weights to reduce the loss. But there are millions of weights. You cannot try every possible combination. You need a smarter approach. The smarter approach is this: figure out how the loss changes when you nudge each weight slightly. If nudging a weight