Gradient descent
Update parameters opposite a local loss gradient; step size affects the result.
Explore a foundation, then return to your lesson. The full AI lesson map below connects all 16 modules. Open a topic’s title to learn it, or choose “Explore connections” to follow its links through the map. Every lesson is open to you.
Use a connection to review, then return. These links never lock lessons or award mastery.
Update parameters opposite a local loss gradient; step size affects the result.
Gradient descent uses as a foundation Slope.
To explain the direction of this scalar gradient update, interpret the local slope of loss with respect to weight. A negative slope suggests increasing the weight for a sufficiently small step.
Explaining the scalar loss update in the pilot, not a course enrollment requirement or a claim that any finite step improves loss.
Source-audited 2026-10-31. Independent subject-expert and learner review remain pending.
Gradient descent can review Learning rate.
The gradient supplies direction and scale; the learning rate multiplies it. Comparing proposed steps with actual losses explains overshoot.
One bounded scalar update and its actual loss; not a convergence guarantee.
Source-audited 2026-10-31. Independent subject-expert and learner review remain pending.
Gradient descent applies to Neural networks.
Once gradients are calculated, an optimizer can update network parameters. Backpropagation computes sensitivities; it is not itself the update.
The simultaneous two-weight update in the backpropagation lesson.
Source-audited 2026-10-31. Independent subject-expert and learner review remain pending.
11 concepts in this cross-subject pilot, not a complete curriculum graph. The existing AI lesson map and progress records remain separate and available below or through AI discovery.
Suggestions use your last lesson and connections to topics with recorded completion or a passed check. These are suggestions, not prerequisites or a readiness assessment. All topics remain freely accessible.
Loading your suggestions…
168 of 168 topics match. Filters affect the topic directory; connections always include other modules.
Solid arrows show foundations → selected topic → lessons that build on it. Dashed arrows show suggested applications. Labels and line patterns distinguish the connections in every palette.
On smaller screens, scroll the map horizontally, or use the text view below. Tab moves between topic links.
Use these connections to review a foundation or choose where to go next. You can open any topic without completing the others.
Substitute input values into a formula and keep track of which quantities change. This makes the lesson’s worked calculations easier to follow.
Turn inputs, a weight, and a bias into a prediction.
See why adding a hidden layer can solve patterns a straight boundary cannot, before paying for a larger model.
Explore how action limits and smooth control affect a physical system’s response.