Learn

Learning preferences

Make learning more comfortable. Changes apply immediately.

Enlarges page content, including diagrams and their labels. You can also use your browser’s zoom.

Choose the colours that are easiest for you to distinguish. Applies to lesson diagrams and lab plots. Labels, shapes, hatching and line patterns also distinguish meanings. Source photographs and raw image brightness stay unchanged; mask-only views are available for image overlays.

ExampleComparisonSample link

Saved in this browser on this device. Preferences are separate from progress backups.

Lesson 18 of 21 in this unit

Build AI Systems · ORIGINAL LEARN AI LESSON

Remember what the current view hides.

Train recurrent state and compare information available during an occlusion.

By the end: Compare a trained recurrent point predictor, current-frame and recent-history baselines, and explicitly conditional hidden-state uncertainty.

Start with the exampleJump to the experimentRead the explanation
Prerequisites and path options

Why learn this? Recognize when memory helps an occluded prediction and when missing information makes a single confident answer unjustified.

01 · TRY

Start with something concrete.

A moving dot disappears behind a screen. Two earlier positions suggest its direction. What if it reverses while hidden?

Try the interactive model
02 · PREDICT
Before you experiment

Two trajectories have identical visible history but different hidden turns. Can a deterministic predictor know which occurred?

Two trajectories have identical visible history but different hidden turns. Can a deterministic predictor know which occurred?
03 · EXPERIMENT

Change one thing. Watch what follows.

Loading this browser experiment…

04 · UNDERSTAND
READ & CONNECT

Understand what changed.

Back to the experiment

A shorter explanation, with the original worked examples available below. Both explain the same experiment and its limits.

Same learning goal in both modes: Compare a trained recurrent point predictor, current-frame and recent-history baselines, and explicitly conditional hidden-state uncertainty.

Remember the last useful observation

A blank view does not tell you where an object went. Two earlier positions can suggest its speed, and a recurrent network can learn to keep useful information in a small changing state. The lab trains three hidden numbers to help predict the next position. A missing flag tells it that zero is only a placeholder.

Compare with simple rules

Train a few updates and inspect the same episode. Compare the neural forecast with using only the current view and with extrapolating from the last two visible positions. The history rule is a strong baseline when motion really stays constant. Simulator truth is a separate privileged diagnostic, never an input to prediction.

Leave room for unknown events

Reverse the object while it is hidden. No model can observe that event from the identical visible prefix. A separate hypothesis range includes only the possibilities you declared. Allow a hidden turn and watch that range widen. It is not a learned confidence interval, and it can fail when the actual event is absent from its assumptions.

Keep the evidence bounded

The graph has fixed axes and the table keeps exact values. Eight training episodes and six public development episodes are reused. Temporary captures and lesson checks are practice, not independent tracking qualification.

Open the full worked examples, calculations and limitations

This is the same reference used in Technical mode. Expand it whenever you need the exact numbers, assumptions or further explanation.

Begin with two visible positions

A dot is at 0.35 scene units, then 0.43 one frame later. Its observed change is 0.08 units per frame. If this speed continues, two hidden frames later it should be at 0.59. That calculation uses history; a single blank frame contains neither position nor direction.

The experiment supplies the first two frames and the last frame of an eight-frame episode. Five intervening frames contain a missing flag and a zero coordinate placeholder. Zero does not mean the object was measured at the origin. Training uses eight complete authored episodes; six different starts provide repeated public development. The supervised target is the next position from the synthetic training environment. Development targets never enter updates.

A state that can learn to retain information

The network has three hidden units. At each frame it combines the observed coordinate, visibility flag and its previous three numbers, then applies tanh. A linear readout predicts the next position. All 22 parameters learn together. The hidden state starts at zero for every episode; it is not a saved memory shared across episodes.

Write the observation vector as oto_t, the three retained numbers as hth_t, and the prediction as x^t+1\hat{x}_{t+1}. The recurrence is ht=tanh⁡(Woot+Whht−1+b)h_t=\tanh(W_o o_t+W_h h_{t-1}+b). The output is x^t+1=wTht+c\hat{x}_{t+1}=w^T h_t+c. Each symbol denotes weights or numbers computed inside the experiment, not hidden simulator truth. Tanh bounds each hidden unit between −1 and +1.

Training minimizes mean half-squared position error. Backpropagation accumulates contributions through all eight frames before the simultaneous update. A direct CPU action makes one or five updates, at most 1,000 total; there is no background timer. The exact hidden values and input flags remain inspectable.

Compare information, not just scores

The current-frame rule repeats an observed position and uses zero when missing. The recent-history rule estimates velocity from the last two visible points and extrapolates. It is strong when constant velocity is correct. A true-state diagnostic has privileged simulator information and zero error by construction; it is not an available deployed baseline.

The recurrent prediction is a point, not a calibrated probability. A separate finite-hypothesis calculation enumerates positive/negative speed and, optionally, a hidden reversal. It retains hypotheses consistent with the visible prefix and reports their minimum and maximum next position. This range is exact only within the declared family.

A missing event cannot be remembered

Turn on a reversal after frame four. The visible prefix is unchanged, so the neural prediction remains unchanged during occlusion. If hidden turns are excluded from the hypothesis family, even its exact range can be wrong. Adding that possibility widens the range: uncertainty reflects missing information, not merely lack of training.

Capture a matched comparison and explain which assumption made each method succeed or fail. Fixed axes disclose clipped predictions; the table retains exact values. These authored episodes and temporary notes do not establish real tracking performance or independent proficiency.

05 · APPLY
Check your understanding

An exact conditional range misses the true state after an unmodeled turn. What failed?

An exact conditional range misses the true state after an unmodeled turn. What failed?
06 · CONTINUE

Take this idea with you.

A recurrent state summarizes observed history. It cannot remove ambiguity caused by hidden events; uncertainty needs explicit assumptions and separate evidence.

My Learning
Explore related topics and the topic map

How this topic connects

Explore this topic on the interactive map

Use these connections to review a foundation or choose where to go next. You can open any topic without completing the others.

What it builds on

You are hereRemember what the current view hides

Train recurrent state and compare information available during an occlusion.

What it enables

  • World-model project Apply in a project

    Freeze the model/planning recipe and compare predicted outcomes with externally executed control in the saved world-model project.