Lesson 18 of 21 in this unit
Remember what the current view hides.
Train recurrent state and compare information available during an occlusion.
By the end: Compare a trained recurrent point predictor, current-frame and recent-history baselines, and explicitly conditional hidden-state uncertainty.
Prerequisites and path options
Why learn this? Recognize when memory helps an occluded prediction and when missing information makes a single confident answer unjustified.
Start with something concrete.
A moving dot disappears behind a screen. Two earlier positions suggest its direction. What if it reverses while hidden?
Try the interactive modelTwo trajectories have identical visible history but different hidden turns. Can a deterministic predictor know which occurred?
Change one thing. Watch what follows.
Loading this browser experiment…
Understand what changed.
A shorter explanation, with the original worked examples available below. Both explain the same experiment and its limits.
Remember the last useful observation
A blank view does not tell you where an object went. Two earlier positions can suggest its speed, and a recurrent network can learn to keep useful information in a small changing state. The lab trains three hidden numbers to help predict the next position. A missing flag tells it that zero is only a placeholder.
Compare with simple rules
Train a few updates and inspect the same episode. Compare the neural forecast with using only the current view and with extrapolating from the last two visible positions. The history rule is a strong baseline when motion really stays constant. Simulator truth is a separate privileged diagnostic, never an input to prediction.
Leave room for unknown events
Reverse the object while it is hidden. No model can observe that event from the identical visible prefix. A separate hypothesis range includes only the possibilities you declared. Allow a hidden turn and watch that range widen. It is not a learned confidence interval, and it can fail when the actual event is absent from its assumptions.
Keep the evidence bounded
The graph has fixed axes and the table keeps exact values. Eight training episodes and six public development episodes are reused. Temporary captures and lesson checks are practice, not independent tracking qualification.
Open the full worked examples, calculations and limitations
This is the same reference used in Technical mode. Expand it whenever you need the exact numbers, assumptions or further explanation.
Begin with two visible positions
A dot is at 0.35 scene units, then 0.43 one frame later. Its observed change is 0.08 units per frame. If this speed continues, two hidden frames later it should be at 0.59. That calculation uses history; a single blank frame contains neither position nor direction.
The experiment supplies the first two frames and the last frame of an eight-frame episode. Five intervening frames contain a missing flag and a zero coordinate placeholder. Zero does not mean the object was measured at the origin. Training uses eight complete authored episodes; six different starts provide repeated public development. The supervised target is the next position from the synthetic training environment. Development targets never enter updates.
A state that can learn to retain information
The network has three hidden units. At each frame it combines the observed coordinate, visibility flag and its previous three numbers, then applies tanh. A linear readout predicts the next position. All 22 parameters learn together. The hidden state starts at zero for every episode; it is not a saved memory shared across episodes.
Write the observation vector as , the three retained numbers as , and the prediction as . The recurrence is . The output is . Each symbol denotes weights or numbers computed inside the experiment, not hidden simulator truth. Tanh bounds each hidden unit between −1 and +1.
Training minimizes mean half-squared position error. Backpropagation accumulates contributions through all eight frames before the simultaneous update. A direct CPU action makes one or five updates, at most 1,000 total; there is no background timer. The exact hidden values and input flags remain inspectable.
Compare information, not just scores
The current-frame rule repeats an observed position and uses zero when missing. The recent-history rule estimates velocity from the last two visible points and extrapolates. It is strong when constant velocity is correct. A true-state diagnostic has privileged simulator information and zero error by construction; it is not an available deployed baseline.
The recurrent prediction is a point, not a calibrated probability. A separate finite-hypothesis calculation enumerates positive/negative speed and, optionally, a hidden reversal. It retains hypotheses consistent with the visible prefix and reports their minimum and maximum next position. This range is exact only within the declared family.
A missing event cannot be remembered
Turn on a reversal after frame four. The visible prefix is unchanged, so the neural prediction remains unchanged during occlusion. If hidden turns are excluded from the hypothesis family, even its exact range can be wrong. Adding that possibility widens the range: uncertainty reflects missing information, not merely lack of training.
Capture a matched comparison and explain which assumption made each method succeed or fail. Fixed axes disclose clipped predictions; the table retains exact values. These authored episodes and temporary notes do not establish real tracking performance or independent proficiency.
An exact conditional range misses the true state after an unmodeled turn. What failed?
Take this idea with you.
A recurrent state summarizes observed history. It cannot remove ambiguity caused by hidden events; uncertainty needs explicit assumptions and separate evidence.
Explore related topics and the topic map
How this topic connects
Explore this topic on the interactive mapUse these connections to review a foundation or choose where to go next. You can open any topic without completing the others.
What it builds on
- Predict in a compact representation
Test whether a compact visual code preserves the information an action needs instead of trusting low prediction error alone.
- Track a hidden state
Combine a sequence of noisy readings to estimate a changing hidden state.
Train recurrent state and compare information available during an occlusion.
What it enables
- World-model project Apply in a project
Freeze the model/planning recipe and compare predicted outcomes with externally executed control in the saved world-model project.