Learn

Learning preferences

Make learning more comfortable. Changes apply immediately.

Enlarges page content, including diagrams and their labels. You can also use your browser’s zoom.

Choose the colours that are easiest for you to distinguish. Applies to lesson diagrams and lab plots. Labels, shapes, hatching and line patterns also distinguish meanings. Source photographs and raw image brightness stay unchanged; mask-only views are available for image overlays.

ExampleComparisonSample link

Saved in this browser on this device. Preferences are separate from progress backups.

Lesson 8 of 9 in this unit

Build AI Systems · ORIGINAL LEARN AI LESSON

Coordinate agents with limited information.

Compare centralized observations, local missing information and explicit communication in a synchronous two-agent grid.

By the end: Trace observations, simultaneous actions, shared success and message costs without confusing programmed cooperation with learned credit assignment.

Start with the exampleJump to the experimentRead the explanation
Prerequisites and path options

Why learn this? Inspect what each agent knows and when its action commits before attributing team success to communication or coordination.

01 · TRY

Start with something concrete.

One teammate knows the row of a meeting point; the other knows its column. Both can move, but neither local view identifies the full destination.

Try the interactive model
02 · PREDICT
Before you experiment

Two agents exchange their missing coordinates before moving. What resource should be reported?

Two agents exchange their missing coordinates before moving. What resource should be reported?
03 · EXPERIMENT

Change one thing. Watch what follows.

Loading this browser experiment…

04 · UNDERSTAND
READ & CONNECT

Understand what changed.

Back to the experiment

A shorter explanation, with the original worked examples available below. Both explain the same experiment and its limits.

Same learning goal in both modes: Trace observations, simultaneous actions, shared success and message costs without confusing programmed cooperation with learned credit assignment.

The idea in everyday terms

Two teammates have parts of a meeting address. A knows the target row; B knows its column. Both must reach the same true corner. Two independently correct guesses do not satisfy the shared task if they lead to different places.

What to watch in the experiment

Compare local partial observations, centralized full observations and explicitly exchanging two coordinates. Inspect both agents before and after every simultaneous tick. Count messages separately from ticks. Disable A to check that shared completion needs both agents. The movement rules are programmed, not trained multi-agent policies.

What this does not establish

The world permits agents to share a cell, and messages arrive before movement. These assumptions would need revision for delayed communication or physical robots. Disabling an agent changes team capability and is not a learned causal credit-assignment method. Four public corner cases are repeated development evidence, not proof of general teamwork.

Open the full worked examples, calculations and limitations

This is the same reference used in Technical mode. Expand it whenever you need the exact numbers, assumptions or further explanation.

Each teammate has only half the address

Two agents must meet at a corner of a 3×3 grid. Agent A sees the target row, while agent B sees its column. A starts at row 1, column 0; B starts at row 1, column 2. Knowing that there are two agents does not magically combine their observations. The information has to reach the decision that needs it.

The shared success condition requires both agents at the true target within six ticks. Arriving separately at different guesses fails, even if each individual followed its own rule correctly. This distinction between component behavior and complete task success applies to software workflows as well as simulated robots.

Three observation contracts

In local mode, each agent fills its missing coordinate with the middle coordinate, 1. A target at row 0, column 2 therefore looks like (0, 1) to A and (1, 2) to B. Neither local target is the true corner. The error is missing information rather than a faulty movement implementation.

Centralized mode supplies both coordinates to both controllers. Communication mode explicitly sends the missing coordinate in each direction before movement: two messages. It obtains the same task information as centralized control but incurs a different communication resource count. The experiment does not invent network latency or convert two messages into a guaranteed wall-clock time.

Each controller moves toward its believed target, changing row first and column second. This is a programmed policy. No neural network, policy gradient or learned messaging protocol is hidden in the demonstration. Multi-agent learning is an optional extension, not a claim established by this observation comparison.

Why action timing matters

At every tick, both actions are computed from the same pre-tick states. Then both next states commit together. Agent B does not get to see A’s newly committed position before choosing its own action. The trace explicitly shows both before/after states so this timing is inspectable.

Sharing a cell is allowed. The agents do not block one another and there is no collision penalty. These are environmental assumptions, not facts about physical robots. Changing them would change the task and require a new protocol, rather than merely another policy label.

Inspect contribution without inventing causality

Disable A’s movement and compare the shared success result. This reveals that reaching the joint target requires both agents in this task. It does not isolate a learned causal credit-assignment signal: the intervention changes team capability and the policy never learns from the result.

Inspect all four corner targets instead of selecting only a successful example. Compare completion, ticks and messages separately. A controller can spend fewer messages by failing to obtain necessary information; that is not a useful efficiency gain under the shared completion contract.

The four corner scenarios are public development cases. They do not establish robustness to delayed messages, adversarial teammates, larger maps or real-world movement. A proposed extension should name its observation, action, timing and success contracts before collecting outcomes, then retain failures alongside successes in Project 14.

05 · APPLY
Check your understanding

A reaches the target while B does not. Under the declared shared goal, is this successful?

A reaches the target while B does not. Under the declared shared goal, is this successful?
06 · CONTINUE

Take this idea with you.

Coordination depends on what each agent can observe, when actions commit and what the joint task requires. More agents alone do not add missing information.

My Learning
Explore related topics and the topic map

How this topic connects

Explore this topic on the interactive map

Use these connections to review a foundation or choose where to go next. You can open any topic without completing the others.

What it builds on

  • Tool contracts

    Build assistants that inspect tool results and recover from failures instead of treating every returned value as trustworthy.

You are hereCoordinate agents with limited information

Compare centralized observations, local missing information and explicit communication in a synchronous two-agent grid.

What it enables

  • Adaptation project Apply in a project

    Carry this comparison into the saved adaptation project, with matched baseline checkpoints, retained failures and separate transfer evidence.