Learning preferences

Make learning more comfortable. Changes apply immediately.

Enlarges page content, including diagrams and their labels. You can also use your browser’s zoom.

Choose the colours that are easiest for you to distinguish. Applies to lesson diagrams and lab plots. Labels, shapes, hatching and line patterns also distinguish meanings. Source photographs and raw image brightness stay unchanged; mask-only views are available for image overlays.

ExampleComparisonSample link

Saved in this browser on this device. Preferences are separate from progress backups.

Lesson 10 of 13 in this unit

Build AI Systems · ORIGINAL LEARN AI LESSON

Compare robotic foundation models.

Compare demonstration provenance, action representation, embodiment and reported generalization.

By the end: Compare demonstration provenance, action representation, embodiment and reported generalization.

Start with the exampleJump to the experimentRead the explanation
Prerequisites and path options

Why learn this? Use a reproducible comparison to make a bounded claim about compare robotic foundation models, while keeping development practice separate from independent review.

01 · TRY

Start with something concrete.

A policy follows a new instruction on its training robot. Does that establish transfer to a different arm?

Try the interactive model
02 · PREDICT
Before you experiment

A diffusion action policy proposes a collision. What does multimodal representation guarantee?

A diffusion action policy proposes a collision. What does multimodal representation guarantee?
03 · EXPERIMENT

Change one thing. Watch what follows.

Loading this browser experiment…

04 · UNDERSTAND
READ & CONNECT

Understand what changed.

Back to the experiment

A shorter explanation, with the original worked examples available below. Both explain the same experiment and its limits.

Same learning goal in both modes: Compare demonstration provenance, action representation, embodiment and reported generalization.

Start with a concrete question

A policy follows a new instruction on its training robot. Does that establish transfer to a different arm?

What to inspect

Compare ACT, Diffusion Policy and RT-2 with the common checklist. Identify a possible failure that the model representation itself cannot prevent.

Robot evidence depends on the body as well as the model. Sensors, joint limits, control frequency, contact and demonstration collection affect what an action means. ACT studies imitation with action chunks on a bimanual setup. Diffusion Policy represents conditional action sequences through denoising. RT-2 investigates transfer from vision-language learning into token-based robot action prediction. The cards link their 2023 primary publications or project pages.

Keep the conclusion bounded

Do not rank these papers from isolated success percentages on different tasks or embodiments. Published failure cases and omitted conditions matter alongside successes. Write a constrained claim such as “this comparison supports the reported task behavior under the studied setup,” then propose a matched test on a new object or sensor condition. The browser cards support research literacy; they do not run the paper models, authenticate a reproduction or qualify a learner to deploy a robot.

Open the full worked examples, calculations and limitations

This is the same reference used in Technical mode. Expand it whenever you need the exact numbers, assumptions or further explanation.

Start with the question

A policy follows a new instruction on its training robot. Does that establish transfer to a different arm?

Mechanism and worked comparison

Robot evidence depends on the body as well as the model. Sensors, joint limits, control frequency, contact and demonstration collection affect what an action means. ACT studies imitation with action chunks on a bimanual setup. Diffusion Policy represents conditional action sequences through denoising. RT-2 investigates transfer from vision-language learning into token-based robot action prediction. The cards link their 2023 primary publications or project pages.

A common comparison asks where demonstrations came from, which observations enter the policy, how actions are represented, how often feedback changes a plan, and which complete tasks were measured. A chunk may smooth behavior while delaying reaction. A multimodal generator may represent alternative actions without deciding which is safe. Language-related transfer may help a semantic choice while leaving grounding, permission and physical feasibility unresolved.

Do not rank these papers from isolated success percentages on different tasks or embodiments. Published failure cases and omitted conditions matter alongside successes. Write a constrained claim such as “this comparison supports the reported task behavior under the studied setup,” then propose a matched test on a new object or sensor condition. The browser cards support research literacy; they do not run the paper models, authenticate a reproduction or qualify a learner to deploy a robot.

Try and explain

Compare ACT, Diffusion Policy and RT-2 with the common checklist. Identify a possible failure that the model representation itself cannot prevent.

Open the reproducible study project or use the implementation studio.

05 · APPLY
Check your understanding

A diffusion action policy proposes a collision. What does multimodal representation guarantee?

A diffusion action policy proposes a collision. What does multimodal representation guarantee?
06 · CONTINUE

Take this idea with you.

Compare demonstration provenance, action representation, embodiment and reported generalization.

My Learning
Explore related topics and the topic map

How this topic connects

Explore this topic on the interactive map

Use these connections to review a foundation or choose where to go next. You can open any topic without completing the others.

What it builds on

You are hereCompare robotic foundation models

Compare demonstration provenance, action representation, embodiment and reported generalization.

What it enables

  • Reproducible research project Apply in a project

    Use the research project to freeze a question, replay all task/seed comparisons and defend a result-linked report with its limitations.