Communication, cooperation and tool use, learned from scratch
Two agents share one recurrent policy and a team reward, and nothing else: no pretrained models, no predefined symbol meanings. A procedural 3D world built from five room types makes each skill necessary in turn. Pick a skill below to watch it develop over training, then switch off the ingredient it depends on.
Replay viewer
loading
Held-out combination
Actor
loading
Puzzle
Camera
Free camera: drag to orbit, scroll to zoom. Keys: space play, ← → step, 1–6 puzzle, C camera, M ablate, [ ] checkpoint. Every checkpoint replays the same puzzles.