We've observed agents discovering progressively more complex tool use while playing a simple game of hide-and-seek.
We've found that self-play allows simulated AIs to discover physical skills like tackling, ducking, faking, kicking, catching, and diving for the ball, without explicitly designing an environment with these skills in mind.