Dynamics and Phenomena in Stateful Multi-Agent Systems