  We consider the dynamics and the interactions of multiple reinforcement
learning optimal execution trading agents interacting with a reactive
Agent-Based Model (ABM) of a financial market in event time. The model
represents a market ecology with 3-trophic levels represented by: optimal
execution learning agents, minimally intelligent liquidity takers, and fast
electronic liquidity providers. The optimal execution agent classes include
buying and selling agents that can either use a combination of limit orders and
market orders, or only trade using market orders. The reward function
explicitly balances trade execution slippage against the penalty of not
executing the order timeously. This work demonstrates how multiple competing
learning agents impact a minimally intelligent market simulation as functions
of the number of agents, the size of agents' initial orders, and the state
spaces used for learning. We use phase space plots to examine the dynamics of
the ABM, when various specifications of learning agents are included. Further,
we examine whether the inclusion of optimal execution agents that can learn is
able to produce dynamics with the same complexity as empirical data. We find
that the inclusion of optimal execution agents changes the stylised facts
produced by ABM to conform more with empirical data, and are a necessary
inclusion for ABMs investigating market micro-structure. However, including
execution agents to chartist-fundamentalist-noise ABMs is insufficient to
recover the complexity observed in empirical data.
