  With the continuous growth of the global economy and markets, resource
imbalance has risen to be one of the central issues in real logistic scenarios.
In marine transportation, this trade imbalance leads to Empty Container
Repositioning (ECR) problems. Once the freight has been delivered from an
exporting country to an importing one, the laden will turn into empty
containers that need to be repositioned to satisfy new goods requests in
exporting countries. In such problems, the performance that any cooperative
repositioning policy can achieve strictly depends on the routes that vessels
will follow (i.e., fleet deployment). Historically, Operation Research (OR)
approaches were proposed to jointly optimize the repositioning policy along
with the fleet of vessels. However, the stochasticity of future supply and
demand of containers, together with black-box and non-linear constraints that
are present within the environment, make these approaches unsuitable for these
scenarios. In this paper, we introduce a novel framework, Configurable
Semi-POMDPs, to model this type of problems. Furthermore, we provide a
two-stage learning algorithm, "Configure & Conquer" (CC), that first configures
the environment by finding an approximation of the optimal fleet deployment
strategy, and then "conquers" it by learning an ECR policy in this tuned
environmental setting. We validate our approach in large and real-world
instances of the problem. Our experiments highlight that CC avoids the pitfalls
of OR methods and that it is successful at optimizing both the ECR policy and
the fleet of vessels, leading to superior performance in world trade
environments.
