  Humanitarian logistics operations face increasing difficulties due to rising
demands for aid in disaster areas. This paper investigates the dynamic
allocation of scarce relief supplies across multiple affected districts over
time. It introduces a novel stochastic dynamic post-disaster inventory
allocation problem with trucks and unmanned aerial vehicles delivering relief
goods under uncertain supply and demand. The relevance of this humanitarian
logistics problem lies in the importance of considering the inter-temporal
social impact of deliveries. We achieve this by incorporating deprivation costs
when allocating scarce supplies. Furthermore, we consider the inherent
uncertainties of disaster areas and the potential use of cargo UAVs to enhance
operational efficiency. This study proposes two anticipatory solution methods
based on approximate dynamic programming, specifically decomposed linear value
function approximation and neural network value function approximation to
effectively manage uncertainties in the dynamic allocation process. We compare
DL-VFA and NN-VFA with various state-of-the-art methods (exact re-optimization,
PPO) and results show a 6-8% improvement compared to the best benchmarks.
NN-VFA provides the best performance and captures nonlinearities in the
problem, whereas DL-VFA shows excellent scalability against a minor performance
loss. The experiments reveal that consideration of deprivation costs results in
improved allocation of scarce supplies both across affected districts and over
time. Finally, results show that deploying UAVs can play a crucial role in the
allocation of relief goods, especially in the first stages after a disaster.
The use of UAVs reduces transportation- and deprivation costs together by
16-20% and reduces maximum deprivation times by 19-40%, while maintaining
similar levels of demand coverage, showcasing efficient and effective
operations.
