  This paper presents a robust version of the stratified sampling method when
multiple uncertain input models are considered for stochastic simulation.
Various variance reduction techniques have demonstrated their superior
performance in accelerating simulation processes. Nevertheless, they often use
a single input model and further assume that the input model is exactly known
and fixed. We consider more general cases in which it is necessary to assess a
simulation's response to a variety of input models, such as when evaluating the
reliability of wind turbines under nonstationary wind conditions or the
operation of a service system when the distribution of customer inter-arrival
time is heterogeneous at different times. Moreover, the estimation variance may
be considerably impacted by uncertainty in input models. To address such
nonstationary and uncertain input models, we offer a distributionally robust
(DR) stratified sampling approach with the goal of minimizing the maximum of
worst-case estimator variances among plausible but uncertain input models.
Specifically, we devise a bi-level optimization framework for formulating DR
stochastic problems with different ambiguity set designs, based on the
$L_2$-norm, 1-Wasserstein distance, parametric family of distributions, and
distribution moments. In order to cope with the non-convexity of objective
function, we present a solution approach that uses Bayesian optimization.
Numerical experiments and the wind turbine case study demonstrate the
robustness of the proposed approach.
