  Early fault detection and fault prognosis are crucial to ensure efficient and
safe operations of complex engineering systems such as the Spallation Neutron
Source (SNS) and its power electronics (high voltage converter modulators).
Following an advanced experimental facility setup that mimics SNS operating
conditions, the authors successfully conducted 21 fault prognosis experiments,
where fault precursors are introduced in the system to a degree enough to cause
degradation in the waveform signals, but not enough to reach a real fault. Nine
different machine learning techniques based on ensemble trees, convolutional
neural networks, support vector machines, and hierarchical voting ensembles are
proposed to detect the fault precursors. Although all 9 models have shown a
perfect and identical performance during the training and testing phase, the
performance of most models has decreased in the prognosis phase once they got
exposed to real-world data from the 21 experiments. The hierarchical voting
ensemble, which features multiple layers of diverse models, maintains a
distinguished performance in early detection of the fault precursors with 95%
success rate (20/21 tests), followed by adaboost and extremely randomized trees
with 52% and 48% success rates, respectively. The support vector machine models
were the worst with only 24% success rate (5/21 tests). The study concluded
that a successful implementation of machine learning in the SNS or particle
accelerator power systems would require a major upgrade in the controller and
the data acquisition system to facilitate streaming and handling big data for
the machine learning models. In addition, this study shows that the best
performing models were diverse and based on the ensemble concept to reduce the
bias and hyperparameter sensitivity of individual models.
