  Controlling energy consumption in buildings through demand response (DR) has
become increasingly important to reduce global carbon emissions and limit
climate change. In this paper, we specifically focus on controlling the heating
system of a residential building to optimize its energy consumption while
respecting user's thermal comfort. Recent works in this area have mainly
focused on either model-based control, e.g., model predictive control (MPC), or
model-free reinforcement learning (RL) to implement practical DR algorithms. A
specific RL method that recently has achieved impressive success in domains
such as board games (go, chess) is Monte Carlo Tree Search (MCTS). Yet, for
building control it has remained largely unexplored. Thus, we study MCTS
specifically for building demand response. Its natural structure allows a
flexible optimization that implicitly integrate exogenous constraints (as
opposed, for example, to conventional RL solutions), making MCTS a promising
candidate for DR control problems. We demonstrate how to improve MCTS control
performance by incorporating a Physics-informed Neural Network (PiNN) model for
its underlying thermal state prediction, as opposed to traditional purely
data-driven Black-Box approaches. Our MCTS implementation aligned with a PiNN
model is able to obtain a 3% increment of the obtained reward compared to a
rule-based controller; leading to a 10% cost reduction and 35% reduction on
temperature difference with the desired one when applied to an artificial price
profile. We further implemented a Deep Learning layer into the Monte Carlo Tree
Search technique using a neural network that leads the tree search through more
optimal nodes. We then compared this addition with its Vanilla version, showing
the improvement in computational cost required.
