  Click-Through Rate (CTR) prediction plays a core role in recommender systems,
serving as the final-stage filter to rank items for a user. The key to
addressing the CTR task is learning feature interactions that are useful for
prediction, which is typically achieved by fitting historical click data with
the Empirical Risk Minimization (ERM) paradigm. Representative methods include
Factorization Machines and Deep Interest Network, which have achieved wide
success in industrial applications. However, such a manner inevitably learns
unstable feature interactions, i.e., the ones that exhibit strong correlations
in historical data but generalize poorly for future serving. In this work, we
reformulate the CTR task -- instead of pursuing ERM on historical data, we
split the historical data chronologically into several periods (a.k.a,
environments), aiming to learn feature interactions that are stable across
periods. Such feature interactions are supposed to generalize better to predict
future behavior data. Nevertheless, a technical challenge is that existing
invariant learning solutions like Invariant Risk Minimization are not
applicable, since the click data entangles both environment-invariant and
environment-specific correlations. To address this dilemma, we propose
Disentangled Invariant Learning (DIL) which disentangles feature embeddings to
capture the two types of correlations separately. To improve the modeling
efficiency, we further design LightDIL which performs the disentanglement at
the higher level of the feature field. Extensive experiments demonstrate the
effectiveness of DIL in learning stable feature interactions for CTR. We
release the code at https://github.com/zyang1580/DIL.
