In January 2017, Olivier was added to South Africa's Test squad ahead of the third Test against Sri Lanka. He replaced Kyle Abbott, who earlier had quit international cricket to sign for the English team Hampshire as a Kolpak player.
