His influence did diminish after 1637, when Władysław married Habsburg Archduchess Cecilia Renata of Austria. After that, Kazanowski became an enemy of the queen and other Habsburg supporters, like Jerzy Ossoliński, and allied himself with Piotr Gembicki (chancellor until 1642).
