In 1864, Yorinori was ordered by the Shogunate to proceed to Mito, in order to deal with an uprising of the Tengu Party, whose members had proposed the policy with the motto of "Revere the emperor, expel the barbarians". The Tengu Party was dissatisfied with the foreign policy of the Shogunate. However, Yorinori failed to deal with the Tengu Party's threat due to his sympathy for their cause, Yorinori was a believer of , a proponent of radical imperialism.
