Kiviniemi's discography numbers more than 200 titles as of 2020, including recordings made on historic organs in the US, Japan, the Philippines, Australia, Italy, France, Switzerland and Germany, such as the Cavaillé-Coll organ of the Church of St. Ouen, Rouen and Orléans Cathedral. Kiviniemi was the first to record the complete organ works of Jean Sibelius, reviewed in 2010:
