Kirsten began playing football for local team BSG Chemie Riesa in 1972. He joined BSG Stahl Riesa in 1978 before joining the youth academy of Dynamo Dresden in 1979. Dynamo Dresden was a center of excellence () and the most prominent club in Bezirk Dresden. It was also the most successful club in East Germany at the time. Kirsten made his professional debut for Dynamo Dresden in the 1983-84 DDR-Oberliga season.
