Bayon was elected as the member of parliament for the Wa East constituency in the 2004 Ghanaian general elections. He thus represented the constituency in the 4th parliament of the 4th republic of Ghana. He was elected with 10,947votes out of 21,307 total valid votes cast. This was equivalent to 51.4% of the total valid votes cast. He was elected over Albert Solomon Bawah Sulley of the People's National Convention and Saliah Issaku Alhaji of the National Democratic Congress. These obtained 1,085votes and 9,275votes out of the total valid votes cast. These were equivalent to 5.1% and 43.5% of the total valid votes cast. Bayon was elected on the ticket of the New Patriotic Party. In all the New Patriotic Party won a majority total of 194 parliamentary representation out of a total 230seats in the 4th parliament of the 4th republic of Ghana.
