Johnson began playing professionally as Florence Mills' accompanist, and formed his own band in 1924. In 1925 he worked with Elmer Snowden, and in 1926 he worked with Billy Fowler. He briefly worked with Henri Saparo and Noble Sissle, and then he joined Sam Woodings band and traveled to Europe in June 1928.
