In 1960, Lloyd was invited to become music director of Chico Hamilton's group, when Eric Dolphy left to join Charles Mingus's band. The Hungarian guitarist Gábor Szabó, bassist Albert "Sparky" Stinson, and trombonist Charles Bohanan soon joined Lloyd in the band. Hamilton's albums on Impulse!, Passin' Thru and Man from Two Worlds, featured music arranged and written almost entirely by Lloyd. He collaborated with Nigerian drummer Babatunde Olatunji, with whom he played when he was not on the road with Hamilton. He joined the Cannonball Adderley Sextet in 1964, and performed with Nat Adderley, Joe Zawinul, Sam Jones and Louis Hayes. For two years he remained with Cannonball Adderley, whom he credits in his own development as a leader.
