 a recipe (the base language model) that they usually follow. Now, you (the user) want to customize this meal. You provide specific ingredients (keywords or textual control) and a picture of the final dish (image or visual control).

The chef now has to prepare the meal according to your specifications. They use their knowledge of the ingredients (token-level textual guidance) and the picture of the final dish (sentence-level visual guidance) to modify the original recipe. 

However, the chef also needs to 