Scottish kings came to favor the site , and it was James IV who decided to transform the simple lodgings into a true royal palace .
Scottish Kings always disliked the place and James IV wildly made it into a royal palace .