He was summoned to answer a case that he had published libels against the prosecution in a case involving the earl of Shaftesbury. He was found guilty by the Lord Chief Justice but he was released within a week after promising to behave better. He did not and the Baldwins were frequently in trouble. In 1690 he found himself in Newgate Prison for High Treason. Unusually he obtained bail.
