Levy married several times. He married Charlotte Jones in 1946 in Dallas, Texas. A few years prior, he had married Juanita Thomas. Unbeknownst to Levy, Thomas was already married at the time. Though separated, she had never obtained a divorce. The relationship ended in 1945, with Levy stating that Thomas was physically abusive towards him.
