Ramirez was born in Los Angeles, California to Saul Ramirez, Sr., and the former Bertha Villarreal. He moved to Laredo when he was three years of age. His father had been a line foreman and diesel engine mechanic at Douglas Aircraft. Ramirez was raised in Laredo, Texas, where he attended the Roman Catholic St. Augustine elementary and high schools.
