Lutcher was born in Lake Charles, Louisiana, the eldest daughter of the 15 children of Isaac and Suzie Lutcher. She was the sister of saxophonist Joe Lutcher. Her father was a bass player and her mother a church organist. She received piano lessons, and her father formed a family band with her playing piano. At age 12, she played with Ma Rainey, when Rainey's regular pianist fell ill and had to be left behind in the previous town. Searching for a temporary replacement in Lake Charles, one of the neighbors told Rainey that there was a little girl who played in church who might be able to do it.
