Avery held a degree in psychology from Taladega College and after her graduation in 1959 she worked for six years at the North Florida State Mental Hospital. After the birth of her first child she worked for a few years at a school program for disabled children before going to receive her master's degree in special education. After her masters she took a job at a university-based children's mental health unit.