Gilmore, Georgia, 1920-1990