Harlem is a city in Columbia County, Georgia, United States. It is part of the Augusta metropolitan area. The population was 2,666 at the 201…Harlem is a city in Columbia County, Georgia, United States. It is part of the Augusta metropolitan area. The population was 2,666 at the 2010 census, up from 1,814 in 2000. This city was named after the neighborhood in the borough of Manhattan. Harlem is the birthplace of comedian Oliver Hardy; the annual Harlem Oliver Hardy Festival is held on the first Saturday each October on Main Street in his honor.