The North had more manpower than the South due to:
The North had a LOT more people than the South, having up to 22 million people where the South had about 9 million.
Plus the Emancipation Act freed a lot of the slaves in the South but they had to fight for the north in the Civil War
