The North.
Slavery was supposedly abolished and Southern States joined the Union. But, African Americans didn't really enjoy equal rights till much later (and not necessarily enjoy all the privileges Caucasians do today), casualties and wounded numbers were enormous for both sides, and even today in the South you will hear references to "The War Between the States" rather than the Civil War, indicating their sense of separateness.