It's actually not complicated at all. What, pray tell, are some of these complications you're referring to?
Incidentally, are you and/or your people from the South?
Nope... From PA just outside Philly.
And yes it is complicated.
1.) There was a tremendous amount of fear within the white community that the freed slaves would want revenge (and rightfully so).. the North did nothing to dissuade that.
2.) Three million uneducated abused former slaves were dumped on the job market and instantly became a threat to what was exclusively white jobs.
3.) Many white families lost relatives and direct family members in the war and to just expect them to forget about it and not seek revenge against the former slaves is being naive.
IMNSHO, the federal government should have ponied up the money and purchased slaves and educated them prior to releasing them into the economy (basic reading/writing/math would have been sufficient). It would have eased the fears and the south would not have had their property confiscated without compensation (I know its sounds barbaric, but yes the slaves were considered property).
If we had done the above, I believe Jim Crow, the KKK and other white supremacist groups would have not become as large and as entrenched as it was.
Lincoln was pretty cheap when it came to the former slaves, as he had plans to deport them all to some British Colonies because he thought that the former slaves would never live peacefully with the whites.
Anyhow, the cause was noble, the method detestable.
FYI, my mothers family is predominately of Quaker and Irish Protestant origin... both sides detested slavery and my 3'rd great grandfather fought in the PA cavalry and was wounded, his brother was killed though.
My fathers family roots are 8 generations deep in Virginia/North Carolina... they stole food in London and were sentenced to transportation to the colonies and worked as indentured servants (basically slaves) till their sentences were over. They were always poor mountain men... half the family down there fought for the South and the other half supported the North and were viewed as scalawags and were forced to move north after the war and lost everything in the process.