How do I track down an ancestor who fought in the Civil war? [View all]

One of my mom's ancestors had been thought by the entire family to have been in the Confederate army. But her uncle found the ancestor's discharge papers, and he was in the Union army! While searching the net, I found a mention that he had been in the cavalry, but haven't been able to repeat the search.

How would I search old military records like this?