Seems to me that there would have been a good chance Stuart knew who Booth probably
was. With the war all but over, Stuart would have had a lot to lose if he got caught helping Lincoln's assassin. I imagine it was to a point where he wanted to steer as far away from trouble as possible. Regardless of what he knew or suspected, I imagine he was just ready to move on.