If you say it about one single black man, it meens he looks like he had just recently gotten out of prison. Therefore you fear for your life and or virginity/innocence.
Jim: Way ahead of you, Man!
Conner: Check out that Bubba, Joey.
Joey: Dont look at him, just keep walking.