Why Do Bikers Call Their Patches 'Colors'?

You've likely seen them rumbling down the highway, a pack of riders on gleaming Harleys, their leather vests covered in intricate patches. You probably know those vests are a big deal for them.