Nor do i believe the rule is based on skin color. It is to eliminate undue distraction to the batter.
If color is mentioned, it is likely to keep something from resembling the ball, or being too loud visually.
If you ever happen to watch martial arts displays, some weapons have flamboyant tassels hanging off the handles to distract from the pointy end.