I'll agree to a point. "The box" is two-dimensional. Many pitches might be over the front of the plate, but move out of the zone before they reach the catcher. Also, most views from center field have an angle so that the pitcher doesn't block the view. Umps do clearly miss pitches, but no one is saying they favor one team or another.