DC offset potentially shifts DC operating points of following gain stages, saturating them, causing signal clipping and reducing amplifier's input sensitivity and dynamic range. Of course, this is bad for zero-IF since the DC component is right in desired signal bandwidth and hard to be discriminated.