It is OK! The only "problem" you might have is that multi-bit ports of type std_logic_vector in IP blocks need casting if you want to use them as numbers with numeric_std.
Your own entities can use unsigned/signed for such ports instead of std_logic_vector.