"Paralleled" means that the SCL and SDA lines go to all 4 chips. You do not need to multiplex them.
You would then have a separate I/O line that goes to the E2 pin of each memory chip. To talk to a single chip, you will hold the E2 line of that one chip at one logic level while holding the other 3 at the other logic level. Then, by setting bit 3 (the E2 Chip enable bit) of the device select code byte to the same logic level as the one chip you are communication with, that one will be active and the other 3 will ignore the command because the select code doesn't match.