Suppose your chip set needs multiple clocks for different circuitry. Why use a PLL and one crystal to generate different clock frequencies instead of using multiple crystals to do so?
Also multiple crystals would take up huge area on the PCB, and for some frequencies like
very high frequencies in the range of hundreds of MHz or GHz, crystal oscillators are not
available. But the most important reason is phase synchronisation between different parts of
the system.