concerning the jitter - as jitter depends on the noise created in the TX driver stage you can do a transient noise simulation with mmsim/spectre from cadence - if you use cadence tools ...
after running the transient noise simulation with a pseudo-random-bit-generator or just a pulse source you can make an eye_diagram with the calculator and you'll get what you want ...
the other way to get information about jitter is to use pss and pnoise ...