In real world you need:
* VCC capacitors
* capacitors at analog inputs (my recommendation)
* to connect all inputs (even the unused ones) with useful signals
* current limiting resistors at the LEDs
We can't verify ENC frequency, nor the voltage levels.
Try "normal operation mode", see Table4.
Common mode input voltage range is off specification.
Differential mode input voltage range is off specification.