I think I see now. It's a matter of selecting one of two analog signals.
The 4066 Quad bilateral switch is suitable. It's very much like a relay. Its internal structure has mosfets arranged a little more complicated than your circuit.
I use the 4066 to switch rapidly between two signals going to my oscilloscope. The inputs/outputs don't seem to care what V the signal is, or whether it's AC or DC.
The control pins respond to logic level signals. When a control is low, then its related output pin is high impedance. When the control is high, internal mosfets connect the output to the input with 80-250 ohms intervening.
Not sure you'll need to put input resistors at the op amp. I drew them in just in case.
This may need some adapting, depending on your supply configuration.
If you use single supply, then consider using a comparator instead of an op amp. The comparator's output will go to either hi-impedance or ground. In order to make output high you'll need to add a pullup resistor.