Generally yes! You use feedbacks to make the gain of the amplifier stable (like in opamps theory) so they don´t change against frequency and/or output current, for example.
But in this particular case, when your load is capacitive, if you try to use feedback you will create a oscillator.
This was a problem in my project since i had to control the output current against variations on the capacitor's impedance. The way i found was to use the amplitude modulation function from the signal generator IC that i used. I couldn't make any kind of feedback to work.