Your waveform resembles 'ringing' like the kind created by resonant action in a loop formed by an inductor and capacitor. Install a resistor in series so that the ringing decays after a few cycles.
A ringing circuit needs a 'kick' to start oscillations. You can start with a charge on the capacitor, or deliver a pulse through a switch, etc.