That method isn't particularly reliable but keeping it simple, the easiest solution is to use a change-over switch instead of a press-to-make push button. Wire it so that when the button is released you connect a low value resistor (~47 Ohms) across the capacitor to give it a higher discharge current. Do not simply short the capacitor out as the spark will damage the switch contacts.