Hi,
Yes, when a discharged capacitor is connected to a DC supply, it momentarily acts like a short circuit. The current flowing from the supply charges the capacitor. As the capacitor voltage increases, the current flow is reduced according to the relation i=C*dv/dt. Once the capacitor voltage reaches the DC supply voltage, the current flow stops.
This short circuiting effect is often in a concern with devices using large input filter capacitors. If the apparent short circuit is not somehow controlled, upstream devices such as supplies, cables, switches, fuses, etc. can be damaged by the huge inrush current.
Regards,
Chris