Battery capacity is rated in Ampere-Hours. It can produce so many Amperes (or milli-amps) for so many Hours.
For instance, suppose your device draws 100 mA, and the battery is 2300 mA-Hr. It can power the device for 23 hours. That's the simple way of putting it. Some batteries have the capacity printed on them. Consider this to be approximate.
Maybe you already know that. Perhaps you are asking whether a 6V battery can be converted to 4V so it can power your 4V device, without too much loss of efficiency? The answer is yes, although it requires additional circuitry. It may or may not be worth the effort after all factors are considered.