you could directly divide the maH capacity by 2ma as the current is small.
Each type of battery is provided with discharge graphs.
interpolation there would be reasonable at higher load currents.
generally the calculations are given for useful voltage
.
for your need, interpolation the battery load graphs is the best way. You need to seek detailed datasheet of the concerned manufacturer.
Batteries are not all the same. Some will last longer than others. I bought some cheap Chinese solar garden lights that came with a Ni-MH rechargeable battery cell. Some of the batteries are pretty good and others are useless. The solar panels are the same.
Alkaline battery cells are also not all the same. Some are pretty good and others are dead and leaking in the store before they are sold.