Those "battery looking things" are called capacitors. You could replace them if you know how to solder but it is likely that some other problem on the card caused them to fail.

Replacement is your best option. You could contact the manufacturer of your card (Nvidia has a list here) and ask about repair or replacement if the card is under warranty.