Are the batteries aligned correctly in the toy? If one is even wrong it will give power but it's messing up the signals going to the servo more than likely, I do hope this helps, if I had a few more details of make/model of toy I may be able to assist you further.

Regards Jem