There may be a service panel GFCI breaker supplying power to the bathroom outlets unless that is what you mean by no GFI in box. Check the breaker in the service panel and even if it is not a GFCI check to make sure it is sending power to the bathrooms. The breaker itself may be bad. Swap it with another breaker of the same amps. By code all bathroom outlets must be GFCI protected. Sometimes a GFCI breaker will be used at the service panel instead of at the receptacle box. If none is there then start at the receptacle closest to the service panel and remove it from the box. Check the wiring to make sure a wire is not loose. Check all receptacles until you find the culprit. Normally this will be a loose neutral (white) wire. Another possibility is that the bathrooms are getting power from another circuit. Look in a hall or someplace you would not normally see for a GFCI outlet. It is obvious all of these outlet are getting power from the same source. You just have to find out what source that is. Post back what you find.

Depending on how old your townhouse is, code should dictate that all "wet areas", be GFI protected. In most cases the GFI will not be in the box, but somewhere on the circuit, an outlet that has a GFI reset. You know that the main and master baths are on that circuit, check those outlets for the reset. If none have it, there is likely another outlet somewhere that does. Sometimes one will be in a crawl space or outside. Do you have any outlets out back? In an attic? A utility room? Good Luck! I hope you find this to be very helpful!