Yes, Azerbaijan is safe for female travelers.  However, like with many major cities, female travelers could be vulnerable to inappropriate behavior from some of the local males, especially in crowded locations.  It is important to remain cautious to the risk and follow basic safety advice.