The blues went a goal behind in the first half at Kingsmeadow.
Mayra Ramirez levelled the score in the 62nd minute, with Lauren James slotting home the winner in added time.
Chelsea remain unbeaten across all competitions for a run of 24 games under manager Sonia Bompastor.
