Yes, it is permissible for a woman to wear underwear while performing Umrah. This is because she should keep her regular clothes that cover all her body while being in a state of Ihram (ritual consecration) for Hajj, or Umrah. However, she should uncover her face and hands, but it is permissible for her to let her head-covering garment drape from her head down over her face when non-Mahram (i.e., marriageable) men pass by her. And Allah Knows Best.