You are permitted to perform Umrah. Strive to repay the debt in hopes of reducing the amount of usurious interest. Allah Says (What means): "And there are others who have acknowledged their sins. They had mixed a righteous deed with another that was bad. Perhaps Allah will turn to them in forgiveness. Indeed, Allah is Forgiving and Merciful." [At-Tawbah/102]. And Allah Knows Best.