Xanax is similar to opiates in that it makes emotional pains and problems go away, the difference is it does this by sedating you rather than giving you overwhelming pleasure.
Apparently benzodiazapine (and alcohol) withdrawals are the worst you can have. I’ve only experienced benzo withdrawals, so I can’t say, but it’s worth remembering that if you just stop using them cold turkey, you can actually die, unlike practically every other withdrawal.
So just remember he’s going through some stuff. Don’t let that be an excuse for him to take advantage of you though.