I recently owned two Pass .5 series amps (X150.5 and XA30.5) used with an X1. My sources have max outputs in a range of 2V (RCA) to 4.5V (XLR), while speaker efficiency was 91dB (nominal).
In this setup, volume increments were borderline too loud even at the setting of "1" - meaning that I and my wife probably could not sleep to the music. But it could still be considered low volume listening, and it worked in my setup. Make sure you use the "low gain" setting for the X1, which has lower noise floor in any event.
Because of the efficiency of the speakers, I had to step down the Ono’s output so that I could get a decent range of volume adjustment. If you have a way to do this with your sources, it should not be a problem. If you have less efficient speakers, you could get better results than I did.
I did try the XP-10, and have since moved on to the INT-30A. Both of these offer a much greater range of volume steps than the X1, which I appreciate.
In addition to the loss of the tape loop, you will lose the "mono" output, a sense of fuller bass, and less warmth with the XP-10 vs. the X1. You will gain increased transparency, speed, lower noise floor, and remote control ergonomics moving to the XP-10.
If you have a system or sources that tend towards thin or bright, the X1 will likely be a good choice. If you have sources that are warm or might benefit from a little energy, the XP-10 will likely be a better match. If your system is pretty neutral, either would likely work well.
Also speak to Kent English at Pass.