Gustav1, I owned an original pair of the Vandy 2s several years back . They were great then and am sure much improved now. Having bought both items recently, I can understand your cash issue. I have been in the same boat recently, Putting together my system over the last 3 years.
I have switched to the use of a MAC Mini as a server as my primary source. I also have a Arcam disk player that I use directly into my preamp though intend to use it as a transport only in the future. I am currently using a M2Tech Hiface USB/SPDIF converter into a PS Audio digital Link III. This approach uses the only Coax provided by the DAC which is a limitation. I could use the Toslink connection for the Arcam but don't believe it serves any better than using the player pluged in directly. In addition, though I believe the DAC represents good value and sounds good in my system, the USB input represents the weakest link as USB to SPDIF conversion has been improved on the last couple years. I continue to research converters/DACs as I intend on upgrading. I have a pair of Esoteric MG10s driven by a BEL 1001MKV amp with a Jolida Fusion pre.
It seems that you are heading down a similar path. Which promotes my interest. For now you might consider purchasing one of the smaller portable USB DACs to improve your computer listening experience. This will allow you to 'jump in' with computer audio and you may find use for it later when you upgrade, or be able to sell it without much loss.
Please let us know how you proceed. Enjoy!