Upsampling disadvantges, mutliplying the mistakes??

I am not a real technical guy, but I understand the logic behind upsampling. Today I talked to somebody who said upsampling to 96 or even 192 is crap because you are also multiplying the mistakes of a CD.
Can someone give me a bit more insight please?