That hiss you noticed with the LOMC cartridge when not being played may very well be the line stage tube in the preamp (assuming your preamp is not solid state)
It was a high-end dealer's demonstration system, and the phono stage was a solid state Musical Fidelity component, feeding McIntosh power amplifiers of some sort. Obvious hiss is not something I had ever experienced in my own systems and I went back to the dealer to confirm whether the hiss was real.
I really was not concentrating on the electronics the first time, because it was at major promotion for B&W loudspeakers. I just happened to notice that the source was a linear tracking deck (Holbo) which impressed me, so I arranged to take some records for a private audition. That's when I really noticed the hiss for the first time.
My guess is it is quiescent electronic noise amplified by the high gain needed for LOMC. I ended up buying a very high output DS Audio optical cartridge instead, so hiss is only of academic interest to me at the moment.

