I have that Mozart box too, and it is certainly a good way to become familiar with his works. He is one of those composers whose every known works is topnotch. After finding favorites, you can then search for alternative performances. That is a big part of the fun--hearing different interpretations of the same work.
Every collector of classical music collects different performances of the same works. It helps to know learn how a conductor or performer interprets a work and how that interpretation is translated into specific ways of playing the piece. There are recordings that include extra material where the performer discusses the performance. For example, Benjamin Zander has issued some CDs that include an extra CD with such explanation with samples from the performance. I have performances of Mahler's Fifth and Ninth Symphonies with such extras from Mr. Zander and I recommend them highly.
Every collector of classical music collects different performances of the same works. It helps to know learn how a conductor or performer interprets a work and how that interpretation is translated into specific ways of playing the piece. There are recordings that include extra material where the performer discusses the performance. For example, Benjamin Zander has issued some CDs that include an extra CD with such explanation with samples from the performance. I have performances of Mahler's Fifth and Ninth Symphonies with such extras from Mr. Zander and I recommend them highly.