All the fuse does is protect the tweeter. You can also protect the tweeter by not overdriving it. So don't do that and you will be fine. If you want to know how loud is safe, simply play one that does have a fuse real loud. At least as loud as you intend to listen. If that doesn't blow the fuse then that level is safe and you can bypass the fuses. Make sense?
