Depends on the purpose of filling the cavity and what the manufacturer advises. If the purpose is to add mass or keep the cabinet from flexing, maybe not. I use unscented kitty litter in metal speaker stands to damp the ringing. No need to add any weight to my stands and it works very well for that purpose.
