When you right click a music folder in Windows Explorer you get this:

To remove the Shop for music online link put this into a registry file and execute it:

Windows Registry Editor Version 5.00

[-HKEY_CLASSES_ROOT\SystemFileAssociations\Directory.Audio\shellex\ContextMenuHandlers\WMPShopMusic]