Hit "Make Offline", then scroll through the album list UNchecking everything. If you just delete the cache yourself, Google Music will re-download it all when you connect.