Once you’ve purchased an album, it is impossible to definitively delete it from your library. However, you can always delete a downloaded album from your device’s memory. Although you’ve deleted it from your memory, it will still be visible in your library.