When choosing "Delete" it asks to permanently remove the song. It is unclear if this means from the list to be updated or from the harddrive.
Hello! 1. Navigate to Settings -> Advanced settings 2. Type "duplicates" in the search bar 3. Set value to "no". Try backing up your music albums again.