One place is never enough, never lost anything but i keep them on micro SD which stays in phone to keep my collection mobile and occasionally mobile and backed up to a hard drive just in case.
All downloaded on 2nd ssd in my pc. The nicest songs are dumped on type 2 Chrome tape (TDK SA-X or Maxell XL-II) for regular listening.