Music datasets
Training and evaluation datasets for music and audio, each at its own address with a dataset card, its license, how the material was gathered and the plugins that declare using it. Licenses and sourcing are our reading of each publisher's description, not legal advice.
50 of 50 datasets
| Dataset | Modality | License | Sourcing | Tasks |
|---|---|---|---|---|
| Lakh MIDI Dataset Colin Raffel | MIDI and symbolic | CC BY 4.0 Commercial use unclear | Collected from the web | Melody generation, MIDI continuation, Harmonization, Arrangement |
| Groove MIDI Dataset Google | MIDI and symbolic | CC BY 4.0 Commercial use allowed | Recorded for the dataset | Drum pattern generation, Groove and quantization |
| MAESTRO v3 Google | Audio | CC BY-NC-SA 4.0 Non-commercial | Recorded for the dataset | Transcription, Expressive performance, Beat tracking |
| JSB Chorales Cheng-Zhi Anna Huang | MIDI and symbolic | Public domain Commercial use allowed | Public domain | Counterpoint generation, Harmonization |
| POP909 Music X Lab, NYU Shanghai | MIDI and symbolic | MIT Commercial use allowed | Recorded for the dataset | Melody generation, Harmonization, Arrangement |
| EMOPIA Hsiao-Tzu Hung et al. | MIDI and symbolic | CC BY 4.0 Commercial use unclear | Collected from the web | Mood tagging, Melody generation |
| Nottingham Jukedeck | MIDI and symbolic | Public domain Commercial use allowed | Public domain | Melody generation, Harmonization |
| Wikifonia (lead sheets) Wikifonia | MIDI and symbolic | Mixed (defunct service) Commercial use unclear | Community contributed | Harmonization, Reharmonization, Melody generation |
| Hooktheory / TheoryTab Hooktheory | MIDI and symbolic | Proprietary (API) Commercial use unclear | Community contributed | Chord suggestion, Harmonization, Reharmonization |
| ADL Piano MIDI Lucas N. Ferreira | MIDI and symbolic | CC BY 4.0 Commercial use unclear | Collected from the web | MIDI continuation, Melody generation |
| MetaMIDI Dataset (MMD) Metacreation Lab, SFU | MIDI and symbolic | Research Non-commercial | Collected from the web | MIDI continuation, Melody generation, Arrangement |
| GiantMIDI-Piano ByteDance | MIDI and symbolic | CC BY 4.0 Commercial use unclear | Collected from the web | Expressive performance, MIDI continuation |
| GTZAN George Tzanetakis | Audio | Research-only Non-commercial | Copyrighted recordings | Genre classification, Beat tracking |
| Free Music Archive (FMA) Michaël Defferrard et al. | Audio | CC-BY-4.0 (per-track) Commercial use unclear | Creative Commons sources | Genre classification, Auto-tagging, Music similarity |
| MagnaTagATune MIRG, City, University of London | Audio | CC + research Non-commercial | Creative Commons sources | Auto-tagging, Music similarity |
| MTG-Jamendo Music Technology Group, UPF | Audio | CC-BY / CC-BY-SA Commercial use unclear | Creative Commons sources | Auto-tagging, Mood tagging, Genre classification, Instrument recognition |
| Million Song Dataset LabROSA, Columbia University | Audio | Free (features) Commercial use unclear | Annotations only | Music similarity, Auto-tagging |
| GiantSteps Key GiantSteps project | Audio | CC BY-NC-SA Non-commercial | Copyrighted recordings | Key detection |
| MUSDB18 / MUSDB18-HQ SigSep | Audio | Mixed (research) Non-commercial | Mixed sources | Source separation |
| MedleyDB MARL, New York University | Audio | CC BY-NC-SA Non-commercial | Licensed | Melody extraction, Source separation, Instrument recognition |
| Slakh2100 Interactive Audio Lab, Northwestern | Audio | CC BY 4.0 Commercial use allowed | Synthetic | Source separation, Drum transcription, Transcription |
| MusicNet John Thickstun et al. | Audio | CC BY 4.0 Commercial use allowed | Creative Commons sources | Transcription, Instrument recognition |
| URMP AIR Lab, University of Rochester | Audio | CC BY 4.0 Commercial use allowed | Recorded for the dataset | Source separation, Transcription, Melody extraction |
| GuitarSet MARL, New York University | Audio | MIT Commercial use allowed | Recorded for the dataset | Chord recognition, Transcription, Beat tracking |
| IDMT-SMT-Drums Fraunhofer IDMT | Audio | Research Non-commercial | Recorded for the dataset | Drum transcription |
| NSynth Google | Audio | CC BY 4.0 Commercial use allowed | Licensed | Synth parameter generation, Instrument recognition, Neural synthesis, Timbre transfer |
| Ballroom Music Technology Group, UPF | Audio | Research Non-commercial | Copyrighted recordings | Beat tracking, Genre classification |
| Harmonix Set Oriol Nieto et al. | Audio | MIT (annotations) Commercial use unclear | Annotations only | Structure segmentation, Beat tracking |
| SALAMI DDMAL, McGill University | Audio | CC BY 4.0 Commercial use unclear | Annotations only | Structure segmentation |
| MusicCaps Google | Audio and text | CC BY-SA 4.0 Commercial use unclear | Annotations only | Text to music, Auto-tagging, Text and audio retrieval |
| Song Describer Dataset Song Describer team | Audio and text | CC BY 4.0 Commercial use allowed | Creative Commons sources | Text to music, Text and audio retrieval |
| DALI Gabriel Meseguer-Brocal et al. | Audio and text | Research / CC Non-commercial | Collected from the web | Lyrics transcription, Melody extraction |
| Opencpop WeNet / Opencpop team | Audio | CC BY-NC-SA 4.0 Non-commercial | Recorded for the dataset | Singing voice synthesis |
| M4Singer M4Singer team | Audio | CC BY-NC-SA 4.0 Non-commercial | Recorded for the dataset | Singing voice synthesis, Voice conversion |
| vocadito Rachel Bittner et al. | Audio | CC BY 4.0 Commercial use allowed | Recorded for the dataset | Melody extraction |
| OpenMIC-2018 CosMIR | Audio | CC BY 4.0 Commercial use allowed | Creative Commons sources | Instrument recognition, Auto-tagging |
| IRMAS Music Technology Group, UPF | Audio | Research Non-commercial | Copyrighted recordings | Instrument recognition |
| RWC Music Database AIST (RWC Music Database) | Audio | Research (RWC license) Non-commercial | Recorded for the dataset | Instrument recognition, Structure segmentation, Genre classification, Beat tracking |
| MIR-1K MIR Lab, National Tsing Hua University | Audio | Research Non-commercial | Recorded for the dataset | Source separation, Melody extraction |
| MAPS Télécom Paris | Audio | Research Non-commercial | Recorded for the dataset | Transcription, Chord recognition |
| ASAP Francesco Foscarin et al. | Audio | CC BY-NC-SA 4.0 Non-commercial | Mixed sources | Transcription, Expressive performance, Beat tracking |
| ATEPP Huan Zhang et al. | MIDI and symbolic | Research Non-commercial | Copyrighted recordings | Expressive performance, MIDI continuation |
| ComMU POZAlabs | MIDI and symbolic | CC BY-NC 4.0 Non-commercial | Recorded for the dataset | Melody generation, MIDI continuation |
| Los Angeles MIDI Aleksandr Lev (asigalov61) | MIDI and symbolic | CC BY-NC-SA 4.0 Non-commercial | Collected from the web | MIDI continuation, Melody generation |
| MoisesDB Moises | Audio | Research (non-commercial) Non-commercial | Licensed | Source separation |
| MedleyVox Chang-Bin Jeon et al. | Audio | Research Non-commercial | Mixed sources | Source separation |
| VocalSet Interactive Audio Lab, Northwestern | Audio | CC BY 4.0 Commercial use allowed | Recorded for the dataset | Singing voice synthesis, Voice conversion, Instrument recognition |
| Saraga (Carnatic) Music Technology Group, UPF | Audio | CC BY-NC-SA 4.0 Non-commercial | Licensed | Melody extraction, Structure segmentation, Auto-tagging |
| Cante100 Music Technology Group, UPF | Audio | Research Non-commercial | Copyrighted recordings | Melody extraction, Key detection |
| AudioSet Google | Audio | CC BY 4.0 (labels) Commercial use unclear | Annotations only | Auto-tagging, Instrument recognition |