Musebench Tests AI Music Detectors Across 361 166 Tracks From Suno Udio And Other Models

Published: 10/14/2026

Source: arXiv — MuseBench: A Benchmark for AI-Generated Music Detection and Artifact Analysis

Researchers introduced MuseBench, a 361,166-track benchmark designed to test whether automated systems can distinguish human music, fully generated tracks and human-AI co-creations under realistic conditions.

The dataset covers ten commercial and open-source generators, including Suno and Udio, plus human-composed music. It also includes tracks altered through compression, acoustic processing, noise and adversarial perturbations to test whether detection survives normal distribution and deliberate evasion.

The researchers evaluated 11 detectors and documented weaknesses when systems encountered unseen datasets, co-created recordings and transformed audio. They also identified recurring spectral, harmonic, vocal and physically implausible performance artifacts.

This is a newly released research preprint, not a final industry standard or peer-reviewed proof that every detector will behave the same way in commercial use.

Can AI music detectors reliably identify every Suno or Udio song? No. MuseBench shows why performance must be tested across models, genres, co-created tracks and post-processed audio rather than summarized with one accuracy number.

Why it matters: Streaming services should measure false positives as carefully as successful detection. A system that wrongly labels human or hybrid music can affect discovery, payment and reputation even when its overall accuracy appears high.

More Recent AI Music News

Movin To The Sun Grammy Decision Separates AI Songwriting From Human Performance Sony And Universal Seek Distrokid Data On The Volume Of AI Music Reaching Streaming Services Korean Startup Neutune Proposes Trackable Attribution For Licensed AI Music Riaa Filing Flags AI Voice Service Lalals Over Unauthorized Celebrity Voices Ellison Awards Create An AI Creative Direction Category For AI Vocal Music Gaslab Raises 1 Million For An AI Music Platform Designed To Attribute And Pay Musicians Taylor Swift Expands Voice Trademark Strategy To The Uk Eu And Australia Suno Adds Private Workspaces And Shareable Custom Models For Collaboration Suno Created Korean Ballad Reaches No 3 On Melon S Top 100 A Ap Rocky Describes AI As A Tool For Stem Separation Not A Replacement For His Creative Team Jamendo Refiles Nvidia AI Training Lawsuit Over A Research Only Music Dataset Youtube Music Begins Labeling Songs Created Primarily With Generative AI Grimes Confirms Selective AI Use In The Accelerando Video Not The Song Suno Creators Question Whether The Platform Can Turn Publishing Into Audience Growth Suno Shows How V6 Can Connect Choreography Song Creation And Music Video Direction Deezer Will Let Listeners Remove Fully AI Generated Music From Search Australian AI Committee Dispute Puts Creator Copyright Safeguards Under Scrutiny Suno Creator Launches A Blind Listening Challenge To Test Assumptions About V6