ACE-Step 1.5

ACE-Step 1.5
Pushing the Boundaries of Open-Source Music Generation

    ACEMusic |
    Project |
    Hugging Face |
    ModelScope |
    Space Demo |
    Discord |
    Technical Report |
    Awesome ACE-Step

      

📰 News

> 🎵 Want a faster & more stable experience? Try acemusic.ai — 100% free!

- [2026-04-02] 🎉 ACE-Step 1.5 XL (4B DiT) Released! — We introduce the XL series with a 4B-parameter DiT decoder for higher audio quality. Three variants available: xl-base, xl-sft, xl-turbo. Requires ≥12GB VRAM (with offload), ≥20GB recommended. All LM models fully compatible. See Model Zoo for details.

Table of Contents

- 📰 News
- ✨ Features
- ⚡ Quick Start
- 🚀 Launch Scripts
- 📚 Documentation
- 📖 Tutorial
- 🏗️ Architecture
- 🦁 Model Zoo
- 🔬 Benchmark

📝 Abstract
🚀 We present ACE-Step v1.5, a highly efficient open-source music foundation model that brings commercial-grade generation to consumer hardware. On commonly used evaluation metrics, ACE-Step v1.5 achieves quality beyond most commercial music models while remaining extremely fast—under 2 seconds per full song on an A100 and under 10 seconds on an RTX 3090. The model runs locally with less than 4GB of VRAM, and supports lightweight personalization: users can train a LoRA from just a few songs to capture their own style.

🌉 At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprints—scaling from short loops to 10-minute compositions—while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). ⚡ Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. 🎚️

🔮 Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilities—such as cover generation, repainting, and vocal-to-BGM conversion—while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. 🎸

✨ Features

⚡ Performance
- ✅ Ultra-Fast Generation — Under 2s per full song on A100, under 10s on RTX 3090 (0.5s to 10s on A100 depending on think mode & diffusion steps)
- ✅ Flexible Duration — Supports 10 seconds to 10 minutes (600s) audio generation
- ✅ Batch Generation — Generate up to 8 songs simultaneously

🎵 Generation Quality
- ✅ Commercial-Grade Output — Quality beyond most commercial music models (between Suno v4.5 and Suno v5)
- ✅ Rich Style Support — 1000+ instruments and styles with fine-grained timbre description
- ✅ Multi-Language Lyrics — Supports 50+ languages with lyrics prompt for structure & style control

🎛️ Versatility & Control

| Feature | Description |
| ✅ Reference Audio Input | Use reference audio to guide generation style |
| ✅ Cover Generation | Create covers from existing audio |
| ✅ Repaint & Edit | Selective local audio editing and regeneration |
| ✅ Track Separation

……（后略，见原文）