Install HeartMuLa Locally with LM Downloader
HeartMuLa is a powerful music creation tool that supports multiple music styles and genres, allowing you to easily create, edit, and generate music works.
HeartMuLa supports multilingual functionality, including but not limited to English, Chinese, Japanese, Korean, and Spanish, meeting the needs of global users.
If you have some development experience, you can download the source code from GitHub and deploy it locally. Alternatively, you can use LM Downloader to deploy HeartMuLa locally with one click—the entire process is fully automated, perfect for beginners, and supports both Mac and Windows.
- HeartMuLa Official Website: https://heartmula.github.io/
Note
- 32GB RAM recommended. 30GB+ storage recommended.
- macOS 15+: M-series chips required.
- Windows 10/11: NVIDIA GPU (12GB+ VRAM) recommended. Intel or AMD GPU compatibility unverified.
Team Introduction
HeartMuLa is developed by a team from the following universities and institutions:
- Peking University
- The Chinese University of Hong Kong
- Scale Global, Ario
- Independent Researchers
Find HeartMuLa in LM Downloader
Open LM Downloader, then click "Local Apps" in the left menu. You can see HeartMuLa in the app list. Click the HeartMuLa icon to go to the introduction page.
Click the Install Button. If you are installing an AI app with LM Downloader for the first time, you will be prompted with the installation directory.
Open the Installation Window, and HeartMuLa will be automatically installed. If you already have HeartMuLa installed, don't worry—this can be treated as an update to the latest version of HeartMuLa and won't affect the music works you've created before. Click the View Log button in the bottom right corner to expand the log interface and troubleshoot any issues during installation.
Run HeartMuLa
On the application details page, click the Run button on the right to open the execution window. Upon successful launch, your browser will open automatically.
Precision Options
In the execution window, you can choose different precision options to balance performance and quality:
| Precision Option | VRAM Requirement | Quality | Description |
|---|---|---|---|
| Auto Precision | Automatically adjusted based on hardware | Balanced | The system will automatically select the most suitable precision based on your hardware configuration |
| float16 Precision | ~16GB | Balanced | Balanced choice between performance and quality |
| bfloat16 Precision | ~12GB | Good | Compatible with newer GPUs only |
| int8 Precision | ~10GB | Average | Lower VRAM requirement |
| int4 Precision | ~8GB | Lower | Lowest VRAM requirement but also lowest quality |
| float32 Precision | ~24GB | Best | Best quality but highest VRAM requirement |
In the running window, you can see quick access to common directories such as "Music Works", "Lyric Files", and "Tag Library".
How to Write Lyrics?
Lyric Guidelines
- Clear Format: Use sections to separate different parts of the song (such as Verse, Chorus, Bridge, etc.)
- Consistent Rhythm: Keep the length and rhythm of each line of lyrics relatively consistent
- Emotional Expression: Express emotions through specific imagery and scenes, avoiding abstraction
- Concise Language: Use clear and concise language that is easy for listeners to understand and remember
- Reasonable Rhyme: Use rhyme appropriately, but don't sacrifice content for rhyme
Lyric Examples
Example 1: Pop Song
[Verse 1]
Morning sun shines through the window
I wake up from my dream
Thinking of your smile
My mood becomes bright
[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your side
[Verse 2]
Night stars are twinkling
I wander alone
Missing your tenderness
Looking forward to seeing you
[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your side
[Bridge]
Even if wind and rain come
Even if the road is long
With your company
I won't hesitate
[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your sideExample 2: Rock Song
[Verse 1]
City nights are noisy
I walk aimlessly on the street
Anger burns in my heart
Wanting to release all repression
[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bonds
[Verse 2]
Life's pressure suffocates me
Reality's cruelty makes me confused
But I won't give up easily
Because music is my belief
[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bonds
[Solo]
(Guitar solo)
[Bridge]
No matter what others say
No matter how hard the road is
I will stick to my dream
Until the end of the world
[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bondsHow to Use the Tag System?
As HeartMuLa is an open-source model trained on a large-scale multilingual dataset, its tag support logic differs slightly from Suno or Udio. It emphasizes semantic alignment through the HeartCLAP model to understand your natural language.
Based on the project's technical whitepaper and underlying architecture, here is a comprehensive breakdown of HeartMuLa's deeply supported tags, divided into five major categories: Structure, Genre, Mood, Vocal, and Instrumentation:
1. Structural Tags
These tags control the logical framework of the song and are typically placed within the lyrics or input through section control parameters.
| Tag | Function Description | Recommended Usage |
|---|---|---|
| [Intro] | Intro, usually instrumental or with minimal vocals. | Combine with style words, e.g., [Intro: Piano] |
| [Verse] | Verse, used to tell the story with a calmer rhythm. | [Verse 1], [Verse 2] |
| [Chorus] | Chorus, the climax of the song with the strongest melody. | [Chorus: Powerful] |
| [Bridge] | Bridge, the transition connecting chorus and verse, usually with melody changes. | [Bridge: Transition] |
| [Interlude] | Interlude, purely instrumental section. | [Interlude: Guitar Solo] |
| [Hook] | Hook, a short, highly catchy melody. | Place before or after chorus. |
| [Outro] | Outro, the end of the song, usually with fade out. | [Outro: Fade out] |
2. Genre Tags
HeartMuLa has excellent support for mainstream genres, especially strengthening popular styles for the Chinese, Japanese, and Korean (CJK) markets.
| Tag | Description | Examples |
|---|---|---|
| Pop | Pop music, including various sub-styles | Mandopop (Chinese pop), J-Pop, K-Pop, Synthpop, City Pop, Ballad (lyrical) |
| Rock | Rock music, including various sub-styles | Soft Rock, Punk, Alternative Rock, Heavy Metal |
| Jazz | Jazz music, including traditional and modern styles | Traditional Jazz, Modern Jazz, Fusion Jazz |
| Classical | Classical music, including various periods and styles | Baroque, Romanticism, Orchestral |
| Electronic | Electronic music, including various sub-styles | EDM, House, Techno, Trance, Lo-fi |
| Folk | Folk music, including traditional and modern styles | Traditional Folk, Modern Folk, Country Folk |
| Hip-hop | Hip-hop music, including rap and R&B | Rap, Trap, R&B |
| Blues | Blues music, including traditional and modern styles | Traditional Blues, Modern Blues |
| Reggae | Reggae music, originating from Jamaica | Traditional Reggae, Modern Reggae |
| Country | Country music, originating from the southern United States | Traditional Country, Modern Country |
3. Mood & Atmosphere Tags
These tags determine the emotional tone of the audio (controlled through HeartCLAP's semantic space).
| Tag | Description | Examples |
|---|---|---|
| Happy | Happy, positive emotion | Cheerful, joyful, excited |
| Sad | Sad, negative emotion | Melancholy, sorrowful, painful |
| Romantic | Romantic, warm and sweet emotion | Warm, sweet, affectionate |
| Energetic | Energetic, dynamic emotion | Dynamic, passionate, powerful |
| Calm | Calm, peaceful emotion | Peaceful, serene, relaxed |
| Melancholic | Melancholic, contemplative emotion | Contemplative, nostalgic, sentimental |
| Angry | Angry, intense emotion | Intense, irritable, rebellious |
| Hopeful | Hopeful, positive emotion | Positive, upward, bright |
| Mysterious | Mysterious,奇幻 emotion | Fantasy, unknown, eerie |
| Nostalgic | Nostalgic, recollection emotion | Recollection, retro, classic |
| Upbeat | Upbeat, cheerful emotion | Cheerful, lively, positive |
| Uplifting | Uplifting, inspiring emotion | Inspiring, motivating, positive |
| Peaceful | Peaceful, tranquil emotion | Tranquil, peaceful, calm |
| Depressing | Depressing, gloomy emotion | Gloomy, depressed, oppressive |
| Aggressive | Aggressive, intense emotion | Intense, combative, aggressive |
| Lonely | Lonely, isolated emotion | Lonely, helpless, isolated |
| Ambience | Ambience, environmental atmosphere | Immersive, environmental, spatial |
| Spacey | Spacey, cosmic atmosphere | Cosmic, spatial, sci-fi |
| Dreamy | Dreamy,虚幻 atmosphere | Dreamy,虚幻, hazy |
| Ethereal | Ethereal,超凡 atmosphere | Ethereal,超凡, transcendental |
| Wedding | Wedding, romantic and solemn atmosphere | Romantic, warm, solemn |
| Cinematic | Cinematic, dramatic atmosphere | Epic, dramatic, emotionally rich |
| Cyberpunk | Cyberpunk, futuristic atmosphere | Futuristic, technological, dark |
| Healing | Healing, warm and soothing atmosphere | Warm, soothing, comforting |
| Dark | Dark, mysterious and oppressive atmosphere | Mysterious, oppressive, horror |
| Bright | Bright, cheerful and positive atmosphere | Cheerful, positive, sunny |
| Party | Party, lively and cheerful atmosphere | Dynamic, lively, cheerful |
| Nature | Nature, peaceful and harmonious atmosphere | Peaceful, fresh, harmonious |
| Urban | Urban, modern and bustling atmosphere | Modern, bustling, fast-paced |
4. Vocal Tags
Due to HeartMuLa's powerful multilingual capabilities, its vocal control is very precise.
| Tag | Description | Examples |
|---|---|---|
| Male vocal | Male vocal, male tone and singing style | Deep, magnetic, powerful |
| Female vocal | Female vocal, female tone and singing style | High-pitched, sweet, gentle |
| Boy/Girl voice | Child voice, child tone and singing style | Innocent, pure, crisp |
| Whisper | Whisper, soft singing style | Soft, mysterious, intimate |
| Powerful | Powerful, explosive singing style | High-pitched, passionate, impressive |
| Airy | Airy, ethereal singing style | Ethereal, floating, fresh |
| Raspy | Raspy, rough singing style | Rough, weathered, textured |
| Smooth | Smooth, fluent singing style | Fluent, gentle, elegant |
| Energetic | Energetic, dynamic singing style | Dynamic, passionate, powerful |
| Emotional | Emotional, expressive singing style | Affectionate, sincere, touching |
| Harmonic | Harmonic, multi-layered singing style | Harmonious, multi-layered, rich |
| Breathy | Breathy, breathy singing style | Soft, delicate,感性 |
| Sweet | Sweet, gentle singing style | Gentle, cute, sweet |
| Husky | Husky, rough singing style | Deep, rough, magnetic |
| Vibrato | Vibrato, trembling singing technique | Vibrato, fluctuation, expressive |
| Falsetto | Falsetto, high-pitched singing technique | High-pitched, falsetto, ethereal |
| Syllabic | Syllabic, clear enunciation technique | Clear, accurate, powerful |
| Rap-singing | Rap-singing, combination of rap and singing | Rap, rhythm, fluent |
5. Instrumentation & Production Tags
You can explicitly specify a particular instrument as the lead.
| Tag | Description | Examples |
|---|---|---|
| Piano | Piano, keyboard instrument | Classical piano, jazz piano, pop piano |
| Grand Piano | Grand piano, large piano | Classical grand piano, concert piano |
| Electric Piano | Electric piano, electronic keyboard instrument | Electronic piano, synthetic piano |
| Synthesizer | Synthesizer, electronic instrument | Analog synthesizer, digital synthesizer |
| Guitar | Guitar, string instrument | Acoustic guitar, electric guitar, classical guitar |
| Acoustic Guitar | Acoustic guitar, unplugged guitar | Folk guitar, classical guitar |
| Electric Guitar | Electric guitar, amplified guitar | Rock guitar, jazz guitar |
| Violin | Violin, string instrument | Classical violin, electronic violin |
| Cello | Cello, string instrument | Classical cello, electronic cello |
| Drums | Drums, percussion instrument | Drum kit, electronic drums, percussion |
| Electronic Drums | Electronic drums, electronic percussion | Electronic drum kit, sampled drums |
| Percussion | Percussion, rhythm instrument | Hand drums, shakers, tambourines |
| Bass | Bass, low-frequency instrument | Electric bass, acoustic bass |
| Trumpet | Trumpet, brass instrument | Jazz trumpet, classical trumpet |
| Saxophone | Saxophone, woodwind instrument | Jazz saxophone, pop saxophone |
| Flute | Flute, woodwind instrument | Classical flute, jazz flute |
| High Fidelity | High fidelity, high-quality recording | High-quality, clear, detailed |
| Studio recording | Studio recording, professional recording | Professional, clear, balanced |
| Reverb | Reverb, sound effect processing | Spatial, echo, atmospheric |
| Compressed | Compressed, dynamic processing | Compact, powerful, balanced |
6. Tempo Tags
These tags are used to describe the speed and rhythm of the music.
| Tag | Description | Examples |
|---|---|---|
| Fast | Fast, relatively fast rhythm music | 120-180 BPM |
| Slow | Slow, relatively slow rhythm music | 60-90 BPM |
| Upbeat | Upbeat, cheerful and lively rhythm | 100-140 BPM |
| Relaxed | Relaxed, comfortable rhythm music | 70-100 BPM |
| Moderate | Moderate, medium rhythm music | 90-120 BPM |
| Very_fast | Very fast, extremely fast rhythm music | 180+ BPM |
| Very_slow | Very slow, extremely slow rhythm music | 60- BPM |
Tag Usage Tips
- Combine Tags: You can use multiple tags simultaneously to more accurately describe music characteristics
- Priority: Put the most important tags first
- Specificity: Try to use specific tags rather than overly broad ones
- Consistency: Maintain consistency in tag style within the same song
- Experimentation: Try different tag combinations to explore new music styles
Tag Examples
Example 1: Pop Song
female_vocal, pop, upbeat, happy, electronic, synthesizer, drumsExample 2: Rock Song
male_vocal, rock, energetic, fast, guitar, drums, bassExample 3: Ambient Music
atmospheric, calm, electronic, synthesizer, slow, healingExample 4: Jazz Song
jazz, smooth, romantic, saxophone, piano, moderateFAQ
Q: Which operating systems does HeartMuLa support?
A: HeartMuLa supports Windows and macOS operating systems. Currently, we have Windows and macOS two versions of the client. You can install HeartMuLa on Windows and macOS operating systems. If you have development experience, you can also deploy HeartMuLa on Linux. Refer to this source code repository: https://github.com/lmdown/heartlib-web-demo
Q: How to improve lyric quality?
A: You can refer to excellent lyric works, learn their structure and expression methods; at the same time, practice more, and continuously modify and improve your lyrics.
Q: Is it better to use more tags?
A: No, tags should be precise and accurate. Choose the tags that best represent the music characteristics, generally 5-8 tags are appropriate.
Q: Do I need music foundation to use HeartMuLa?
A: No, HeartMuLa is designed as a user-friendly tool that even beginners without music foundation can easily get started with.