Skip to content

Install HeartMuLa Locally with LM Downloader

HeartMuLa is a powerful music creation tool that supports multiple music styles and genres, allowing you to easily create, edit, and generate music works.

HeartMuLa supports multilingual functionality, including but not limited to English, Chinese, Japanese, Korean, and Spanish, meeting the needs of global users.

If you have some development experience, you can download the source code from GitHub and deploy it locally. Alternatively, you can use LM Downloader to deploy HeartMuLa locally with one click—the entire process is fully automated, perfect for beginners, and supports both Mac and Windows.

Note

  • 32GB RAM recommended. 30GB+ storage recommended.
  • macOS 15+: M-series chips required.
  • Windows 10/11: NVIDIA GPU (12GB+ VRAM) recommended. Intel or AMD GPU compatibility unverified.

Team Introduction

HeartMuLa is developed by a team from the following universities and institutions:

  • Peking University
  • The Chinese University of Hong Kong
  • Scale Global, Ario
  • Independent Researchers

Find HeartMuLa in LM Downloader

Open LM Downloader, then click "Local Apps" in the left menu. You can see HeartMuLa in the app list. Click the HeartMuLa icon to go to the introduction page.

Click the Install Button. If you are installing an AI app with LM Downloader for the first time, you will be prompted with the installation directory.

Open the Installation Window, and HeartMuLa will be automatically installed. If you already have HeartMuLa installed, don't worry—this can be treated as an update to the latest version of HeartMuLa and won't affect the music works you've created before. Click the View Log button in the bottom right corner to expand the log interface and troubleshoot any issues during installation.

Run HeartMuLa

On the application details page, click the Run button on the right to open the execution window. Upon successful launch, your browser will open automatically.

Precision Options

In the execution window, you can choose different precision options to balance performance and quality:

Precision OptionVRAM RequirementQualityDescription
Auto PrecisionAutomatically adjusted based on hardwareBalancedThe system will automatically select the most suitable precision based on your hardware configuration
float16 Precision~16GBBalancedBalanced choice between performance and quality
bfloat16 Precision~12GBGoodCompatible with newer GPUs only
int8 Precision~10GBAverageLower VRAM requirement
int4 Precision~8GBLowerLowest VRAM requirement but also lowest quality
float32 Precision~24GBBestBest quality but highest VRAM requirement

In the running window, you can see quick access to common directories such as "Music Works", "Lyric Files", and "Tag Library".

How to Write Lyrics?

Lyric Guidelines

  1. Clear Format: Use sections to separate different parts of the song (such as Verse, Chorus, Bridge, etc.)
  2. Consistent Rhythm: Keep the length and rhythm of each line of lyrics relatively consistent
  3. Emotional Expression: Express emotions through specific imagery and scenes, avoiding abstraction
  4. Concise Language: Use clear and concise language that is easy for listeners to understand and remember
  5. Reasonable Rhyme: Use rhyme appropriately, but don't sacrifice content for rhyme

Lyric Examples

Example 1: Pop Song

[Verse 1]
Morning sun shines through the window
I wake up from my dream
Thinking of your smile
My mood becomes bright

[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your side

[Verse 2]
Night stars are twinkling
I wander alone
Missing your tenderness
Looking forward to seeing you

[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your side

[Bridge]
Even if wind and rain come
Even if the road is long
With your company
I won't hesitate

[Chorus]
You are my sunshine
Lighting up my heart
No matter where and when
I'll always be by your side

Example 2: Rock Song

[Verse 1]
City nights are noisy
I walk aimlessly on the street
Anger burns in my heart
Wanting to release all repression

[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bonds

[Verse 2]
Life's pressure suffocates me
Reality's cruelty makes me confused
But I won't give up easily
Because music is my belief

[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bonds

[Solo]
(Guitar solo)

[Bridge]
No matter what others say
No matter how hard the road is
I will stick to my dream
Until the end of the world

[Chorus]
Rock and roll!
Let music ignite my soul
Rock and roll!
Let the shout break all bonds

How to Use the Tag System?

As HeartMuLa is an open-source model trained on a large-scale multilingual dataset, its tag support logic differs slightly from Suno or Udio. It emphasizes semantic alignment through the HeartCLAP model to understand your natural language.

Based on the project's technical whitepaper and underlying architecture, here is a comprehensive breakdown of HeartMuLa's deeply supported tags, divided into five major categories: Structure, Genre, Mood, Vocal, and Instrumentation:

1. Structural Tags

These tags control the logical framework of the song and are typically placed within the lyrics or input through section control parameters.

TagFunction DescriptionRecommended Usage
[Intro]Intro, usually instrumental or with minimal vocals.Combine with style words, e.g., [Intro: Piano]
[Verse]Verse, used to tell the story with a calmer rhythm.[Verse 1], [Verse 2]
[Chorus]Chorus, the climax of the song with the strongest melody.[Chorus: Powerful]
[Bridge]Bridge, the transition connecting chorus and verse, usually with melody changes.[Bridge: Transition]
[Interlude]Interlude, purely instrumental section.[Interlude: Guitar Solo]
[Hook]Hook, a short, highly catchy melody.Place before or after chorus.
[Outro]Outro, the end of the song, usually with fade out.[Outro: Fade out]

2. Genre Tags

HeartMuLa has excellent support for mainstream genres, especially strengthening popular styles for the Chinese, Japanese, and Korean (CJK) markets.

TagDescriptionExamples
PopPop music, including various sub-stylesMandopop (Chinese pop), J-Pop, K-Pop, Synthpop, City Pop, Ballad (lyrical)
RockRock music, including various sub-stylesSoft Rock, Punk, Alternative Rock, Heavy Metal
JazzJazz music, including traditional and modern stylesTraditional Jazz, Modern Jazz, Fusion Jazz
ClassicalClassical music, including various periods and stylesBaroque, Romanticism, Orchestral
ElectronicElectronic music, including various sub-stylesEDM, House, Techno, Trance, Lo-fi
FolkFolk music, including traditional and modern stylesTraditional Folk, Modern Folk, Country Folk
Hip-hopHip-hop music, including rap and R&BRap, Trap, R&B
BluesBlues music, including traditional and modern stylesTraditional Blues, Modern Blues
ReggaeReggae music, originating from JamaicaTraditional Reggae, Modern Reggae
CountryCountry music, originating from the southern United StatesTraditional Country, Modern Country

3. Mood & Atmosphere Tags

These tags determine the emotional tone of the audio (controlled through HeartCLAP's semantic space).

TagDescriptionExamples
HappyHappy, positive emotionCheerful, joyful, excited
SadSad, negative emotionMelancholy, sorrowful, painful
RomanticRomantic, warm and sweet emotionWarm, sweet, affectionate
EnergeticEnergetic, dynamic emotionDynamic, passionate, powerful
CalmCalm, peaceful emotionPeaceful, serene, relaxed
MelancholicMelancholic, contemplative emotionContemplative, nostalgic, sentimental
AngryAngry, intense emotionIntense, irritable, rebellious
HopefulHopeful, positive emotionPositive, upward, bright
MysteriousMysterious,奇幻 emotionFantasy, unknown, eerie
NostalgicNostalgic, recollection emotionRecollection, retro, classic
UpbeatUpbeat, cheerful emotionCheerful, lively, positive
UpliftingUplifting, inspiring emotionInspiring, motivating, positive
PeacefulPeaceful, tranquil emotionTranquil, peaceful, calm
DepressingDepressing, gloomy emotionGloomy, depressed, oppressive
AggressiveAggressive, intense emotionIntense, combative, aggressive
LonelyLonely, isolated emotionLonely, helpless, isolated
AmbienceAmbience, environmental atmosphereImmersive, environmental, spatial
SpaceySpacey, cosmic atmosphereCosmic, spatial, sci-fi
DreamyDreamy,虚幻 atmosphereDreamy,虚幻, hazy
EtherealEthereal,超凡 atmosphereEthereal,超凡, transcendental
WeddingWedding, romantic and solemn atmosphereRomantic, warm, solemn
CinematicCinematic, dramatic atmosphereEpic, dramatic, emotionally rich
CyberpunkCyberpunk, futuristic atmosphereFuturistic, technological, dark
HealingHealing, warm and soothing atmosphereWarm, soothing, comforting
DarkDark, mysterious and oppressive atmosphereMysterious, oppressive, horror
BrightBright, cheerful and positive atmosphereCheerful, positive, sunny
PartyParty, lively and cheerful atmosphereDynamic, lively, cheerful
NatureNature, peaceful and harmonious atmospherePeaceful, fresh, harmonious
UrbanUrban, modern and bustling atmosphereModern, bustling, fast-paced

4. Vocal Tags

Due to HeartMuLa's powerful multilingual capabilities, its vocal control is very precise.

TagDescriptionExamples
Male vocalMale vocal, male tone and singing styleDeep, magnetic, powerful
Female vocalFemale vocal, female tone and singing styleHigh-pitched, sweet, gentle
Boy/Girl voiceChild voice, child tone and singing styleInnocent, pure, crisp
WhisperWhisper, soft singing styleSoft, mysterious, intimate
PowerfulPowerful, explosive singing styleHigh-pitched, passionate, impressive
AiryAiry, ethereal singing styleEthereal, floating, fresh
RaspyRaspy, rough singing styleRough, weathered, textured
SmoothSmooth, fluent singing styleFluent, gentle, elegant
EnergeticEnergetic, dynamic singing styleDynamic, passionate, powerful
EmotionalEmotional, expressive singing styleAffectionate, sincere, touching
HarmonicHarmonic, multi-layered singing styleHarmonious, multi-layered, rich
BreathyBreathy, breathy singing styleSoft, delicate,感性
SweetSweet, gentle singing styleGentle, cute, sweet
HuskyHusky, rough singing styleDeep, rough, magnetic
VibratoVibrato, trembling singing techniqueVibrato, fluctuation, expressive
FalsettoFalsetto, high-pitched singing techniqueHigh-pitched, falsetto, ethereal
SyllabicSyllabic, clear enunciation techniqueClear, accurate, powerful
Rap-singingRap-singing, combination of rap and singingRap, rhythm, fluent

5. Instrumentation & Production Tags

You can explicitly specify a particular instrument as the lead.

TagDescriptionExamples
PianoPiano, keyboard instrumentClassical piano, jazz piano, pop piano
Grand PianoGrand piano, large pianoClassical grand piano, concert piano
Electric PianoElectric piano, electronic keyboard instrumentElectronic piano, synthetic piano
SynthesizerSynthesizer, electronic instrumentAnalog synthesizer, digital synthesizer
GuitarGuitar, string instrumentAcoustic guitar, electric guitar, classical guitar
Acoustic GuitarAcoustic guitar, unplugged guitarFolk guitar, classical guitar
Electric GuitarElectric guitar, amplified guitarRock guitar, jazz guitar
ViolinViolin, string instrumentClassical violin, electronic violin
CelloCello, string instrumentClassical cello, electronic cello
DrumsDrums, percussion instrumentDrum kit, electronic drums, percussion
Electronic DrumsElectronic drums, electronic percussionElectronic drum kit, sampled drums
PercussionPercussion, rhythm instrumentHand drums, shakers, tambourines
BassBass, low-frequency instrumentElectric bass, acoustic bass
TrumpetTrumpet, brass instrumentJazz trumpet, classical trumpet
SaxophoneSaxophone, woodwind instrumentJazz saxophone, pop saxophone
FluteFlute, woodwind instrumentClassical flute, jazz flute
High FidelityHigh fidelity, high-quality recordingHigh-quality, clear, detailed
Studio recordingStudio recording, professional recordingProfessional, clear, balanced
ReverbReverb, sound effect processingSpatial, echo, atmospheric
CompressedCompressed, dynamic processingCompact, powerful, balanced

6. Tempo Tags

These tags are used to describe the speed and rhythm of the music.

TagDescriptionExamples
FastFast, relatively fast rhythm music120-180 BPM
SlowSlow, relatively slow rhythm music60-90 BPM
UpbeatUpbeat, cheerful and lively rhythm100-140 BPM
RelaxedRelaxed, comfortable rhythm music70-100 BPM
ModerateModerate, medium rhythm music90-120 BPM
Very_fastVery fast, extremely fast rhythm music180+ BPM
Very_slowVery slow, extremely slow rhythm music60- BPM

Tag Usage Tips

  1. Combine Tags: You can use multiple tags simultaneously to more accurately describe music characteristics
  2. Priority: Put the most important tags first
  3. Specificity: Try to use specific tags rather than overly broad ones
  4. Consistency: Maintain consistency in tag style within the same song
  5. Experimentation: Try different tag combinations to explore new music styles

Tag Examples

Example 1: Pop Song

female_vocal, pop, upbeat, happy, electronic, synthesizer, drums

Example 2: Rock Song

male_vocal, rock, energetic, fast, guitar, drums, bass

Example 3: Ambient Music

atmospheric, calm, electronic, synthesizer, slow, healing

Example 4: Jazz Song

jazz, smooth, romantic, saxophone, piano, moderate

FAQ

Q: Which operating systems does HeartMuLa support?

A: HeartMuLa supports Windows and macOS operating systems. Currently, we have Windows and macOS two versions of the client. You can install HeartMuLa on Windows and macOS operating systems. If you have development experience, you can also deploy HeartMuLa on Linux. Refer to this source code repository: https://github.com/lmdown/heartlib-web-demo

Q: How to improve lyric quality?

A: You can refer to excellent lyric works, learn their structure and expression methods; at the same time, practice more, and continuously modify and improve your lyrics.

Q: Is it better to use more tags?

A: No, tags should be precise and accurate. Choose the tags that best represent the music characteristics, generally 5-8 tags are appropriate.

Q: Do I need music foundation to use HeartMuLa?

A: No, HeartMuLa is designed as a user-friendly tool that even beginners without music foundation can easily get started with.