​
RhythmCraft: AI-Powered Music Generation with Timestamps

Compose music synchronized with your lyrics by providing timestamped text and reference audio!

​
Overview

RhythmCraft is an AI tool that specializes in generating music based on timestamped lyrics and a reference audio track. This allows for precise synchronization between the vocals (represented by the timestamped lyrics) and the generated music. It’s perfect for musicians, producers, or anyone wanting to create music where the timing of the vocals is a critical element.

Timestamped Lyrics

Generate music that aligns precisely with the timing of your lyrics.

Reference Audio

Influence the musical style and structure using a reference audio file or URL.

AI Composition

Generate a complete audio track synchronized with your lyrics.

Timestamp Generation

Tool to help you add timestamps to your lyrics automatically.

​
How to Use RhythmCraft

Follow these steps to generate music with RhythmCraft:

Enter Timestamped Lyrics

Input your song lyrics into the Lyrics text area. Your lyrics must include timestamps in the format [MM:SS.ms] at the beginning of each line or section you want timed.

Example Timestamped Lyrics:

[00:05.25] This is the first line
[00:08.00] And this is the second line
[00:12.50] Starting a new verse here

Generate Timestamps (Optional)

If your lyrics do not have timestamps, click the Generate Timestamps button. This opens a modal where you can set parameters (like start time, line interval, and section interval) to automatically add timestamps to your lyrics. Review the preview and click Apply Timestamps to use the generated timestamps.

Provide Reference Audio

Choose how to provide reference audio:

  • Upload Reference Audio: Click Choose File to upload an audio file from your device (MP3 or WAV recommended).
  • Reference Audio URL: Enter the URL of an existing audio file online.

Adjust Parameters

Configure the generation settings using the sliders:

  • Number of Inference Steps: Controls the detail and refinement of the music.
  • Max Frames: Sets the maximum length or complexity of the generated audio.

Generate Music

Click the Generate Music button. Ensure you have enough credits (20 credits per song). The AI will generate the music synchronized with your timestamped lyrics and influenced by the reference audio.

​
Input Parameters and Options

RhythmCraft requires timestamped lyrics and a reference audio source, along with adjustable parameters:

​
Lyrics
string
required

Your song lyrics, including timestamps in [MM:SS.ms] format.

​
Generate Timestamps Button
button

Opens a modal to automatically add timestamps to your lyrics.

​
Upload Reference Audio
file

Upload an audio file from your device to use as a reference. Accepts audio formats like WAV, MP3. Max file size 50MB.

​
Reference Audio URL
string
required

Enter the URL of an audio file to use as a reference. Accepts .wav or .mp3 formats.

​
Number of Inference Steps
integer

Controls the number of processing steps for music generation. Default: 32 | Range: 1-100

​
Max Frames
integer

Influences the maximum length and complexity of the generated audio. Default: 2048 | Range: 1024-2048 (steps of 64)

​
Timestamp Generation Settings

When using the Generate Timestamps button, you can configure the following:

​
Song History

RhythmCraft keeps a history of your generated songs for easy access.

​
Credits

Generating music with RhythmCraft costs 20 credits per song. Your current credit balance is displayed at the top left of the interface.

Click the Buy More button to purchase additional credits if needed.

​
Tips for Best Results

Accurate Timestamps

Ensure your timestamps accurately reflect the desired timing of the lyrics in the music. Use the timestamp generator or manually edit for precision.

Relevant Reference Audio

Choose a reference audio track with a musical style or structure that complements your lyrics and desired rhythm.

Experiment with Parameters

Adjust Inference Steps and Max Frames to explore different musical outcomes and lengths.

Clear Lyrics

Provide clear, well-formatted lyrics to help the AI process them correctly, especially when generating timestamps.

​
Troubleshooting

If you encounter issues with RhythmCraft, consider these solutions:

​
Conclusion

RhythmCraft offers a unique approach to AI music generation by focusing on the synchronization of music with timestamped lyrics. By providing precise timing information and a reference audio track, you can create custom music that perfectly complements your vocal ideas.