RhythmCraft: AI-Powered Music Generation with Timestamps
Compose music synchronized with your lyrics by providing timestamped text and reference audio!
Overview
RhythmCraft is an AI tool that specializes in generating music based on timestamped lyrics and a reference audio track. This allows for precise synchronization between the vocals (represented by the timestamped lyrics) and the generated music. It’s perfect for musicians, producers, or anyone wanting to create music where the timing of the vocals is a critical element.
Timestamped Lyrics
Generate music that aligns precisely with the timing of your lyrics.
Reference Audio
Influence the musical style and structure using a reference audio file or URL.
AI Composition
Generate a complete audio track synchronized with your lyrics.
Timestamp Generation
Tool to help you add timestamps to your lyrics automatically.
How to Use RhythmCraft
Follow these steps to generate music with RhythmCraft:Enter Timestamped Lyrics
Input your song lyrics into the Lyrics text area. Your lyrics must include timestamps in the format
[MM:SS.ms]
at the beginning of each line or section you want timed.Example Timestamped Lyrics:Generate Timestamps (Optional)
If your lyrics do not have timestamps, click the Generate Timestamps button. This opens a modal where you can set parameters (like start time, line interval, and section interval) to automatically add timestamps to your lyrics. Review the preview and click Apply Timestamps to use the generated timestamps.
Provide Reference Audio
Choose how to provide reference audio:
- Upload Reference Audio: Click Choose File to upload an audio file from your device (MP3 or WAV recommended).
- Reference Audio URL: Enter the URL of an existing audio file online.
Adjust Parameters
Configure the generation settings using the sliders:
- Number of Inference Steps: Controls the detail and refinement of the music.
- Max Frames: Sets the maximum length or complexity of the generated audio.
Generate Music
Click the Generate Music button. Ensure you have enough credits (20 credits per song). The AI will generate the music synchronized with your timestamped lyrics and influenced by the reference audio.
Input Parameters and Options
RhythmCraft requires timestamped lyrics and a reference audio source, along with adjustable parameters:Your song lyrics, including timestamps in
[MM:SS.ms]
format.Opens a modal to automatically add timestamps to your lyrics.
Upload an audio file from your device to use as a reference. Accepts audio formats like WAV, MP3. Max file size 50MB.
Enter the URL of an audio file to use as a reference. Accepts .wav or .mp3 formats.
Controls the number of processing steps for music generation.
Default: 32 | Range: 1-100
Influences the maximum length and complexity of the generated audio.
Default: 2048 | Range: 1024-2048 (steps of 64)
Timestamp Generation Settings
When using the Generate Timestamps button, you can configure the following:Start Time (seconds)
Start Time (seconds)
Sets the timestamp for the first line of lyrics.
Line Interval (seconds)
Line Interval (seconds)
Sets the default time interval between consecutive lines of lyrics.
Section Interval (seconds)
Section Interval (seconds)
Adds extra time between detected sections (like verses or choruses) in your lyrics.
Song History
RhythmCraft keeps a history of your generated songs for easy access.View History
View History
Click the Show History tab on the right side of the screen to open the history sidebar.
Download Songs
Download Songs
Download individual songs as WAV files.
Clear History
Clear History
Clear all generated songs from your history.
Download All
Download All
Download all songs in your history as a ZIP file.
Credits
Generating music with RhythmCraft costs 20 credits per song. Your current credit balance is displayed at the top left of the interface.Click the Buy More button to purchase additional credits if needed.
Tips for Best Results
Accurate Timestamps
Ensure your timestamps accurately reflect the desired timing of the lyrics in the music. Use the timestamp generator or manually edit for precision.
Relevant Reference Audio
Choose a reference audio track with a musical style or structure that complements your lyrics and desired rhythm.
Experiment with Parameters
Adjust Inference Steps and Max Frames to explore different musical outcomes and lengths.
Clear Lyrics
Provide clear, well-formatted lyrics to help the AI process them correctly, especially when generating timestamps.
Troubleshooting
If you encounter issues with RhythmCraft, consider these solutions:Music Doesn't Sync with Lyrics
Music Doesn't Sync with Lyrics
Double-check that your lyrics have correctly formatted timestamps
[MM:SS.ms]
. Ensure the timestamps are in chronological order.Poor Music Quality
Poor Music Quality
Try increasing the Number of Inference Steps. Experiment with a different reference audio track.
Processing Errors
Processing Errors
Ensure your reference audio file is in a supported format and within the size limit if uploading. Check your internet connection.
Timestamp Generation Issues
Timestamp Generation Issues
Ensure your raw lyrics (before generating timestamps) are clearly separated by line breaks. Adjust the interval settings in the timestamp generator modal.