SAN FRANCISCO, CA – freebeat, an AI music video platform, has launched a new feature positioning it as an innovator in lyric visualization. The company has served over one million creators across 150+ countries, generating more than one billion seconds of beat-synced content.
The new ai lyrics video maker moves beyond traditional captioning to embed animated song lyrics directly into the fabric of a video scene. Instead of sitting on top of the footage, the lettering appears as part of the visual world.
When a user uploads a song, the platform’s AI listens to the track and identifies the lyrics. It then designs a visual environment based on the music’s mood and structure. The lyrics appear within this environment, matching the scene’s lighting, perspective, and camera motion.
This approach means the lettering is not a static layer. It can appear as if it is part of a character’s clothing, etched onto a wall, or floating in the air, with textures and materials that match the surrounding visual aesthetic. The company states this process is fully generative and does not rely on a library of templates.
For decades, creating a lyrics video involved editors manually timing text animations to an audio track. The process was often limited to simple text effects on a flat plane. freebeat’s new feature attempts to treat the lyrics as a core part of the cinematic direction, rather than an add-on.
freebeat was founded by Stanford alumni Bruce Chen, a former Macquarie banker; Henry Fan, previously a vice president at Morgan Stanley; and Richie Liu, a chief technology officer who formerly managed a product at Baidu with what the company describes as five million daily active users.
The company’s approach has gained industry attention, including a profile in Forbes covering its real-time video engine and a strategic role as an official Yamaha Creator Pass partner, integrating its tools into the music company’s global creator ecosystem.
The underlying technology begins by analyzing the entire song for its structural components, including tempo, energy curve, and beat grid. The AI then generates a background film and a custom typographic treatment for the lyrics, ensuring both are thematically connected to the music.
According to the company, its sung-word recognition engine achieves over 98% accuracy. To handle the remaining margin of error, the system presents all detected lyrics to the user in an editable list before any video is generated, allowing for manual corrections.
“Our goal has always been to make music seen, not just heard,” said Bruce Chen, co-founder and CEO of freebeat. “With lyrics, the words are as much a part of the song as the melody. This tool treats them that way, making them actors in the scene, not just subtitles.”
The platform’s workflow is broken into distinct, reviewable stages. Users can approve the AI’s creative brief, preview individual clips, and request revisions on specific segments without having to restart the entire generation process. For faster results, an “Auto mode” can produce a finished video in approximately 10 minutes, the company says.
“We are building a proprietary taste intelligence that understands audio-visual synergy,” explained Henry Fan, co-founder and COO. “This new feature is guided by the same core principle, using our reinforcement learning flywheel to develop an intuitive grip on pacing, visual cuts, and how typography can amplify a song’s emotional arc.”
The launch comes as other major players in the generative video space, such as Runway, continue to focus on general-purpose, text-to-video models. freebeat has maintained its focus on the music vertical, building specialized tools that treat audio as the primary creative input.
“The technical challenge isn’t just placing text in a 3D space; it’s making it feel like it belongs there,” said Richie Liu, co-founder and CTO. “The system has to reason about lighting, physics, and motion to ensure the letters interact with the environment believably. It’s a multi-layered generative task, running concurrently.”
Whether this integrated approach to lyrics will become a new standard for creators or a niche tool for more ambitious projects will depend on its adoption. The company is betting that by automating the most technically demanding parts of the process, it can unlock a more cinematic form of lyric video for a wider audience.
About freebeat
freebeat is a music-first AI video creation platform founded by Stanford alumni. According to the company, its platform serves over a million creators in more than 150 countries.
###
Media Contact
Company: RANDOM MOTION TECHNOLOGY INC
Contact Person: Henry Fan
Email: Send email
Website: freebeat.ai
