30 秒视频,50+ 参考图。 立即体验
Seedance 2.0 音频工作流

Seedance 2.0 音频参考不生效?

尝试这套黑屏视频工作流,让 Seedance 2.0 在口型同步、MV 制作和角色视频中更精准地遵循参考音频。

问题

音频参考可能在节奏和间隔上出现偏移。

解决方法

将音频片段用作黑屏视频输入。

问题所在

音频参考听起来相似,但仍会偏移

Seedance 2.0 原生支持音频参考,但直接用音频作为参考,可能导致生成音频与原始音频出现明显差异,音乐场景尤为明显。

输入音频与 Seedance 输出波形对比 1
输出结果听起来可能相似,但节奏和间隔可能不同。
输入音频与 Seedance 输出波形对比 2
使用黑屏视频作为参考,能让输出结果与输入音频更加一致。
核心工作流

将音频转换为黑屏视频

关键解决方案很简单:把每段音频转换成黑屏视频,然后将该黑屏视频作为 Seedance 2.0 的输入。

展示音频在 Seedance 生成前转换为黑屏视频的工作流程
01

准备素材

先准备原始音频、清晰的角色形象参考,以及定义预期口型同步的歌词或台词。

02

拆分音频

由于 Seedance 2.0 支持的视频时长不超过 15 秒,请将较长的音乐或对白拆分成多个短片段。

03

将每个片段转换为黑屏视频

创建带原始音轨的黑屏 MP4。这会把音频转换为 Seedance 能更精准跟随的视频输入。

04

用 Seedance 2.0 生成

将黑屏视频作为输入参考,并保持输出时长与输入视频时长严格一致。

素材

准备音频、歌词和形象参考

Seedance 音频指南角色参考

原始音频

歌词

Waking up to golden light. Coffee warm and feeling right.

Birds are singing just for me. Living life so wild and free.

This is my beautiful life. Every moment shining bright.

Dancing through the ups and downs. Wearing joy like a crown.

Beautiful life, oh yeah. Beautiful life

关键步骤:在用作 Seedance 2.0 视频参考之前,先将每段音频转换为黑屏 MP4。
转换

创建黑屏视频

你可以用 FFmpeg 创建,也可以使用 CapCut 等视频编辑器,将音频片段放在黑色画布上并导出为 MP4。

FFmpeg 命令示例
ffmpeg -f lavfi -i color=c=black:s=1280x720:r=24 -i clip1_audio.mp3 -shortest -c:v libx264 -c:a aac clip1.mp4
效果展示

黑屏输入 vs Seedance 输出对比

每个片段都以黑屏视频作为参考输入,然后让 Seedance 2.0 驱动图片中的主角,实现严格的唇形同步。

01

woo~

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, creating an overall light, lively, and sunny atmosphere. Lip-sync is strictly synchronized: "woo~ woo~"

黑屏视频

输出视频

02

Waking up to golden light. Coffee warm and feeling right.

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, change the outfit and background, and create an overall light, lively, and sunny atmosphere. Lip-sync strictly: "Waking up to golden light. Coffee warm and feeling right."

黑屏视频

输出视频

03

Birds are singing just for me. Living life so wild and free.

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, change the outfit and background, and create an overall light, lively, and sunny atmosphere. Lip-sync strictly: "Birds are singing just for me. Living life so wild and free."

黑屏视频

输出视频

04

This is my beautiful life

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, change the outfit and background, and create an overall light, lively, and sunny atmosphere. Lip-sync strictly: "This is my beautiful life"

黑屏视频

输出视频

05

Every moment shining bright. Dancing through the ups and downs. Wearing joy like a crown.

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, change the outfit and background, and create an overall light, lively, and sunny atmosphere. Lip-sync strictly: "Every moment shining bright, Dancing through the ups and downs. Wearing joy like a crown."

黑屏视频

输出视频

06

woo~ Beautiful life, oh yeah Beautiful life.

黑屏参考视频与 Seedance 2.0 输出

提示词

Use the audio from @Video 1 to drive the protagonist in @Image 1 to generate an MV with multiple shots, change the outfit and background, and create an overall light, lively, and sunny atmosphere. Lip-sync strictly: "woo~ Beautiful life, oh yeah Beautiful life"

黑屏视频

输出视频

最终成品

唇形同步视频与原始音频合成后的最终成品

输出音频与输入音频并非 100% 一致,但一致性已经足够高,能有效降低 MV 制作中后期调整的成本。

在 Seedance 2.0 上体验音频工作流。

将音频片段转换为黑屏视频参考,然后在 SeeGen AI 上生成一致性更高的唇形同步视频。

免费试用 Seedance 2