Skip to main content

ByteDance Lip Sync is ByteDance's video lip-sync service, part of its video translation tools, with Lite for frontal single-speaker footage and Basic for complex single-speaker scenes. It returns audio-timed MP4 at 25 fps.

From $0.048/s

Workbench

Send a request

Quickstart

Examples use the selected endpoint’s public parameter definitions. Replace the API key and example media, then send the request from your server.

SDKs & integrations
POSThttps://api.spicyapi.ai/api/v1/jobs/createTask

API authentication

Keep the API key in the server environment variable SPICY_API_KEY. Use Bearer authentication and Content-Type: application/json for JSON requests.

Authorization: Bearer $SPICY_API_KEY
Sample outputUse this example
# Generate the idempotency key once; reuse it when retrying after a lost response.
export SPICY_IDEMPOTENCY_KEY="${SPICY_IDEMPOTENCY_KEY:-$(uuidgen)}"
curl -X POST https://api.spicyapi.ai/api/v1/jobs/createTask \
  -H "Authorization: Bearer $SPICY_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $SPICY_IDEMPOTENCY_KEY" \
  -d '{
  "model": "bytedance/lip-sync/lip-sync",
  "input": {
    "audio_url": "https://example.com/reference.mp3",
    "generation_mode": "lite",
    "video_url": "https://example.com/reference.mp4"
  }
}'

# Copy data.taskId from the response into TASK_ID, then poll the status.
TASK_ID="TASK_ID_FROM_RESPONSE"
curl "https://api.spicyapi.ai/api/v1/jobs/recordInfo?taskId=$TASK_ID" \
  -H "Authorization: Bearer $SPICY_API_KEY"

Generated from this model’s input schema — the same one the API validates every request against.

Input parameters

Place these fields inside the request body’s input object. Names and types match the API. Do not assume a default when none is specified.

audio_urlstringRequiredAffects price

Required for either profile, with no default: clean human speech in MP3, WAV, AAC, M4A, or OGG, up to 10 MB. Duration must exceed 1 second and stay within 240 seconds for Lite or 210 for Basic. This duration sets billed seconds after upward rounding and determines the intended output length.

Default
Not specified
Constraints
minLength:1
format:"uri"
contentMediaType:["audio/mpeg","audio/wav"]
video_urlstringRequired

Required in Lite and Basic, with no default: provide MOV, MP4, or MKV at 360p–1080p, 24–60 fps, and 1–30 Mbps. H.264 is recommended. Above-1080p video is reduced to 1080p and below-360p input is rejected. Its length does not set the billed seconds.

Default
Not specified
Constraints
minLength:1
format:"uri"
contentMediaType:["video/mp4","video/webm","video/quicktime"]
video_start_secondsnumberOptional

Optional numeric source position for Lite, default 0 seconds. Choose a starting point within the supplied video; omit this field in Basic. Starting later changes picture selection, while the full uploaded recording still sets billed audio seconds.

Default
0
Constraints
minimum:0
maximum:3600
loop_reversebooleanOptional

Optional Lite boolean, default false; meaningful with loop_video enabled. Repeated footage alternates between forward and reverse playback. Omit in Basic. Direction changes do not alter the chargeable audio duration.

Default
false
loop_videobooleanOptional

Optional Lite boolean, default true. Repeats footage to cover speech that runs longer than the video. Omit this field when using Basic, even when carrying settings over from a Lite request; uploaded audio remains the billing measure.

Default
true
scene_detectionbooleanOptional

Optional Basic boolean, default false. Enables scene detection and speaker recognition for its single-speaker workflow. Do not enable it in Lite, where that combination is rejected before processing. It does not alter the audio-second rate.

Default
false
remove_background_noisebooleanOptional

Optional Lite boolean, default false. Separates background sound from the recording before mouth alignment. Omit the field in Basic: that combination is rejected at acceptance after three failed Basic test attempts informed the restriction. Audio-second billing is unchanged.

Default
false
generation_modestringOptional

Optional selector accepting lite or basic, default lite. Lite targets frontal single-speaker video; Basic targets complex single-speaker scenes. Selecting Basic changes the compatible controls and audio ceiling, with no rate difference.

Default
"lite"
Allowed values
"lite""basic"

Track the task

HTTP 202 means the task was accepted, not completed. Save the returned taskId and query that task. Do not create another task while waiting for its result.

Accepted response
HTTP/1.1 202 Accepted
Location: /api/v1/jobs/recordInfo?taskId=job_01k3m8x9q2z4v7n5p6r8s0t1w3

{
  "code": 200,
  "msg": "success",
  "request_id": "req_example_create",
  "data": {
    "taskId": "job_01k3m8x9q2z4v7n5p6r8s0t1w3",
    "state": "queued",
    "estimatedCost": "0.750000"
  }
}

The accepted response includes the estimate so your app can show the same amount in task history and billing.

Read the job
curl --get "https://api.spicyapi.ai/api/v1/jobs/recordInfo" \
  --data-urlencode "taskId=$TASK_ID" \
  -H "Authorization: Bearer $SPICY_API_KEY"

Start polling at about 2 seconds and gradually increase the interval. Stop at a terminal state. After a connection failure, query the original taskId. Retry creation only with the original idempotency key and body.

Or let the callback find you
import { verifyWebhook } from "@spicyapi/sdk";

// express.raw keeps the bytes we signed; express.json never matches.
app.post("/hooks/spicy", express.raw({ type: "application/json" }), (req, res) => {
  const { payload } = verifyWebhook({
    rawBody: req.body,
    timestamp: req.header("X-Webhook-Timestamp"),
    signature: req.header("X-Webhook-Signature"),
    payloadVersion: Number(req.header("X-Webhook-Payload-Version")),
    secret: process.env.SPICY_WEBHOOK_SECRET,
  });
  res.status(200).end();
  void handleFinishedTask(payload);
});

Pass callBackUrl when you create the task and the finished record is POSTed to you — no polling loop at all. Every delivery carries X-Webhook-Timestamp, X-Webhook-Signature and X-Webhook-Payload-Version. The signature is a base64 HMAC-SHA256 over taskId.timestamp.sha256(body), so it must be checked against the raw bytes: parsing the JSON and re-serialising it changes them and the check will fail. Failed deliveries are retried, so the same taskId can arrive twice — make the handler idempotent. Answer 2xx first and do the work afterwards; a slow handler is treated as a failed delivery.

Read the result

Consume output only when state is succeeded. On failure, use errorCode, errorMessage and request_id to investigate. Example costs and states do not represent an actual bill.

Completed response example
{
  "code": 200,
  "msg": "success",
  "request_id": "req_example_record",
  "data": {
    "taskId": "job_01k3m8x9q2z4v7n5p6r8s0t1w3",
    "model": "bytedance/lip-sync/lip-sync",
    "state": "succeeded",
    "output": {
      "assets": [
        {
          "key": "tasks/2026/08/28/job_01k3m8x9q2z4v7n5p6r8s0t1w3/3f7a1c9e5b2d48f0a6c1e3d5b7f9a1c3.mp4",
          "mime": "video/mp4",
          "url": "https://example.r2.cloudflarestorage.com/results/job_01k3m8x9q2z4v7n5p6r8s0t1w3/result.mp4?X-Amz-Signature=SIGNATURE_FROM_RESPONSE",
          "expiresAt": "2026-08-28T12:20:08.000Z"
        }
      ]
    },
    "cost": "0.750000",
    "settled": true,
    "createdAt": "2026-08-28T12:00:00Z",
    "completedAt": "2026-08-28T12:00:30Z"
  }
}

For each available asset, open or download assets[].url directly without an API Authorization header. The signed URL expires at expiresAt; poll the task again to refresh it while the asset remains within its retention period. A pending or unavailable asset has no URL. Treat signed URLs as private.

SDKs & integrations

Use SpicyAPI in your app, terminal, AI assistant or visual workflow. Choose a setup guide below.

Use it in ComfyUI

Install the SpicyAPI nodes from ComfyUI Manager or with the command below, then search for ByteDance Lip Sync · Lip Sync a Video to New Audio on the canvas. The node has the same options as this page and shows its price before it runs.

cd ComfyUI/custom_nodes
git clone https://github.com/spicyapi-ai/comfyui-spicyapi