Grok Imagine Video on AI Gateway

Source: Vercel Blog

Generate high-quality videos with natural motion and audio using xAI’s Grok Imagine Video, now in AI Gateway. Try it out via the v0 Grok Creative Studio, AI SDK 6, or by selecting the model in the AI Gateway playground.

Grok Imagine is known for realistic motion and strong instruction following:

• Fast Generation – creates clips in seconds rather than minutes
• Instruction Following – understands complex prompts and follow‑up instructions to tweak scenes
• Video Editing – transform existing videos by changing style, swapping objects, or altering scenes
• Audio & Dialogue – native audio generation with natural, expressive voices and accurate lip‑sync

Three ways to get started

Video generation is in beta and currently available for Pro and Enterprise plans and paid AI Gateway users.

• v0 Grok Creative Studio – a template powered by AI Gateway to create and showcase Grok Video and Image generations.
• AI SDK 6 – generate videos programmatically with generateVideo:

import { experimental_generateVideo as generateVideo } from 'ai';

const { videos } = await generateVideo({
  model: 'xai/grok-imagine-video',
  prompt: 'A golden retriever catching a frisbee mid-air at the beach',
});

• Gateway Playground – experiment with video models without code in the configurable AI Gateway playground. Compare providers, tweak prompts, and download results directly from the model list.

Available model

Simple: Text‑to‑Video

Generate a video from a text description. In this example, xai/grok-imagine-video creates a short clip of two swans. You can also specify the output duration.

import { experimental_generateVideo as generateVideo } from 'ai';

const { videos } = await generateVideo({
  model: 'xai/grok-imagine-video',
  prompt: `Two elegant white swans gliding on a misty lake at dawn, soft golden light,
           reflections on still water, romantic atmosphere, cinematic`,
  aspectRatio: '16:9',
  resolution: '1280x720',
  duration: 3,
});

Advanced: Reference‑to‑Video

Transform an existing video into a new style. This example takes a previously generated Grok Imagine Video and applies an animated watercolor look.

import { experimental_generateVideo as generateVideo } from 'ai';

const { videos } = await generateVideo({
  model: 'xai/grok-imagine-video',
  prompt: 'Transform into anime style, soft hand-painted look, warm dreamy atmosphere',
  providerOptions: {
    xai: {
      videoUrl: sourceVideo, // URL or identifier of the source video
    },
  },
});

Learn more

For additional examples and detailed configuration options, see the Video Generation Documentation. Simple getting‑started scripts are available in the Video Generation Quick Start.