Renderer & Capability Specification

Complete technical reference for the server-side Vulkan GPU compositor, motion graphics library, effects pipeline, and AI orchestration layer. Every capability listed here is implemented in production code — not planned or in development.

128+
Motion graphic types
33
Transition effects
21
VFX / shader effects
118+
Canonical AI actions
Architecture: Preview runs on WebGPU / WGSL in the browser. Export runs on Vulkan / SPIR-V server-side. Both share the same .wgsl shader source — compiled to SPIR-V for Vulkan, consumed natively by WebGPU — so preview and export output are pixel-identical. Hardware video decode via NVDEC, encode via NVENC, zero-copy CUDA → Vulkan texture pool for ML inference results.
🎬
Post-Processing Pipeline
Dedicated shader pass per effect — same pipeline for preview (WebGPU) and export (Vulkan)

Lighting & Global Illumination

  • Screen-space global illumination (SSGI) — ssgi.frag
  • Screen-space ambient occlusion (SSAO) — ssao.frag
  • Volumetric god rays — godrays.frag
  • Surface reflections — reflection.frag
  • Lens flare — flare.frag
  • Ambient lighting (per-layer color temperature)

Bloom & Glow

  • Multi-pass bloom — bright extract → 5-level downsample → upsample → composite
  • Glow blur — glow_blur.frag
  • Glow composite — glow_composite.frag
  • Drop shadow composite — shadow_composite.frag
  • Inner shadow pass

Camera & Lens

  • Depth of field / bokeh — dof.frag
  • Chromatic aberration — ca.frag
  • Vignette — vignette.frag
  • Motion blur — shutter angle + sample count, keyframe-animated
  • Adjustment layers — adjustment.frag

Color & Grading

  • LUT color grading — lut.frag
  • 3-way color wheels (lift / gamma / gain)
  • 12 cinematic preset looks
  • Film grain — grain.frag
  • Mesh gradient / aurora — meshgrad.frag
  • Parametric brightness, contrast, saturation, hue, temperature
  • Waveform / vectorscope scopes — scopes.comp

Compositing

  • WBOIT — weighted, order-independent transparency
  • 17 blend modes: Normal, Multiply, Screen, Overlay, Darken, Lighten, Color Dodge, Color Burn, Hard Light, Soft Light, Difference, Exclusion, Hue, Saturation, Color, Luminosity, Additive
  • Mask types: Luma, Alpha, Inverse Luma, Inverse Alpha, LUT, Depth, Chroma
  • Glassmorphism / frosted glass composite

Hardware Pipeline

  • NVDEC hardware video decode (zero-CPU decode path)
  • NVENC hardware H.264 & H.265 encode
  • Zero-copy CUDA → Vulkan texture pool (ML inference → compositor)
  • SSAA (super-sampled anti-aliasing, device-tiered)
  • Compute shaders for GPU-parallel operations
VFX & Procedural Effects
21 named effects, all keyframe-animated with intensity / speed / size / spread controls
Smoke / Dust / Steam / Mist / Fog Fire Explosion / Glimmer Portal Lightning Lava Snow Bokeh Glitch Telomere Corrosion Scanlines / CRT / VHS Film Grain Glassmorphism / Frosted Glass Halftone Dots Gooey / Metaball / Liquid Holographic / Iridescent Kaleidoscope Dithering / Bayer Perspective Tunnel / Wormhole Aurora / Mesh Gradient Light Sweep / Shine / Gloss
⚛️
GPU Compute Particle Physics
Physics simulated on GPU via WGSL compute shaders — real particle dynamics, not sprite animations
Rain — rain.wgsl Snow — snow.wgsl Dust / Embers — dust.wgsl Portal vortex — portal.wgsl Noise field — noise.wgsl Physics engine — physics.wgsl (velocity, drag, life, gravity)
🔀
Transitions
33 transition types — all directional (8 directions), with optional neon edge glow composited on the seam

Basic

  • Fade
  • Slide (8 directions)
  • Wipe
  • Iris
  • Zoom
  • Blur Fade
  • Cross Dissolve
  • Whip Pan
  • Zoom Blur

Cinematic

  • Dip to Black
  • Dip to White
  • Luma Fade
  • Glitch
  • Spin Blur
  • Spin
  • RGB Split
  • VHS Static
  • Film Dissolve
  • Glow Dissolve
  • Directional Blur

Geometric / Pattern

  • Radial Wipe
  • Barn Door
  • Checkerboard
  • Gradient Wipe
  • Venetian Blinds
  • Star Wipe
  • Bowtie Wipe
  • Pixelate Dissolve
  • Ripple Warp
  • Lens Distort
  • Polka Dots
  • Perlin Dissolve
  • Kaleidoscope
✍️
Text & Caption Rendering
MSDF / SDF rendering — pixel-perfect at any size, with 10 SDF visual modes and per-character animation

SDF Text Modes (10)

  • Plain — clean fill at any scale
  • Outline — configurable border color & width
  • Drop Shadow
  • Outline + Shadow
  • Outer Glow
  • Inner Glow
  • Dual Glow / Neon Tube
  • Striped fill
  • Landscape gradient
  • Overload (multi-color)

Per-Character Animation

  • Typewriter
  • Slide Up / Down / Left / Right
  • Fade In
  • Scale In
  • Rotate In
  • Bounce In
  • Flip In
  • Karaoke word-highlight (synced to word timings)
  • 25+ built-in caption templates
📐
3D & Spatial Transforms
Per-layer 3D transforms via Mat4 — perspective camera, axis rotation, Z translation
Perspective camera Rotate X / Y / Z axis Translate Z (depth) 3D scene / mesh loading (Scene3D) Parallax 2.5D camera push card.flip (3D card flip animation) title.extrude_3d (extruded text)
🎭
Animation Runtimes
Lottie via Skia/Skottie on Vulkan GPU backend — full spec support. Rive runtime also integrated.

Skottie / Lottie (Skia + Vulkan)

  • Full Lottie spec: trim paths, repeaters, blend modes, expressions
  • GPU-first via Skia Vulkan backend — zero-copy VkImage
  • Bundled catalog of 158 accent-grade Lottie assets
  • LLM-generated concept Lotties (procedural builder)
  • SVG → Lottie transpiler (nested groups, transforms, opacity)

Rive

  • Rive runtime integrated via rive_player.rs
  • State machine + timeline animations
  • GPU-accelerated rendering on Vulkan
🎨
Motion Graphics Library — 128+ Types
All LLM-selectable, all animated, all rendered by the Vulkan compositor. Organized across 5 capability phases.
📊

Charts & Data Visualization

8 types
chart.bar_grow chart.line_reveal chart.pie_segment chart.icon_array_waffle chart.dashboard chart.bar_race chart.sankey_flow chart.treemap
🔗

Diagrams & Process

5 types
diagram.explainer diagram.schematic diagram.equation process.flowchart process.decision_tree
📋

Lists & Comparisons

5 types
list.numbered_steps list.bullet_stagger compare.vs_card compare.split_screen compare.checklist
✍️

Captions & Kinetic Subtitles

4 types
caption.word_pop caption.keyword_highlight caption.supersize caption.emoji_burst
🔤

Kinetic Typography & Titles

15 types
text.paragraph text.word_swap text.echo_stack text.on_path text.typewriter_prompt text.glitch_reveal text.stretch text.mirror text.cascade text.neon_glow text.word_reveal title.section_card title.mega_type title.blend_overlay title.extrude_3d
🛍️

Product / SaaS / Pitch Deck

8 types
mockup.browser mockup.phone product.callout product.hero_reveal pricing.tiers feature.grid logo.cloud social.testimonial
📈

Stats & Data Callouts

8 types
stat.counter stat.big_number stat.percentage_ring stat.comparison_bar stat.trend_arrow stat.growth_chart stat.leaderboard stat.multi_metric
🌍

Geo & Maps

4 types
geo.country_highlight geo.route_draw geo.map_zoom_pin geo.globe_spin
🖼️

Media & Imagery

4 types
media.broll_card media.video_card media.annotated_photo media.double_exposure
💬

Quotes, Attribution & Lower Thirds

3 types
quote.callout source.card name.lower_third
▶️

CTA / Engagement / YouTube / HUD

8 types
cta.subscribe_button cta.engagement_bar poll.choice_card hud.scoreboard progress.chapter_bar timer.countdown youtube.info_card_teaser youtube.end_screen_layout

FX / Ambient / Backgrounds

10 types
fx.radial_pulse fx.confetti_burst fx.gradient_sweep fx.color_blocks fx.filter fx.particles fx.lens_flare fx.audio_waveform bg.gradient_morph bg.blob_gradient
🪟

Glass / UI / Motion Devices

8 types
layout.glass_card layout.glass_menu layout.social_notification layout.ticker_tape layout.composition button.liquid_glass button.glass_toggle card.flip
🎥

Cinematic & Depth

2 types
scene.parallax_3d focus.pointer_highlight
🔧

Utility

5 types
concept.icon_lottie logo.reveal_stroke privacy.blur_region time.timeline_marker none
🤖
AI Orchestration Layer
118+ canonical actions across 10 PowerPacks — typed IR → deterministic DAG → verified execution

Planning & Execution

  • LLM emits typed intent IR
  • Deterministic DAG compiler (60+ task kinds)
  • Bounded repair loop (max 2 attempts)
  • Post-run typed verifier
  • Typed failure codes + auto-repair

Perception (GPU)

  • Face detection + ArcFace embeddings
  • Speaker diarization
  • GroundingDINO object detection
  • RVM neural background matting
  • Depth estimation
  • Text detection + OCR
  • Shot detection + beat analysis

Export & Delivery

  • H.264, H.265, WebM
  • 4K UHD, 1440p, 1080p, 720p, 480p
  • TikTok, Reels, Shorts, YouTube, LinkedIn, Instagram
  • SRT / VTT subtitle export
  • Audio mastering to EBU R128 LUFS
  • Pre-export delivery check
OpenClaw is the agent interface to this renderer.
One natural-language brief → typed IR → DAG → Vulkan compositor → verified export.
No timeline. No keyframes. No app required.