Skip to content

sandraschi/worldlabs-mcp

Repository files navigation

FastMCP Version Ruff Linted with Biome Built with Just

worldlabs-mcp (v0.4.0)

MCP gateway to World Labs Marble + Spark 2.0. Generate navigable 3D worlds from text, images, panoramas, multi-view sets, or video; view them with a streaming Gaussian-splat renderer; and ground a voice agent in scene coordinates.

🚀 Quick Start

  1. Setup: uv pip install -e ".[dev]"
  2. Key: Set WORLDLABS_API_KEY environment variable (get one at https://platform.worldlabs.ai/api-keys).
  3. Launch: python scripts/run_server.py

🏛️ Core Engines (v0.4.0)

  • Marble (LWM): The Large World Model foundation. Generatively persistent reconstructed worlds with coordinate consistency.
  • Spark 2.0 (Renderer): Hierarchical LoD splat trees with virtual GPU memory paging. Handles 100M+ primitives.
  • Chisel (Geometry): Geometric distillation pipeline for extracting watertight physics proxies and triangular meshes from radiance fields.

💎 Features

Shipping

  • Marble 1.1 + 1.1-plus world generation from text, image, multi-image, video, or local file upload.
  • Spark 2.0 Spatial Engine — High-fidelity Gaussian-splat streaming (.rad / .spz) with hierarchical LoD and virtual GPU paging.
  • Industrial Toolbox: Persistent Scene Baking (Persistence), Blender DCC Handshake, and Sovereign Art Gallery.
  • Plex Cinema: Authenticated media streaming from plex-mcp to in-world 5.5m cinematic surfaces.
  • Sovereign Command Console: Interactive 3D terminal with live CPU/MEM/VRAM hardware telemetry.
  • World Portals: Seamless TORUS-frame world jumping with procedural "Latent Ripple" shaders.
  • Spatial Voice Agent: Integrated WebAudio HRTF (Gemini 3.1 Flash TTS) for coordinate-grounded narration.

Under Refinement

  • Automatic Grounding: Chisel-based raycast physics for complex imported Blender meshes.
  • DCC Live Link: Real-time transformation sync between Blender and the Spark Viewer.

📚 Documentation

🛠️ Tools (16)

Group Tool
generate generate_world_from_text, generate_world_from_image, generate_world_from_multi_image, generate_world_from_video, generate_world_from_media_asset
upload upload_and_generate, prepare_media_upload
poll get_operation, wait_for_world
world list_worlds, get_world
spatial broadcast_spatial_notification, broadcast_spatial_audio, place_world_tv, spawn_agent_avatar
meta worldlabs_help

🛡️ Quality

Ruff for Python, Biome for Web, Just for automation. Pytest + pytest-httpx for the Marble wrapper. FastMCP 3.2+ with Prefab UI for in-chat rich tool results.


MIT License • Maintained by sandraschi. Not affiliated with World Labs.

About

FastMCP 3.2 server and webapp wrapping the World Labs Marble API — generate navigable 3D worlds from text, images, and video

Topics

Resources

Contributing

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors