GameRealm: Grounding Visual Learning in Interactive Games

GitHub Technical Report Huggingface Pi4 Explore demos
GameRealm / Research previewCONCEPT VISUALIZATION

OBSERVE. INTERACT. UNDERSTAND.

A world beyond
the frame.

From interactive worlds to grounded intelligence.

Games · Geometry · Intelligence

GameRealm Dataset

GameRealm brings together diverse game environments, multiple viewpoints, and multimodal observations, including RGB, depth, camera parameters, point tracks, audio, text, and control inputs.

Content Diversity

Interaction

Video to be added

Select a video from the thumbnails above.

Viewpoint Diversity

Multi-View video

Video to be added.

Modality Diversity

Finetuned Models Based on GameRealm

Explore models finetuned on GameRealm for interactive world modeling and visual geometry learning, with demonstrations of action-conditioned video generation, 3D reconstruction, and point tracking.

World Model (Finetuned Helios)

Multi-View World Model (Finetuned Helios)

Panoramic World Model (Finetuned LTX-2.0)

CONTINUE EXPLORING

Project resources

Research materials will be linked here as they become available.