MakeNTU2024: CaRPG

1st place of AUO Enterprise Award.

Introduction

CaRPG is an in-car RPG game designed for interactive smart window. Users can choose their favorite theme of story to play with, and the players' behaviors/choices during the game will affect the story’s direction. Sometimes players may encounter battles, they need to shoot all the monsters and beat them to win the fight. There might also be some random events when the camera catches something unusual (e.g. a monkey), the element the camera caught would then join the story and make it more immersive.

Key Features

1. Customizable and Interactive Stories.
2. Random Events (related to the environment).
3. Gesture-Based Shooting Game.
4. Maintain Travel Records.

Techniques

Storyteller

• Flutter
• TTS (Text to Speech), ASR (Auto Speech Recognition)

Backend Server

• Fast API
• OpenAI GPT Assistants
• Database(MongoDB)

Game

• Gesture Capture and Recognition
• Self-Trained Pytorch Models
• Pygame

Future Work

• More interactive games
• Augmented Reality
• Story Restoration