VR Job Interview Simulator
[Unity, C#, VR, LLM]

Game Overview

An immersive virtual job interview simulator that recreates realistic job interview scenarios with the use of a LLM and generative AI. The player assumes the role of an job applicant entering a virtual interview room where an AI-driven interviewer, powered by ChatGPT, conducts a natural and adaptive conversation. The simulator supports multiple industries and job difficulty levels (entry, mid, senior), while tailoring questions and feedback relevant to the player's performance. Through voice interaction and behavioural analysis, the AI evaluates communication skills, confidence, and engagement. The experience aims to provide a practice tool for interview training by blending VR immersion with intelligent AI-driven dialogues.

Genres

Virtual Reality
First-Person
LLM

Project Type

Individual

Development Features

Dialogue and Event System

Built a modular asynchronous AI dialogue system integrating ChatGPT with JSON-based prompt templates and dynamic interviewer responses.

VR Interaction Framework

Built core interaction systems using Unity's XR Interaction Toolkit, integrating hand tracking, motion controls, and spatial audio for immersive player experiences.

VR Tablet and Quiz System

Designed and developed an in-world VR tablet that appears after the oral interview stage, featuring a fully interactive quiz with UI navigation, input handling, progress tracking, and event-driven state transitions.

Data Recording and Analytics

Implementing pipelines to capture gaze direction, voice activity, response timing, and interaction metrics for AI evaluation.

AI Feedback and Analytics

Developing a generative feedback module where the LLM produces communication and behavioral evaluations after each session.

Scalability and Design Flexibility
Built systems supporting multiple industries and job levels (entry, mid, senior) with customizable scenarios and AI questioning templates.

Technical Highlights

Custom event-driven architecture controlling interview flow
(Oral --> Quiz --> Evaluation).

Asynchronous ChatGPT wrapper with retry logic, session memory, and response parsing.

VR Tablet built with world-space UI, interactable buttons, and XR ray interactor logic.

Modular JSON prompt system allowing the addition of new industries or job difficulty levels easily.

Profile and LLM Integration

This code configures the AI interviewer based on the player's chosen industry and seniority level (entry, mid, senior). It dynamically builds a system prompt and sends it to the ChatGPT client, which drives the entire conversation. Every player response is sent back to the LLM, and the reply is spoken in-game using Google Text-to-Speech.

AI-Generated Quiz (MCQ)

Instead of hard-coding questions, I use ChatGPT to generate multiple choice questions at runtime based on the selected industry and level.

Sends a strict JSON schema to the LLM to ensure the response is machine-parsable.

Requests a custom number of questions, each with four options and a correct index.

Deserializes and validates the result into a string MCQ list used by the in-game tablet UI.

Voice-Driven Input

This code handles push-to-talk voice input in VR. The system records audio from the microphone, converts it to WAV, sends it to OpenAI's Whisper model for transcription, and forwards the recognized text to the AI interviewer.

Voice-Driven Input

Uses Unity's input system for XR push-to-talk behavior.

Handles microphone recording, trimming, and conversion to WAV.

Integrates with OpenAI Whisper via HTTP multipart form data.

Pipes the transcript straight into the exsting ChatGPT TTS pipeline.

Page updated

Google Sites

Report abuse

VR Job Interview Simulator [Unity, C#, VR, LLM]