Project overview
This project was a Proof of Concept (POC) demonstrating an innovative immersive attraction: transforming a real bus into a dynamic simulator. Developed using Unreal Engine, the experience takes passengers (primarily children) on a virtual jungle tour, viewed through monitors replacing the bus windows. The simulation features interactive driving via a Logitech steering wheel (or autopilot mode) and includes exciting scripted events like a T-Rex encounter. A core technical achievement was the implementation of Unreal Engine’s nDisplay plugin to seamlessly map the virtual world across multiple physical screens.
The Challenge
The client needed a compelling demonstration to secure investment for their unique bus simulator concept. The technical challenges were significant for a POC:
- Multi-Display Synchronization: Accurately configuring and synchronizing multiple monitors (representing bus windows) to display a cohesive, perspective-correct view of the virtual world using Unreal Engine’s nDisplay.
- Immersive Environment Creation: Building an engaging and visually appealing jungle environment optimized for real-time performance across multiple displays.
- Interactive Control System: Implementing both manual driving controls responsive to a physical Logitech steering wheel/pedals and keyboard, alongside a smooth autopilot navigation system.
- Dynamic Event Scripting: Creating and triggering engaging events (like the T-Rex appearance) reliably within the simulation.
- Hardware Integration: Ensuring seamless communication between Unreal Engine and the external Logitech steering hardware.
- Delivering a Polished Demo: Creating a convincing and stable experience within the constraints of a POC budget and timeline.
My Role
As the Unreal Engine Developer for this Proof of Concept, I was responsible for the entire technical development and implementation of the Bus Experience Simulator. My key contributions included:
- Designing and building the interactive 3D jungle environment in Unreal Engine and also creating 3D assets with 3ds max.
- Programming the bus physics and driving mechanics, integrating input from both Logitech steering wheel/pedals and keyboard.
- Developing the autopilot functionality for automated tours.
- Scripting the T-Rex encounter and other potential environmental events using Blueprints and C++.
- Configuring, calibrating, and implementing Unreal Engine’s nDisplay plugin to correctly project the virtual camera views onto the multi-monitor setup, simulating the bus windows.
- Optimizing the entire simulation for smooth, real-time performance across the distributed rendering setup.
The Solution
I delivered a fully functional Proof of Concept showcasing the immersive potential of the bus simulator:
- Seamless Multi-Screen Immersion (nDisplay): Successfully configured Unreal Engine’s nDisplay to distribute the rendered scene across multiple monitors, creating a wrap-around “window” effect that accurately reflected the virtual environment from the passengers’ perspective inside the bus.
- Engaging Unreal Engine Environment: Created a vibrant jungle setting with pathways suitable for the bus tour and specific locations for scripted events.
- Dual Control Modes: Implemented responsive driving controls using the Logitech G-series wheel/pedals for manual operation, alongside a reliable autopilot mode for guided tours.
- Dynamic Scripted Encounter: Developed a triggered event featuring a T-Rex appearing near the bus, adding excitement and demonstrating dynamic content possibilities.
- Robust Hardware Integration: Ensured stable communication and input handling from the Logitech peripherals within the Unreal Engine environment.
Results / Outcome
This Proof of Concept successfully demonstrated the technical feasibility and high potential of the immersive bus simulator idea. Key outcomes:
- Validated the Core Concept: Proved that a compelling multi-screen simulator experience could be created using Unreal Engine and nDisplay within a bus-like setup.
- Showcased Technical Capability: Highlighted the power of Unreal Engine for creating interactive, high-fidelity simulations with complex display requirements.
- Provided a Powerful Fundraising Tool: Equipped the client with a tangible, impressive demo to present to potential investors and stakeholders.
- Delivered an Engaging Experience: Created a simulation with interactive controls and dynamic events suitable for capturing the imagination of the target audience.
