Unity · Companion · Device prototype
UbiquityVX
A companion that listens, reacts and turns toward you.
Unity client engineering across live audio, companion state, expressive visuals and a physically mounted iOS device.
- My role
- Lead Unity client developer
- Platform
- Unity · iOS · DockKit
- Project context
- Prototype & device integration
Session events
Responsive visuals
DockKit tracking
Unity client work, in collaboration with a separate backend team.
01Owning the Unity client
I led the Unity client work for the UbiquityVX companion, collaborating with a separate backend team. The client connects conversation sessions, visual behaviour and device movement within one application.
This work covered the implemented prototype and device integration, including live-service and mock/test paths for development.
02Keeping the session connected
The client handles session lifecycle, WebRTC audio and event sockets. These connections carry the audio and events used by the companion experience.
A centralized companion state and emotion system connects incoming events to the client’s behaviour, rather than leaving each visual or device feature to interpret the session independently.
03Coordinating expression and motion
My work included voice-responsive shader visuals and state-driven companion expression. These are part of the client experience, coordinated with the conversation state.
An iOS native bridge and DockKit integration connect the phone to gimbal tracking. The mounted device turns toward the viewer to support eye contact while remaining part of the physical companion setup.