Walkabout Mini Golf: Baked Light, Shader Flashlight
Performant FX for mobile VR platforms
Brief: Mobile VR like the Quest 1 and Quest 2 are very limited hardware and couldn’t allow for complex visuals and would drive myself and others to come up with simple solutions to get close to a desired look with cheap tricks. Oftentimes we would pull old-school game dev tricks into VR to get a desired look that would perform on mobile.
Essentially instead of using real-time lights in a scene that was impossible to run with hardware limitations, without letting go of the art style, we decided to develop a way to use a spotlight or point light as a reference for data that was shared to the shader to then create a mask version of said light we could feed in and use “real-time” as a fake shader light effect.
We attached these reference lights to all 8 players in a multiplayer match and fed them into the shader, so everyone saw flashlights that looked real-time but were driven entirely by the shader.
One key point of this effect was missing. What about areas where we wanted flashlights but also wanted to “light” the scene normally.
Hence: Lighting the level with RGB light
Here you can see behind the curtain of the level on screen left where we want the player to end and see the vista in ambient light, but also on the right side where the player starts in almost pure darkness and needs to rely on their “flashlight” to navigate and play.
We decided to guide our lighting artist to actually “light” the level not with typical colored light but with RGB light so we could extract those channels to use in the overall effect of the level.
Extracting the Red channel to use mostly for the “flashlight” mask so that as the player moved into more “lit” areas they can still have somewhat of a flashlight effect but still enjoy the ambient light they could see. Green and Blue channels gave an extra level of finesse when it came to lighting and how much the flashlight would also influence that light.
The shader light trick now runs through the red light channel in the lightmaps to accomplish the effect required. We could then light areas that are solely using “flashlight” with RED light and other areas that use mixes of GREEN and BLUE.
Widow’s Walkabout Film Noir Hard Mode
This DLC course was directed to be a black and white NOIR effect to contrast with the already spooky Easy mode lighting. Knowing we only needed to light in one channel gave me the idea we could light in all three RGB channels. So to push the idea of a haunted stormy night in black and white, the course was lit with overall BLUE light for the ambient color. Then a very bright RED light was cast onto the entire level from where the lightning flashes would be. With the GREEN channel I used a real-time shader light from Journey as a way to sweep light across a clue to reveal a hint.
I pulled all of that together in shader to create the fake real-time lightning look you get throughout a level with only baked lights and a mask. The creative solution to make the vision work even helped the ideas in the foxhunt to incorporate the level VFX into the clue.