Sprayscape

A perfectly imperfect vr-ish camera app.
An experiment in PHOTOGRAPHY AND FREE EXPRESSION in virtual reality. Patent#US10127632

OCTOBER 2016

VR is cool. Taking pictures is cool. Why not try smashing the two together?

Sprayscape is a quick hack using the phone’s gyroscope to take pictures on the inside of a 360-degree sphere. Just point your phone and tap the screen to spray faces, places, or anything else onto your canvas. Like what you’ve captured? Share your creations via a link and your friends can jump into your scapes and have a look around using their phones or even Google Cardboard.

Sprayscape is built in Unity with native Android support. Sprayscape maps the camera feed on a 360 degree sphere, using the Cardboard SDK to handle gyroscope data and the NatCam Unity plugin for precise camera control.

The GPU makes it all possible. On user tap or touch, the camera feed is rendered to a texture at a rate of 60 frames per second. That texture is then composited with any existing textures by a fragment shader on the GPU. That same shader also creates the scape you see in app, handling the projection from 2D camera to a 360 sphere.

When a user saves a scape, a flat panorama image is stored in the app data. When a user shares a scape, the three.js web viewer takes that flat image and wraps it to a sphere, making it navigable on mobile web by panning, tilting, and moving your device.

Patent#US10127632

ROLE

Product Manager
Interaction Designer
Creative
Film Producer

LINKS

Read about it on the Google blog

Get the open-source code on GitHub

CREDITS

Troy Lumpkin, Brian Kehrer, Glenn Cochon, Brendon Avalos, Dan Motzenbecker, Jonas Jongejan, Chris Kim, Jeramy Morrill, Mathew Ray, Hook Studios

Previous
Previous

new interaction models and new experiences in WebVR

Next
Next

an interactive sign for Google NYC made of 5880 light-up arcade buttons