Mike Swanson's Blog • Encoding Spatial Video

submited by

Style Pass

2024-03-28 19:00:06

As I mentioned in my prior post about Spatial Video, the launch of the Apple Vision Pro has reignited interest in spatial and immersive video formats, and it’s exciting to hear from users who are experiencing this format for the first time. The release of my spatial video command-line tool and example spatial video player has inadvertently pulled me into a lot of fun discussions, and I’ve really enjoyed chatting with studios, content producers, camera manufacturers, streaming providers, enthusiasts, software developers, and even casual users. Many have shared test footage, and I’ve been impressed by a lot of what I’ve seen. In these interactions, I’m often asked about encoding options, playback, and streaming, and this post will focus on encoding.

To start, I’m not an Apple employee, and other than my time working at an immersive video startup (Pixvana, 2016-2020), I don’t have any secret or behind-the-scenes knowledge. Everything I’ve written here is based on my own research and experimentation. That means that some of this will be incorrect, and it’s likely that things will change, perhaps as early as WWDC24 in June (crossing my fingers). With that out of the way, let’s get going.