Download OZO Live: General user guide

O Z O
U s e r
L I V E
G u i d e
Introduction
OZO Live enables the revolutionary Nokia OZO VR Camera to be used for live VR broadcasts. It is
a software product, running on GPU-assisted reference hardware, which converts the
compressed 1.5Gb/sec HD-SDI signal from the OZO into either a standard 4K UHD video signal
for live post-production, delivered via quad-link HD-SDI, or an RTMP uplink to a cloud delivery
service. OZO Live provides advanced real-time stitching functionality, spatial audio processing,
color correction, h.264 encoding, and a variety of advanced options in a powerful and easy-touse package.
OZO Live is designed for professional broadcast production use. It supports three primary
deployment modes: (1) single-camera workflow with direct RTMP uplink; (2) single-camera
workflow to a single external broadcast encoder, and (3) multi-camera workflows with full
production switching and sound reinforcement. A typical single-camera workflow is diagrammed
below:
PAGE 1
U s i n g
O Z O
L i v e
OZO Live runs as two separate services: a core processing service, which performs the real-time
video and audio processing functions, and a web service, which presents a graphical user
interface to any browser. In a default installation, both services start automatically on system
boot; the GUI operates as a service (ozo-live-web) running on standard HTTP port 80, which
communicates with the core service (ozo-live-daemon) using port 30000.
Users may interact with OZO Live using either the web service or a command-line interface -however, certain features are available only through the command-line interface. As the OZO
Live team continues to develop the product, features will generally appear first in the commandline interface before being enabled in the web GUI. For these reasons we strongly recommend
that OZO Live operators familiarize themselves with both control modes.
Operating OZO Live from a Web Browser
To access the OZO Live GUI, simply point your web browser at the IP address of the OZO Live
server. The GUI provides easy, touch-enabled control over much of the functionality of OZO Live,
and has been tested on a range of browsers including Chrome, Firefox and Safari mobile.
PAGE 2
Broadcast Controls tab
The Broadcast Controls tab provides access to the basic settings for control of the OZO Live
server. These settings cannot be changed while the server is running; they require a restart.
Typically they are set at the start of a production and do not change over the course of a live
event.
The options available are outlined below.
PAGE 3
Output
As of version 1.3, OZO Live now enables either direct video output over SDI or an encoded video
bitstream via RTMP. Click the "Change Output" button to switch between these options.
For RTMP output, you may enter the target uplink URL and the target bitrate. Please refer to the
section on "RTMP Delivery Settings" for information on how to connect directly to distribution
services such as YouTube 360, Akamai, or others.
For SDI output, OZO Live will automatically choose the available 4K SDI output device, whether
Aja or Blackmagic.
Please note that the current version does not support simultaneous SDI and RTMP output. This
will be supported in a future release.
Frame Rate
The OZO camera runs at a fixed 30fps. OZO Live enables alternate frame rate output in order to
support downstream equipment. These rates are supported with simple frame removal or
doubling.
Supported rates on AJA output cards are 29.97, 30, 59.94, and 60. Blackmagic output cards
currently only support 29.97 and 30fps.
Video Format
OZO Live outputs a UHD 3840x2160 frame over quad-link HD-SDI or 6G-SDI. The specific
projection format used in the visual output can be switched among several options. For most
third-party players, the equirectangular projection in either mono or "top/bottom" stereo is
recommended.
OZO Live uses the four "equatorial" lenses on the OZO to create a stereoscopic output. 3
cameras are used for monoscopic output.
Supported video output formats include:
Monoscopic 360°, equirectangular projection
Stereoscopic 360°, top/bottom, equirectangular projection
Stereoscopic 180°, left/right, equirectangular projection
Monoscopic 360°, Lambert projection
Stereoscopic 360°, top/bottom, Lambert projection
Stereoscopic 180°, left/right, Lambert projection
Monoscopic 360° cube map
PAGE 4
Audio Format
OZO Live contains an audio processing subsystem which can convert the 8 microphone signals
from the OZO into a number of output formats. Output is at 48kHZ, 24bit per SDI standard.
5.0 Surround (L,R,C,SL,SR)
Stereo (L,R)
8-ch pass-through
The first two options run the 8 microphone signals from the OZO Camera through an OZO Audio
processor built into the OZO Live software. This processor processes and downmixes all 8
microphones into either the 5.1 or stereo output format.
The Bypass option passes all inputs through. It can be used to pass external audio signals
embedded into the input, or raw OZO microphone signals (not recommended).
All audio is delayed within OZO Live and kept in sync with the video pipeline delay.
PAGE 5
Video Processing tab
The Video Processing tab enables control over color correction, white balance, denoising and
sharpening. These settings are typically made at the beginning of a live event, but may be
changed on-the-fly.
PAGE 6
Color Correction
OZO Live enables color correction of the entire visual frame as well as for the individual images
from the four OZO Camera lenses which are stitched into the full frame. Due to OZO Live's
multiband blending capability, in most cases, it is not necessary to adjust color balance of
individual lenses; however, if your scene has a very large imbalance of light sources across
sensors (e.g. if there is bright sun on only one side) it may be useful to modify color levels at the
per-lens level. For global and per-lens operation, the user interface is the same.
Enabling the "Link" button allows levels to be simultaneously modified across the three R/G/B
channels. Alternatively, a single channel may be selected and edited individually.
White Level defaults to 1 and Black Level to 0, providing the full dynamic range of the camera.
White level may be decreased to increase the overall brightness of the scene; black level can be
increased to deepen shadow areas. The gamma curve may also be modified to maintain dynamic
range while increasing or decreasing overall contrast.
The "Reset" button resets all correction values to defaults.
Illuminant
The illuminant setting affects the white balance of the image. This is selected at the camera
using the OZO Remote software, however no in-camera modification of the raw image data
occurs; this is just metadata carried with the image. As a result it can be overridden by OZO Live.
If the Override Remote Setting switch is OFF, the camera selection of illuminant will be observed.
If the Override Remote Setting switch is ON, the illuminant may be selected using the slider.
Video Filters: Denoising
OZO Live contains a sophisticated temporal denoising algorithm. Details are retained well, while
noise is diminished substantially, especially in low light scenes. Use of the denoising option is
highly recommended.
Video Filters: Sharpening
OZO Live's sharpening algorithm enhances the appearance of edges in the video frame. This can
be effective in increasing perceived resolution, however it does induce artifacts, especially at
higher settings. For most applications we recommend starting with a setting of 3 and adjusting
as desired.
PAGE 7
Stitcher Settings tab
The Stitcher Settings tab allows control over the real-time stitching parameters, along with the
digital pan capability.
Digital Pan
A major challenge in 360 video in general, and in multi-camera productions in particular, lies in
managing the user's attention. When the director cuts from one camera to another, he wants
the user's focus of attention in the original scene to match their attention in the new scene. The
viewer shouldn't have to look around to find the subject after the cut. With moving subjects, and
stationary camera, this becomes quite a challenge.
Digital Pan provides a solution. Simply by clicking and dragging the preview image, the camera
can be "virtually rotated" to center the subject in the user's default field of view. The camera
remains physically stationary, but the video output from OZO Live is rotated along the Y-axis,
providing the effect of a pan.
Please note that the pan occurs in real-time without smoothing; the movement is jerky. Digital
Pan should be avoided on live cameras, and used only when the camera is being previewed.
PAGE 8
Stitching: Per-Stitch Settings
OZO Live combines the four (or three, for monoscopic output) sensor images from OZO into a
single UHD output frame. The stitching settings allow the operator to optimize the seam areas
between individual images.
OZO has 5 stitch areas when running in stereoscopic mode (4 when in monoscopic mode). Each
stitch can be configured with a blend width, an offset, and three convergence settings, except
the rear seam which has no offset.
Offset allows the stitch area to be moved left or right. OZO has overlap of about 25° between
cameras, so a stitch line can be moved about 12.5° in either direction from the default center
position.
Convergence sets the distance at which the image from two adjacent sensors is perfectly
aligned. Subjects closer than the convergence point will be occluded; subjects further away will
be doubled. A convergence value of 1 represents infinity; 1.06 is about one meter. The usable
range is between these values.
OZO Live now supports three separate convergence depths across a single seam. These depths
are interpolated between over the course of the seam. This allows the stitcher to simultaneously
handle a close-up subject and a far-away ceiling, for example.
Stitching: Auto Tune
The OZO Live Auto Tune capabilities make it easy to generate a good starting point for a stitch.
In many cases the Auto Tune will create an excellent stitch without requiring any further user
input. The recommended best practice is to tune Seam Convergence first, and Location second.
Auto Tune Seam Location will examine the errors caused by each possible seam location across
the image, and will choose a minimum-error location automatically.
Auto Tune Convergence is an operation which attempts to determine the optimal convergence
for all three convergence values, for each stitch in the scene, based on a minimum error
algorithm.
Note: the Auto Tune actions will cause a visible "stutter" in the image and may cause repeated
frames in output. It should not generally be used on a live camera but only in preview.
PAGE 9
RTMP Delivery Settings
OZO Live now enables you to encode and deliver video streams directly to an online video
service in RTMP format. This capability makes use of the hardware h.264 encode capabilities on
the NVIDIA GPU card. It can be used to deliver an encoded stream to a wide variety of streaming
services including YouTube 360, Facebook 360, Periscope 360, and virtually any video platform
which can accept live RTMP ingest.
The options available are outlined below.
URI
Enter the URI for the RTMP ingest point in this box. It must start with rtmp://
Video and Audio Bitrate
Enter the desired encoded bitrate for the video and audio streams, respectively, in these input
fields. Note that the Video bitrate is expressed in megabits per second, while the audio bitrate is
expressed in kilobits per second.
Typical uplink bitrates for 4K content range from 20-50mbps. We do not recommend delivering
the stream at less than 10mbps as quality will be quite poor.
Typical uplink bitrates for audio range from 128kbps to 512kbps for 5.1 surround.
PAGE 10
Uplink Settings for YouTube 360 Live
These instructions were correct at time of writing, but may be invalidated by changes to the
YouTube interface.
Follow YouTube's instructions for establishing a live 360 event. When creating the event, be sure
to go to the "Advanced Settings" tab and tick the "This live stream is 360" box. On the
"Ingestion Settings" tab, you will be shown a "Primary Server URL" as well as a "Stream Name."
You must concatenate these two fields together to arrive at the URI to enter into OZO Live.
As an example, the Server URL might be rtmp://a.rtmp.youtube.com/live2 and the Stream Name
might be s9cs-41ma-tk99-b2qs. In this case you would enter the following URI into OZO Live:
rtmp://a.rtmp.youtube.com/live2/s9cs-41ma-tk99-b2qs
At the time of writing, YouTube supports only 30fps monoscopic ingest, and requires a bitrate
between 13-30 Mbps. Please visit the YouTube site to confirm current requirements.
PAGE 11
Operating OZO Live from the
Command-line
OZO Live may be operated in command-line mode. This mode enables some scripting workflows
and may permit access to early features before they are available within the graphical UI.
In order to access the command-line mode, you must first access the OZO Live machine, either
from a connected keyboard/monitor, or using SSH from a terminal client.
Running OZO Live as a service
In most cases, the core OZO Live capability runs as two services (or daemons). These are called
the ozo-live-pipeline and ozo-live-web. The ozo-live-pipeline service does the all the processing
of the video and audio and the ozo-live-web is managing the web application. By default the
OZO Live services starts automatically on boot, or on reboot or power-on. To manage the OZO
Live services, the following commands are useful.
To see the current status of the services, use:
$ sudo service ozo-live-web status
$ sudo service ozo-live-pipeline status
To restart a currently running service:
$ sudo service ozo-live-web restart
$ sudo service ozo-live-pipeline restart
To stop a service:
$ sudo service ozo-live-web stop
$ sudo service ozo-live-pipeline stop
To start a service:
$ sudo service ozo-live-web start
$ sudo service ozo-live-pipeline start
Once the ozo-live-pipeline service is started, commands are delivered using the netcat on port
30001.
$ nc localhost 30001 (when logged into the machine)
Once connected to the interface, press h (and return) to see available options.
PAGE 12
Control Commands
Once the OZO Live process is running with established netcat connection, you can use following
commands to control the OZO Live.
System commands
h or help
q or quit #quit the application. Use -C to end a netcat session
Video processing commands
g or gamma = view_point, r, g, b #set gamma per RGB level for specified view_point (e.g. g=3,
1.1, 1.1, 1.0)
gg or global_gamma = r, g, b #set gamma per RGB for all view port (e.g. gg=1.1, 1.1, 1.1)
b or black_level=view_point, r, g, b #set black level per RGB channel for specified view_point
(e.g. b=3,0.01,0.012 0.0)
gb or global_blacklevel = r, g, b #set black level per RGB for all view port (e.g. gb=0.005,
0.005, 0.005)
w or white_level=view_point, r, g, b #set white level per RGB channel for specified view_point
(e.g. w=2,0.95,1.0 0.92)
gw or global_white_level = r, g, b #set whitelevel per RGB for all view port (e.g. gw=1.0,.9,1.0)
si or scene_illumination #display available scene illuminantions
i or illumination #show current illumination setting
i or illumination=value #set manual illumination value. If 0 use as set in OZO remote (e.g.
i=4000).
dn or denoise=value #set denoising levels (e.g. dn=5)
sh or sharpen=value #set sharpening filter strength (e.g. sh=3)
PAGE 13
Stitcher processing commands
ss #display the current location of the stereo stitch seams
ss=left_most,left,right,right_most #set the location of stereo seams (e.g.
ss=-100,-40,40,100)
ms #display the current location of the mono seams
ms=left,right #set the location of seams (e.g. ms=-110,130)
s180 #display the current location of the stereo 180 seams
s180=left,right #set the location of seams (e.g. s180=-60,60)
assf #display current stereo stitching focus values
assf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. assf=1, 2, 1.03)
sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for bottom
segments
amsf #display current mono stitching focus values
amsf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. amsf=1, 2, 1.03)
sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for bottom
segments
as180sf #display current stereo 180 stitching focus
as180sf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. as180sf=1, 2,
1.03) sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for
bottom segments
ssw #display current blending widthes for the stereo stitches
ssw=sw_left_most,sw_left,sw_right,sw_right_most,sw_back #set the width of stitch seams in
degrees (e.g. ssw=3.0,2.0,5.0,2.0,2.0)
msw #display current blending widthes for the mono stitches
msw=sw_left,sw_right,sw_back #set the width of stitch seams in degrees (e.g.
msw=3.0,2.0,3.0)
s180sw #display current blending widthes for the stereo 180 stitches
s180sw=sw_left,sw_right #set the width of stitch seams in degrees (e.g. s180sw=3.0,2.0)
PAGE 14
dp #display current digital pan setting
dp=digitalpan #pan the output from the center point (e.g. dp=10.0 for 10.0 deg right)
flip #show current output flip mode
flip=value #set camera flip mode. Value is one of 'on' or 'off'.
Audio processing Commands
ad=value #set audio delay in ms
ag=value #set audio gain (e. g. ag = 5)
al #output current audio levels per channel
Other Useful Commands
save=filename #save pipeline configuration to user specified filename
load=filename #load pipeline configuration from user specified file
r or restore #restore all settings to factory default
d or dump #dump a frame into png files
p or params #print connected OZO camera settings
s or stat #print streaming statistics
video/conf or video/config #display current streaming configuration
cci #display information about the connected OZO camera
PAGE 15
Typical Production Architecture
OZO Live is a versatile real-time VR software solution for both single camera as well as multicamera productions. The typical production architectures for single camera and multi-camera
productions are shown below. The quad-link HD-SDI output of OZO Live is compatible with
standard 4k video production equipment, which enables a wide range of live production options.
Single Camera
Multi Camera
PAGE 16
S u p p o r t
The entire OZO team wants to make sure your experience with OZO Live is a good one. We are
ready to help and are eager for your feedback.
OZO Live Forum
The OZO Live Forum is a place for OZO Live users and partners to exchange information. It may
be found as part of the "Support and Community" section of the Nokia OZO website, at
http://support.ozo.nokia.com/
Support
Registered users of OZO may access the OZO Support team via email at
[email protected] or online form at https://ozo.nokia.com/ozo_en/contact/. All customer
support request will be responded whithin 24 hours.
If you find any issue with OZO Live, we recommend to report your issues with more information
for better analysis. Please run following command in the folder that you ran the ozo_live
application.
$ /opt/nokia/ozo_live/bin/report.sh
report_201610281154.txt.gz is generated, please attach the file in the support request
Then you will see report_xxxx.txt.gz in the same folder. Attaching this file to your support
request will help the support team diagnose your issue more efficiently.
PAGE 17
L e g a l
I n f o r m a t i o n
Open source software is shipped with the Licensed Software. A listing of the open source
software and the accompanying license terms is included in a .txt file in the software package.
Please read the applicable license terms. Your use of the Licensed Software is only permitted if
you comply with the terms and conditions of the open source software licenses included in the
.txt file.
Copyright © Nokia Technologies Ltd. and/or its subsidiary(-ies).
This OZO Live software, including the accompanying documentation, is protected by copyright
controlled by Nokia Technologies Ltd. All rights reserved. Unless you have signed an individually
negotiated license agreement with Nokia, the license terms applicable to your use of this
software are available at:
https://ozo.nokia.com/ozo_en/ozo-live-product-license-agreements
If you have signed an individually negotiated license agreement with Nokia, the terms contained
in that license agreement shall govern your use of this software.
PAGE 18