Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
O Z O U s e r L I V E G u i d e Introduction OZO Live enables the revolutionary Nokia OZO VR Camera to be used for live VR broadcasts. It is a software product, running on GPU-assisted reference hardware, which converts the compressed 1.5Gb/sec HD-SDI signal from the OZO into either a standard 4K UHD video signal for live post-production, delivered via quad-link HD-SDI, or an RTMP uplink to a cloud delivery service. OZO Live provides advanced real-time stitching functionality, spatial audio processing, color correction, h.264 encoding, and a variety of advanced options in a powerful and easy-touse package. OZO Live is designed for professional broadcast production use. It supports three primary deployment modes: (1) single-camera workflow with direct RTMP uplink; (2) single-camera workflow to a single external broadcast encoder, and (3) multi-camera workflows with full production switching and sound reinforcement. A typical single-camera workflow is diagrammed below: PAGE 1 U s i n g O Z O L i v e OZO Live runs as two separate services: a core processing service, which performs the real-time video and audio processing functions, and a web service, which presents a graphical user interface to any browser. In a default installation, both services start automatically on system boot; the GUI operates as a service (ozo-live-web) running on standard HTTP port 80, which communicates with the core service (ozo-live-daemon) using port 30000. Users may interact with OZO Live using either the web service or a command-line interface -however, certain features are available only through the command-line interface. As the OZO Live team continues to develop the product, features will generally appear first in the commandline interface before being enabled in the web GUI. For these reasons we strongly recommend that OZO Live operators familiarize themselves with both control modes. Operating OZO Live from a Web Browser To access the OZO Live GUI, simply point your web browser at the IP address of the OZO Live server. The GUI provides easy, touch-enabled control over much of the functionality of OZO Live, and has been tested on a range of browsers including Chrome, Firefox and Safari mobile. PAGE 2 Broadcast Controls tab The Broadcast Controls tab provides access to the basic settings for control of the OZO Live server. These settings cannot be changed while the server is running; they require a restart. Typically they are set at the start of a production and do not change over the course of a live event. The options available are outlined below. PAGE 3 Output As of version 1.3, OZO Live now enables either direct video output over SDI or an encoded video bitstream via RTMP. Click the "Change Output" button to switch between these options. For RTMP output, you may enter the target uplink URL and the target bitrate. Please refer to the section on "RTMP Delivery Settings" for information on how to connect directly to distribution services such as YouTube 360, Akamai, or others. For SDI output, OZO Live will automatically choose the available 4K SDI output device, whether Aja or Blackmagic. Please note that the current version does not support simultaneous SDI and RTMP output. This will be supported in a future release. Frame Rate The OZO camera runs at a fixed 30fps. OZO Live enables alternate frame rate output in order to support downstream equipment. These rates are supported with simple frame removal or doubling. Supported rates on AJA output cards are 29.97, 30, 59.94, and 60. Blackmagic output cards currently only support 29.97 and 30fps. Video Format OZO Live outputs a UHD 3840x2160 frame over quad-link HD-SDI or 6G-SDI. The specific projection format used in the visual output can be switched among several options. For most third-party players, the equirectangular projection in either mono or "top/bottom" stereo is recommended. OZO Live uses the four "equatorial" lenses on the OZO to create a stereoscopic output. 3 cameras are used for monoscopic output. Supported video output formats include: Monoscopic 360°, equirectangular projection Stereoscopic 360°, top/bottom, equirectangular projection Stereoscopic 180°, left/right, equirectangular projection Monoscopic 360°, Lambert projection Stereoscopic 360°, top/bottom, Lambert projection Stereoscopic 180°, left/right, Lambert projection Monoscopic 360° cube map PAGE 4 Audio Format OZO Live contains an audio processing subsystem which can convert the 8 microphone signals from the OZO into a number of output formats. Output is at 48kHZ, 24bit per SDI standard. 5.0 Surround (L,R,C,SL,SR) Stereo (L,R) 8-ch pass-through The first two options run the 8 microphone signals from the OZO Camera through an OZO Audio processor built into the OZO Live software. This processor processes and downmixes all 8 microphones into either the 5.1 or stereo output format. The Bypass option passes all inputs through. It can be used to pass external audio signals embedded into the input, or raw OZO microphone signals (not recommended). All audio is delayed within OZO Live and kept in sync with the video pipeline delay. PAGE 5 Video Processing tab The Video Processing tab enables control over color correction, white balance, denoising and sharpening. These settings are typically made at the beginning of a live event, but may be changed on-the-fly. PAGE 6 Color Correction OZO Live enables color correction of the entire visual frame as well as for the individual images from the four OZO Camera lenses which are stitched into the full frame. Due to OZO Live's multiband blending capability, in most cases, it is not necessary to adjust color balance of individual lenses; however, if your scene has a very large imbalance of light sources across sensors (e.g. if there is bright sun on only one side) it may be useful to modify color levels at the per-lens level. For global and per-lens operation, the user interface is the same. Enabling the "Link" button allows levels to be simultaneously modified across the three R/G/B channels. Alternatively, a single channel may be selected and edited individually. White Level defaults to 1 and Black Level to 0, providing the full dynamic range of the camera. White level may be decreased to increase the overall brightness of the scene; black level can be increased to deepen shadow areas. The gamma curve may also be modified to maintain dynamic range while increasing or decreasing overall contrast. The "Reset" button resets all correction values to defaults. Illuminant The illuminant setting affects the white balance of the image. This is selected at the camera using the OZO Remote software, however no in-camera modification of the raw image data occurs; this is just metadata carried with the image. As a result it can be overridden by OZO Live. If the Override Remote Setting switch is OFF, the camera selection of illuminant will be observed. If the Override Remote Setting switch is ON, the illuminant may be selected using the slider. Video Filters: Denoising OZO Live contains a sophisticated temporal denoising algorithm. Details are retained well, while noise is diminished substantially, especially in low light scenes. Use of the denoising option is highly recommended. Video Filters: Sharpening OZO Live's sharpening algorithm enhances the appearance of edges in the video frame. This can be effective in increasing perceived resolution, however it does induce artifacts, especially at higher settings. For most applications we recommend starting with a setting of 3 and adjusting as desired. PAGE 7 Stitcher Settings tab The Stitcher Settings tab allows control over the real-time stitching parameters, along with the digital pan capability. Digital Pan A major challenge in 360 video in general, and in multi-camera productions in particular, lies in managing the user's attention. When the director cuts from one camera to another, he wants the user's focus of attention in the original scene to match their attention in the new scene. The viewer shouldn't have to look around to find the subject after the cut. With moving subjects, and stationary camera, this becomes quite a challenge. Digital Pan provides a solution. Simply by clicking and dragging the preview image, the camera can be "virtually rotated" to center the subject in the user's default field of view. The camera remains physically stationary, but the video output from OZO Live is rotated along the Y-axis, providing the effect of a pan. Please note that the pan occurs in real-time without smoothing; the movement is jerky. Digital Pan should be avoided on live cameras, and used only when the camera is being previewed. PAGE 8 Stitching: Per-Stitch Settings OZO Live combines the four (or three, for monoscopic output) sensor images from OZO into a single UHD output frame. The stitching settings allow the operator to optimize the seam areas between individual images. OZO has 5 stitch areas when running in stereoscopic mode (4 when in monoscopic mode). Each stitch can be configured with a blend width, an offset, and three convergence settings, except the rear seam which has no offset. Offset allows the stitch area to be moved left or right. OZO has overlap of about 25° between cameras, so a stitch line can be moved about 12.5° in either direction from the default center position. Convergence sets the distance at which the image from two adjacent sensors is perfectly aligned. Subjects closer than the convergence point will be occluded; subjects further away will be doubled. A convergence value of 1 represents infinity; 1.06 is about one meter. The usable range is between these values. OZO Live now supports three separate convergence depths across a single seam. These depths are interpolated between over the course of the seam. This allows the stitcher to simultaneously handle a close-up subject and a far-away ceiling, for example. Stitching: Auto Tune The OZO Live Auto Tune capabilities make it easy to generate a good starting point for a stitch. In many cases the Auto Tune will create an excellent stitch without requiring any further user input. The recommended best practice is to tune Seam Convergence first, and Location second. Auto Tune Seam Location will examine the errors caused by each possible seam location across the image, and will choose a minimum-error location automatically. Auto Tune Convergence is an operation which attempts to determine the optimal convergence for all three convergence values, for each stitch in the scene, based on a minimum error algorithm. Note: the Auto Tune actions will cause a visible "stutter" in the image and may cause repeated frames in output. It should not generally be used on a live camera but only in preview. PAGE 9 RTMP Delivery Settings OZO Live now enables you to encode and deliver video streams directly to an online video service in RTMP format. This capability makes use of the hardware h.264 encode capabilities on the NVIDIA GPU card. It can be used to deliver an encoded stream to a wide variety of streaming services including YouTube 360, Facebook 360, Periscope 360, and virtually any video platform which can accept live RTMP ingest. The options available are outlined below. URI Enter the URI for the RTMP ingest point in this box. It must start with rtmp:// Video and Audio Bitrate Enter the desired encoded bitrate for the video and audio streams, respectively, in these input fields. Note that the Video bitrate is expressed in megabits per second, while the audio bitrate is expressed in kilobits per second. Typical uplink bitrates for 4K content range from 20-50mbps. We do not recommend delivering the stream at less than 10mbps as quality will be quite poor. Typical uplink bitrates for audio range from 128kbps to 512kbps for 5.1 surround. PAGE 10 Uplink Settings for YouTube 360 Live These instructions were correct at time of writing, but may be invalidated by changes to the YouTube interface. Follow YouTube's instructions for establishing a live 360 event. When creating the event, be sure to go to the "Advanced Settings" tab and tick the "This live stream is 360" box. On the "Ingestion Settings" tab, you will be shown a "Primary Server URL" as well as a "Stream Name." You must concatenate these two fields together to arrive at the URI to enter into OZO Live. As an example, the Server URL might be rtmp://a.rtmp.youtube.com/live2 and the Stream Name might be s9cs-41ma-tk99-b2qs. In this case you would enter the following URI into OZO Live: rtmp://a.rtmp.youtube.com/live2/s9cs-41ma-tk99-b2qs At the time of writing, YouTube supports only 30fps monoscopic ingest, and requires a bitrate between 13-30 Mbps. Please visit the YouTube site to confirm current requirements. PAGE 11 Operating OZO Live from the Command-line OZO Live may be operated in command-line mode. This mode enables some scripting workflows and may permit access to early features before they are available within the graphical UI. In order to access the command-line mode, you must first access the OZO Live machine, either from a connected keyboard/monitor, or using SSH from a terminal client. Running OZO Live as a service In most cases, the core OZO Live capability runs as two services (or daemons). These are called the ozo-live-pipeline and ozo-live-web. The ozo-live-pipeline service does the all the processing of the video and audio and the ozo-live-web is managing the web application. By default the OZO Live services starts automatically on boot, or on reboot or power-on. To manage the OZO Live services, the following commands are useful. To see the current status of the services, use: $ sudo service ozo-live-web status $ sudo service ozo-live-pipeline status To restart a currently running service: $ sudo service ozo-live-web restart $ sudo service ozo-live-pipeline restart To stop a service: $ sudo service ozo-live-web stop $ sudo service ozo-live-pipeline stop To start a service: $ sudo service ozo-live-web start $ sudo service ozo-live-pipeline start Once the ozo-live-pipeline service is started, commands are delivered using the netcat on port 30001. $ nc localhost 30001 (when logged into the machine) Once connected to the interface, press h (and return) to see available options. PAGE 12 Control Commands Once the OZO Live process is running with established netcat connection, you can use following commands to control the OZO Live. System commands h or help q or quit #quit the application. Use -C to end a netcat session Video processing commands g or gamma = view_point, r, g, b #set gamma per RGB level for specified view_point (e.g. g=3, 1.1, 1.1, 1.0) gg or global_gamma = r, g, b #set gamma per RGB for all view port (e.g. gg=1.1, 1.1, 1.1) b or black_level=view_point, r, g, b #set black level per RGB channel for specified view_point (e.g. b=3,0.01,0.012 0.0) gb or global_blacklevel = r, g, b #set black level per RGB for all view port (e.g. gb=0.005, 0.005, 0.005) w or white_level=view_point, r, g, b #set white level per RGB channel for specified view_point (e.g. w=2,0.95,1.0 0.92) gw or global_white_level = r, g, b #set whitelevel per RGB for all view port (e.g. gw=1.0,.9,1.0) si or scene_illumination #display available scene illuminantions i or illumination #show current illumination setting i or illumination=value #set manual illumination value. If 0 use as set in OZO remote (e.g. i=4000). dn or denoise=value #set denoising levels (e.g. dn=5) sh or sharpen=value #set sharpening filter strength (e.g. sh=3) PAGE 13 Stitcher processing commands ss #display the current location of the stereo stitch seams ss=left_most,left,right,right_most #set the location of stereo seams (e.g. ss=-100,-40,40,100) ms #display the current location of the mono seams ms=left,right #set the location of seams (e.g. ms=-110,130) s180 #display the current location of the stereo 180 seams s180=left,right #set the location of seams (e.g. s180=-60,60) assf #display current stereo stitching focus values assf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. assf=1, 2, 1.03) sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for bottom segments amsf #display current mono stitching focus values amsf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. amsf=1, 2, 1.03) sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for bottom segments as180sf #display current stereo 180 stitching focus as180sf=seam_index,segment_index,sf_value #set the focus of stitching (e.g. as180sf=1, 2, 1.03) sf_value: 1.0 for infinity, 1.1 for close, segment_index:0 for top, 1 for middle, 2 for bottom segments ssw #display current blending widthes for the stereo stitches ssw=sw_left_most,sw_left,sw_right,sw_right_most,sw_back #set the width of stitch seams in degrees (e.g. ssw=3.0,2.0,5.0,2.0,2.0) msw #display current blending widthes for the mono stitches msw=sw_left,sw_right,sw_back #set the width of stitch seams in degrees (e.g. msw=3.0,2.0,3.0) s180sw #display current blending widthes for the stereo 180 stitches s180sw=sw_left,sw_right #set the width of stitch seams in degrees (e.g. s180sw=3.0,2.0) PAGE 14 dp #display current digital pan setting dp=digitalpan #pan the output from the center point (e.g. dp=10.0 for 10.0 deg right) flip #show current output flip mode flip=value #set camera flip mode. Value is one of 'on' or 'off'. Audio processing Commands ad=value #set audio delay in ms ag=value #set audio gain (e. g. ag = 5) al #output current audio levels per channel Other Useful Commands save=filename #save pipeline configuration to user specified filename load=filename #load pipeline configuration from user specified file r or restore #restore all settings to factory default d or dump #dump a frame into png files p or params #print connected OZO camera settings s or stat #print streaming statistics video/conf or video/config #display current streaming configuration cci #display information about the connected OZO camera PAGE 15 Typical Production Architecture OZO Live is a versatile real-time VR software solution for both single camera as well as multicamera productions. The typical production architectures for single camera and multi-camera productions are shown below. The quad-link HD-SDI output of OZO Live is compatible with standard 4k video production equipment, which enables a wide range of live production options. Single Camera Multi Camera PAGE 16 S u p p o r t The entire OZO team wants to make sure your experience with OZO Live is a good one. We are ready to help and are eager for your feedback. OZO Live Forum The OZO Live Forum is a place for OZO Live users and partners to exchange information. It may be found as part of the "Support and Community" section of the Nokia OZO website, at http://support.ozo.nokia.com/ Support Registered users of OZO may access the OZO Support team via email at [email protected] or online form at https://ozo.nokia.com/ozo_en/contact/. All customer support request will be responded whithin 24 hours. If you find any issue with OZO Live, we recommend to report your issues with more information for better analysis. Please run following command in the folder that you ran the ozo_live application. $ /opt/nokia/ozo_live/bin/report.sh report_201610281154.txt.gz is generated, please attach the file in the support request Then you will see report_xxxx.txt.gz in the same folder. Attaching this file to your support request will help the support team diagnose your issue more efficiently. PAGE 17 L e g a l I n f o r m a t i o n Open source software is shipped with the Licensed Software. A listing of the open source software and the accompanying license terms is included in a .txt file in the software package. Please read the applicable license terms. Your use of the Licensed Software is only permitted if you comply with the terms and conditions of the open source software licenses included in the .txt file. Copyright © Nokia Technologies Ltd. and/or its subsidiary(-ies). This OZO Live software, including the accompanying documentation, is protected by copyright controlled by Nokia Technologies Ltd. All rights reserved. Unless you have signed an individually negotiated license agreement with Nokia, the license terms applicable to your use of this software are available at: https://ozo.nokia.com/ozo_en/ozo-live-product-license-agreements If you have signed an individually negotiated license agreement with Nokia, the terms contained in that license agreement shall govern your use of this software. PAGE 18