Download Set-Top Box

3-D virtual worlds for broadcast television
IST project MADISON
Thierry Keutgen
Senior Application Engineer
DELTATEC
[email protected]
www.deltatec.be
Television ?
Internet ?
Brussels, 28th November 2003
Television ?
Internet on TV …… TV on Internet
Is it the issue ?
Television is evolving in a new framework
New business models: pay TV, pay-per-view, games,
T-commerce, …
Content to multiple types of supports
Brussels, 28th November 2003
How do we make it happen ?
Deltatec is a
High-tech explorer for its customers
Specialist in broadcast
This revolution is an opportunity
It’s far from trivial … R&D work needed
Brussels, 28th November 2003
European IST Project
With real-world objectives it is a nice framework to
Meet technical experts
Meet industrial end-users
Explore new technical fields
Get a technical edge for our customers
Brussels, 28th November 2003
Idea – Issues - Solutions
3-D
Multi-user
Client-to-client
interaction
Broadcast
Latency
Distributed
application
No demonstrator for
the technology
IEEE DIS
MPEG-4
Brussels, 28th November 2003
MPEG-4
MPEG-4 allows to wrap 3-D synthesis
information into more general mulitmedia
structures where video, audio, 3-D and image
objects coexist and interact
NOT low bit rate video
NOT encoding / decoding
NOT internet
BROADCAST
Brussels, 28th November 2003
Architecture
Set-Top Box
Content
Provider
Simulation
Server
Data
Injector
Distributor
Internet
Satellite/
Cable
receiver
MPEG 4
Subsystem
Network
Layer
Application
Software
Operating system
Brussels, 28th November 2003
TV set
User
Interaction
devices
Architecture
Set-Top Box
Content
Provider
Simulation
Server
Data
Injector
Distributor
Internet
Satellite/
Cable
receiver
MPEG 4
Subsystem
Network
Layer
Application
Software
Operating system
Brussels, 28th November 2003
TV set
User
Interaction
devices
Architecture
Set-Top Box
Content
Provider
Simulation
Server
Data
Injector
Distributor
Internet
Satellite/
Cable
receiver
MPEG 4
Subsystem
Network
Layer
Application
Software
Operating system
Brussels, 28th November 2003
TV set
User
Interaction
devices
Partners
Archetypon
Boostworks
Canal+ Belgique
Deltatec
EPFL
Memondo
Norsk Regnesentral
Brussels, 28th November 2003
Results produced
Simulation server – IEEE DIS-like message protocol
MPEG-4 over MPEG-2 injector
Network acceleration layer
Prototype STB
Brussels, 28th November 2003
Channel selection
Brussels, 28th November 2003
3-D virtual world
Brussels, 28th November 2003
Interaction with context or other users
Brussels, 28th November 2003
Data Injector
Set-Top Box
Content
Provider
Simulation
Server
Data
Data
Injector
Injector
Distributor
Internet
Satellite/
Cable
receiver
MPEG 4
Subsystem
Network
Layer
Application
Software
Operating system
Brussels, 28th November 2003
TV set
User
Interaction
devices
MPEG-4 over MPEG-2 injector
Different options to inject data over a MPEG-2 TS :
Raw data over a MPEG-2 TS
IP over MPEG-2 TS
MP4 file hinting and
injection
«True» MPEG-4 SL-Packets
embedding through a
DMIF interface
Brussels, 28th November 2003
MPEG-4 over MPEG-2 injector
Based on a PCI board with:
2 DVB ASI transmitters and 2 receivers
Reconfigurable I/O controller to process MPEG-2 TS
Applications:
PID filtering and TS processing
DVB MPEG-2 video servers
Interactive Television (iTV)
IP data insertion/Data broadcasting
Video over IP (VoIP)
Video-on-Demand (VoD)
Brussels, 28th November 2003
SL-Packets injector
Simulation
Server
MPEG-4
descriptors
MPEG-4
SL-Packets
Data Injector
FlexMux
TS Packet
Builder
TCP/IP
MPEG-2 TS
ASI
PSI
Monitoring
and Update
Core
Embedder
DVB
Multiplexer
DVB
Server
Brussels, 28th November 2003
MP4 file hinter and injector
Simulation
Server
Local MP4 file
MP4 file
TCP/IP
MPEG-2 TS
ASI
Hinter
Data Injector
TS Packet
Builder
PSI
Monitoring
and Update
Core
Embedder
DVB
Multiplexer
DVB
Server
Brussels, 28th November 2003
Prototype Set-Top Box
Set-Top Box
Content
Provider
Data
Injector
Distributor
Satellite/
Cable
receiver
MPEG 4
Subsystem
TV set
Set-Top Box
Simulation
Server
Internet
Network
Layer
Application
Software
Operating system
Brussels, 28th November 2003
User
Interaction
devices
Prototype STB - MadBox
Based on a PC running Windows 2000
QAM receiver board and demultiplexer
MPEG-4 DMIF for
Local files
Internet
Broadcast
Customised housing
Everything managed through a TV remote
control
Brussels, 28th November 2003
Broadcast DMIF
Brussels, 28th November 2003
Broadcast DMIF
Top-level terminal layers
Broadcast DMIF
Instance
Application Layers
(Decoders + Compositor)
BroadcastInstance Class
DAI Primitives
Sync Layer
Callback
Methods
MPEG-4 Parsing functions
Delivery Layer
FlexMux
MPEG-2 Parsing functions
DMIF Filter
Local Files
DMIF
Broadcast
DMIF
Network
DMIF
Low-level TS access functions
Delivery Medium (MPEG-2 Transport Stream)
Brussels, 28th November 2003
MPEG-4 for broadcast…
for now
MPEG-4 is not just low bit-rate video
Authoring tools are missing
3-D is really a step forward
MPEG-4 and 3-D are very demanding for the STB
Enhancements are good, content is key
Brussels, 28th November 2003
Next R&D step
We are ready for MPEG-4 in broadcast
We want to go further
IST ENAMORADO project:
Production of multimedia content for live events: AR,
metadata, transmission, …
Delivery to multiple types of mobile clients
Focus on MPEG-7, R&D on MPEG-21
Deltatec, Canal+, Siemens Mobile, …
Brussels, 28th November 2003
Get concrete
Brussels, 28th November 2003
DELTA-asi
DELTA-sdi
From a MADISON prototype … to a range of products
www.deltacast.tv
Brussels, 28th November 2003
Get concrete
STB processing power is market-driven …
Manufacturers still to endorse the technology
Let’s demonstrate the technology on programs that pay
In football: ad insertion, synthetic replay, new camera
views, T-commerce, virtual after-match pub, …
Brussels, 28th November 2003
Thank you
Thierry Keutgen
[email protected]
+32 4 239 78 80
www.deltatec.be
Brussels, 28th November 2003