Nextreaming Corporation

1
????? ?? ?? ??? ????? ??? ?? ??

• 2002-9-27
• ? ? ?
• ????? ????
• Nextreaming Corporation

2
Wireless, Mobile Multimedia?
Streaming
3
???? ?? ??? ???

• ?? ?? ??? ??
• ??? ????? ?? ??? ???? ??
• ????, ???, ??????, ????
• ?? ?? ??? ??
• ???? ????
• ??? ?? ?? ?? ??
• ? ?? ???? ???? ?? ?? ??
• ?? ?? ?? ?? ? ?? ?? ??
• ??? ??, ?? ? ??? ???
• ?? ?? ?? ?? ???
• ??? ?? ???? ?? ??? ??? ??? ??? ??? ??? ?? ????
  ???, ?? ??? ??

4
Multimedia Streaming Service Flow
Creation
Distribution
Playback
Wired Network
Web Server
Contents Creation
Wireless Network
Streaming Server
File Server
Streaming Player
5
Architecture of Simple Streaming Client
6
Technical Elements for Streaming

• Session Set-up and Control
• Media Codecs
• Speech, Audio, Video
• Still Images, Vector Graphics, Synthetic Audio,
  etc.
• Transport Protocol
• For Realtime Media
• For Static Media
• Scene Description
• Spatial and Temporal Layout of Media Objects
• File Formats
• Exchange
• Storage and Retrieval

7
Standards for Streaming Services

• Standardization Bodies
• UMTS (W-CDMA)

• cdma2000

• Industry Forum
• WMF

• ISMA

8
3GPP (3rd Partnership Project)

• Evolved from GSM
• Packet Switched Multimedia Services
• TSG-SA WG4 (CODEC)
• Packet Switched Streaming (TS 26.233, 26.234)
• Multimedia Codecs for MMS (TS 26.140)
• Circuit Switched / Packet Switched Conversational
  Services (TS 26.110, TS 26.235, etc.)
• Streaming
• From 3GPP Spec Release 4
• Rel-4 (2001/3) ? Rel-5 (2002/3) ? Rel-6 (2003/12?)

9
3GPP Streaming Terminal

• Rel-4
• Video, Audio, Speech, Image, Text
• SMIL to integration various media types
• Rel-5
• Vector graphics, synthetic audio added
• Capability exchange specified for personalized
  services

10
3GPP Specification details

• Default video codec H.263 baseline
• Optional video codec MPEG-4 SP _at_ L0, H.263
  profile 3 level 10
• Default speech codec AMR
• Optional audio codec AAC Low Complexity (LC)
• Transport RTP
• Control RTSP, SDP
• Default still image JPEG
• Optional still image GIF
• Formatted text xhtml
• Scene description SMIL 2.0 basic profile
• File format 3GPP (based on MP4 file format)

11
3GPP2

• Evolved from CDMA
• Working Groups Relevant to Multimedia Services
• TSG-C WG1 SWG2 (Video Services)
• Two Service Categories
• Multimedia Streaming Services (C.S0027)
• Started from Video Streaming Services
• Current draft is highly related to 3GPP works
• Video Conferencing Services
• Circuit Switched (C.P9016)
• Packet Switched (C.P9008)

12
3GPP2 Specification details

• Default video codec MPEG-4 SP _at_ L0
• Optional video codec MPEG-4 SSP _at_ L0, H.263
  Profile 34 _at_ L 10
• Optional speech codec EVRC, QCELP, SMV
• Transport RTP
• Control RTSP, SDP

13
Wireless Multimedia Forum (WMF)

• Overview
• Working Period Mar. 2000 Mar. 2002
• Members more than 60 vendors (device
  manufacturers, service providers, solution
  providers, contents providers, )
• Activity
• Technical Specification
• Interop Test Completed in Oct. 2001 (6 months)
• Impacts
• Influence many other organizations activity
• Became a basement of 3GPPs initial works
• IMTC took over its interop experiences
  (procedures, management, and so on)

14
WMF Spec Details

• MPEG-4 SP _at_ L0 (QCIF, 64 kb/s)
• Either AMR or EVRC
• RTP
• RTSP, SDP

15
Internet Streaming Media Alliance (ISMA)

• Founded in Dec. 2000
• Apple, Cisco, Sun, IBM, Phillips, Kasenna
• Goals
• To accelerate the market adoption of open
  standards for streaming rich media over Internet
  Protocol (IP).
• Specification
• Version 1.0 released (available at www.isma.tv)
• Current works
• Corrigenda to Technical Spec
• Digital Right Management
• Advanced Contents

16
ISMA Specification Details

• Profile 0
• MPEG-4 SP _at_ L1 (QCIF, 64 kb/s)
• High Quality Audio Profile _at_ L2 (CELP, AAC LC)
• RTP, RTSP, SDP
• Profile 1
• MPEG-4 Advanced Simple Profile(ASP) _at_ L3b (CIF,
  1.5 Mb/s)
• High Quality Audio Profile _at_ L2 (CELP, AAC LC)
• RTP, RTSP, SDP

17
Standards-Related Organizations
Certificate
Interoperability Tests
Streaming Specification
18
IMTC (International Multimedia Telecommunication
Consortium)

• Interop Tests
• H.323, H.324, SIP, IP Security, etc.
• 3GPP Packet-Switched Streaming ? PSS-AG
• PSS-AG
• 12 vendors are participating
• Ericsson, Motorola, Nokia, Philips, Siemens,
  Serome, etc.
• 1st round completed in Mar. 2002 (9 vendors)
• 2nd round is ongoing ? to be completed 4Q 2002

19
?? ?? ???

• TTA (??????????)
• ???????? ??
• ??? ?? ??
• PSM ????? ???? ??? ?? ??
• MMS ????? ????? ??? ??? ?? ??
• ???? 3?, ??????, ??? ? ?? ?? ?? ???? ??
• ???? ??? ?? ??
• ?? ?? ?? ??? (?? ?? ?)
• ???? www.kwisforum.org

20
KWISF ???? ??? ??

• ??? ??
• ?? ??
• ??? ?????, ????
• ?? ??????, ??????, ????
• ???? ?????, ??????, ??????, (????)

21
KWISF ?? (1/2)

• ??? ??
• ???
• H.263 Profile 0 Level 10(Baseline) (??)
• MPEG-4 SP_at_L0 (??)
• ?? (?? ? ???? ??)
• AMR
• 3GPP2 ???? (EVRC, SMV, etc.)
• ???
• AAC Low Complexity (??)

22
KWISF ?? (2/2)

• ??????
• RTP (Realtime Transport Protocol)
• ? ??? ????? IETF? ?? RFC? ??
• ??????
• IETF RTSP (RFC 2326)
• IETF SDP (RFC 2327)
• ????
• MP4 ?? ??? ???? ??, 3GPP? ???? ???? ???
• ?? ??? ??? ?? ??? ????? ?.

23
Next Generation Streaming Services

• Rich Media
• SMIL (Synchronized Multimedia Integration
  Language)
• BIFS (Binary Format for Scenes)
• Interaction with User
• Personalized Services
• Tailored services based on user profile
• Automatic contents selection according to
  terminal capability
• Service differentiation per subscribers gender,
  age, interests

24
Rich Media Example SMIL
ltsmilgt ltheadgt ltlayoutgt ltroot-layout
width176 height144 /gt ltregion idtitle
top124 left17 width159 height20 /gt
ltregion idmap top3 left131 width42
height42 /gt ltregion idmovie top0
left0 width176 height144 /gt lt/layoutgt
lt/headgt ltbodygt ltpargt ltvideo regionmovie
srcrtsp//foo.com/movice.mp4 begin0s /gt
ltimg regionmap srchttp//bar.com/map.jpg
begin5s /gt lttext regiontitle
srchttp//bar.com/welcome.txt begin3s /gt
lt/pargt lt/bodygt lt/smilgt
Define spatial layout of the scene
map area
movie area
title area
Define temporal layout and their URLs
t
movie
map
The syntax of SMIL looks like HTML
title
... ... ... ... ...
25
Rich Media Example BIFS
Caption On/Off Button (Image with Event Callback)
Synchronized Caption (Realtime text may be pushed
dynamically during a session)
Highlight Image (Shows larger images when clicked)
26
Multimedia Codecs for Mobile Terminals

• Software codec (i.e., inside modem)
• Qualcomm MSM 5000 series ARM7 core, 20 MHz ?
  128x96 size H.263 decoding 2 frames/sec
• Qalcomm MSM 6000 series built-in MPEG-4 block
  (QCIF size video and AAC LC audio)
• Hardware codec (i.e., outside modem)
• Emblaze ER4520 ARM9 core peripherals
• Hitachi SH Mobile SH3 core DSP peripherals
• Toshiba T3 hardwired logic based, codec
• TI OMAP C5x DSP peripherals

27
OS or Middleware for Mobile Terminals

• REX, z-REX
• pSOS
• Qualcomm Brew
• Java
• WIPI
• Symbian
• WinCE

28
?? ?? ?? ????

• 3GPP, www.3gpp.org
• 3GPP2, www.3gpp2.org
• ISMA, www.isma.tv
• IMTC, www.imtc.org (http//www.imtc.org/act_pss.ht
  m)
• M4IF, www.m4if.org
• MPEG, mpeg.telecomitalialab.com
• IETF, www.ietf.org
• W3C, www.w3.org (SMIL, http//www.w3.org/AudioVide
  o/)
• TTA, www.tta.or.kr
• KWISF, www.kwisforum.org

29
Thank you !
QA
Jae-Yong Lee (jlee_at_serome.com)