INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6902Brisbane, October 2004

Source Leonardo Chiariglione, Convenor

Title Report of the 66th meetingStatus

Report of the 66th meeting

1 Opening The 66th WG meeing was held at Brisbane, QLD, AU from 2003/10/20T09:00 to 24T20:30 at the kind invitation of Standards Australia.

2 Roll call of participants The attendance list is given in Annex 1.

3 Approval of agenda The adopted agenda is given in Annex 2.

4 Allocation of contributions The list of input documents is given in Annex 3.

5 Communications from Convenor No specific communications were made.

6 Report of previous meeting This was approved.

7 Processing of NB Position Papers   8 MPEG Phase 2 8.1 Part 1 – Systems 8.1.1 Amendments The following documents were approved

5972 Request for ISO/IEC 13818-1:2000/AMD4

1

5973 Text of ISO/IEC 13818-1:2000/PDAM45974 WD 1.0 of ISO/IEC 13818-1:2000/PDAM5

8.2 Part 4 – Conformance 8.2.1 Standard The following document was approved

6061 ISO/IEC 13818-4 MPEG-2 Conformance Testing 2nd

Edition

8.2.2 AmendmentsThe following documents were approved

6062 Study Text of ISO/IEC 13818-4 / PDAM1

6063 WD 3.0 of ISO/IEC 13818-4 / AMD2

8.3 Part 5 – Reference software 8.3.1 AmendmentThe following document was approved

6064 Study Text of ISO/IEC 13818-5 / DAM1

8.4 Part 7 – Advanced Audio Coding8.4.1 Standard The following document was approved

5998 Proposed ISO/IEC 13818-7:2004

8.4.2 CorrigendaThe following document was approved

5999 ISO/IEC 13818-7:2003/DCOR 1

8.5 Workplan This was approved (N6003).

9 MPEG Phase 4 9.1 Requirements The following document was approved

6037 MPEG-4 Profiles under Consideration

2

9.2 Part 1 – Systems 9.2.1 Amendments The following documents were approved

N5975 DoC on ISO/IEC 14496-1:2001/FPDAM7

N5976 Text of ISO/IEC 14496-1:2001/FDAM7

9.3 Part 2 – Visual 9.3.1 Standard The following document was approved

5952 MPEG-4 Visual: List of Problems Reported version 10.06034 Plan for the Formal Verification Tests of Error Resilient Simple Scalable

Profile

9.3.2 CorrigendaThe following document was approved

5951 Text of ISO/IEC 14496-2:200X/DCOR1

9.4 Part 3 – Audio 9.4.1 Standard The following document was approved

6006 Proposed ISO/IEC 14496-3:2004

9.4.2 AmendmentsThe following documents were approved

6009 Report on the Verification Tests of MPEG-4 High Efficiency AAC6010 Study on ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio)6012 WD 1 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)6014 WD 0 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable to Lossless Coding

(SLS)

9.4.3 CorrigendaThe following documents were approved

6007 ISO/IEC 14496-3:2001/DCOR 26008 ISO/IEC 14496-3:2001/AMD 1:2003/DCOR

1

3

9.5 Part 4 – Conformance Testing 9.5.1 AmendmentsThe following documents were approved

6065 Study Text of ISO/IEC 14496-4 / FPDAM46067 DoC on ISO/IEC 14496-4 / PDAM76066 ISO/IEC 14496-4 / FPDAM76019 WD of Audio Contribution to MPEG-4 Conformance (Bandwidth

Extension)

9.6 Part 7 – Optimised software 9.6.1 AmendmentThe following documents were approved

5953 Disposition of Comments on ISO/IEC 14496-7 DAM1

6050 Text of ISO/IEC 14496-7/Amd.1

9.6.2 CorrigendaThe following document was approved

5954 Text of ISO/IEC 14496-7/Amd.1 DCOR1

9.7 Part 9 – Hardware Reference Description 9.7.1 AmendmentThe following document was approved

N5293 Working Draft of Amendment 1 to TR 14496-9 Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description

9.8 Part 10 – Advanced Video Coding 9.8.1 Standard The following document was approved

6035 AVC Video Verification Test Plan Version 3.0

9.9 Part 11 – Scene Description and Application Engine 9.9.1 Standard

9.9.2 AmendmentsThe following documents were approved

N5977 DoC on ISO/IEC 14496-11/FPDAM1N5979 Study Text of ISO/IEC 14496-11/FPDAM2

4

N5981 WD 3.0 of ISO/IEC 14496-11/Amd.3N5982 Open Issues in WD3.0 of Audio BIFS

ExtensionsN5983 WD 1.0 of ISO/IEC 14496-11/Amd.4

9.9.3 CorrigendaThe following document was approved

N5978 Study Text of ISO/IEC 14496-11/DCOR1

9.10 Part 12 – ISO Base Media File Format9.10.1 AmendmentsThe following document was approved

N5984 WD 3.0 of ISO/IEC 14496-12/Amd.1

9.11 Part 16 Animation Framework eXtension (AFX)9.11.1 AmendmentThe following document was approved

5966 ISO/IEC 14496-16/AMD1 WD 2.0

9.12 Part 18 Font Compression and Streaming9.12.1 Standard The following documents were approved

N5985 Request for ISO/IEC 14496-18N5986 Study of ISO/IEC

14496-18/FCD

9.13 Workplan This was approved (N6003)

10 MPEG Phase 7 10.1 Systems 10.1.1 AmendmentThe following document was approved

N5987 Study Text of ISO/IEC 15938-1/FPDAM1

10.2 Visual 10.2.1 AmendmentsThe following document was approved

5

5955 Study Text of ISO/IEC 15938-3 FPDAM 1

10.3 Audio 10.3.1 CorrigendaThe following document was approved

6021 Proposed Corrigendum 1 on ISO/IEC 15938-4:2001

10.4 Description Schemes 10.4.1 AmendmentThe following document was approved

5926 MPEG-7 MDS Extensions II PDAM

10.4.2 CorrigendaThe following document was approved

5927 MPEG-7 MDS Cor/1 WD v1.0

10.5 Extraction and use of visual descriptors 10.5.1 AmendmentThe following document was approved

5957 Text of ISO/IEC TR 15938-8 PDAM1

10.6 Profiles10.6.1 Standard  The following documents were approved

6076 Request for subdivision ISO/IEC 15938-9 MPEG-7 Profiles

6040 Text of Committee Draft for ISO/IEC 15938-9 (MPEG-7 Profiles)

10.7 Schema definition10.7.1 Standard  The following document was approved

5929 MPEG-7 Schema Definition CD

6

10.8 Workplan This was approved (N6003)

11 MPEG phase 21 11.1 Part 1 – Vision, Technologies and Strategy 11.1.1 Technical Report The following document was approved

6042 Working Draft of 21000-1 MPEG-21 Vision, Technologies and Strategy

11.2 Part 2 – Digital Item Declaration 11.2.1 StandardThe following document was approved

5930 ISO/IEC 21000-2 DID 2nd Edition WD v.1

11.3 Part 7 – Digital Item Adaptation 11.3.1 Standard  The following documents were approved

5932 Study of Draft Comments on FCD – Digital Item Adaptation

5933 Study of ISO/IEC 21000-7 FCD – Part 7: Digital Item Adaptation

11.4 Part 8 – Reference software 11.4.1 Standard  The following documents were approved

5931 MPEG-21 REL/RDD Software Implementation Plan v.4

6068 WD 3.0 of ISO/IEC 21000-8 MPEG-21 Reference Software

11.5 Part 9 – File format11.5.1 Standard  The following document was approved

N5991 WD 4.0 of ISO/IEC 21000-9

11.6 Part 10 – Digital Item Processing11.6.1 Standard  The following document was approved

5939 MPEG-21 Digital Item Processing WD

7

v.3

11.7 Part 11 – Persistent Association11.7.1 Standard  The following document was approved

6047 Text of ISO/IEC 21000-11 WD 4.0 Evaluation Tools for Persistent Association Technologies

11.8 Part 13 – Scalable video coding11.8.1 Standard  The following document was approved

5958 Call for Proposals for Scalable Video Coding

11.9 Part 14 – Conformance11.9.1 Standard  The following documents were approved

6070 Request for Subdivision ISO/IEC 21000-14 MPEG-21 Conformance

6069 WD 1.0 of ISO/IEC 21000-14 MPEG-21 Conformance

11.10 Workplan This was approved (N6003)

12 Overall WG11 workplanThis was approved (N6003)

13 Liaison matters The following output documents were approved

N5908 Responses to National Body CommentsN5909 Liaison Statement to the Open Mobile Alliance (OMA)N5910 Liaison Statement to SMPTE regarding Microsoft VC-9 standardizationN5911 Liaison Statement to ITU-R SG 6/WP 6MN5912 Liaison Statement to the Content Reference Forum on Event Reporting RequirementsN5913 Liaison Statement to the Content Reference Forum on Usage EnvironmentsN5914 Liaison Statement to ISO TC 46/SC 9/WG 1N5915 Liaison Statement to DVB CPTN5916 Liaison Statement to 3GPP on extending the scope of the SC29 liaisonN5917 Liaison Statement to 3GPPN5918 Liaison Statement to SC36N5919 Liaison Statement to ATSCN5920 Liaison Statement to ITU-R SG 6N5922 List of Organisations with which MPEG entertains liaisonsN6073 Liaison Statement to SMPTE regarding new work item VC-9 Video Bitstream and

8

Decoding StandardN6074 Liaison Statement to DVB on audio and video compression standardsN6077 Liaison Statement to ATSC on audio and video compression standards

14 Administrative matters 14.1 Schedule of future MPEG meetings The following meeting schedule was approved

Meeting City Country

Yr.

Mo. Days

66th Brisbane, QLD

AU 03 10 20-24

67th Waikaloa, HI US 03 12 08-12

68th München DE 04 03 15-19

69th Seattle US 04 07 19-23

70th ? ES 04 10 18-22

71st Hong Kong CN 05 01 17-21

72nd ? KR 05 04 11-15

73rd Poznań PL 05 07 25-29

15 Organisation of this meeting 15.1 Joint meetings The following joint meetings were held

Groups What Where Day TimeReq-Sys-Mds M3W CL1 Mon 17:00-

18:00Req-Sys-Snh MP4 profiles, incl. X3D profiles Req Tue 09:00-

10:30Snh-Sys XMT Sys Tue 10:30-

11:00Aud-Sys Signaling of MP4 P&L in MP2 Sys Aud Tue 14:00-

14:30Mds-Int REL/RDD/DIA software Mds Tue 14:00-

15:30Vid-Tst SVC CfP Vid Tue 14:00-

16:00Aud-Sys Time stamps and AAC normative behav. Aud Tue 14:30-

15:00Aud-Sys Music notation Aud Tue 15:00-

16:00Aud-Sys Audio BIFS extensions Aud Tue 16:00-

16:30

9

Req-Vid SVC Req Tue 16:00-17:00

Req-Vid 3DAV Req Tue 17:00-17:30

Req-Mds-Aud-Vid-Sys MPEG-7 profiles Req Wed 11:30-13:00

Req-Sys-Snh Explorations: scene description, MPEG-J

Req Wed 14:00-15:00

Tst, Vid Error resilience VT plan Tst Wed 14:00-15:00

Req, Sys, Mds M3W Sys Wed 16:00-17:00

Tst, Vid SVC CfP Vid Wed 16:00-18:00

Mds, Int MPEG-21 integrated sw Mds Wed 17:00-18:00

Req-Snh SNHC profiles Req Thu 08:30-09:30

Req-Sys IP QoS Req Thu 09:30-10:00

Req, Sys, Snh MPEG-4 Profiles Req Thu 10:00-10:30

Req, Vid SVC Req Thu 10:45-11:00

Req, Vid Intra-only MPEG Req Thu 11:00-11:30

Mds, Snh Graphics DIA Mds Thu 11:00-11:30

Mds, Req, Sys IPMP tool capability Mds Thu 11:30-12:00

Mds, Req Metadata adaptation Mds Thu 12:00-12:30

TV Anytime presentation Req Thu 12:30-13:00

Vid-Snh 3D perceptual description Vid Thu 14:00-14:30

Req, Aud Profile for MPEG-4 Ext.2, Spatial Audio Aud Thu 14:00-14:30

Tst, Vid AVC/SVC/ER Vid Thu 17:00-18:00

15.2 Planning of future activities The following ad hoc groups were established:

5995 AHG on IM15994 AHG on MPEG-4 Scene Representation5993 AHG on MPEG-7 Systems5963 AHG on 3DAV Coding5970 AHG on AFX conformance5968 AHG on AFX document editing and Core Experiments

10

5971 AHG on AFX profiles5969 AHG on AFX SW implementation6032 AHG on Audio Explorations6036 AHG on AVC Verification Tests5949 AHG on Core Experiments for MPEG-21 DIA5945 AHG on Editing MPEG-21 DIA Study of FCD & AM5950 AHG on Editing MPEG-21 DID/DIP and Core Experiments for DIP5962 AHG on Editing MPEG-7 Visual related Document6057 AHG on Event Reporting 5946 AHG on Integration of DIA with REL and RDD6060 AHG on intra-only coding in MPEG5960 AHG on Maintenance of MPEG-4 Visual Draft Corrigendum, Reference Software and

Conformance5996 AHG on MPEG File format 6053 AHG on MPEG Multimedia Middleware (M3W)6072 AHG on MPEG Multimedia Test Bed6026 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software6024 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP46058 AHG on MPEG-21 Architecture and IPMP Requirements6071 AHG on MPEG-21 DIA Reference Software6055 AHG on MPEG-21 in Broadcasting 5948 AHG on MPEG-21 Media Locators 6054 AHG on MPEG-21 Profiles and Extensions5944 AHG on MPEG-21 REL and RDD Reference Software6025 AHG on MPEG-4 Audio Conformance6027 AHG on MPEG-4 Audio Extensions 1 and 26028 AHG on MPEG-4 Audio Lossless Coding5924 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 26029 AHG on MPEG-7 Audio6056 AHG on MPEG-7 Interoperability and Profiling5997 AHG on MPEG-J Extensions 6030 AHG on Music Notation Application Requirements  6059 AHG on Persistent Association Technologies5964 AHG on Scalable Video Coding6031 AHG on Timestamps and Audio Codec Behavior5947 AHG on Virtual Resources in DIA5961 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7

16 Resolutions of this meeting These were approved

17 A.O.B There was no other business18 Closing The meeting closed at 2003/10/24T20:30

11

Annex 1Attendance list

Title First Name Surname CountryMrs Myriam Amielh AustraliaMr Axel Becker AustraliaDr Ian S Burnett AustraliaMr Glenn Carrick AustraliaDr Joe F Chicharo AustraliaDr Eric Choi AustraliaMr Stephen Davis AustraliaMr Lakshan De Silva AustraliaMr Gerrard Drury AustraliaMr Daniel Franklin AustraliaMr Wei-Jyh Heng AustraliaMr Charles Hoang AustraliaMr Hartono Kurnio AustraliaDr Russell Lang AustraliaMr Matthew Leditschke AustraliaDr Wanqing Li AustraliaMr Spencer Lieng AustraliaMs Qiong Liu AustraliaMr Scott Maher AustraliaMr Michael Malone AustraliaMr Reiji Mathew AustraliaDr Philip Orgunbona AustraliaMr Guillame Potard AustraliaMr Brett Powley AustraliaMr Lee Rong AustraliaDr Claudia Schremmer AustraliaMr Charles Sevior AustraliaMr Stephen Spicer AustraliaDr Gautam Tendulkar AustraliaDr Raymond Wang AustraliaMs Marie Wines AustraliaDr Varuni Witana AustraliaDr Lei Ye AustraliaDr Zhenghua (Jack) Yu AustraliaMr Jian Zhang AustraliaProf Hermann Hellwagner AustriaMr Christian Timmerer AustriaDr Jan Bormans BelgiumMr Eric Delfosse BelgiumProf Rik Van de Walle BelgiumMr Alexandru Salomie BrusselsDr Feng Wu ChinaMr Marc Klein Middelink EindhovenMr Werner Oomen EindhovenMr Artur Lugmayr Finland

12

Dr Ye-Kui Wang FinlandMr Olivier Avaro FranceMs Raphaele Balter FranceDr Abdellatif Benjelloun

TouimiFrance

Mr Alexandre Cotarmanac'h FranceMr Christophe Daguet FranceProf Jean-Claude Dufourd FranceDr Patrick Gioia FranceMr Marc Vulcher Guez FranceDr Gwenaelle Marquant FranceDr Marius Preda FranceProf Francoise Preteux FranceMr Jean-Bernard Rault FranceMr Francois Xavier FranceMr Peter Amon GermanyMr Oliver Baum GermanyMr Markus Cremer GermanyDr Bernhard Feiten GermanyMr Ralf Geiger GermanyMr Matthias Gruhne GermanyDr Juergen Herre GermanyMr Joerg Heuer GermanyMr Tilman Liebchen GermanyMr Jens-Rainer Ohm GermanyMr Thomas Rusert GermanyMr Jurgen Schmidt GermanyDr Aljoscha Smolic GermanyMr Ralph Sperschneider GermanyMr Herbert Thomas GermanyMr Zvi Lifshitz IsraelMr Yuval Noimark IsraelMr Vittorio Baroncini ItalyDr Leonardo Chiariglione ItalyMr Roberto Flaiani ItalyProf Ricardo Leonardi ItalyProf Paolo Nesi ItalyDr Terumasa Aoki JapanMr Kohtaro Asai JapanProf Toshiaki Fujii JapanDr Koiti Hasida JapanMr Satoshi Ito JapanMr Toru Kambayashi JapanMr Itaru Kaneko JapanMr Kimihiko Kazui JapanMr Hideaki Kimata JapanMr Takahiro Kimoto JapanMr Ryuji Kitaura JapanMr Takuyo Kogure Japan

13

Ms Mayumi Koike JapanDr Takehiro Moriya JapanDr Tokumichi Murakami JapanMr Mizuho Narimatsu JapanMr Hirofumi Nishikawa JapanMr Toshiyuki Nomura JapanMs Yukiko Ogura JapanMr Masanori Sano JapanMr Mikio Sasaki JapanMr Craig Schultz JapanMr Takanori Senoh JapanMr Yoshinori Sugihara JapanMr Yoshinori Suzuki JapanMr Teruhiko Suzuki JapanDr Thiow Keng Tan JapanMr Naoya Tanaka JapanProf Masayuki Tanimoto JapanMr Takafumi Ueno JapanMr Shuicihi Watanabe JapanProf Hiroshi Watanabe JapanDr Akio Yamada JapanMr Yoshihisa Yamada JapanMr Kazumasa Yamazawa JapanDr Jong Jin Chae KoreaMr Yongju Cho KoreaProf Jong-Ki Han KoreaMr Mahnjin Han KoreaDr Yo-Sung Ho KoreaMr Youngsik Huh KoreaMr Han Ki Hun KoreaProf Euee S Jang KoreaMr Yeonjeong Jeong KoreaMr Senator Jeong KoreaDr Jechang Jeong KoreaMs Kyunghee Ji KoreaMr Sang-ug Kang KoreaDr Seok Cheol Kee KoreaMr Jong-Nam Kim KoreaMr Wook Joong Kim KoreaMr HyungJung Kim KoreaMr Jae-Gon Kim KoreaProf Hae-Kwang Kim KoreaMr Duck Hoon Kim KoreaDr Hyun Mun Kim KoreaMr Ki Seob Kim KoreaMr Yejin Kim KoreaMr James D.K Kim KoreaMr Sang-Wook Kim KoreaProf Munchurl Kim Korea

14

Prof Yung Lyul Lee KoreaMr Yung-Gi Lee KoreaMr Seung Wook Lee KoreaMr Sangyoun Lee KoreaMr Young-Kwon Lim KoreaDr Jeho Nam KoreaDr Seoung-Jun Oh KoreaMr Weongeun Oh KoreaMr Keunsoo Park KoreaMr Soojun Park KoreaDr In Kyu Park KoreaMr Jeongil Seo KoreaMr Jong Won Seok KoreaDr Woo Sung Shim KoreaMr Jae-Seob Shin KoreaDr DongKyoo Shin KoreaMs Young Joo Song KoreaMr Youngho Suh KoreaDr Doug Young Suh KoreaProf Chee Sun Won KoreaDr Kisong Yoon KoreaDr Andrew Tokmakoff NetherlandsMr Bas van den Heuvel NetherlandsMs Lena Pedersen NorwayProf Fernando Pereira PortugalDr Kok Seng Chong SingaporeMr Zhongyang Huang SingaporeMr Ming Ji SingaporeMr Men Huang Lee SingaporeMr Chak-Joo Lee SingaporeDr Keng Pang Lim SingaporeDr Xiao Lin SingaporeMr Jing Liu SingaporeMr Sua Hong Neo SingaporeMs Shengmei Shen SingaporeDr Rahardja Susanto SingaporeMr Rongshan Yu SingaporeProf Jaejoon Kim South KoreaProf Myoung Ho Lee South KoreaMr Thang Truong Cong South KoreaMr Francisco Moran Burgos SpainDr Jaime Delgado SpainMr Marc Gauvin SpainDr Per Frojdh SwedenMr Kristofer Kjoerling SwedenMr Claudio Alberti SwitzerlandProf Touradj Ebrahimi SwitzerlandMr Chris Joslin SwitzerlandMr Guy Moreillon Switzerland

15

Dr Julien Reichel SwitzerlandDr Francesco Ziliani SwitzerlandMr Jean H.A. Gelissen NetherlandsMr Chris Barlas United

KingdomDr Miroslaw Bober United

KingdomMr Richard Gooch United

KingdomDr Catherine Grant United

KingdomMr Andy Harrower United

KingdomMr Don Harwood United

KingdomMr Paul Jessop United

KingdomDr Panos Kudumakis United

KingdomMr Keith Millar United

KingdomMr Niels Rump United

KingdomDr Leszek Cieplinski United

KingdomDr Simon Rowe United

KingdomMr Jonathan Teh United

KingdomMr Simon Watt United

KingdomMr Barney Wragg United

KingdomMr Mikael Bourges-Sevenier USAMr Wo Chang USADr George Chen USAMs Fang-Chu Chen USAMr Greg Conklin USAMr Thomas DeMartini USAMr Matt Fellers USADr Charles Fenimore USAMr Brad Gandee USAMr Walter Gish USAMr Marco Hurtado USAMr Walt Husak USAMr James Johnston USAMr Rob Koenen USAMr Vladimir Levantovsky USAMr Tom McMahon USA

16

Dr Debargha Mukherjee USAMr Martha Nalebuff USADr Mandayam Narasimhan USAMr Gerald Powell USAMr Schuyler Quackenbush USADr Justin Ridge USAMr Mike Rubinfeld USAMr Peter Schirling USAMr Paul Schumacher USADr John Smith USAMr Huifang Sun USADr Viswanathan Swaminathan USADr Andy Tescher USADr Anthony Vetro USAMr Mark Vinton USAMr Mohammed

ZubairVisharam USA

Dr Xin Wang USA

17

Annex 2Agenda

1 Opening 2 Roll call of participants 3 Approval of agenda 4 Allocation of contributions 5 Communications from Convenor 6 Report of previous meeting 7 Processing of NB Position Papers    8 MPEG Phase 1 8.1 Part 1 – Systems 8.2 Part 2 – Video 8.2.1 Corrigenda 8.3 Part 3 – Audio 8.4 Part 4 – Conformance 8.5 Part 5 – Reference software 9 MPEG Phase 2 9.1 Requirements 9.2 Part 1 – Systems 9.2.1 Standard 9.2.2 Amendment 1 9.2.3 Amendment 2 - Support of IPMP on MPEG-2 Systems 9.2.4 Amendment 3 - Carriage of AVC Content 9.2.5 Corrigenda 9.3 Part 2 – Video 9.4 Part 3 – Audio 9.5 Part 4 – Conformance 9.5.1 Standard 9.5.2 Amendment 1 9.5.3 Amendment 2 9.5.4 Amendment 3 9.5.5 Amendment 4 9.5.6 Corrigenda 9.6 Part 5 – Reference software 9.6.1 Standard 9.6.2 Amendment 9.6.3 Corrigenda 9.7 Part 6 – DSM-CC 9.8 Part 7 – Advanced Audio Coding 9.8.1 Standard 9.8.2 Amendment 1 - Embedding of bandwidth extension 9.8.3 Corrigenda 9.9 Part 9 – System extension RTI 9.10 Part 10 – Conformance extension - DSM-CC 9.11 Part 11 – IPMP on MPEG-2 Systems 9.11.1 Standard 9.11.2 Amendment 9.11.3 Corrigenda 9.12 Workplan  10 MPEG Phase 4

18

10.1 Requirements 10.2 Part 1 – Systems 10.2.1 Standard 10.2.2 Amendment 1 – FlexTime 10.2.3 Amendment 2 – XMT BIFS nodes 10.2.8 Amendment 7 – Systems Extensions for AVC 10.2.9 Amendment 8 – Advanced Text & Graphics 10.2.10

Amendment 9 – Use of MPEG-7 in MPEG-4 Systems

10.2.12

Corrigenda

10.3 Part 2 – Visual 10.3.1 Standard 10.3.2 Amendment 1 – Studio Profile 10.3.3 Amendment 2 – FGS 10.3.4 Amendment 3 – New Levels &Tools 10.3.5 Amendment 4 – Error Resilience in Scalable Enhancement Layer 10.3.6 Corrigenda 10.4 Part 3 – Audio 10.4.1 Standard 10.4.2 Amendment 1 – Bandwidth Extension 10.4.3 Amendment 2 – Parametric Extension 10.4.4 Amendment 3 – Lossless Audio 10.5 Part 4 – Conformance Testing 10.5.1 Standard 10.5.2 Amendment 1 – SP, FGS, FlexTime 10.5.3 Amendment 2 – XMT 10.5.4 Amendment 3 – Visual New L&T 10.5.5 Amendment 4 – AVC 10.5.6 Amendment 5 - Error Resilience Scalable Profile Conformance 10.5.7 Amendment 6 - AVC 10.5.8 Amendment 7 - AFX 10.5.7 Corrigenda 10.6 Part 5 – Reference software 10.6.1 Standard 10.6.2 Amendment 1 – SP, FGS, FlexTime 10.6.3 Amendment 2 – XMT, DMIF 10.6.4 Amendment 3 – Visual New L&T 10.6.5 Amendment 4 – AVC 10.6.6 Amendment 5 - Error Resilience Scalable Profile Reference Software 10.6.7 Amendment 6 - AVC 10.6.8 Amendment 7 - AFX 10.6.7 Corrigenda 10.7 Part 6 – DMIF 10.7.1 Standard 10.7.2 Corrigenda 10.8 Part 7 – Optimised software 10.8.1 Technical Report 10.8.2 Amendment 1 - Optimised software for simple profile and error

resilience 10.9 Part 8 – 4 on IP Framework

19

10.9.1 Standard 10.9.2 Corrigenda 10.10 Part 9 – Hardware Reference Description 10.10.1

Technical Report

10.10.2

Amendment

10.11 Part 10 – Advanced Video Coding 10.11.1

Standard

10.12 Part 11 – Scene Description and Application Engine  10.12.1

Standard

10.12.1

Amendment 1 

10.13 Part 12 – ISO Base Media File Format 10.13.1

Standard

10.13.2

Amendment

10.14 Part 13 – IPMP Extensions  10.14.1

Standard

10.15 Part 14 – MP4 File Format  10.15.1

Standard

10.16 Part 15 – AVC File Format  10.16.1

Standard

10.17 Part 16 – Animation Framework Extension (AFX) 10.17.1

Standard

10.8.2 Amendment 1 - AFX Extension 10.17 Workplan 11 MPEG Phase 7 11.1 Requirements 11.2 Systems 11.2.1 Standard  11.2.2 Amendment 1 - Systems Extensions 11.2.3 Corrigenda 11.3 Description Definition Language 11.3.1 Standard  11.3.2 Corrigenda 11.4 Visual 11.4.1 Standard  11.4.2 Amendment 1 - Visual Descriptors Extensions 11.4.3 Corrigenda 11.5 Audio 11.5.1 Standard  11.5.2 Amendment 1 - Audio Visual Descriptors Extensions11.5.3 Corrigenda

20

11.6 Description Schemes 11.6.1 Standard  11.6.2 Amendment 1 - Multimedia Description Schemes Extensions 11.7 Reference software 11.7.1 Standard  11.7.2 Amendment 1 - Reference software extensions 11.7.3 Corrigenda 11.8 Conformance Testing 11.8.1 Standard  11.9 Extraction and use of visual descriptors 11.9.1 Technical Report 11.9.2 Amendment11.10 Workplan 12 MPEG phase 21 12.1 Requirements 12.2 Part 1 – Vision, Technologies and Strategy 12.3 Part 2 – Digital Item Declaration 12.3.1 Standard  12.3.2 Amendment 12.3.3 Corrigendum 12.4 Part 3 – Digital Item Identification 12.4.1 Standard  12.4.2 Amendment 12.4.3 Corrigendum 12.5 Part 4 – Intellectual Property Management and Protection 12.5.1 Standard  12.6 Part 5 – Rights Expression Language 12.6.1 Standard  12.7 Part 6 – Rights Data Dictionary 12.7.1 Standard  12.8 Part 7 – Digital ItemAdaptation 12.8.1 Standard  12.9 Part 8 – Reference software 12.9.1 Standard  12.10 Part 9 – File format 12.10.1

Standard 

12.11 Part 10 - Digital Item Processing12.10.1

Standard 

12.12 Part 11 - Evaluation Tools for Persistent Association12.12.1

Technical Report

12.13 Part 12 - Test Bed for MPEG-21 Resource Delivery12.13.1

Standard 

12.11 Other MPEG-21 parts 12.11.1

Event reporting

12.11.2

Broadcasting

21

12.12 Workplan 13 Overall WG11 workplan 14 Explorations 14.1 Scalable Video Coding 14.2 3D AV coding  14.3 Test material 14.4 Vocabulary15 Liaison matters 16 Administrative matters 16.1 Schedule of future MPEG meetings 16.2 Promotional activities 17 Organisation of this meeting 17.1 Tasks for subgroups 17.2 Joint meetings 18 Planning of future activities 19 Resolutions of this meeting 20 A.O.B 21 Closing

22

Annex 3List of documents submitted

No. Authors Title

9949 Wo Chang Document Register for SC29/WG11 Meeting Brisbane, AU

9950 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

9951T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual Text, Reference Software and Conformance

9952 Miroslaw BoberSang-Kyun Kim

AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7

9953

A. YamadaL. Cieplinski Sang Kyun Kim

AHG on Editing MPEG-7 Visual FPDAM1, DCOR1 and WD for 15538-8 DAM1

9954 Aljoscha SmolicHideaki Kimata AHG on 3DAV Coding

9955Mihaela van der SchaarU. BenzlerC.J. Tsai

AHG on Scalable Video Coding

9956 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

9957 Ralph Sperschneider AHG on MPEG-4 Audio Conformance

9958 Ralph SperschneiderHeiko Purnhagen AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

9959 T. Nomura AHG on MPEG-4 Audio Extensions 1 and 2

9960 Schuyler Quackenbush AHG on MPEG-4 Audio Lossless Coding

9961 Jan RohdenJoerg Bitzer AHG on MPEG-7 Audio

9962Marius PredaMahnjin HanMikael Bourges-S‚venier

AHG on AFX documents editing and Core Experiments

9963 Patrick GioiaJames D. K. Kim AHG on AFX SW Implementation

9964Mahnjin HanAlain MignotMikael Bourges-Sevenier

AHG on AFX Conformance

9965 Marius PredaMahnjin Han AHG on AFX Profile

9966

Frederic VexoMario GutierrezMarius PredaFrançoise PreteuxJens Piesk

AHG on Cluster Animation and Morphing

9967 Claude SeyratAli Tabatabai AHG on MPEG-7 Systems

23

9968Jean-Claude DufourdYuval FisherJuergen Schmidt

AHG on MPEG-4 Scene Representation

9969 Zvi Lifshitz AHG on IM1

9970Young-Kwon LimJan Van der MeerCarsten Herpel

AHG on the Carriage of MPEG-4 Content

9971 Dave Singer AHG on MP4 Extensions

9972Chun-Jen TsaiMihaela van der ShaarYoung-Kwon Lim

AHG on MPEG Multimedia Test Bed

9973 Tobias OelbaumTK Tan AHG on AVC Verification Tests

9974 Barney WraggThomas DeMartini

AHG on Editing the MPEG-21 Rights Expression Language FDIS

9975 Xin WangJaime Delgado AHG on MPEG-21 REL and RDD Reference Software

9976 Chris BarlasGodfrey Rust AHG on editing RDD FDIS

9977Anthony VetroChristian TimmererEric Delfosse

AHG on Editing MPEG-21 Digital Item Adaptation FCD & AM

9978

Thomas DeMartiniAnthony VetroSylvain DevillersBarney WraggChris Barlas

AHG on Integration of DIA with REL and RDD

9979 Jeho NamDebargha Mukherjee

AHG on Core Experiments for MPEG-21 Digital Item Adaptation

9980Andrew PerkisAndreas HutterZhongyang Huang

AHG on Updating DIA Descriptions

9981

GerrardDruryRik Van de WalleIan BurnettMunchurl Kim

AHG on Editing MPEG-21 DID and DIP Working Drafts

9982 Wo ChangMasanori Sano AHG on MPEG-7 Interoperability and Profiling

9983 Paolo NesiGiorgio Zoia AHG on Music Notation Requirements

9984Simon WattCraig SchultzRob Koenen

AHG on MPEG-21 Architecture

9985 FXNuttallAndrew Tokmakoff AHG on MPEG-21 Event Reporting

9986 Jong-NamKimArtur LugmayrAbdellatif

AHG on study of MPEG-21 and broadcasting

24

Benjelloun Touimi

9987 Jaime Delgado AHG on MPEG-21 Profiles

9993Niels Rump Richard GoochPaul Jessop

Editors' input on Evaluation Tools for Persistent Association Technologies

9988 Paul JessopNiels Rump AHG on Persistent Association

9989 Brad GandeeChris Barlas AHG on Profiles and Extensions for the MPEG-21 REL

9990 Ian BurnettBas van den Heuvel AHG on Multimedia Middleware (M3W)

9991 Mike Rubinfeld AHG on Vocabulary

9992Gerrard DruryChristian TimmererJeho Nam

AHG on MPEG-21 DIA Reference Software

9994 29 Secretariat Liaison Statement from TV-Anytime Forum [SC 29 N 5554]

9995 Schultz MPEG-21 IPMP Architecture

9996 Schultz Rights Discovery Use Case

9997 Thomas DeMartiniXin Wang Rights Display Use Case

9998Xin WangThomas DeMartiniBrad Gandee

MPEG-21 IPMP Use Case for Digital Item Distribution

9999Thomas DeMartiniAnthony VetroDebargha Mukherjee

Input on DIA/REL/RDD Integration

10000

Xin WangThomas DeMartiniJaime DelgadoEva RodriguezSilvia Llorente

Data Types for MPEG-21 REL Interpretation Conformance Software

10001

Xin WangThomas DeMartiniMai Nguyen Edgar ValenzuelaJaime DelgadoEva RodriguezSilvia Llorente

MPEG-21 REL Validation Rules

10002 JTC 1 Secretariat via SC 29 Secretariat

Summary of Voting on ISO/IEC TR 14496-7/DAM 1 [SC 29 N 5559]

10003 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-16 [SC 29 N 5560]

10004

ZY HuangMing JiSM ShenJing LiuTaka SenohTakafumi UenoTakuyo Kogure

Use cases for DI consumption with information exchange and related requirement for MPEG-21 architecture

25

10005 Andrew Tokmakoff MPEG-21 Architecture: An Event Reporting Perspective

10006

Takanori SenohTakafumi UenoTakuyo KogureSM ShenMing JiZY HuangJing Liu

An MPEG-21 Architecture Use Case Scenario for a Peer-to-Peer Transaction of DI

10007 Melanie Dulong de RosnayDaniela Parayre Use cases for MPEG-21 IPMP architecture

10008 Steve Mitchell none

10009 Itaru Kaneko - WasedaMika Ohnishi - MMG Technical analysis of Use Cases – m9698

10010 A. Schultz Proposed Core Use cases.

10011 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 7 [SC 29 N 5561]

10012 SC 29 Secretariat

IEC NP: Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958- Part 8: Non-linear PCM bitstreams according to the Windows Media Audio Professional [SC 29 N 5562]

10013 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2000/FDAM 2 [SC 29 N 5565]

10014 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2001/FDAM 1 [SC 29 N 5566]

10015Jean Le FeuvreCyril ConcolatoJean-Claude Dufourd

Issues on externProto Coding

10016 Yuval Fisher 14496-1 Candidate

10017 Yuval Fisher 14496-11 Candidate

10018 Yuval Fisher 14496-1,14496-11 master document

10019 Sylvain Devillers on behalf of the BNB

Preliminary list of Belgian NB comments on MPEG-21 DIA FCD

10020 Sylvain DevillersEric Delfosse

Problems in the current DIA schema design, proposal for an abstract model and a corrected schema design

10021 The USMPEGCommittee US Contribution to the Future of WG 11

10022 SC 29 Secretariat Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5570]

10023 SC 29 SecretariatIEC CDV 61883-6: Consumer audio/video equipment -- Digital interface -- Part 6: Audio and music data transmission [SC 29 N 5571]

10024 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 3 [SC 29 N 5572]

10025George ChenKim NgHuisheng Wang

A Multi View Video Compression Scheme Based on Direct View Synthesis

10026 MarquantViéron

Contribution to the definition of the draft call for proposals on new tools for scalable video coding technology

26

FrancoisBoissonRobert

10027Tamer ShanablehJonathan TehTony May

An analysis of the bit error sensitivity of the MC-EZBC bitstream

10028 Andy Tescher for USNB USNB Contribution: Proposed communication to SMPTE

10029 Andy Tescher for USNB USNB Contribution: MPEG-7 profiles

10030 Andy Tescher for USNB USNB Contribution: “MPEG-4 Profiles under Consideration” document

10031 Andy Tescher for USNB USNB Contribution: Subdivision 17 of MPEG-4

10032 Andy Tescher for USNB USNB Contribution: Lossless audio

10033 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-14 [SC 29 N 5579]

10034 SC 29 Secretariat Summary of Voting on ISO/IEC CD 14496-17

10035 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-1/DCOR 1

10036Sylvain DevillersEric DelfosseJan Bormans

Use of the XPointer framework as URI fragment identifiers for addressing MPEG-21 descriptions

10037 Christian TimmererHermann Hellwagner Proposed modifications to MPEG-21 DIA FCD

10038Eva RodriguezJaime DelgadoSilvia Llorente

DMAG REL License Interpreter v.1.1

10039Eva RodriguezJaime DelgadoSilvia Llorente

DMAG REL Schema Checker

10040Silvia LlorenteJaime DelgadoEva Rodriguez

DMAG REL License Creator

10041Eva RodriguezJaime DelgadoSilvia Llorente

DMAG REL Validation Rules Checker

10042

Filippo Chiariglione (CRL) Panos Kudumakis (CRL)Claudio Alberti (EPFL)Antonio Romeo (EPFL)Massimo Balestri (TILAB)João Trindade (ADETTI)Ji Ming

MOSES implementation of MPEG-4 IPMP Messages - version 1.1

10043 John R. Smith MPEG-7 Schema Definition (Part 10) WD v1.1

10044

Peter van BeekThomas DeMartiniBhavan Gandhi Debargha MukherjeeJohn R. SmithAnthony Vetr

Preliminary Comments on DIA FCD

10045 Chris JoslinThomas DiGiacomo

Swiss NB Comment on DeviceBenchmarking for DIA

27

Stephane GarcheryNadia Magnenat-Thalmann

10046 Andy Tescher for the USNB USNB Contribution: ITTF ballot processing

10047

Doug Young SuhChun-Jen TsaiAlexandre CotarmanachKyuheon KimAndrew Perkis

Comprehensive interoperability between MPEG and Internet

10048 CJ Lee for SgNB SgNB Comments on Requirements for Scalable Lossless Audio Coding

10049

Roland Tusch Christian Timmerer Laszlo Böszörmenyi Hermann Hellwagner

Implementation of Usage Environment Description Tools in an Adaptive Distributed Multimedia Streaming Server

10050 Yoram Elichai Synthesized Texture update

10051

Raphaele BalterPatrick GioiaLuce MorinFranck Galpin

Comments on Model Based Video Streaming

10052Anthony VetroChristian TimmererSylvain Devillers

Editors Input on DIA Study of FCD

10053Anthony VetroChristian TimmererSylvain Devillers

MPEG-21 Digital Item Adaptation AM v6.1

10054 Hideaki Kimata Preliminary study on multiple view coding for the Ray Space representation (3DAV EE2)

10055 Moriya Dai Tracy Yang Proposal of Core Experiment for Lossless Coding of Audio in Floating-point Format

10056 Julien ReichelFrancesco Ziliani

Contribution to Applications and Requirements for Scalable Video Coding

10057Tom McMahonPeter SymesOliver Morgan

SMPTE Liaison to WG11 regarding Microsoft VC-9 standardization

10058 Yejin KimTae-Joon Park

Call for Requirements and discussion for On-Line Gaming (OLGA)

10059

Chris JoslinThomas Di GiacomoNadia Magnenat-ThalmannMarius PredaFrançoise Prêteux

CE Report on Avatar Preferences

10060 Cyril ConcolatoJean-Claude Dufourd Various fixes on XMT-A schema

10061 Shuichi WatanabeJoerg Heuer

Report on MPEG-7 Systems ME-1: Evaluation of the rational position codes framework

10062 MPEG-21 & Broadcasting Use Case – The End-to-End QoS Management in Broadcasting Systems

10063 Romulo Pinho (TV Globo) Support for MPEG-7 Core Content Description Profile

28

10064 Fernando Pereira on behalf of the Portuguese National Body Proposal for study of licensing models

10065 Fernando Pereira on behalf of the Portuguese National Body Regarding MPEG-4 profiling

10066

Masanori SanoBhavan GandhiAlan MelbyRomulo Pinho

Supporting Descriptions for the Core Content Description Profile (CCDP) and a Proposed Grouping Within CCDP

10067 Giorgio ZoiaPaolo Nesi AHG on Music Notation Requirements

10068

Giorgio ZoiaPaolo NesiPierfrancesco BelliniJerome Barthelemy

Music Notation Application Requirements and MPEG Technology

10069 Soo-Jun Park Report of cross verification result of VCE-1, Perceptual 3D Shape Descriptor

10070 Soo-Jun Park Report of Core Experiment result of VCE-2, Binary Representation of Visual Descriptors

10071Soo-Jun ParkMyung Gil JangChee Sun Won

A proposal for feature based classification of MPEG-7 visual descriptors

10072 Wo Chang Editorial Changes to MPEG-7 Profile under Consideration

10073 Wo Chang Propose MPEG-7 Profile Part 9 Committee Draft

10074 Takahiro KimotoYoshihiro Miyamoto

Comments on Draft Call for Proposals on Scalable Video Coding Technology

10075

Kohtaro AsaiYoshihisa YamadaHirofumi NishikawaTokumichi Murakami

Consideration on MPEG-intra

10076

Truong Cong ThangYong Ju JungYong Man RoJae-Gon KimJeho NamJin-Woo Hong

Modality Conversion for QoS Support in UMA

10077

Yongju ChoLim Young-KwonSong MoonsupKime Hyoung-Joong

Suggestion to MPEG-21 file format

10078 Ralf Geiger Jürgen Herre Technical Description of Improved IntMDCT

10079 Tilman Liebchen Verification Report on MPEG-4 ALS Core Experiment 1 (Improving Coding of Prediction Residual)

10080 Tilman Liebchen Proposed Core Experiment for Supporting Multichannel, 32-bit PCM, and Arbitrary Input File Formats in MPEG-4 ALS

10081 Christian Timmereron behalf of the CE Report on CE of Universal Constraints Descriptor (UCD)

10082 Jean-Claude Dufourd Integration Report for the 65th meeting

29

10083 Won-Geun Oh (ETRI) Kwang-Bum Jin (Sejong Univ.)

Standard efforts for still image watermarking certification in Korea

10084 Te-Ming ChiuFang-Chu Chen SFBBS on BSAC system

10085

Myriam AmielhErnest WanIan BurnettGerrard DrurySilvia PfeifferClaudia Schremmer

Generic syntax for an addressing scheme dedicated to non-XML documents

10086 Myriam AmielhErnest Wan Location of a volume or a moving region in audiovisual content

10087

ZY HuangSM ShenMing JiTaka SenohTakafumi UenoTakuyo Kogure

Device Property of IPMP tools in DIA

10088 Makoto OkuiFumio Okano Real-time 3-D Imaging Method based on Integral Photography

10089 Kim A Proposal for Multi-view Face descriptor

10090

YoungJoo SongJinWoo HongKyunghee JiNammee Moon

MPEG-21 Event Reporting Message Structure based on digital data broadcasting use case scenarios

10091

Senator JeongWeon-Guen OhKi-Song YoonYeon-Jeong Jeong

Contractual perspective of Event Reporting Requirements

10092 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 15938-7 [SC 29 N 5582]

10093In Kyu ParkDuck Hoon KimIl Dong Yun

Perceptual 3D shape descriptor: Result of core experiment (VCE-1)

10094 Shinjun LeeIn Kyu Park

Syntactic Description of PointTexture Compression in Depth Image-based Representation (DIBR)

10095Kazumasa Yamazawa (NAIST)Hideaki Kimata (NTT)Takashi Matsuyama (Kyoto Univ.)

Plan of JEITA for Omni-directional Video

10096Jens-Rainer OhmYi-Shin Tung Tihao Chang

Draft Text of ISO/IEC 14496-2:2003/DCOR1

10097 Jean-Claude Dufourd A simpler, efficient binary encoding for MPEG-4 scenes

10098

Euee S. JangSun Young LeeHyun Jong OhSung Won ParkWook-Joong KimMyungsuk KiKyuheon Kim

Study and experiments on the random access (partial decoding and rendering) of panoramic image

30

10099

Christian Timmerer Hermann HellwagnerEric Delfosse Sylvain Devillers

Implementation of a Digital Item Adaptation Engine

10100 Tanton BBC UKNB Position paper regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

10101 Bob FengShiqiang Yang MPEG-4 AVC Reference Software Optimization

10102 Leszek Cieplinski Additional results of VCE-3 for DominantColor descriptor

10103 Jan RohdenMatthias Gruhne

First Draft of the syntax description for Rhythmic Pattern Representation

10104 Letian RongIan Burnett In response to FCD comments on DIAConfiguration

10105

Dae Ha RyuMi Ja KimDae Yong KimSung Won ParkEuee S. Jang

Results of mini experiment on lossless 3DMC

10106 Keith Millar Results of Core Experiment on Indexing (TV-Anytime)

10107 Lifang Wu Estimation of facial pose

10108Rene van der VleutenFons BrulsJan van der Meer

Comments on Draft Call for Proposals on new Tools for Scalable Video Coding Technology

10109Christophe ClercMassimo RavasiMarco Mattavelli

Complexity Evaluation, in-depth Analysis and Possible Optimisations of Different Configurations of JVT Codec

10110 Jean-Claude Dufourd Rationale for a New Scene Description Format

10111

Mariam Kimiaei-Asadi Jean-Claude DufourdTruong Cong ThangYong Man RoJeho Nam

Report of CE on Transmoding

10112 Jérôme Daniel Proposal of a new SoundField node in MPEG-4 BIFS

10113 Kristofer KjörlingAndreas Schneider

Proposed additions to the working draft on SBR conformance (N5724).

10114 Gyeong Ja Jang The specifications for XMT-A compliant BitWrapper node and the encoding parameters

10115 Kristofer KjörlingPierrick Philippe

(Proposed) Report on the Verification Tests of the new MPEG-4 Audio Profile, High Efficiency AAC

10116

Kristofer KjörlingPierrick PhilippeEwen CamberleinKok SengNomura

Proposed additions to ISO/IEC 14496-3:200x/Cor.x.

10117 Kristofer KjörlingHeiko Purnhagen

Proposed modification of 14496-3:200X/Cor. X (N5712) in order to resolve the problems with LATM and explicit SBR signalling.

10118 Ralph Sperschneider WD 3.0 of ISO/IEC 13818-4:2004/Amd.5 (Audio Conformance)

31

on behalf of the AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

10119Ye-Kui WangEmre AksuMiska Hannuksela

Signaling of error resilience information in file formats

10120 Juergen SchmidtJérôme Daniel Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3

10121 Kristofer KjörlingHeiko Purnhagen

Proposed addition to 14496-3:200x/Cor.x. (N5712) enabling DRC in combination with SBR.

10122 Juergen SchmidtJérôme Daniel

Comments on Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3

10123Ye-Kui WangMiska Hannuksela Emre Aksu

Support of sub-sample in file formats

10124 Ye-Kui WangHarri Honko Signaling of location metadata in file formats

10125 KNB KNB Comment on 14496-4:2003/PDAM7 (AFX Conformance)

10126 Werner Oomen Sound material for CfP on lossless coding of 1 bit oversampled audio

10127 Werner Oomen MPEG-4 Extension 2, Core Experiments on Low complexity decoding

10128 Krzysztof KucharskiWladyslaw Skarbek

Cross verification results of the Dominant Color Descriptor (VCE-3)

10129Andy GerritsBert den BrinkerWerner Oomen

Core Experiment on ADPCM coding of sinusoidal parameters in MPEG-4 Audio Extension 2

10130 Werner Oomen MPEG-4 Extension 2, proposed editorial changes

10131 Marc Klein MiddelinkWerner Oomen MPEG-4 Extension 2, proposal for a profile definition

10132

James D.K. KimJeong-Hwan AhnSang-Oak WooMahnjin Han

Proposal for Simple Compressed 3D Profile

10133Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance

Status on MPEG-4 Audio Conformance

10134 Werner Oomen MPEG-4 Ext.2 Verification test issues

10135

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Technical Description of I2R’ Proposal for MPEG-4 Audio Scalable Lossless Coding (SLS): Advanced Audio Zip (AAZ)

10136

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Proposed Core Experiment for improving coding efficiency in MPEG-4 audio scalable coding (SLS)

10137 Keith MillarJoerg Heuer

Report on Core experiments for MPEG-7 Systems extensions (Harmonization of the Index Systems)

32

Andrea Kofler-Vogt

10138Sylvain DevillersEric DelfosseJan Bormans

Hierarchical addressing scheme for ISO file format

10139

Marius PredaFrançoise PreteuxFrederic VexoJens Piesk

Animation by Morphing

10140

Joerg HeuerAndreas HutterHarald KoschAndrea Kofler-Vogt

Report on Core experiments for MPEG-7 Systems extensions (Multiple-Field Queries)

10141 Marius PredaFrançoise Preteux Proposal for Animated Character Profile

10142Leszek CieplinskiJordi CaballAndrew Secker

Intra-frame prediction of high-pass frames in MCTF

10143 Mohammed Zubair VAli Tabatabai

Recommendation for the Interoperability issue related to the storage of AAC content in the MP4 File Format

10144 Sylvain Devillerson behalf of the CE Report of CE on BSD Transformation Instructions

10145Joerg HeuerDaniel PeintnerAndreas Hutter

Results of CE for Systems Extensions - ME-2

10146Joerg HeuerGabriel PanisAndreas Hutter

Contribution to CE on BSD Transformation Instructions

10147 Heiko PurnhagenKristofer Kjörling

Proposed clarification for carriage of MPEG-4 Audio over MPEG-2 Systems

10148

Brad GandeeTJ PannuManuel HamXin WangThomas DeMartini

Proposal for Creating a Profile of MPEG-21 REL for Mobile DRM Systems

10149 Julien ReichelFrancesco Ziliani

Comments on Draft Call for Proposals on Scalable Video Coding Technology

10150

Markus BeermannKonstantin HankeThomas RusertMathias Wien

Investigation of Test Sequences for Call for Proposals on New Tools for Scalable Video Coding Technology

10151 Thomas Rusert Operating Point Adaptation in Interframe Wavelet Video Coding

10152 Karsten MuellerAljoscha Smolic Study on View-Dependent Multitexturing for MPEG-4 AFX

10153P. van BeekS. WatanabeI. Sezan

Current status of MPEG-7 User Description Profile

10154 P. van BeekW. Chang

Signaling of profile & level in MPEG-7 descriptions

33

T. DeMartiniB. GandhiA. MelbyM. SanoJ. SmithA. Vetro

10155 Jean-Claude Dufourd Request for a mechanism to add to a closed stream

10156

Ralph Sperschneider on behalf of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Proposed ISO/IEC13818-7:2004 (AAC 3rd edition)

10157

Ralph Sperschneider on behalf of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Working Draft of Third Edition of ISO/IEC14496-3

10158John WoodsYongjun Wu Robert Cohen

An Overlapped Block Motion Compensation for MC-EZBC

10159 Chun-Jen TsaiChung-Neng Wang

Proposed Draft Requirements for ISO/IEC TR21000-12 Multimedia Test Bed for Resource Delivery, v. 3

10160

Chia-Yang TsaiHsiao-Chiang ChuangJin-He ChenJau-Ching MaChi-Yu LiuChen-Wei FanChung-Neng WangChun-Jen Tsai

Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

10161 Yuriy A. Reznik Proposed WD1 of ISO/IEC 14496-3:2001 /AMD 4 (Audio Lossless Coding - ALS)

10162 Yuriy A. Reznik Additional Improvements in MPEG-4 ALS CE1 (Coding of Prediction Residual)

10163Chun-Jen TsaiMihaela van der ScharrYoung-Kwon Lim

MPEG Multimedia Test Bed WD 3.0 for MPEG-21 DIA support

10164 Andrew Tokmakoff A simple multi-peer MPEG-21 scenario

10165 Schuyler Quackenbush Draft Report on Audio Bandwidth Enhancement Verification Report

10166 Bourges-SevenierAaron E. Walsh X3D Interactive profile, bitstream update

10167 Mikael Bourges-SevenierVishy Swaminathan MPEG-J extensions to create applications

10168 Akio Yamada Sang Kyun Kim WD 1.1 of ISO/IEC TR 15938-9/AMD1

10169 Akio Yamada Leszek Cieplinski Editor's Study on ISO/IEC 15938-3/FPDAM1

10170 David Singer Proposed ISO Amendment Working Draft Text

10171 Akio Yamada A Proposed fix on GopGofFeature Binary Syntax

34

10172 Akio Yamada Preliminary Study on the Categorization of Description Tools of Visual Signal Characteristics for Snapshots

10173

Yi-Shin TungChung-Neng WangTiHao ChiangJens-Rainer Ohm

MPEG-4 Visual: Updated List of Problems Reported, v.9.1

10174 Jing-Xin WangAlvin W.Y. Su

NCKU MPEG-4 Simple Profile Software Encoder Contribution

10175

Eunmi OhJung-Hoe Kim Miao Lei Sang-Wook Kim

Effects of lossy core components in audio scalable lossless coding

10176 Mohammed Zubair VisharamDave Singer

Storage/Signaling encrypted media in MP4-FF and MPEG-4 Systems

10177 Gerrard DruryIan Burnett Evaluation Criteria for currently proposed DIBOs

10178 Masayuki TanimotoToshiaki Fujii Coding of multiple views using temporal and spatial prediction

10179Jing LiuMing JiShengmei Shen

Update of MPEG-2 IPMP Reference Software

10180Jing LiuMing JiShengmei Shen

Progress Report of MPEG-2 IPMP Conformance Test

10181 Stephen DavisIan Burnett Comments on DIA structure compression

10182 SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 5576]

10183

ZY Huang SM Shen M Ji (PSL)Taka Senoh Takafumi Ueno (MEI)Melanie Dulong de RosnayDaniela Parayre (MediaLive)

Use cases studies for MPEG-21 architecture

10184 Lugmayr Abdellatif Benjelloun Touimi Jong-NamKim MPEG-21 in broadcasting AHG report

10185 Mikael Bourges-SevenierVishy Swaminathan New requirements for MPEG-J Renderer API

10186

Ji MingLiu JingSM ShenTaka SenohTakafumi UenoTakuyo Kogure

MPEG-2 IPMP Messages Implementation version 1.0

10187

Ji MingZY HuangSM ShenTaka SenohTakafumi UenoTakuyo Kogure

Hierarchical Diagrams for MPEG-21 architecture

10188 Ji Ming 14496-13 Candidate

10189 Ji Ming 14496-1/FDAM 3 Candidate

35

10190 Lakshan De SilvaIan Burnett Digital Item Meta-data Adaptation Engine

10191 Lakshan De SilvaIan Burnett MPEG-21 Hierarchical Device Aggregation

10192 Lakshan De SilvaIan Burnett Distributed Digital Item Processing

36

Annex 4Report of Requirements meeting

Source: Rob Koenen, InterTrust Technologies

Agenda

Monday  9:00-13:45 opening plenary meeting  13:45-14:45 Lunch (ends one hour after plenary ends)  

14:45-16:45

MPEG-21 Architecture and IPMP RequirementsNB: some of the following documents were already discussed; some will be discussed in

Break-out Group: 9984 AHG on MPEG-21 Architecture - Simon Watt, Craig Schultz, Rob Koenen 9995 MPEG-21 IPMP Architecture - Schultz 9996 Rights Discovery Use Case - Schultz 9997 Rights Display Use Case - Thomas DeMartini, Xin Wang 9998 MPEG-21 IPMP Use Case for Digital Item Distribution - Xin Wang, Thomas DeMartini, Brad Gandee10004 Use cases for DI consumption with information exchange and related requirement for MPEG-21

architecture - ZY Huang, Ming Ji, SM Shen, Jing Liu, Taka Senoh, Takafumi Ueno, Takuyo Kogure10006 An MPEG-21 Architecture Use Case Scenario for a Peer-to-Peer Transaction of DI – Senoh et.al., 10007 Use cases for MPEG-21 IPMP architecture - Melanie Dulong de Rosnay, Daniela Parayre10009 Technical analysis of Use Cases – m9698 - Itaru Kaneko - Waseda, Mika Ohnishi – MMG10010 Proposed Core Use cases. - A. Schultz10183 Use cases studies for MPEG-21 architecture - ZY Huang et.al.10164 A simple multi-peer MPEG-21 scenario - Andrew Tokmakoff10187 Hierarchical Diagrams for MPEG-21 architecture - Ji Ming et.al.10192 Distributed Digital Item Processing - Lakshan De Silva, Ian Burnett

Rqs

17:00-18:00M3W – joint with Systems and MDS

Discussion may run after 18:009990 AHG on Multimedia Middleware (M3W) - Ian Burnett, Bas van den Heuvel

C.L.

Tuesday

09:00-10:30

MPEG-4 Profiling (joint with Systems)10065 Regarding MPEG-4 profiling - Fernando Pereira on behalf of the Portuguese NB10030 USNB Contribution: “MPEG-4 Profiles under Consideration” document - Andy Tescher for USNB10031 USNB Contribution: Subdivision 17 of MPEG-4 - Andy Tescher for USNB 10166 X3D Interactive profile, bitstream update - Bourges-Sevenier, Aaron E. Walsh

Rqs

11:00-12:00

Update of Technical Report? – Jan BormansEvent Reporting

9985 AHG on MPEG-21 Event Reporting - FXNuttall, Andrew Tokmakoff10091 Contractual perspective of Event Reporting Requirements - Senator Jeong et.al.10005 MPEG-21 Architecture: An Event Reporting Perspective - Andrew Tokmakoff10090 MPEG-21 Event Reporting Message Structure based on digital data broadcasting … YoungJoo

Song

Rqs

12:00-13:00

MPEG-21 Persistent Association Technical Report 9988 AHG on Persistent Association - Paul Jessop, Niels Rump10083 Standard efforts for still image watermarking certification in Korea - Won-Geun Oh (ETRI) et.al. 9993 Editors' input on Evaluation Tools for Persistent Association Technologies - Niels Rump et.al.

Rqs

13:00-14:00 Lunch

14:00-14:30 MPEG-21 Testbed 10159 Proposed Draft Requirements for ISO/IEC TR21000-12 …, v. 3 - Chun-Jen Tsai, et.al. Rqs

14:30-15:30

MPEG-21 Profiling 9989 AHG on Profiles and Extensions for the MPEG-21 REL - Brad Gandee, Chris Barlas10148 Proposal for Creating a Profile of MPEG-21 REL for Mobile DRM systems - Brad Gandee et.al.10022 Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5570] - SC 29 Secretariat 9987 AHG on MPEG-21 Profiles - Jaime Delgado

Rqs

16:00-17:00

Scalable Video Coding (review of discussions in break-out group, Joint with Video) 9955 AHG on Scalable Video Coding - Mihaela van der Schaar, U. Benzler, C.J. Tsai10056 Contribution to Applications and Requirements for Scalable Video Coding - Julien Reichel, et.al.10149 Comments on Draft Call for Proposals on Scalable Video Coding Technology - Julien Reichel et.al., 10108 Comments on Draft CfP on new Tools for SVC Technology - Rene van der Vleuten et.al.

Rqs

17:00-17:30

Joint with Video on 3DAV (joint with Video) 9954 AHG on 3DAV Coding - Aljoscha Smolic, Hideaki Kimata10051 Comments on Model Based Video Streaming - Raphaele Balter, et.al.10095 Plan of JEITA for Omni-directional Video - Kazumasa Yamazawa (NAIST) et.al.

Rqs

17:30-18:00 Review of MPEG-21 Architecture B-O Discussions RqsWednesday

  9:00-11:00 Plenary meeting11:30-13:00 MPEG-7 Plenary (Profiles), joint with MDS, Audio, Video, Systems … Rqs

37

10154 Signaling of profile & level in MPEG-7 descriptions - P. van Beek, et.al.10153 Current status of MPEG-7 User Description Profile - P. van Beek, S. Watanabe, I. Sezan10073 Propose MPEG-7 Profile Part 9 Committee Draft - Wo Chang10072 Editorial Changes to MPEG-7 Profile under Consideration - Wo Chang10066 Supporting Descriptions for CCDP and a Proposed Grouping Within CCDP - Masanori Sano et.al., 10063 Support for MPEG-7 Core Content Description Profile - Romulo Pinho (TV Globo)10029 USNB Contribution: MPEG-7 profiles - Andy Tescher for USNB 9982 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano

13:00-14:00 Lunch

14:00-15:00

Joint with Systems, SNHC on MPEG- J and Simple Scene Description10021 US Contribution to the Future of WG 11 - The USMPEGCommittee10058 Call for Requirements and discussion for On-Line Gaming (OLGA) - Yejin Kim, Tae-Joon Park10110 Rationale for a New Scene Description Format - Jean-Claude Dufourd10185 New requirements for MPEG-J Renderer API - Mikael Bourges-Sevenier, Vishy Swaminathan

Rqs

15:00-15:45

MPEG-21 and Broadcasting10184 MPEG-21 in broadcasting AHG report - Lugmayr Abdellatif Benjelloun Touimi Jong-NamKim10062 MPEG-21 & Broadcasting Use Case – The End-to-End QoS Management in Broadcasting sys - 9986 AHG on study of MPEG-21 and broadcasting - Jong-NamKim, et.al.

Rqs

16:00-16:30 M3W (Joint with Systems, MDS)This meeting is actually an hour but Requirements will leave after 16:30

Syst

16:30-18:00

MPEG-21 Issues, with approximate times16:30 MPEG-21 Profiles16:50 MPEG-21 PAT17:10 MPEG-21 Event Reporting17:30 MPEG-21 Architecture and IPMP

Rqs

Thursday

08:30-09:30

Joint wth SNHC on SNHC Profiles09965 AHG on AFX Profile - Marius Preda, Mahnjin Han10139 Animation by Morphing - Marius Preda, Françoise Preteux, Frederic Vexo, Jens Piesk10141 Proposal for Animated Character Profile - Marius Preda, Françoise Preteux10132 Proposal for Simple Compressed 3D Profile - James D.K. Kim, et.al.

Rqs

09:30-10:00 Joint with Systems on IP QoS10047 Comprehensive interoperability between MPEG and Internet – Doug Young Suh et.al. Rqs

10:00-10:30 MPEG-4 Profiles (joint with Systems, SNHC) Rqs10:45-11:00 Scalable Video Coding (Joint with Video) Rqs11:00-11:30 Intra Coding in MPEG (Joint with Video)

10075 Consideration on MPEG-intra - Kohtaro Asai, et.al. Rqs11:30-12:00 IPMP Tool Capability in DIA MDS12:00-12:30 Metadata Adaptation (Joint with MDS)

10190 Digital Item Meta-data Adaptation Engine - Lakshan De Silva, Ian Burnett MDS

12:30-13:00 Open13:00-14:00 Lunch

14:00-14:30 Joint meeting with Audio on Extension 2, Spatial Audio10131 MPEG-4 Extension 2, proposal for a profile definition - Marc Klein Middelink, Werner Oomen

Audi

14:30-15:00 MPEG-21 Architecture and IPMPReview of work Rqs

15:00-15:30 Review of MPEG-21 in Broadcast Rqs15:30-16:00 Review of ER Requirements Rqs16:00-16:30 Review of PAT Rqs16:30-17:00 Review of MPEG-21 part 1 – new PDTR Rqs17:00- 18:00 MPEG-21 Architecture and IPMP

Review of Documents Rqs

Friday

8:00-9:00

Explorations/General8:00 intra-only MPEG AHG and Resolution – Asai-san8:20 3DAV - Aljoscha8:40 SVC - ??

Rqs

9:00- 9:30 Concluding MPEG-4Profiles under Consideration – Marius Preda Rqs

9:30-10:30

Concluding MPEG-7CD for MPEG-7 part 9 - WoProfiles under Consideration – WoDefinition of MPEG-7 Description ProfilingAHG on Profiles and Interop - Wo

Rqs

10:30-12:00 Concluding MPEG-21MPEG-21 Requirements document - Jan BormansMPEG-21 Architecture IPMP Requirements document – RobMPEG-21 IPMP & Arch Background document MPEG-21 Call for Requirements

Rqs

38

MPEG-21 MM Test Bed Requirements – CJMPEG-21 TR WDPAT WD – NielsER RequirementsAHG on Event Reporting AHG on Architecture and IPMP Requirements – SimonAHG on MPEG-21 in Broadcasting - ArturAHG on PAT - NielsAHG on REL Profiles and Extensions (including OeBF work) – BradAHG on MPEG-21 Profiling

12:30-14:00 Lunch  14:00-22:10 Plenary meeting  Plen

 

Explorations, General

Scalable Video CodingTuesday 21 October 2003, 16:11 (Scalable Video Coding) 9955 AHG on Scalable Video Coding - Mihaela van der Schaar, U. Benzler, C.J. Tsai10149 Comments on Draft Call for Proposals on Scalable Video Coding Technology - Julien Reichel et.al., 10108 Comments on Draft CfP on new Tools for SVC Technology - Rene van der Vleuten et.al.10056 Contribution to Applications and Requirements for Scalable Video Coding - Julien Reichel, et.al.

New requirements were incorporated into SVC Applications and Requirements document. No large changes were made to requirements document. Call for Proposals was greatly improved. Documents were declared final and approved, and released to the public.

3DAV10095 Plan of JEITA for Omni-directional Video - Kazumasa Yamazawa (NAIST) et.al.JEITA is no longer seek to use Core Profile for this application, but looking at Simple and AVC. Individual companies are proposing that too. No specific action at this point in time.

3DAV Call for Comments was published after minor brushing up. The Requirements Group drew attention to the Call in a resolution.

M3WMonday 20 October 2003, 17:09 (M3W)Wednesday 22 October 2003, 16:00 (M3W) 9990 AHG on Multimedia Middleware (M3W) - Ian Burnett, Bas van den Heuvel Two good sessions were held on M3W. There was more interest and enthusiasm in the discussions than at previous meetings, and the result shows this. Details can be found in the Systems meeting report.

Intra-only in MPEGThursday 23 October 2003, 11:16 (Intra-only in MPEG)10075 Consideration on MPEG-intra - Kohtaro Asai, et.al.A useful and comprehensive overview was given on where Intra-only MPEG technology could be used.

The question that was most prominently asked in the discussion is whether it will actually be used.

39

The group thought that Intra-only would enable much lower complexity Profile, but the consensus was that this needed further study.

An assessment of possible actions included:1) Documents to promote use of I-only MPEG technology (such as a Technical Report)2) Creation of new Profiles in existing standards (MPEG-2, MPEG-4)3) Adding new elements in existing standards and then creating new Profiles that use those

new elements

The Requirements group asked for an expression of interest in a resolution. An Ad Hoc Group will further study the matter, notably (but not only) the complexity questions.

Lossless Audio CodingThursday 23 October 2003, 14:15 (Joint with Audio)A discussion on the focus of the work on lossless audio coding led to the conclusion that it is OK to update the focus of the work in order according to an improved understanding of the market. It is also valid to work on an assessment of requirements that are perhaps not relevant today, but may be so in the future. Both practices have existed in MPEG throughout its work.

Music NotationThursday 23 October 2003, 14:25A document with use cases and updated requirements document was produced. The most important point of study remains: what elements does MPEG already offer and which new ones could MPEG gainfully standardize? An Ad Hoc Group continues.

MPEG-4

AudioThursday 23 October 2003, 14:05 (Joint with Audio on AMD2 Extensions)10131 MPEG-4 Extension 2, proposal for a profile definition - Marc Klein Middelink, Werner Oomen

Proposal for new Profile using high quality parametric audio coding. The proposed Profile was put into new version of Profiles under Consideration Document N5865. A resolution drawing attention to all new profiles, including this one. More support is required.

ProfilesTuesday 21 October 2003, 09:02 (Joint with Systems on Profiles)Thursday 23 October 2003, 10:00 (Profiling in MPEG-4)10166 X3D Interactive profile, bitstream update - Bourges-Sevenier, Aaron E. Walsh

New X3D streams were submitted (26), but we need some more bitstreams, on BIFS commands and Quantization Parameters. These weren’t present, so the profile could not be adopted in the Draft standard, but it was updated in the Profiles under Consideration document.The Profile is stable in X3D – in FDIS stage in SC24 (ISO/IEC 19776). The MPEG Profile will give the world a compressed format for the X3D standard.

40

10030 USNB Contribution: “MPEG-4 Profiles under Consideration” document - Andy Tescher for USNBAgreement that the document in question should have been available sooner.

10031 USNB Contribution: Subdivision 17 of MPEG-4 - Andy Tescher for USNB Contribution asks for new dimension. After much discussion, the Requirements Group decides to indeed go that route. A brief summary of the arguments that surfaced in the discussion follows.

An argument in favor of a new dimension is that different text profiles will be desired for deployment of the same application in different language areas, whereas the same graphics profiles will suffice.

Past MPEG-4 experience teaches that it is hard for MPEG to make choices for industry beyond a certain level of aggregation. We need to take that reality into account in our profiling approach.

If MPEG adds a dimension, a risk exists of an explosion of dimensions. The Requirements Group still wants to prevent that from happening, for the obvious reason that it does not promote interoperability.

Other questions were raised: Should we define something below the current profiling structure? Does existing split between graphics and scene graph make sense? Does it make sense to allow combining profiles from the same dimension in a single

bitstream? Should we create separate dimensions for 2D and 3D (notably graphics)

The following options were mentioned, listed in ascending order of how much they alter the current structure:

1) No change to existing structure; define new Graphics Profiles2) Add the Text dimension (as proposed by USNB)3) Let Text Profiles be Graphics Profiles, but allow a compliant bitstream to use two (more?)

Profiles from the same (Graphics) Dimension simultaneouslya. Does this apply to only the Graphics dimension, or to others as well?b. Can it be signalled in content in a backward-compatible way? (Initial assessment

appears affirmative)2) A Study, leading to a potential overhaul of the existing Profiling Dimensions, probably

leaving the deployed ones intact (Audio, Visual)

Option 3) seems to be a significant departure from the existing paradigm. It would have led, had we chosen it from the beginning, to a much more modular profile philosophy (with, arguably, less interoperability because of the increased degrees of freedom)

Option 2) is a departure from the current design – you can call it a fix – but seems to fit in the philosophy. It would allow text to be used in 2D and 3D.

The group decides for option 2) after extensive discussions. There was no discussion right on the 2D / 3D split in the graphics/scene graph discussions. We welcome contributions.

Adding Profiles to PuC (Vlad) following procedure as defined for MPEG-4 Profiling. Marius edits the document

41

Thursday 23 October 2003, 08:30 (SNHC/Systems Profiles)9965 AHG on AFX Profile - Marius Preda, Mahnjin Han10141 Proposal for Animated Character Profile - Marius Preda, Françoise Preteux10132 Proposal for Simple Compressed 3D Profile - James D.K. Kim, Jeong-Hwan Ahn, Sang-Oak

Woo, Mahnjin Han

There are companies supporting the Animated Character and Simple Compression 3D Profiles (both Scene Graph and Graphics). Decision is to add to PuC, so they can be considered.

There should be an evaluation of the complexity of adding (the rest of) compression tools to the Simple Compression Scene Graph (compare complexity of Profile with and without such tools).

Approved changes and newly proposed Profiles were incorporated into the PuC.

OtherNew Scene Description Format, Aggregation Format?Wednesday 22 October 2003, 14:3210021 US Contribution to the Future of WG 11 - The USMPEGCommittee10110 Rationale for a New Scene Description Format - Jean-Claude Dufourd

A proposal was put on the table for a new, simpler scene description format, termed Advanced Scene Coding.Initial interest was shown by quite a few companies: ENST, France Télécom, Agfa Monotype, Samsung, Sun, INT, Mindego, UPM, Waseda University, IST, Net&TV, Hanyang University, Pixtree, ETRI.

In the same vein, initial display of interest in Simple Aggregation Format as described in m10110 was shown by: ENST, France Télécom, INT, Net&TV, Hanyang University, ETRI, Samsung, UPM

The Requirements Group wrote a Resolution to ask NB’s and Companies to voice support and bring requirements at next meeting. Also, an output document was created documenting initial requirements for these two proposed new elements to MPEG-4

10058 Call for Requirements and discussion for On-Line Gaming (OLGA) - Yejin Kim, Tae-Joon ParkThe most important question with respect to online gaming is: who will use it in which application? Before restarting the activity, there should be more clarity around that question, and enough support to make sure the work can be carried through to a good end.

New MPEG-J API’s?

Thursday 23 October 2003, 10:34 (MPEG-J API’s)10185 New requirements for MPEG-J Renderer API - Mikael Bourges-Sevenier, Vishy Swaminathan

There are two issues on the table:1) A quick fix to the renderer interface – as an amendment to MPEG-J2) A new rendering API – A larger amendment to MPEG-J ?

42

Item 2) Could be developed more generically, as a potentially useful part of M3W. But timing is important, and M3W is seen as taking more time, as something that is still being morphed. The consensus can be expressed as follows:

we need this API We want to do it now We will develop in a generic way with MPEG-J mapping

o Constraints from M3W – if any are defined – will be accommodated The work can be re-used later in M3W in a more generic fashion.

The next step is to define and refine the requirements. Systems will approve mandate of the required AHG.

MPEG-7

ProfilesWednesday 22 October 2003, 11:58 (MPEG-7 Profiling)10153 Current status of MPEG-7 User Description Profile - P. van Beek, S. Watanabe, I. Sezan09982 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano

After listing the pros and cons, as also reported in the MDS report, it was decided to create a Corrigendum for signaling the Profiles rather than Amendment. That will allow one to define profiles for version 1 in version 1 rather than in a later version.

09982 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano 10154 Signaling of profile & level in MPEG-7 descriptions - P. van Beek, et.al.10029 USNB Contribution: MPEG-7 profiles - Andy Tescher for USNBThe signaling itself was worked out (and reported in MDS report) but there is still a on open question for the issue of being able to signal unions and intersections. Unions are relevant when we want to enable a structure in which a description could use tools from two different, non-overlapping Profiles. Intersections are of interest when we want to enable the signaling of the fact that a Description conforms to one Profile and also to another. (i.e., it only uses tools that are in the intersection of the two profiles. Requirements gathering will continue. At this point it is mainly an issue of not blocking future options.

It was decided to update the Requirements Document at the next meeting, after an AHG discussion.

10066 Supporting Descriptions for CCDP and a Proposed Grouping Within CCDP - Masanori Sano et.al.,

10063 Support for MPEG-7 Core Content Description Profile - Romulo Pinho (TV Globo)10072 Editorial Changes to MPEG-7 Profile under Consideration - Wo Chang10073 Propose MPEG-7 Profile Part 9 Committee Draft - Wo Chang

Minor changes were made to the original profile proposals. In a continuation of a discussion from the last meeting, the group concluded that the proposed Levels or subsets of the CCDP profile really presented a set of different (possibly hierachical) profiles, and not a set of Levels. The group then decided to not do these subsets but rather to have the subsets that made sense as independent Profiles to which the profiling rules apply individually. This also meant that the ‘normal’ level definition (a set of complexity constraints) could now be applied again.

The following Profiles were adopted into the Committee Draft for MPEG-7 part 9: Simple Metadata Profile

43

User Description Profile Core Description Profile (renamed from Core Content Description Profile)

All of these have support and the 10% rule has been met for all of them as well.A new profile, originally the simplest subset of the CDP, now called Limited Device Profile (LDP). Whthere the Requirements for this Profile are met will need to be independently established.

The naming of the Profiles in the CD is tentative. Suggestions for possible improvements are welcome.

The Committee Draft was issued at this meetingA request was made for the appropriate subdivision.

MPEG-21

Technical Report (Part 1) and relatedTuesday 21 October 2003, 11:08 (Technical Report)It was decided to issue a Public Draft of the new version of the technical report at this meeting. There will not be any text on architecture yet, but placeholder instead. One good use case should suffice.

The Requirements will not seek to update the Use Case document at this moment.

The plan is to go to PDTR in December. For the final publication date, it makes no difference whether te new version goes to PDTR now or in March.

Architecture and IPMP RequirementsMonday 20 October 2003, 14:45 (MPEG-21 Architecture and IPMP)Tuesday 21 October 2003, 17:30 (Arch & IPMP Break-out status report)Wednesday 22 October 2003, 17:45 (IPMP and Arch)Thursday 23 October 2003, 14:57 (IPMP B-O G)Many different contributions, see agenda

The plan of action is decided as follows: Call for Requirements Now Updated Requirements Document in December Based on that document, Call for Technology in December (IPMP and Architecture) Current thinking is a public call for IPMP technology and an internal effort on the

architecture. Committee Draft for the Architecture at the 68th meeting.

A more elaborate version of this timeline is in N6046 “Timeline on MPEG-21 IPMP and the MPEG-21 architecture”.

The documentation supporting this work was reorganized. It now consists of a pure requirements document, which contains mainly high-level requirements for the

moment. a background document describing the goals of the work, but not the direct requirements a timeline document a call for requirements.

44

ProfilingTuesday 21 October 2003, 14:30 (MPEG-21 Profiles)09989 AHG on Profiles and Extensions for the MPEG-21 REL - Brad Gandee, Chris Barlas

SC39 will make a Profile (International Standard Profile) of REL for its purposes. One could wonder whether MPEG shouldn’t define that profile itself, so that it is more accessible for a broader community and potentially form the basis for more interoperability

10022 Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5570] - SC 29 Secretariat10148 Proposal for Creating a Profile of MPEG-21 REL for Mobile DRM systems - Brad Gandee et.al.Group wil work through OMA liaison to understand their requirements and use these to carve out a Profile proposal. Liaison was sent beck to OMA asking for relevant recent documents.

09987 AHG on MPEG-21 Profiles - Jaime DelgadoQuestion was raised whther Profiles are useful in MPEG-21.The preliminary answer was “yes, at the very least we need to show there are useful things people can do with simple subsets in MPEG-21”.

Assuming we will define Profiles, there are at least the following three options:1) Profiles that go across MPEG-21 parts 2) Profiles per part3) Or some sort of combination of those two options.

At least there needs to be a consistent approach to defining Profiles in MPEG-21. The way profiles are defined in MPEG-4 and MPEG-7 can serve as an example. We would need a Profile Development Document for MPEG-21 as well. Is MPEG-7 the best example?

Some basis is always required for defining Profile – application description, use case, set of requirements. These could come from inside or outside of MPEG. Profiles can have a tendency to fall in industry sectors – although we always strive for profiles that can bridge sectors, and to be as generic as possible

There is a lot of experience since we did the initial MPEG-4 Profiling in making sure the Profiles we define are actually useful and are indeed used.

The following documents can give a good starting point for MPEG-21 Profiles: N4671 (Generic; goes across MPEG, and will need to be adapted to the situation in MPEG-

21) N5527 (Or rather the most recent Profiles under Consideration document) N5240 (A bit MPEG-7 specific, but a good starting point)

A closer look at the individual parts yields the following overview:Part 1 – MPEG-21 Vision, Technologies and Strategy – Profiles don’t applyPart 2 – DID – probably no Profile neededPart 3 – DII – same thing, group can’t see how that would workPart 4 – IPMP – not yet ready; too early to tellPart 5 – REL – MPEG is working on Profiles for REL

45

Part 6 – RDD – there will (need to) be profiles, but the question is if MPEG can define them. Perhaps with respect to the DIA work it can.

Part 7 – DIA – yes, here we could see if we could define something simple, as DIA is quite big. Part 8 – Reference Software – Profiles do not seem to apply, although the ref soft may reflect the

profiles as defined with respect to other partsPart 9 – File Format – There was no need for a Profile in MPEG-4, so we wil assume none is

needed in MPEG-21 either.Part 10 – DIP – perhaps it is useful to have profiles of collections of base operations?Part 11 – PAT – Profiles do not applyPart 12 – Test Bed – Profiles do not apply

Rather than having a separate Profiling AHG, a generic mandate was added to the REL Profiling AHG

Event Reporting

Wednesday 22 October 2003, 17:30 (Event Reporting)Thursday 23 October 2003, 15:47 (Event Reporting)Tuesday 21 October 2003, 11:20 (Event Reporting)A9985 AHG on MPEG-21 Event Reporting - FXNuttall, Andrew Tokmakoff10005 MPEG-21 Architecture: An Event Reporting Perspective - Andrew Tokmakoff

After some input and work at the meeting, the requirements can now be considered as stable and of good quality. A Call for Proposals will be considered at the next meeting

10090 MPEG-21 Event Reporting Message Structure based on digital data broadcasting … YoungJoo SongContribution contained good use cases. Break-out group was tasked with extracting requirements into Requirements Report.

10091 Contractual perspective of Event Reporting Requirements - Senator Jeong et.al.Contribution proposes that Event Reporting should be able to express contract. Doubts are expressed in the Requirements Group as to whether this is fully in scope. Agreement exists that contracts are in scope inasmuch as they are licenses related to content. But group thinks the creation of the contracts is probably out of scope.

Persistent AssociationTuesday 21 October 2003, 12:00 (Persistent Association)Thursday 23 October 2003, 16:28 (Persistent Association)09988 AHG on Persistent Association - Paul Jessop, Niels Rump09993 Editors' input on Evaluation Tools for Persistent Association Technologies - Niels Rump et.al.

It was decided that there was not enough meat in the Video area to keep this the Report now that it goes to Proposed Draft Technical Report, and hence the draft PDTR now concentrates on Audio The Report can be Amended or issued in a new Version if there is enough material to cover Video as well. Publication of PDTR scheduled for December. Again, this will not affect the last publication date.

46

The requirements were taken out of the document (they had served their purpose) and the document was cleaned up in general. It was decided to go to PDTR in December, as that would allow some external review and it doesn’t imply a later publication date.

10083 Standard efforts for still image watermarking certification in Korea - Won-Geun Oh (ETRI) et.al.Interesting contribution about developments in Korea to set up a sort of Certification Authority that tests many aspects of watermarks in a uniform and automated way. It was considered to augment the report to have it include such automatic performance metrics …

TestbedTuesday 21 October 2003, 14:00 (Testbed)10159 Proposed Draft Requirements for ISO/IEC TR21000-12 …, v. 3 - Chun-Jen Tsai, et.al.Group has begun to expend the requirements. Working to show MPEG-2 IPMP; thinking about MPEG-4.

DIA

Thursday 23 October 2003, 12:14 (Metadata Adaptation)10190 Digital Item Meta-data Adaptation Engine - Lakshan De Silva, Ian BurnettDIA should accommodate adaptation of Metadata – Gro agrees that this is already covered. Should there be a requirement to be able to store adaptation record for metadata? Requirements will be derived in AHG on DIA

Other Requirements IssuesWednesday 22 October 2003, 15:30 (MPEG-21 in Broadcasting)10184 MPEG-21 in broadcasting AHG report - Lugmayr Abdellatif Benjelloun Touimi Jong-

NamKim10062 MPEG-21 & Broadcasting Use Case – The End-to-End QoS Management in Broadcasting

sys - 09986 AHG on study of MPEG-21 and broadcasting - Jong-NamKim, et.al.

“Broadcasting in MPEG-21” is becoming an interesting activity. After a divergence phase there must now be convergence to a few really good use cases. Also, the purpose should first be to convenience the people MPEG before marketing this work beyond MPEG, so no outreach is planned yet.

47

Annex 5Report of Systems meeting

Source: Systems Chair and Break-out group Chairs

Contributors:

Olivier Avaro (France Telecom R&D), Young-Kwon Lim (net&tv), Joerg Heuer (Siemens), Olivier Baum (Fraunhofer IIS), David Singer (Apple)

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP Available13818-1:2000/Amd.4 Metadata Application Format CP

N5972 Request for ISO/IEC 13818-1:2000/Amd.4 No 2003/10/24N5973 Text of ISO/IEC 13818-1:2000/PDAM4 No 2003/10/24

13818-1:2000/Amd.5 New Audio P&L SignalingN5974 WD 1.0 of ISO/IEC 13818-1:2000/PDAM5 No 2003/10/24

14496-1:2001/Amd.7 AVC in MPEG-4 SystemsN5975 DoC on ISO/IEC 14496-1:2001/FPDAM7 No 2003/10/24N5976 Text of ISO/IEC 14496-1:2001/FDAM7 No 2003/11/14

14496-11:2003/Amd.1 AFXN5977 DoC on ISO/IEC 14496-11/FPDAM1 No 2003/10/24

14496-11:2003/Amd.2 ATGN5978 Study Text of ISO/IEC 14496-11/DCOR1 No 2003/10/24N5979 Study Text of ISO/IEC 14496-11/FPDAM2 No 2003/10/24N5980 Items for Cor. and Amd. on ExternProto

CodingNo 2003/10/24

14496-11 :2003/Amd.3 Audio BIFS ExtensionsN5981 WD 3.0 of ISO/IEC 14496-11/Amd.3 No 2003/10/24N5982 Open Issues in WD3.0 of Audio BIFS

ExtensionsNo 2003/10/24

14496-11:2003/Amd.4 XMT and MPEG-J Extensions

N5983 WD 1.0 of ISO/IEC 14496-11/Amd.4 No 2003/11/0714496-12:2003/Amd.1 ISO File Format Extensions

N5984 WD 3.0 of ISO/IEC 14496-12/Amd.1 No 2003/10/3114496-18 Font Compression and Streaming

N5985 Request for ISO/IEC 14496-18 No 2003/11/14N5986 Study of ISO/IEC 14496-18/FCD No 2003/11/14

15938-1 SystemsN5987 Study Text of ISO/IEC 15938-1/FPDAM1 No 2003/11/07N5988 Core Experiments for Systems Extensions No 2003/10/31N5989 Technology under consideration for

15938-1/Amd.1No 2003/10/31

N5990 MPEG-7 Systems reference software workplan No 2003/10/3121000-9 MPEG-21 File Format

48

N5991 WD 4.0 of ISO/IEC 21000-9 No 2003/10/24Explorations and Support

N5992 MPEG Multimedia Middleware No 2003/10/27

General issues

GeneralThe meeting report has been approved.

List of standards under development

Pr

Pt Edit.

Project

Description CfP WD CD FCD FDIS

2 1 2000 Amd.4 Metadata Application Format CP

03/10

04/03

04/07

2 1 2000 Amd.5 New Audio Profile and Level Sig.

03/10

03/12

04/07

05/01

4 11 2003 Amd.2 Advanced Text and 2D Graphics

02/07

03/03

03/07

03/12

4 11 2003 Amd.3 Audio BIFS Extensions 03/10

03/12

04/07

05/01

4 11 2003 Amd.4 XMT and MPEG-J Extensions

03/10

03/12

04/07

05/01

4 11 2003 Cor.1 Scene Description Corrigendum

03/03

03/07

03/12

4 12 2003 Amd.1 ISO File Format Extensions 03/10

03/12

04/07

05/01

4 17 2003 1st Ed. Streaming Text Format 03/03

03/07

03/12

04/03

4 18 200x 1st Ed. Font Compression and Streaming

03/12

7 1 2002 Cor.1 Systems Corrigendum 02/12

03/07

03/12

7 1 2002 Amd.1 Systems extensions 02/03

02/07

02/12

03/07

03/12

21 9 200x 1st Ed. File Format 03/10

03/12

04/07

05/01

Latest references

Pr Pt Standard Issue No. Published2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd

Edition)00/12 2000/12/01

2 1 ISO/IEC 13818-1:2000/COR1 01/01 Pisa N3844

2002/03/01

2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 03/07 Trondheim

N5867

Not

49

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) 03/03 Pattaya N5604

Not

2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2)

03/07 Trondheim

N5771

Not

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) 03/03 Pattaya N5607

Not

4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) 02/10 Shanghai

N5277

Not

4 1 ISO/IEC 14496-1:2003/Amd.1(AVC on 4) 03/10 Brisbanne

N5976

Not

4 6 ISO/IEC 14496-6:2000 2000/12/154 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) 02/03 Jeju N471

2Not

4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description)

02/10 Shanghai

N5279

Not

4 11 ISO/IEC 14496-11/Amd.1 (AFX) 02/10 Awaji N5480

Not

4 12 ISO/IEC 14496-12 (ISO Base Media File Format)

02/10 Shanghai

N5295

Not

4 13 ISO/IEC 14496-13 (IPMP-X) 02/10 Shanghai

N5284

Not

4 14 ISO/IEC 14496-14 (MP4 File Format) 02/10 Shanghai

N5298

Not

4 14 ISO/IEC 14496-14/Amd.1 (AVC File Format) 03/07 Trondheim

N5780

Not

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) 01/07 Sydney N4285

2002/07/06

7 2 ISO/IEC 15938-2 (MPEG-7 DDL) 01/07 Sydney N4288

2002/02/02

DemonstrationsThe following demonstrations have been made:

3D Chess Game (Mindego) demonstrating the value of MPEG-J extensions.

FAQThe FAQ were updated as needed.

AOBNone.

MPEG-2 Systems (13818-1)

13818-1:2000 Amd.4

Topics

Elementary Stream Management1. ISAN and VISAN Signaling

50

Contributions

Elementary Stream ManagementM10197: Liaison statement to ISO/IEC JTC 1/SC 29/WG 11 concerning an amendment to ISO/IEC 13818-1. Cf. Liaison answer. Decision to initiate an amendment to 13818-1 to support ISAN / VISAN.

13818-1:2000 Amd.5

Topics

Elementary Stream Management1. New Audio Profile and Level Indication

Contributions

Elementary Stream ManagementM10147: Proposed clarification for carriage of MPEG-4 Audio over MPEG-2 Systems. Decision to initiate a new amendment to signal the new audio profile and level indication (WD in Brisbanne, PDAM in Hawai). The contribution also proposes clarifications on the use of LATM. Decision to include this clarification in the WD and to advertise it through a resolution (Audio) so that companies can check if it impacts their products.

M10100: Cf. Answer to NB Comments.

MPEG-4 Systems (14496-1)

14496-1:2001 Amd.7

Topics

Elementary Stream Management2. Use of AVC in MPEG-4 Systems

Miscellaneous3. Stream Type for protected content.

Contributions

Elementary Stream ManagementM10110: Comments on FPDAM ballot was reviewed and disposed.

MiscellaneousM10176: Proposition to include stream types for protected content. This will avoid indeterminist behavior of non-IPMP MPEG-4 terminal trying to access streams delivered by an IPMP compliant MPEG-4 streaming server. Decision to be taken in Hawaii.

51

14496-1 Exploratory activity

Topics

Elementary Stream ManagementContributions

Elementary Stream ManagementM10047: Comprehensive interoperability between MPEG and Internet. Agreement that this is something MPEG should work on although there are currently not too many network supporting differentiated QoS. Decision to further study the current in status in MPEG (mainly MPEG-4 and MPEG-21), to study what’s currently possible on existing networks and what will be possible with foreseen extensions of these networks. Assess what is missing in MPEG and what should be done. (ref. AHG mandates on MPEG-21 test bed).

MPEG-4 Scene Description (14496-11)

14496-11:2003 Cor. 1

Topics

Scene Description4. Miscellaneous Corrigenda Item

Contributions

Scene DescriptionM10060: Various fixes on XMT-A schema. To be included in the current Study of DCOR.

M10015: Issues on externProto Coding. Noted. Agreement that there is indeed an issue to be addressed. First solution drafted by the group. Documented in N5980 for review on the Scene Description AHG..

M10205: Items for correction. Decision to integrate in the study of DCOR.

14496-11:2003 Amd.2

Topics

Scene Description5. Advanced Text and 2D Graphics

ProfilingContributions

Scene DescriptionM10050: Withdrawn.

52

ProfilingM10166: X3D Interactive profile, bitstream update. BIFS Command and other functionality are not yet implemented. To be included in Amd.2 if usual conditions are met (bitstream, company supports). Allows interoperability with X3D profile defined in SC24 (currently FDIS stage).

M10065: Portuguese NB comments regarding MPEG-4 Profiling. Noted.

M10030: USNB Contribution: “MPEG-4 Profiles under Consideration” document. Misunderstanding on the conclusion of the Trondheim meeting (Cf. Systems and Req. report). No discussion happened on the AHG on the topic. Issue further discussed (see req. report).

M10031: USNB Contribution: Subdivision 17 of MPEG-4. Noted. Issue further discussed (see req. report).

14496-11:2003 Amd.3

Topics

Scene Description6. New Audio BIFS

Contributions

Scene DescriptionM10112: New SoundField node. It has been was merged into current WD after discussion and editing.M10120: Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3). It has been merged into current WD.M10122: Comments on Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3). Based on these comments various decisions were taken:

AudioChannelConfig node: placement in the AudioBIFS subtree; No phaseGroup information when AudioChannelConfig node is present in AudioBIFS subtree.

14496-11:2003 Amd.4

Topics

Scene Description7. XMT Extensions8. MPEG-J Extensions

Contributions

Scene DescriptionM10167: MPEG-J extensions to create applications. Proposal for a SceneController APIs. Felt useful by most of the attendees to improve efficiency of MPEG-J application. To be included in WD1.0 of 14496-11 Amd.4. (Will be further studied in MPEG-J AHG).

M10114: The specifications for XMT-A compliant BitWrapper node and the encoding parameters. Mechanism to be added in XMT to allow import and include of other schema. (To be studied in Scene Representation AHG).

53

14496-11 Exploratory activity

Topics

Elementary Stream ManagementMPEG-J9. APIs to access sync. Information and elementary stream data.10. Scene Controller APIs

Low Complexity BIFSMusic Notation

Contributions

Elementary Stream ManagementM10155: Request for a mechanism to add to a closed stream. Presentation of the use cases. Has been studied during breakout. To be further discussed in AHG.

MPEG-JM10185: New requirements for MPEG-J Renderer API. Requirements needs to be finalized and industry support needs to be further demonstrated. Should be designed in a way it can be re-used within M3W (language and platform independent APIs specification + Java mapping). To be further studied in MPEG-J AHG.

Low Complexity BIFSM0097: A simpler, efficient binary encoding for MPEG-4 scenes. Result of a study on BIFS low complexity that demonstrates that BIFS is not a good solution in environments where memory footprints and decoder complexity are crucial issues. Noted. Further discussed with requirements (see companion document M10110).

M10110: See Requirements report.

Music NotationM10068: (See Audio report).

ISO File Format (14496-12)

14496-12:2003 Amd.1

Topics

Extensions of the ISO File FormatContributions

Extensions of the ISO File FormatM10143: Recommendation for the Interoperability issue related to the storage of AAC content in the MP4 File Format. A solution is to be further studied in AHG (cf. Audio report).

54

M10170: Editor submitted new proposed text for WD 3.0 and is accepted as a base text.

M10176: This contribution proposes a way to signal encrypted media in ISO File Format and MPEG-4 Systems. New 4CCs and an ProtectionInfoBox for encrypted media is proposed. New stream types to distinguish encrypted stream from normal one is also proposed. By using this signalling decoders/terminals having no capability of decryption can safely ignore those streams. Proposal for new table for stream type will be amended to ISO/IEC 14496-1:2001 FDAM7. (Cf. AVC on 4 section). Extensions of the file format will be further studied on AHG.

M10119 Proposal on signalling error resiliency feature of stream through a MediaResilienceInfoBox. Concerns have been raised that signalling target loss rate without any other information is not enough to achieve such goal. It is recommended to consider the proposal together with other similar proposals such as M10047 and propose more complete solutions at the next meeting. This is considered as a work item for exploratory phase of MPEG systems (see AHG on MPEG File Format Mandates).

M10123: Proposition of a SubSampleInformationBox to give relative priorities, discardability and accessibility (for efficient packetization) of fragments of sample. There seems to be applications beneficial from this proposal (e.g. for AVC). It is recommended to add to WD as an optional box with modification of removing “offset” from proposed syntax.

M10124: Proposing to have LocationInformationBox to signal geographical location of contents. This does not seems to be a generic solutions for all this kind of information such as performer etc. And the information may not be valid for the entire media/track. To have this information more frequently such as in sample entry is too overkill. MPEG-7 provides such functionalities.

Streaming Text (14496-17)

Topics

Streaming TextContributions

Streaming TextNo contribution.

Font Compression and Streaming (14496-18)

Topics

Font Compression and StreamingContributions

Font Compression and StreamingDiscussion on ProfilingSee Req. report. As the conclusion of the discussion was to create a new dimension for Text, it was decided to create a new part of the MPEG-4 standard for font compression and streaming. This part

55

will have the same status as former 14496-11/Amd.2, i.e., study of FCD and will reach FDIS status in the next MPEG meeting in Hawaï.

56

MPEG-7 Systems (15938-1)

General

Reference SoftwareTo further the implementation of the reference software a telephone conference was set up with the contributors to the reference software. Agreement on a common approach to implement the binary description tree in the BiM reference software was reached. Furthermore a first draft to specify the encoder configuration of the reference software has been issued and a detailed workplan to organize the work until the 67th MPEG meeting has been compiled.

Joint with Requirements – MPEG-7 Schema ProfilingThe signaling of profiles in textual MPEG-7 descriptions has been discussed. It has been agreed to signal profiles with attributes respectively elements. These attributes respectively elements contain a list of URIs to refer to the profile specifications. This approach supports to encode all profiles specified on a specific version of MPEG-7 with the same BiM code tabels. For details see the Requirements report. The aspect of encoding profile specifications with specific type codecs have been raised.

15938-1/Cor1

Topics

MPEG-7 Systems CorrigendumContributions

MPEG-7 Systems CorrigendumM10035: Summary of Voting on ISO/IEC 15938-1/DCOR 1. Will de disposed of at the 67th MPEG meeting in Hawaii.

15938-1/Amd 1

Topics

Joint meetingsMPEG-7 Systems extensions

Contributions

GeneralA study document of the FPDAM has been compiled. Beside several editorial corrections also technical issues have been raised which are reflected in the study document. As an outcome of the CE on rational position codes a new implicit assignment of position codes to the nodes transmitted in the FUU payload has been adopted.

MPEG-7 Systems extensionsM10061 - The ME considered the implicit assignment of rational position codes of elements transmitted in the payload of FUUs. This effects the code size of subsequent send FUUs. Tests have shown that for specific use cases (insert, replace) the implicit assignment can be approved by a balanced assignment of rational position codes. However in other use cases (append) the current

57

ascending assignment of rational position codes perform better. The context path codings differ by approximately 5% in size for the specified testdata. It is proposed to adopt this assignment as alternative to the current specification. Issues: signaling which assignment is used, should this signaling be possible per FUU or only once in the decoder config, specification of balanced rational position code assignment without reordering, are different assignments also applicable to multiple payload mode, (implementation, see reference software). It seems that a mode “in between” balanced and ascending order is a compromise between simplicity and size. Agreement to adopt the balanced approach to Study of FPDAM.

M10145 - The ME evaluated the schema transmission with respect to the serialization of anonymous types. Three different approaches to implement and specify the schema serialization have been investigated (two in the textual domain, one in the binary domain). It has been identified that the current specification in the FPDAM is not sufficient. The approaches have been evaluated with respect to increase of size and requirements on the SchemaOfSchema specification. It has been shown that the reordering in the binary domain (bitstream partitioning) does not increase the size and has no additional requirement on the SchemaOfSchema. It is proposed to improve the text of the FPDAM and to consider to specify the serialization as reordering of the bitstream in the binary domain (e.g. the textual representation of the schema and the automatons are not changed).Issues: what order of sorting of serialized anonymous types has to be used (implicit assignment of element declarations to anonymous types), implementation in reference software, Paused the discussions (due to the need of extensive remote discussions to come to an agreement on a not major issue; also the implementation in the reference software should be finished before further discussions).

M10137 – This contribution reported the results of the CE on fast random access. It was poited out the in the CE two different use cases are evaluated: beforehand known or unknown indexed subset of information.In section 3 issues with respect to M9892 Proposal (crystalisation points for harmonization) were raised: (a) Partitioning of information categories (indexList, values ..) (first two bullets); (b) Reference outside the stream, supported by TVA but not in a differential/hierarchical manner; (c) For long lists of index entries fixed size entries are used for binary search; (d) Specific in dynamic cases: tree structures for index entries seems not to be appropriate (complex updates)However consensus have been reached to apply a common index structure to both the TVA and the index proposed in M9892 to allow the comparison of tools.It has been proposed to extend the testdata set. There was the agreement that TVA Data is welcome, as it represents a very valid use case (and an extreme characteristic of the data). However copyright issues have still to be clarified. Beside this offer the group still seeks for other XML testdata of common use cases to allow representative testing.

M10140 - Report on the status of the index implementation based on a tree structure for the index entry which facilitates binary path representation for the index and position codes for the support of multiple key entries. First results have shown that the support of arbitrary multiple key values increases the size of the index significantly. Further studies on this are proposed in a commonly agreed framework.Points raised: efficient joining on position codes by matching in the binary domain, support of complex content queries, how the binary Pos Codes are stored?

M10106 - Report on the implementation of the TVA-Indexing approach including modifications to support position codes and complex content index. First results on the agreed test data showed that that the use of position code makes up a significant part of the size. For this specific data set also

58

the structure headers are significant. Compared to the position code approach the TVA approach is more efficient wrt size and search complexity by assuming predefined queries.

M10181 - Based on MPEG-21 terminal capabilities descriptions the efficiency of the BiM codec is evaluated and compared with respect to zip, XMill, XMLPPM. Based on different instantiations of display characteristics specifications with multiple occurrences it has been shown that also the size of the BiM representation is increased if the multiple occurrences are forked at higher level elements.

MPEG-21 (21000)

21000-9

Topics

File FormatContributions

File FormatM10077 This contribution proposes modification of syntax and semantics of ItemLocationBox and DataInformationBox to address specific elements from mp4 file as a resource of MPEG-21 DI. URL-like symbolic addressing scheme is proposed. This could add and complete those boxes. This is accepted in principal. To be added to WD.

M10036 This contribution proposes generalized referencing scheme. No course of action is taken because no specific action points are proposed and contributor is not present at the meeting. Contributors also information that there were generic addressing scheme combining existing proposals related to this contribution proposed to MDS group, M10085 and M10086. Other contributors on MPEG-21 file format are recommended to take a look. This work will be a part of mandate of AHG (studying generalized addressing scheme for ISO file format and propose specific solutions for MPEG-21 file format.).

21000 Exploratory Activities

Topics

ArchitectureBinarisation

Contributions

ArchitectureCf. Req. report.

BinarisationNo contribution.

59

Unpublished Systems Standard

Standard Title Status Document with

Purpose TopicsNo.

MPEG-2 Systems

13818-1:2000/Amd.1

Generic coding of moving pictures and associated audio information: Systems Amendment 1

FDIS 2002-10-25 Secretariat FDAM ballot was closed.To be published.

Elementary Stream Management Carriage of Metadata in MPEG-2 Systems.

13818-1:2000/Cor.1

Generic coding of moving pictures and associated audio information: Systems Corrigendum 1

DCOR 2003-03 Secretariat Integration with Amd.1

13818-1:2000/Amd.3

Generic coding of moving pictures and associated audio information: Systems Amendment 2

FDIS 2003-07-25 Editor Final text editing until 2003-10-24 Elementary Stream Management Carriage of AVC.

13818-1:2000/Amd.2

Generic coding of moving pictures and associated audio information: Systems Amendment 2

FDIS 2003-03-14 ITTF To be published. IPMP Support for IPMP tools in MPEG-2.

13818-11:2003Generic coding of moving pictures and associated audio information: IPMP Extensions

FDIS 2003-03-14ITTF FDIS ballot due 2003-10-21 IPMP

IPMP Tool Representation and Communication Systems mapping on MPEG-2 Systems

MPEG-4 Systems

14496-1:2001/ COR1

Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM1

DCOR ballot : from ‘01-02-09 to ‘01- 05-09COR : ‘01-07-20

Editor To be consolidated to 3rd Edition Miscellaneous correction to 14496-1

60

Standard Title Status Document with

Purpose TopicsNo.

14496-1:2001/Amd.2

Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Textual Format

FDAM (Jeju w4698)2002-03[Editor's submission (FDAM and DOCR):2002-06]

Editor To be consolidated to 3rd Edition

MPEG-4 Textual Format11. XMT-A12. XMT-

Scene Description13. Media Sensor14. MediaControl15. MediaBuffer16. MatteTexture

Elementary Stream Management17. OD Framework additions (OD execute,

Segment Descriptors)18. MP4 additions

Profiles and LevelsBasic2D, Core2D, Main2D, Advanced2D (Scene Graph and Graphics) profile.

14496-1:2001/Cor2

Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM2

Cor2 2002-10-25 Editor To be consolidated to 3rd Edition Miscellaneous correction to 14496-1

14496-1:2003 Coding of audio-visual objects --Part 1: Systems Editor 3rd Edition

MPEG-4 Systems Edition 2003: Integration of 14496-1:2001, 14496-1:2001/Amd.1, 14496-1:2001 COR 1, 14496-1:2001/Amd;2, 14496-1:2001 COR2

14496-1:2001/Amd.3

Coding of audio-visual objects --Part 1: Systems Amendment 3 FDAM 2002-10-25 Editor Final Edits IPMP Extensions

14496-1:2001/Amd.4

Coding of audio-visual objects --Part 1: Systems Amendment 1 FDAM 2002-12-13 Editor To be consolidated to 3rd Edition SL Extensions

14496-1:2003/Amd.1

Coding of audio-visual objects --Part 1: Systems Amendment 1 FDAM 2003-10-24 Editor Final text editing Usage of AVC in MPEG-4 Systems

MPEG-4 Transport of MPEG-4 over IP Networks

14496-8Coding of audio-visual objects --Part 8: Transport of MPEG-4 over IP Network (14496-8)

FDIS (w4712)2001-12-07

Young-Kwon Integrate IETF comments

IETF RFC for transport of MPEG-4 over IPFramework for the carriage of MPEG-4 content over IP network.

MPEG-4 Scene Description and Application Engine

61

Standard Title Status Document with

Purpose TopicsNo.

14496-11Coding of audio-visual objects --Part 11: Scene Description and Application Engine

2002-10-25 Yuval 3rd EditionBIFSXMTMPEG-J

14496-11/Amd.1

Coding of audio-visual objects --Part 11: Scene Description and Application Engine Amendment 1

2002-12-13

SC29 To ITTF* ITTF doesn't issue FDAM ballot without submission of the original body, i.e. 14496-11.

Multi-user and AFX

MPEG-4 ISO Base Media File Format

14496-12 Coding of audio-visual objects --Part 12: ISO Base Media File Format 2002-10-25 ITTF FDIS ballot to be issued on 03/10/28 File Format

MPEG-4 IPMP Extension

14496-13 Coding of audio-visual objects --Part 13: IPMP Extension 2002-10-25 ITTF Final Edits IPMP Extension

MP4 File Format

14496-14 Coding of audio-visual objects --Part 14 : MP4 File Format 2002-10-25 ITTF To be published MP4 File Format

14496-14/Amd.1

Coding of audio-visual objects --Part 14 : Amendment 1 2003-07-25 ITTF FDIS to be issues AVC File Format

62

Published Systems Standard

Standard Title Status Topics

MPEG-2 Systems

13818-1/Amd.7Generic coding of moving pictures and associated audio information: Systems AMENDMENT 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1

Published 2000-12-01

Elementary Stream Management MPEG-4 Over MPEG-2

13818-1:2000Generic coding of moving pictures and associated audio information:Systems

Published 2000-12-01 MPEG-2 Systems Edition 2000

13818-1:2000/COR1Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 1

published on 2002-03-01

Elementary Stream Management FlexMux Descriptor

13818-1:2000/COR2Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 2

published 2002/12/01

Elementary Stream Management Buffer model for PID2.

MPEG-2 DSM-CC

13818-6/COR1Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 1

Published 1999-12-01

Elementary Stream Management Editorial correction

13818-6/Amd.3

Generic coding of moving pictures and associated audio information --Part 6: Extensions for DSM-CCAMENDMENT 3: Transport buffer model in support of synchronized user-to-network download protocol

Published 2001-12

Elementary Stream Management Transport buffer model in support of synchronized user-to-network download protocol.

13818-6/ COR2Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2

Published 2002 Q3

Elementary Stream Management Editorial correction

13818-6/ Amd.1:2000/COR1

Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2

Published 2002 Q3 Elementary Stream Management

Editorial correction

MPEG-4 Systems

63

Standard Title Status Topics

MPEG-2 Systems

14496-1 Coding of audio-visual objects – Part 1: Systems Published1999-12-15

Elementary Stream Management Systems Decoder Model Object Descriptor Framework Synchronization of Elementary streams Multiplexing of Elementary streams Object Content Information IPMP

Scene Description BIFS

Syntactic Description LanguageProfiles and Levels

14496-1:1999/Amd.1 Coding of audio-visual objects –Part 1: SystemsAMENDMENT 1: Systems extensions

Published 2001-11

Elementary Stream Management MPEG-4 File Format (MP4)

Scene Description Application Window as a BIFS node Advanced Audio BIFS Material Keying Advanced coding (PROTO, Integration of Mesh, coding of Mfield).

Application Engine (MPEG-J)Profiles and Levels

14496-1:1999/COR1 Coding of audio-visual objects – Part 1: SystemsTECHNICAL CORRIGENDUM 1

Published 2001-11 Miscellaneous correction to 14496-1

14496-1:2001 Coding of audio-visual objects --Part 1: Systems

Published 2001-11

MPEG-4 Systems Edition 2001 Integration of 14496-1, 14496-1/Amd.1, 14496-1 COR 1

14496-1:2001/Amd.1Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Extended BIFS

Published2001-10

Elementary Stream Management Flextime Rebufering

Scene Description Flextime nodes ServerCommand ExternProto Advanced BIFS Coding

Profiles and LevelsMPEG-7 Systems

64

Standard Title Status Topics

MPEG-2 Systems

15938-1 Multimedia content description interface Part 1: Systems Published 2002-07/06

MPEG-7 ArchitectureMPEG-7 dynamic descriptionsMPEG-7 binary format

15938-2 Multimedia content description interface Part 1: DDL Published 02-02-2002 MPEG-7 DDL

65

Resolutions of SystemsCf. WG11 resolution.

Action Plan

N° What Who When Status Trace1. Check Patent

statements & License for OpenType

David ASAP O Companies that have IP on OpenType spec. submitted Patent Statement but for Apple.

List of reviewed contribution

N° Title Authors10011 Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 7 [SC

29 N 5561]SC 29 Secretariat

10015 Issues on externProto Coding Jean Le Feuvre et al.10016 14496-1 Candidate Yuval Fisher10017 14496-11 Candidate Yuval Fisher10018 14496-1,14496-11 master document Yuval Fisher10030 USNB Contribution: “MPEG-4 Profiles under Consideration”

documentAndy Tescher for USNB

10031 USNB Contribution: Subdivision 17 of MPEG-4 Andy Tescher for USNB10034 Summary of Voting on ISO/IEC CD 14496-17 SC 29 Secretariat10035 Summary of Voting on ISO/IEC 15938-1/DCOR 1 SC 29 Secretariat10047 Comprehensive interoperability between MPEG and Internet Doug Young Suh et al.10050 Synthesized Texture update Yoram Elichai10060 Various fixes on XMT-A schema Cyril Concolato

Jean-Claude Dufourd10061 Report on MPEG-7 Systems ME-1: Evaluation of the rational

position codes frameworkShuichi WatanabeJoerg Heuer

10065 Regarding MPEG-4 Profiling Fernando Pereira10068 Music Notation Application Requirements and MPEG

TechnologyGiorgio Zoia et al.

10077 Suggestion to MPEG-21 file format Yongju Cho et al.10097 A simpler, efficient binary encoding for MPEG-4 scenes Jean-Claude Dufourd10100 UK National Body Position regarding the use of ISO 639

language descriptor in ISO/IEC 13818-1UK NB

10100 UK National Body Position regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

UK NB

10106 Results of Core Experiment on Indexing (TV-Anytime) Keith Millar10110 Rationale for a New Scene Description Format Jean-Claude Dufourd10112 Proposal of a new SoundField node in MPEG-4 BIFS Jérôme Daniel

66

N° Title Authors10114 The specifications for XMT-A compliant BitWrapper node and

the encoding parametersGyeong Ja Jang

10119 Signaling of error resilience information in file formats Ye-Kui Wang et al.10120 Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3 Juergen Schmidt et al.10122 Comments on Update to WD 2.0 of ISO/IEC

14496-11:2003/AMD 3Juergen Schmidt et al.

10123 Support of sub-sample in file formats Ye-Kui Wang et al.10124 Signaling of location metadata in file formats Ye-Kui Wang

Harri Honko10137 Report on Core experiments for MPEG-7 Systems extensions

(Harmonization of the Index Systems)Keith MillarJoerg HeuerAndrea Kofler-Vogt

10138 Hierarchical addressing scheme for ISO file format Sylvain Devillers et al.10140 Report on Core experiments for MPEG-7 Systems extensions

(Multiple-Field Queries)Joerg HeuerAndreas HutterHarald KoschAndrea Kofler-Vogt

10143 Recommendation for the Interoperability issue related to the storage of AAC content in the MP4 File Format

Mohammed Zubair et al.

10145 Results of CE for Systems Extensions - ME-2 Joerg HeuerDaniel PeintnerAndreas Hutter

10147 Proposed clarification for carriage of MPEG-4 Audio over MPEG-2 Systems

Heiko Purnhagen et al.

10155 Request for a mechanism to add to a closed stream Jean-Claude Dufourd10166 X3D Interactive profile, bitstream update Bourges-Sevenier et al.10167 MPEG-J extensions to create applications Mikael Bourges-Sevenier

Vishy Swaminathan10167 MPEG-J extensions to create applications Mikael Bourges-Sevenier

Vishy Swaminathan10170 Proposed ISO Amendment Working Draft Text David Singer10176 Storage/Signaling encrypted media in MP4-FF and MPEG-4

SystemsMohammed Zubair et al.

10185 New requirements for MPEG-J Renderer API Mikael Bourges-SevenierVishy Swaminathan

10185 New requirements for MPEG-J Renderer API Mikael Bourges-SevenierVishy Swaminathan

10188 14496-13 Candidate Ji Ming10189 14496-1/FDAM 3 Candidate Ji Ming10197 Liaison ISAN / VISAN9994 Liaison Statement from TV-Anytime Forum [SC 29 N 5554] 29 Secretariat

67

Annex 6Report of MDS meeting

Source: John R. Smith (on behalf of MDS sub-group)

Chair (contact):John R. SmithIBM T. J. Watson Research Center30 Saw Mill River RoadHawthorne, NY 10532 USAjrsmith@watson.ibm.com

The MPEG MDS sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items for the week included the following:

MPEG-7:o MPEG-7 MDS (Part 5):

MPEG-7 AMD/1 MDS Extensions FDAM (Editing) MPEG-7 AMD/2 MDS Extensions 2 PDAM MPEG-7 MDS COR/1 WD v.1

o MPEG-7 Schema Definition (Part 10) MPEG-7 Part 10 CD

o MPEG-7 Industry Usage v.2 MPEG-21:

o MPEG-21 Part 2 – Digital Item Declaration 2nd Editiono MPEG-21 Part 5 – Rights Expression Language Softwareo MPEG-21 Part 6 – Rights Data Dictionary Softwareo MPEG-21 Part 7 – Digital Item Adaptation Study of FCDo MPEG-21 Part 10 – Digital Item Processing WD v.3

MPEG- 21:• DI D (FDI S 2nd ED)• DI I (FDI S)• REL (FDI S)• RDD (FDI S)• DI A (FCD Study)• DI P (WD v.3)MPEG- 7 v.2:

• MDS AMD/2• MDS COR/1

MPEG- 7 v.1:• MDS (FDI S)• Schema Def.• Profiles

Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 66 th

Brisbane meeting.

68

MPEG MDS Group activities

Num. Contributions  Agenda, Goals and Issues for the Week for MDS Sub-Group

Agenda, Goals and Issues for the Week for MDS GroupJohn R. Smith

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:

Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP)o All work held in main MDS track except where indicated for specific Break-out

Groups (BoG) Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for software development for MPEG-21 REL, RDD, DIA Schedule of joint meetings

MPEG-7 activities: MPEG-7 Extensions (Part 5):

o MPEG-7 MDS AMD/1 FDAM (final editing)o MPEG-7 MDS AMD/2 PDAMo MPEG-7 MDS COR/1 WD (profile signaling)?

MPEG-7 Conformance (Part 7):o AMD/1 (Version 2 bitstreams) Study

MPEG-7 Profiles (Part 9):o Joint with Requirements, Systems, Video, Audio

MPEG-7 Schema Definition (Part 10):o MPEG-7 Schema Definition CD

MPEG-21 activities: MPEG-21 Rights Expression Language (Part 5):

o Input: Software contributions on REL Liaison statements Input contribution on REL profile

o Actions: Review software status and integration Update REL software plan Update MPEG-21 MDS FAQ

o Output: Liaison responses Revised REL software plan

MPEG-21 Rights Data Dictionary (Part 6):o Input:

69

RDD Softwareo Actions:

Review software contribution Update RDD software plan Update MPEG-21 MDS FAQ

o Output: Revised RDD software plan

MPEG-21 Digital Item Adaptation (Part 7):o Input:

DIA Editors’ Input on Study of FCD, AM 6.1, AHG reports (5), CE reports (5) Proposal documents (9)

o Actions: Review draft NB comments Review CE results and proposals Revise DIA spec. (study) & define core experiments Update DIA reference software plan

o Output: MPEG-21 DIA Study of FCD MPEG-21 DIA Software Implementation Plan v.5

MPEG-21 Digital Item Processing (Part 10):o Input:

Input contributions (2)o Actions:

Review proposal documents Define CE’s Revise DIP WD and DIP PM

o Output: MPEG-21 DIP WD v.3, PM v.3

o MPEG-21 DIP CEs

Joint Meetings (as of Monday): MPEG-7:

o Wed (11h30 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video)

MPEG-21:o Tues (14h00 - 15h30): REL-RDD-DIA Software with Integrationo Exploratory:o Mon (17h00 – 18h00): Multimedia Middleware with Requirements, Systemso Tues (14h00 - 16h00): MPEG-7 Profiles with Requirements, Audio, Video,

Systems

Break-out Groups (created at kick-off meeting): RDD SW BoG:

o Mandate: review input contribution on RDD ontologyo Tuesday, 10:00-11:00 – Booth CL-3

DIP BoG:

70

o Mandate: o Evaluate DIP tools against criteria and consider evaluation input (from gerrard)o Discuss issues listed in AHG reporto Produce WD v.3o Wednesday, 12:00-14:00 – Booth CL-3

UCD BoG:o Mandate:o Discuss UCDo Review draft NB comments related to UCD and BSDL, gBSD, A-QoS, BSD-Linko Produce text for Study of FCDo Draft text of semantics for “original attribute”o Sub-resource adaptationo Monday, 20:00-tbd – To be posted on MDS boardo Tuesday, 20:00-tbd – Norfolk room

REL/RDD integration with DIA BoG:o Mandates:o Revise classification scheme for media informationo Draft syntax and semantics of formal change constrainto Tuesday, 18:00-19:00 – Marquis Room (MDS room)

REL Profiling BoGo Mandate: review M10148o Tuesday, 16:00PM, Booth CL-3

Review of AHG resolutions and action points:

Doc No. Contribution Source

9974 Barney Wragg, Thomas DeMartiniAHG on Editing the MPEG-21 Rights Expression Language FDIS

Topic: Editing of REL FDISResults: Completed editing and submitted to ISOActions: Waiting editing result from ITTF

9976 Chris Barlas, Godfrey Rust AHG on editing RDD FDIS

9975 Xin Wang, Jaime DelgadoAHG on MPEG-21 REL and RDD Reference Software

Topic: Editing of RDD FDISResults: Completed editing and submitted to ISOActions:

71

Waiting editing result from ITTF

9977Anthony Vetro, Christian Timmerer, Eric Delfosse

AHG on Editing MPEG-21 Digital Item Adaptation FCD & AM

Topic: Editing of DIA FCD and AMResults: Completed editing of DIA FCD according to DoC produced at the Trondheim meetingActions: Input editors input on DIA

9978Thomas DeMartini, Anthony Vetro, Sylvain Devillers, Barney Wragg, Chris Barlas AHG on Integration of DIA with REL and RDD

Topic: Expression of rights for adaptationsResults: UCD approach:

o Condition puts contraint on adaptation spatial size reductiono Condition uses classification scheme corresponding to media information

What is the purpose for “original” attributes -- > need to support case of “input” and “original”

Classification scheme based on MPEG-7 media information Should the classification be minimally normative – that is, the DIA engine must

support the terms of the list Syntax and semantics of change results constraint – use full UCD or stack function,

semantics TBD Syntax and semantics of formal change constraint

o Syntax List of methods with and wo implementation Particular method wo implementation Method whose implementation is given by a resource

o Semantics - TBDActions: Need to draft semantics of “original attribute” as input to DIA engine Refine media attributes classification scheme – flatten/re-organize, exemplary and not

minimally normative UCD BoG to study sub-resource adaptation

9992 Gerrard Drury, Christian Timmerer, Jeho Nam AHG on MPEG-21 DIA Reference SoftwareTopic: Integration plan for DIA softwareResults: Development of generic DIA software base was not completedActions: Need organization of DIA software and integration plan

9980 Andrew Perkis, Andreas Hutter, Zhongyang Huang AHG on Updating DIA DescriptionsTopic: Use of MPEG-7 tools for updatingResults: Not much participation from MPEG-7 systems Cannot conclude that MPEG-7 systems is insufficient

9981Gerrard Drury, Rik Van de Walle, Ian Burnett, Munchurl Kim

AHG on Editing MPEG-21 DID and DIP Working Drafts

72

Topic: Editing of DID and DIPResults: Completed editing and uploaded documentsActions: Continue work on DID (amendment) and DIP

9979 Jeho Nam, Debargha MukherjeeAHG on Core Experiments for MPEG-21 Digital Item Adaptation

10059

Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann, Marius Preda, Françoise Prêteux CE Report on Avatar Preferences

10081 Christian Timmerer, on behalf of the CEReport on CE of Universal Constraints Descriptor (UCD)

10111Mariam Kimiaei-Asadi , Jean-Claude Dufourd, Truong Cong Thang, Yong Man Ro, Jeho Nam Report of CE on Transmoding

10144 Sylvain Devillers, on behalf of the CEReport of CE on BSD Transformation Instructions

Topic: Core experiments for DIAResults: Reviewed Core Experiments in AHG meeting on Sunday prior to MPEG meetingActions: Recommendations from CE on Universal Constraints Descriptor (UCD):

o refine syntax and semantics of AdaptationQoS and UCD based on the draft open issues listed in the CE report (provided during the meeting)

o promote the proposed modifications of AdaptationQoS to the Study of FCD

o promote UCD to the Study of FCD Recommendations from CE on BSD Transformation Instructions

o promote BSDTrIs to Study of FCD o further discuss offset referencing during the week.o further work on complexity evaluation of BSDTrIs vs. XSLT and STX to

be confucted in the coming CE.s Recommendations from CE on Transmoding

o Further study the scope and broaden range of transmoding tools Recommendations from CE on Avatar Preferences and Levels of Detail/Articulation

o Establish to continue CE in which demonstration and Reference SW is provided.

MPEG-21 DIA Editing:

Doc No. Contribution Source

10052Anthony Vetro, Christian Timmerer, Sylvain Devillers Editors Input on DIA Study of FCD

10053Anthony Vetro, Christian Timmerer, Sylvain Devillers MPEG-21 Digital Item Adaptation AM v6.1

Topic:

73

Editing of DIAResults: Reviewed editing input based on draft commentsActions: Review proposals and take decisions for promotions to Study of FCD to be generated

at Brisbane meeting

MPEG-21 DIA Specification :

Doc No. Contribution Source

10076Truong Cong Thang, Yong Ju Jung, Yong Man Ro, Jae-Gon Kim, Jeho Nam, Jin-Woo Hong Modality Conversion for QoS Support in UMA

Actions: Adopt to DIA AM v.7: ModalityConversionQoS

10045Chris Joslin, Thomas DiGiacomo, Stephane Garchery, Nadia Magnenat-Thalmann

Swiss NB Comment on DeviceBenchmarking for DIA

Actions: Adopted to DIA “Study of FCD”: benchmark (Ref SW to be provided by Dec.)

10196 Simon Watt CRF Liason contribution on Usage EnvironmentsTopic: Usage environment descriptions requested by CRFResults: Requests for user information attributes to be included in MPEG-7 or MPEG-21 (if not

already present).Actions: Drafted responses for each specific user field

MPEG-21 DIA and REL/RDD Integration:

Doc No. Contribution Source

9978Thomas DeMartini, Anthony Vetro, Sylvain Devillers, Barney Wragg, Chris Barlas AHG on Integration of DIA with REL and RDD

9999Thomas DeMartini, Anthony Vetro, Debargha Mukherjee Input on DIA/REL/RDD Integration

Topic: Integration of REL/RDD with DIA (adaptation rights)Results: AHG and BoG produced initial solutionActions: Adopt solution as follows:

o Adaptation CapabilitiesType: MethodTerm MethodUri MethodResource MethodOther

o Classification Scheme for Media Information:o UCD Related – still need to see text

74

MPEG-21 DIA Input :

Doc No. Contribution Source

10020 Sylvain Devillers, Eric Delfosse

Problems in the current DIA schema design, proposal for an abstract model and a corrected schema design

Topic: Problems with DIA spec. resulting from design for flexibility For example, cannot fix user preferences with particular user Multiple ways to interpret association of displays and terminals Cardinalities of many things are not correct, e.g., only one audio output and several

displays Propose an abstract model approach for checking the design of DIA schemaAction: Request Sylvain to create revised draft of affected types

10193 Sylvain Devillers, Eric Delfosse Input to the problem of extensibility in DIATopic: What does conformance mean if schema is extended?Action: Sylvain to create initial draft of DIA conformance

10019 Sylvain Devillers on behalf of the BNBPreliminary list of Belgian NB comments on MPEG-21 DIA FCD

10044

Peter van Beek, Thomas DeMartini, Bhavan Gandhi , Debargha Mukherjee, John R. Smith, Anthony Vetr Preliminary Comments on DIA FCD

Topic: About 90 comments to be reviewed in detail at this meeting

10104 Letian Rong, Ian BurnettIn response to FCD comments on DIAConfiguration

Topic: DIAConfiguration specification in DIA FCDResults: Proponents cannot fully explain the purpose of Consumer, Provider in cases in which

there are multiple stages of transaction/adaptation Proponents will work to improve definitions – terms & definitionsActions: Create meaningful example (already one in AM?) – should address multiple stages of

transaction

10087ZY Huang, SM Shen, Ming Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure Device Property of IPMP tools in DIA

Topic: Revised definition from AM and propose to adopt in DIA studyActions: Proponents to improve semantics, e.g., meaning of tool id Show concrete example of use of the tool Confirm with requirements, re: IPMP

MPEG-21 REL-RDD Reference SW:

75

Doc No. Contribution Source

9975 Xin Wang, Jaime DelgadoAHG on MPEG-21 REL and RDD Reference Software

10000Xin Wang, Thomas DeMartini, Jaime Delgado, Eva Rodriguez, Silvia Llorente

Data Types for MPEG-21 REL Interpretation Conformance Software

10001

Xin Wang, Thomas DeMartini, Mai Nguyen , Edgar Valenzuela, Jaime Delgado, Eva Rodriguez, Silvia Llorente MPEG-21 REL Validation Rules

Topic: REL software development since Trondheim meeting according to REL/RDD

Software planResults: Examples of valid and invalid licensesActions: To add text to REL Conformance WD Update REL and RDD software plan with new results

10038 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL License Interpreter v.1.1

10039 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Schema Checker

10040 Silvia Llorente, Jaime Delgado, Eva Rodriguez DMAG REL License Creator

10041 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Validation Rules Checker

10194 Roberto Garcia , Jaime Delgado RDDOnto, Rights Data Dictionary OntologyTopic: Additional REL software development since Trondheim meeting according to

REL/RDD Software planResults: Enhancements to use of variables Update of REL License creator Checks validity of the expression against the schema Implemented against validation test cases Search interface for RDDActions: Update REL and RDD software plan with new results

MPEG-21 DIA Reference SW:

Doc No. Contribution Source

9992 Gerrard Drury, Christian Timmerer, Jeho Nam AHG on MPEG-21 DIA Reference Software

10099Christian Timmerer , Hermann Hellwagner, Eric Delfosse , Sylvain Devillers

Implementation of a Digital Item Adaptation Engine

Topic: Contribution on integration platform for reference s/w (Java)Results: Proposed roadmap for integration of all DIA tools

76

Actions: Adopt roadmap and plan for software integration of DIA tools

MPEG-21 DIA:

Doc No. Contribution Source

10181 Stephen Davis, Ian Burnett Comments on DIA structure compressionTopic: Evaluation of compression tools for DIA (BiM, WinZIP, XMill, )Results: The compressability of the XML descriptions should be considered in schema design

and choosing among alternativesActions: Consider BiM compression as one factor for design of tools

10191 Lakshan De Silva, Ian Burnett MPEG-21 Hierarchical Device AggregationTopic: Aggregation of UEDResults: Informative presentation on the aggregation of terminal capabilities and other UED

descriptions

MPEG-21 DIP:

Doc No. Contribution Source

10177 Gerrard Drury, Ian BurnettEvaluation Criteria for currently proposed DIBOs

Topic: DIP evaluation criteriaResults: Some issues for DIP

o PlayResource DIBOo Remove attributeo Adapt, should pass component or resourceo Semantics of printo Resolve conditionso Is condition satisfied

Actions: Address in DIP BoG and report to MDS

10192 Lakshan De Silva, Ian Burnett Distributed Digital Item ProcessingTopic: Distributeed DIPResults: Addresses how digital item methods can be called from remote locations Message bus Secure DDIP

77

MPEG-7 Profiles with Requirements, Video, Audio, Systems:

Doc No. Contribution Source

9982 Wo Chang, Masanori Sano AHG on MPEG-7 Interoperability and Profiling

10029 Andy Tescher for USNB USNB Contribution: MPEG-7 profiles

10063 Romulo Pinho (TV Globo)Support for MPEG-7 Core Content Description Profile

10066Masanori Sano, Bhavan Gandhi, Alan Melby, Romulo Pinho

Supporting Descriptions for the Core Content Description Profile (CCDP) and a Proposed Grouping Within CCDP

10072 Wo ChangEditorial Changes to MPEG-7 Profile under Consideration

10073 Wo Chang Propose MPEG-7 Profile Part 9 Committee Draft

10153 P. van Beek, S. Watanabe, I. SezanCurrent status of MPEG-7 User Description Profile

10154P. van Beek, T. DeMartini, B. Gandhi, A. Melby, M. Sano, J. Smith, A. Vetro

Signaling of profile & level in MPEG-7 descriptions

10200 Wo Chang Study Report on MPEG-7 Profile SignalingTopic: Input on MPEG-7 profilesResults: A correction or extension to the MPEG-7 MDS standard should be defined to enable

signaling of profiling and level of descriptions. o AGREED.

A combination of an element and an attribute as described above should be used to enable signaling of profile and level of descriptions in an extensible manner.

o AGREED. Further discussion is needed to decide on the precise type of the

profileAndLevelIndication attribute. Recommended options are either the use of QName or URI.

o NOTE: URI type allows space in URI (could be a problem if listing multiple profiles). Care needs to be taken to express in semantics that space should not be included.

o Values of URI strings are defined in MPEG-7 Part 9. Part 9 is amended once new profiles are added.

o QNAME vs. URI: choose URI o To consider enabling signaling that a single description complies to

multiple profile@levels. o NOTE: Requirement for signaling of multiple profiles? Case (1)

description conforms to either profile, Case (2) description conforms to combination of profiles

o ACTION: Add requirement for both of these cases (Wo).o ACTION: Thomas and Wo to work on new definition accommodating

both these cases. Regarding the process of specifying this correction or extension: either (a) this

signaling capability is specified in a corrigendum on the MDS part of MPEG-7 (ISO/IEC 15938-5), or (b) this capability is specified in an amendment to the MDS part. The first amendment to MPEG-7 MDS has just been finalized, while a second amendment is currently in working draft stage. Therefore, specifying this capability in

78

the second amendment would take significantly longer than specifying this capability in a corrigendum (given that a corrigendum takes fewer meeting cycles to complete), assuming that a corrigendum can be drafted at the Brisbane or Hawaii meeting. Furthermore, if this capability is specified in the second amendment, profiles could not be defined with respect to the first version of MPEG-7. Therefore, the use of a corrigendum seems to be the most convenient.

o Choose corrigendum

Actions: Promotion of profiles:

o CCDP (Basic) – o CCDP (Full) – o UDP – support, 100% rule meto SMP – support, 100% rule met

MPEG-21 REL Profiles:

Doc No. Contribution Source

10148Brad Gandee, TJ Pannu, Manuel Ham, Xin Wang, Thomas DeMartini

Proposal for Creating a Profile of MPEG-21 REL for Mobile DRM Systems

10022 SC 29 SecretariatLiaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5570]

Topic: REL ProfilesResults: OMA contribution on requirements – should MPEG develop profiles then they should

address stated requirements Content Guard contributed input document (10148) that gives some responses to OMA

requirementso Includes proposal of profile requirementso Requirements not yet defined for profileso Recommendation for AHG to continue and work on (1) requirements set,

(2) solicit contributions on REL profileo What is an “REL profile”? – subset of tools, rules on number of

occurrences, and constraints on other thingsActions: Requirements to continue REL profile AHG

MPEG-21 DIA:

Doc No. Contribution Source

10146 Joerg Heuer, Gabriel Panis, Andreas HutterContribution to CE on BSD Transformation Instructions

Topic: BSD Transformation InstructionsResults: Propose to continue CE evaluation in order to evaluate complexity and conduct

benchmarking

79

Propose to adopt change to syntax allow specifying multiple adaptation transformations

Actions: Continue CE (have multiple parties), adopt change in syntax to Study of FCD

10085

Myriam Amielh, Ernest Wan, Ian Burnett, Gerrard Drury, Silvia Pfeiffer, Claudia Schremmer

Generic syntax for an addressing scheme dedicated to non-XML documents

10086 Myriam Amielh, Ernest WanLocation of a volume or a moving region in audiovisual content

Topic: DID resource fragment indexingResults: Proposing fragment representation of media locators. Functionality similar to MPEG-

7 Media Locators. Proponent not familiar with MPEG-7 Media Locators. The MPEG-21 Requirement is general enough that MPEG-7 satisfies the requirement. However, proposal is to be compatible with DID fragment.

Proponent to study MPEG-7, contribute more detailed requirementActions: Create AHG to study locating of fragments

10049Roland Tusch , Christian Timmerer , Laszlo Böszörmenyi , Hermann Hellwagner

Implementation of Usage Environment Description Tools in an Adaptive Distributed Multimedia Streaming Server

Topic: Implementation (informative)Results: Distributed streaming server Include id attribute

MPEG-7 MDS AMD/2:

Doc No. Contribution Source

5595MPEG-7 Multimedia Description Schemes XM (v17.0) M. Kim

Topic: MPEG-7 MDS XM and AMD/2Results: Editing completed after TrondheimActions: Produce PDAM

9899 Signaling of profile & level in MPEG-7 descriptions Peter van Beek Topic: Profiles signalingResults: Solutions require modification to MDS root elementActions: Adopt modification to MDS root element Produce MDS COR/1

MPEG-7 Schema Definition:

Doc Contribution Source

80

No.

10043 John R. Smith MPEG-7 Schema Definition (Part 10) WD v1.1Topic: MPEG-7 Part 10Results: Input includes schema definition from MPEG-7 version 1 + amendmentsActions: Produce CD

MPEG-21 Graphics DIA:

Doc No. Contribution Source

10059

Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann, Marius Preda, Françoise Prêteux CE Report on Avatar Preferences

Topic: Avatar Preferences for Graphics DIAResults: Avatar Preferences – Interest zonesQuestions: Is it possible to combine zones (yes, unbounded)? What generic mechanism is provided for graphics adaptation?

GraphicsPresentationPreference Feedback from SNHC is that DIA graphics definitions are reasonable and the tools are

useful for adapting graphics (SNHC participated in this CE).Actions: Recommend adopt to Study of FCD (check reference S/W).

MPEG-21 IPMP Tool Capability:

Doc No. Contribution Source

10087ZY Huang, SM Shen, Ming Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure Device Property of IPMP tools in DIA

Topic: IPMP tool support description in terminal (for DIA)Results: Prior request from MDS:

o Provide use case with XML example Questions:

o DIA has different parts of specification for different toolso Generic description of usage environmento In MPEG-2/-4 IPMP there are two ways to describe IPMP tool:

128 bit long identifier or parametric textual description

Actions: ACTION: Add textual parametric description (string) ACTION: Add 16-bit number (base64) for registration authority entry ACTION: Allow base64 encoding of string for 128-bit tool id

81

No differentiation of MPEG-2/-4 tool Clarify semantics for IPMP support flag Specifically identify MPEG-2/-4 IPMP tools.

MPEG-21 Metadata Adaptation:

Doc No. Contribution Source

10190 Lakshan De Silva, Ian Burnett Digital Item Meta-data Adaptation EngineTopic: Metadata adaptationResults: Tool for metadata adaptation (DIA should accommodate adaptation of DID) – OK,

already DIA requirement Ability to describe adaptation record that allows reconstruction of previosuly

performed adaptationsQuestions: Why does this need to be normative? How about adaptation record for adaptation of resources? Are there identification schemes that describe history of DIs? Does change or revision

history or record of dependencies/linking among digital items need to be expressed in normative way?

Actions: ACTION: need text for requirement ACTION: task DIA AHG to develop text for requirements addressing linking of

digital items and reconstruction of adaptation

MPEG-21 DIA Transmoding:

Doc No. Contribution Source

10111Mariam Kimiaei-Asadi , Jean-Claude Dufourd, Truong Cong Thang, Yong Man Ro, Jeho Nam Report of CE on Transmoding

Topic: Transmoding (specifying functions and parameters for DIA)Results: Some relation to modality conversion DS. Complementary functionality vs.

overlapping functionality. Transmoding addresses some cases that cannot be done using adaptation QoS and modality conversion, for example, conversion of video to summary.

REL/RDD Integration in DIA currently addresses:o Constraints on attributes of resourceso Constraints on adaptation method – allow industry to specify adaptation

method Not addressed at present:

o Constraints on parameters of adaptation Current definition of transmoding provides a way to express parameters associated

with particular transcoding operation, for example, video video summary. Actions:

82

This idea should be extended to address general adaptation methods and their parameters.

Recommendation: (1) AHG mandate (could be part of CE AHG) to investigate how the transmoding

solution can be extended to address other adaptation methods and their parameters.

Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:

Results on MDS MPEG-7 work items:

1. MPEG-7 MDS (Part 5): MPEG-7 AMD/1 MDS Extensions FDAM

o Completed final editing; sent document to ISO MPEG-7 AMD/2 MDS Extensions 2 PDAM

o Promoted tools for Person attributes, User Preferences, Visual Feature Descriptors in Segments

MPEG-7 MDS COR/1 WD v.1o Change to MPEG-7 root element to allow signaling of MPEG-7 Profiles

2. MPEG-7 Schema Definition (Part 10) Part 10 CD: Includes MPEG-7 v.1 and v.2 schemas from MPEG-7 MDS, Video,

Results on MDS MPEG-21 work items:

1. Analyzed recommendations of AHGs and Core Experiments.

2. MPEG-21 Part 2 – Digital Item Declaration: Produced DID 2nd Edition WD v.1.0: Revision of DID 1st Edition to allow XML form of resources and to include additional

DID validation rules

3. MPEG-21 Rights Expression Language (REL): REL Software contributions – License Interpreter v.1.1, Schema Checker, License

Creator, Validation Rules Checker,… Produced REL/RDD Software Plan v.5 with new modules and plan for integration with

DID REL Software MPEG-21 Part 8 – Reference Software WD

4. MPEG-21 Rights Data Dictionary (RDD): RDD Software – new contribution on RDD ontology representation using RDF and

interface for searching RDD Software MPEG-21 Part 8 – Reference Software WD

5. MPEG-21 Part 7 – Digital Item Adaptation: Reviewed draft comments on DIA FCD (~90) – ballot closes before Dec. 2003 meeting Produced “Study of Draft Comments on DIA FCD” Adopted to DIA “Study of FCD”:

AvatarPreferences (Ref SW to be provided by Dec.) Benchmark (Ref SW to be provided by Dec.) IPMPTool (Ref SW to be provided by Dec.) Universal Constraints Descriptor

83

BSD Transformation Instructions Adopted to DIA “Study of FCD” Annex:

Description of Usage of BSDLink Tool Description of Usage of DIA Configuration Description of DIA/REL/RDD Integration

Adopted to DIA AM v.7: ModalityConversionQoS Transmoding (updated text from CE)

Contribution on DIA extensibility and conformance MPEG-21 Part 14 – Conformance WD

DIA Ad Hoc Groups: DIA/REL/RDD Integration AHG:

o Solution for “Permissible Adaptation Control” for DIAo Describe Adaptation Capabilities in DIAo Define Classification Scheme for Media Informationo Express constraints on adapted resources using DIA stack function

Virtual Resources in DIAo Extending transmoding concept to allow description of “virtual resources”

(resources that are generated by specified DIA adaptation methods/parameters)

6. MPEG-21 Part 10 – Digital Item Processing: Carried out evaluation of DIBOs in DIP WD v.2:

o Most passedo Some revisions, eg., AdaptResourceo DIP reference software provided for DIBOs in WD

Studied DOM API vs. DIDL DIBOs:o Conclusion: retain DIDL specific DIBOs to allow interaction at granularity of

DID objects Object Map:

o Adopt object map definition from DIP TuC v.2 (replace definition in DIP WD v.2)

o Defined DIP Core Experiment to validate prior DIP implementations with object map definition

Output:o DIP WD v.3 (DIP CD in December), DIP TuC v.3

7. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)

84

New Core Experiments (CEs):

The following MPEG-21 experiments for MPEG-21 Digital Item Adaptation (DIA) and Digital Item Processing (DIP) were approved during the Brisbane meeting:

Organisations Application ReviewersSiemens AGHewlett-PackardLaboratoriesUniversity KlagenfurtETRI

Workplan for Core Experiment on BSD Transformation Instructions

Sylvain Devillers(IMEC), Ingo

Wolf, Bernhard Feiten(T-Systems)

ICUETRIHP

Work plan for CE on ModalityConversionQoS

Christian Timmerer Eric Delfosse Huh Youngsik

University of WollongongGhent University

Work plan for Core Experiment on Object Map Technology

Informatrion and Communications University (ICU)Korean Broadcasting System (KBS)Panasonic Singapore Labs

Workplan for Core Experiment on DIBO Exploration

Gerrard DruryFrederik De KeukelaereJeho Nam

85

List of MDS Output documents:

No. Title TBP Available

15938-5 MPEG-7 Multimedia Description Schemes 592

6 MPEG-7 MDS Extensions II PDAM Y 03/11/15

5927 MPEG-7 MDS Cor/1 WD v1.0 N 03/10/31

5928 MPEG-7 Industry Usage v2.0 Y 03/10/24

15938-7 MPEG-7 Conformance

15938-8 MPEG-7 Schema definition 592

9 MPEG-7 Schema Definition CD Y 03/10/31

21000-2 MPEG-21 Digital Item Declaration593

0 ISO/IEC 21000-2 DID 2nd Edition WD v.1 N 03/11/07

21000-5 MPEG-21 Rights Expression Language593

1 MPEG-21 REL/RDD Software Implementation Plan v.4 N 03/10/24

21000-6 MPEG-21 Rights Data Dictionary

21000-7 MPEG-21 Digital Item Adaptation593

2 Study of Draft Comments on FCD – Digital Item Adaptation N 03/10/24

5933 Study of ISO/IEC 21000-7 FCD – Part 7: Digital Item Adaptation N 03/11/12

5934 MPEG-21 Digital Item Adaptation AM v.7 N 03/11/12

5935 MPEG-21 DIA Software Implementation Plan v.5 N 03/10/24

5936 Overview of MPEG-21 DIA Core Experiments Y 03/10/24

5937

Workplan for Core Experiment on BSD Transformation Instructions N 03/10/24

5938

Workplan for Core Experiment on Modality Conversion QoS N 03/10/24

21000-10 MPEG-21 Digital Item Processing593

9 MPEG-21 Digital Item Processing WD v.3 Y 03/11/07

5940 MPEG-21 Digital Item Processing TuC v.3 N 03/11/07

5941 Overview of MPEG-21 DIP Core Experiments N 03/10/24

5942 Workplan for Core Experiment on Object Map Technology N 03/10/24

5943 Workplan for Core Experiment on DIBO Exploration N 03/10/24

86

List of AHGs approved by the MDS group:

N5944 AHG on MPEG-21 REL and RDD Reference SoftwareMandate: 1. To continue development of conformance licenses and test cases

2. To develop interpretation conformance software3. To develop the REL license interpretation using RDD term genealogy4. To coordinate work on other software in the REL/RDD reference software plan

Chairman: Xin Wang, xin.wang@contentguard.comCo-Chair: Jaime Delgado, jaime.delgado@upf.edu

Chris Barlas, chris.barlas@rightscom.com Duration: Until 67th Meeting Meetings Business will also be conducted by E-mail or Telephone.Reflector: mpeg-21-list@imec.be

Message titles prefixed [REL/RDD-RS]N5945

18.1.1 AHG on Editing MPEG-21 DIA Study of FCD & AMMandate: 1. Produce the Study of FCD and AM by 2003/11/12.

2. Maintain the schema and description examples for the Study of FCD and AM7.0 at http://www.midgardmedia.net.

3. Investigate open issues with schema design included in the Study of FCD.4. Study terminal capabilities and network characteristics description tools.5. Discuss the issue of namespaces in the DIA specification.6. Follow up on unresolved issues from the Study of Draft Comments.7. Produce Editors Input on FDIS and AM7.1.

Chairman Anthony Vetro (avetro@merl.com)Co-chairman Christian Timmerer (christian.timmerer@itec.uni-klu.ac.at)

Sylvain Devillers (Sylvain.Devillers@imec.be)Duration: Until the 67th Meeting.Meetings:

AHG Meeting to be held on the Saturday and Sunday prior to 67th meeting.Reflector: mpeg21-uma@merl.comN5946

18.1.2 AHG on Integration of DIA with REL and RDDMandate: Study the proposed solution for DIA/REL/RDD Integration as adopted to the Study of FCD

[N5933] and recommend improvements to the individual tools being standardized and the integration approach.

Chairman Thomas DeMartini (Thomas.DeMartini@CONTENTGUARD.COM)Co-chairman Chris Barlas (chris.barlas@rightscom.com)

Sylvain Devillers (Sylvain.Devillers@imec.be)Anthony Vetro (avetro@merl.com)

Duration: Until the 67th Meeting.Meetings:

AHG Meeting to be held on the weekend prior to 67th meeting.Reflector: mpeg-21-list@imec.be message titles prefixed [DIA-REL-RDD]N5947 AHG on Virtual Resources in DIAMandate: 1) Explore the notion of Virtual Resources, i.e. resources defined as a transformation of another, actual

resource.2) Integrate Transmoding into the Virtual Resources model.3) Study other kinds of adaptations within the Virtual Resources model.4) Investigate complexity issues in relationship with Virtual Resources5) Investigate the integration of the Virtual Resources with REL/RDD and DID governance.

Co-Chairs JC Dufourd (ENST), Thomas DeMartini (ContentGuard), Riccardo Leonardi (UoBrescia)Duration: Until 67th MeetingMeetings: Saturday or Sunday before next meetingReflector: mpeg-21-list@imec.be with the prefix "[VR]" in front of the subjectSubscribe:N5948

18.1.3 AHG on MPEG-21 Media LocatorsMandates 1. Investigate usage of MPEG-7 Media Locators in MPEG-21

a. For referencing a location within the MPEG File Format.b. For referencing locations within a media resource using the syntax and semantics of the

MPEG-21 parts.2. If MPEG-7 Media Locators are not sufficient in all cases:

87

a. Discuss a harmonized framework for media location schemeb. Define relevant media-dependent location schemesc. Recommend proposed text.

Chairman Gerrard Drury (gerrardx@xenikos.com)Co Chair Myriam Amielh (myriam.amielhx@xcisra.canon.com.au)

Sylvain Devillers (sylvain.devillersx@imec.be)Yongju Cho (yongjuchox@xetri.re.kr)

Duration Until the 67th MeetingMeetings None scheduled.

Bussiness will be conducted by email or telephone.Reflector mpeg-21-listx@ximec.be

Plese use the prefix [medialoc]N5949 AHG on Core Experiments for MPEG-21 DIAMandate: 1. Maintaining the MPEG-21 MDS CE Development process document.

2. Carry out Core Experiments on DIA and make recommendations to modify and improve the Study of FCD and Adaptation Model (AM v7.0).

3. Encourage delivery (according to software implementation plan v.5 N5935) of implementation software from participants.

Chairman: Jeho Nam (namjeho x @ x etri.re.kr )Co-Chair: Debargha Mukherjee (debargha x @ x hpl.hp.com )Duration: Until 67th MPEG meeting

Meetings: A meeting will be held on the weekend before the Hawaii meeting. Other business will be conducted by E-mail or Telephone.

Reflector: mpeg21-uma@merl.comN5950

18.1.4 AHG on Editing MPEG-21 DID/DIP and Core Experiments for DIPMandates 3. Edit MPEG-21 DIP WD v.3

4. Edit MPEG-21 DID 2nd Edition WD v.1S.5. Produce study on MPEG-21 DIP WD v.3 and recommendations on improving this document6. Produce study on MPEG-21 DID 2nd Edition WD v.1 and recommendations on improving this

document7. Encourage discussion on usage of DIMs and DIBOs by other parts of MPEG-21 and development

of new proposals for evaluation according to the Procedure for accepting DIBOs in MPEG-21 DIP document

8. Carry out Core Experiments on DIP.9. Encourage delivery (according to the MPEG-21 software implementation plan) of implementation

software from CE participants.Chairman Gerrard Drury (gerrardx@xenikos.com)Co Chair Rik Van de Walle (rik.vandewallex@xugent.be)

Munchurl Kim (mkimx@xicu.ac.kr)Duration Until the 67th MeetingMeetings AHG Meeting to be held on the Sunday prior to 67th meeting.

Other business to be conducted by email or phone.Reflector mpeg-21-dip@uow.edu.auSubscribe See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dipN5944 AHG on MPEG-21 REL and RDD Reference SoftwareMandate: To continue development of conformance licenses and test cases

To develop interpretation conformance softwareTo develop the REL license interpretation using RDD term genealogyTo coordinate work on other software in the REL/RDD reference software plan

Chairman: Xin Wang, xin.wang@contentguard.comCo-Chair: Jaime Delgado, jaime.delgado@upf.edu

Chris Barlas, chris.barlas@rightscom.com Duration: Until 67th Meeting Meetings Business will also be conducted by E-mail or Telephone.Reflector: mpeg-21-list@imec.be

Message titles prefixed [REL/RDD-RS]N5945

18.1.5 AHG on Editing MPEG-21 DIA Study of FCD & AMMandate: Produce the Study of FCD and AM by 2003/11/12.

Maintain the schema and description examples for the Study of FCD and AM7.0 at http://www.midgardmedia.net.

Investigate open issues with schema design included in the Study of FCD. Study terminal capabilities and network characteristics description tools. Discuss the issue of namespaces in the DIA specification.

88

Follow up on unresolved issues from the Study of Draft Comments. Produce Editors Input on FDIS and AM7.1.

Chairman Anthony Vetro (avetro@merl.com)Co-chairman Christian Timmerer (christian.timmerer@itec.uni-klu.ac.at)

Sylvain Devillers (Sylvain.Devillers@imec.be)Duration: Until the 67th Meeting.Meetings:

AHG Meeting to be held on the Saturday and Sunday prior to 67th meeting.Reflector: mpeg21-uma@merl.com

89

MPEG MDS group schedule for 66th meeting:

MDS Sub-Group Schedule 

MPEG-7 and MPEG-21 V.3.10    

Number TITLE ROOM & SOURCE STD NOTES

         

Monday Morning (9h00-13h00)     

MPEG Plenary  Plenary room    

         

Monday Afternoon (14h00-20h00)     

         

Kick-off of MPEG MDS activities (14h00-14h30)  Marquis (MDS Room) ALL  

 Agenda, Goals and Issues for the Week for MDS Group John R. Smith    

         

Review of AHG resolutions and action points (14h30-16h00)  Marquis (MDS Room) ALL  

9974 Barney Wragg, Thomas DeMartiniAHG on Editing the MPEG-21 Rights Expression Language FDIS    

9976 Chris Barlas, Godfrey Rust AHG on editing RDD FDIS    

9975 Xin Wang, Jaime DelgadoAHG on MPEG-21 REL and RDD Reference Software    

9977Anthony Vetro, Christian Timmerer, Eric Delfosse

AHG on Editing MPEG-21 Digital Item Adaptation FCD & AM    

9978Thomas DeMartini, Anthony Vetro, Sylvain Devillers, Barney Wragg, Chris Barlas

AHG on Integration of DIA with REL and RDD    

9992 Gerrard Drury, Christian Timmerer, Jeho Nam AHG on MPEG-21 DIA Reference Software    

9980Andrew Perkis, Andreas Hutter, Zhongyang Huang AHG on Updating DIA Descriptions    

9981Gerrard Drury, Rik Van de Walle, Ian Burnett, Munchurl Kim

AHG on Editing MPEG-21 DID and DIP Working Drafts    

9979 Jeho Nam, Debargha MukherjeeAHG on Core Experiments for MPEG-21 Digital Item Adaptation    

10059

Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann, Marius Preda, Françoise Prêteux CE Report on Avatar Preferences    

10081 Christian Timmerer, on behalf of the CEReport on CE of Universal Constraints Descriptor (UCD)    

10111Mariam Kimiaei-Asadi , Jean-Claude Dufourd, Truong Cong Thang, Yong Man Ro, Jeho Nam Report of CE on Transmoding    

10144 Sylvain Devillers, on behalf of the CEReport of CE on BSD Transformation Instructions    

         Define BoGs and Mandates (16h00-16h30)  Marquis (MDS Room) ALL  

  REL, RDD, DIA, BSD, DIP      

         

MPEG-21 DIA Editing (16h30 - 17h00) Marquis (MDS Room) 21  

10052Anthony Vetro, Christian Timmerer, Sylvain Devillers Editors Input on DIA Study of FCD    

10053Anthony Vetro, Christian Timmerer, Sylvain Devillers 21 Digital Item Adaptation AM v6.1    

90

         Multimedia Middleware (M3W) with Rqmts and Syst, (17h00 - 18h00)  Prince (Requirements Room) 21  

9990 Ian Burnett, Bas van den Heuvel AHG on Multimedia Middleware (M3W)    

         MPEG-21 DIA specification (17h00 - 18h30)  Marquis (MDS Room) 21  

10076Truong Cong Thang, Yong Ju Jung, Yong Man Ro, Jae-Gon Kim, Jeho Nam, Jin-Woo Hong

Modality Conversion for QoS Support in UMA    

10045Chris Joslin, Thomas DiGiacomo, Stephane Garchery, Nadia Magnenat-Thalmann

Swiss NB Comment on DeviceBenchmarking for DIA    

10036 Sylvain Devillers, Eric Delfosse, Jan Bormans

Use of the XPointer framework as URI fragment identifiers for addressing 21 descriptions    

10196 Simon WattCRF Liason contribution on Usage Environments    

         MPEG-21 DIA UCD Breakout Group (20h00 - TBD)  Check MDS Board for location 21  

         

         

Tuesday Morning (09h00-13h00)     

         

MPEG-21 DIA and REL/RDD Integration (09h00 - 10h00)  Marquis (MDS Room) 21  

9978Thomas DeMartini, Anthony Vetro, Sylvain Devillers, Barney Wragg, Chris Barlas

AHG on Integration of DIA with REL and RDD    

9999Thomas DeMartini, Anthony Vetro, Debargha Mukherjee Input on DIA/REL/RDD Integration    

         

MPEG-21 RDD Software Breakout Group (10h00 - 11h00)  Booth CL-3 21  

10194 Roberto Garcia , Jaime Delgado RDDOnto, Rights Data Dictionary Ontology    

         

MPEG-21 DIA Input (10h00 - 13h00)  Marquis (MDS Room) 21  

10020 Sylvain Devillers, Eric Delfosse

Problems in the current DIA schema design, proposal for an abstract model and a corrected schema design    

10193 Sylvain Devillers, Eric Delfosse Input to the problem of extensibility in DIA    

10019 Sylvain Devillers on behalf of the BNBPreliminary list of Belgian NB comments on 21 DIA FCD    

10044

Peter van Beek, Thomas DeMartini, Bhavan Gandhi , Debargha Mukherjee, John R. Smith, Anthony Vetr Preliminary Comments on DIA FCD    

10104 Letian Rong, Ian BurnettIn response to FCD comments on DIAConfiguration    

10037 Christian Timmerer, Hermann Hellwagner Proposed modifications to 21 DIA FCD    

10087ZY Huang, SM Shen, Ming Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure Device Property of IPMP tools in DIA    

         

         

Tuesday Afternoon (14h00-20h00)    

         

MPEG-21 REL-RDD Reference SW (14h00 - 15h00) with Marquis (MDS Room) 21  

91

Integration 

9975 Xin Wang, Jaime DelgadoAHG on 21 REL and RDD Reference Software    

10000Xin Wang, Thomas DeMartini, Jaime Delgado, Eva Rodriguez, Silvia Llorente

Data Types for 21 REL Interpretation Conformance Software    

10001

Xin Wang, Thomas DeMartini, Mai Nguyen , Edgar Valenzuela, Jaime Delgado, Eva Rodriguez, Silvia Llorente 21 REL Validation Rules    

10038 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL License Interpreter v.1.1    

10039 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Schema Checker    

10040 Silvia Llorente, Jaime Delgado, Eva Rodriguez DMAG REL License Creator    

10041 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Validation Rules Checker    

10194 Roberto Garcia , Jaime Delgado RDDOnto, Rights Data Dictionary Ontology    

         MPEG-21 DIA Reference SW (15h00 - 15h30) with Integration  Marquis (MDS Room) 21  

9992 Gerrard Drury, Christian Timmerer, Jeho Nam AHG on 21 DIA Reference Software    

10099Christian Timmerer , Hermann Hellwagner, Eric Delfosse , Sylvain Devillers

Implementation of a Digital Item Adaptation Engine    

         

MPEG-21 REL Profiling (16h00 - TBD)  Booth CL-3 21  

         

MPEG-21 DIA (15h30- 17h00)  Marquis (MDS Room) 21  

10181 Stephen Davis, Ian Burnett Comments on DIA structure compression    

10191 Lakshan De Silva, Ian Burnett 21 Hierarchical Device Aggregation    

10111Mariam Kimiaei-Asadi , Jean-Claude Dufourd, Truong Cong Thang, Yong Man Ro, Jeho Nam Report of CE on Transmoding    

         

MPEG-21 DIP (17h00 - 18h00)  Marquis (MDS Room) 21  

10177 Gerrard Drury, Ian BurnettEvaluation Criteria for currently proposed DIBOs    

10192 Lakshan De Silva, Ian Burnett Distributed Digital Item Processing    

         MPEG-21 REL/RDD Integration with DIA BoG (18h00 - 19h00)  Marquis (MDS Room) 21  

   

         

Wednesday Morning (09h00-13h00)       

MPEG Plenary (9h00-11h30)  Plenary room MPEG Plenary

         

MPEG-21 DIA Input (11h30 - 13h00)  Marquis (MDS Room) 21  

10019 Sylvain Devillers on behalf of the BNBPreliminary list of Belgian NB comments on 21 DIA FCD    

10044

Peter van Beek, Thomas DeMartini, Bhavan Gandhi , Debargha Mukherjee, John R. Smith, Anthony Vetr Preliminary Comments on DIA FCD    

10104 Letian Rong, Ian BurnettIn response to FCD comments on DIAConfiguration    

10037 Christian Timmerer, Hermann Hellwagner Proposed modifications to 21 DIA FCD    

92

         MPEG-7 Profiles (11h30 - 13h00) with Requirements, Video, Audio, Systems  Prince (Requirements Room) MPEG-7  

9982 Wo Chang, Masanori SanoAHG on MPEG-7 Interoperability and Profiling    

10029 Andy Tescher for USNB USNB Contribution: MPEG-7 profiles    

10063 Romulo Pinho (TV Globo)Support for MPEG-7 Core Content Description Profile    

10066Masanori Sano, Bhavan Gandhi, Alan Melby, Romulo Pinho

Supporting Descriptions for the Core Content Description Profile (CCDP) and a Proposed Grouping Within CCDP    

10072 Wo ChangEditorial Changes to MPEG-7 Profile under Consideration    

10073 Wo ChangPropose MPEG-7 Profile Part 9 Committee Draft    

10153 P. van Beek, S. Watanabe, I. SezanCurrent status of MPEG-7 User Description Profile    

10154P. van Beek, T. DeMartini, B. Gandhi, A. Melby, M. Sano, J. Smith, A. Vetro

Signaling of profile & level in MPEG-7 descriptions    

10200 Wo Chang Study Report on MPEG-7 Profile Signaling    

         

MPEG-21 DIP BoG (12h00 - 14:00)  Booth CL-3 21  

         

         

Wednesday Afternoon (14h00-17h30)       

         

MPEG-21 REL Profiles (14h00 - 14h30)  Marquis (MDS Room) 21  

10148Brad Gandee, TJ Pannu, Manuel Ham, Xin Wang, Thomas DeMartini

Proposal for Creating a Profile of 21 REL for Mobile DRM Systems    

10022 SC 29 SecretariatLiaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5570]    

         

MPEG-21 DIA (14h30 - 15h30)  Marquis (MDS Room) 21  

10146 Joerg Heuer, Gabriel Panis, Andreas HutterContribution to CE on BSD Transformation Instructions    

10085

Myriam Amielh, Ernest Wan, Ian Burnett, Gerrard Drury, Silvia Pfeiffer, Claudia Schremmer

Generic syntax for an addressing scheme dedicated to non-XML documents    

10086 Myriam Amielh, Ernest WanLocation of a volume or a moving region in audiovisual content    

10138 Sylvain Devillers, Eric Delfosse, Jan BormansHierarchical addressing scheme for ISO file format    

10049Roland Tusch , Christian Timmerer , Laszlo Böszörmenyi , Hermann Hellwagner

Implementation of Usage Environment Description Tools in an Adaptive Distributed Multimedia Streaming Server    

         

MPEG-21 DID and DIA Namespaces (15h30 - 16h00)  Marquis (MDS Room) 21  

         

M3W (16h00 - 17h00) with Systems, Requirements  Systems All  

         MPEG-21 Integrated Software (17h00 - 18h00) with Marquis (MDS Room) 21  

93

Integration 

         

MPEG Social Event (18h00 - midnight)     

         

Thursday Morning (09h00-12h30)       

   

MPEG-21 DIP BoG (09h00 - 11h00)  To be posted outside of MDS room MPEG-7  

   

MPEG-21 DIA (09h00 - 11h00)  Marquis (MDS Room) MPEG-7  

   

MPEG-7 Schema Definition (09h00 - 09h30)  Booth CL-3 MPEG-7  

10043 John R. SmithMPEG-7 Schema Definition (Part 10) WD v1.1    

         

MPEG-7 MDS Amd/1 (09h30-10h00)  Booth CL-3 MPEG-7  

         

MPEG-7 MDS Amd/2 (10h00-11h00)  Booth CL-3 MPEG-7  

         

MPEG-21 Graphics DIA (11h00 - 11h30) with SNHC  Marquis (MDS Room) 21  

10059

Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann, Marius Preda, Françoise Prêteux CE Report on Avatar Preferences    

         MPEG-21 IPMP Tool Capability (11h30 - 12h00) with Req, Sys  Marquis (MDS Room) 21  

10087ZY Huang, SM Shen, Ming Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure Device Property of IPMP tools in DIA    

         

MPEG-21 Metadata Adaptation (12h00 - 12h30) with Req Marquis (MDS Room) 21  

10190 Lakshan De Silva, Ian Burnett Digital Item Meta-data Adaptation Engine    

         

MPEG-21 DIA Transmoding (12h30 - 13h00)  Marquis (MDS Room) 21  

10111Mariam Kimiaei-Asadi , Jean-Claude Dufourd, Truong Cong Thang, Yong Man Ro, Jeho Nam Report of CE on Transmoding    

   

Thursday Afternoon (14h00-19h00)       

         

MPEG-21 DID Namespace (14h00 - 14h30)  Marquis (MDS Room) 21  

         

MPEG-21 DIA and REL/RDD Integration (14h30 - 15h00)  Marquis (MDS Room) 21  

         

MPEG-21 DIA (15h00 - 16h00)  Marquis (MDS Room) 21  

10019 Sylvain Devillers on behalf of the BNBPreliminary list of Belgian NB comments on MPEG-21 DIA FCD    

10044

Peter van Beek, Thomas DeMartini, Bhavan Gandhi , Debargha Mukherjee, John R. Smith, Anthony Vetr Preliminary Comments on DIA FCD    

94

10104 Letian Rong, Ian BurnettIn response to FCD comments on DIAConfiguration    

10037 Christian Timmerer, Hermann HellwagnerProposed modifications to MPEG-21 DIA FCD    

10196 Simon WattCRF Liason contribution on Usage Environments    

         

Plenary MDS and Reports of BoG (16h00 - 17h00)  Marquis (MDS Room) MDS PlenaryReview of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00)  Marquis (MDS Room)    

         Friday Morning (09h00-13h00)       

Wrapping up (09h00 - 13h00)  Marquis (MDS Room) MDS Plenary

 Approval of resolutions, AHGs and Output documents      

         

Friday Afternoon (14h00-21h00)       

MPEG Plenary  Plenary room MPEG Plenary

95

Annex 7Report of Video meeting

Source: Jens-Rainer Ohm

MPEG-4

Corrigendum over Edition 3A draft corrigendum was issued (N5951) which resolves all items related to 14496-2, as previously contained in the "MPEG-4 Visual List of Problems Reported". The Video subgroup has issued a resolution that requests NBs to consider the draft corrigendum, such that possible improvements can be made at the December meeting by a Study of DCOR.

Documents reviewed:

M9951 AHG on Maintenance of MPEG-4 Visual Text, Reference Software and Conformance

Tihao ChiangYi-Shin Tung Chung-Neng Wang

M10096 Draft Text of ISO/IEC 14496-2:2003/DCOR1Jens-Rainer OhmYi-Shin Tung Tihao Chang

M10173 MPEG-4 Visual: Updated List of Problems Reported, v.9.1

Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm

New Version of Visual List of Problems ReportedVersion 10 of the document "MPEG-4 Visual List of Problems Reported" (N5952) was issued. This contains now only issues related to problems with Reference Software, Conformance and the Verification Model. The work plan foresees to have all software related issues resolved by the 67 th

meeting with two corrections made after NB comments. It is further planned to resolve the items related to VM when a new version of the verification model description is produced.

Documents reviewed:

M9951 AHG on Maintenance of MPEG-4 Visual Text, Reference Software and Conformance

Tihao ChiangYi-Shin Tung Chung-Neng Wang

M10173 MPEG-4 Visual: Updated List of Problems Reported, v.9.1

Yi-Shin TungChung-Neng WangTiHao ChiangJens-Rainer Ohm

Optimised Reference Software An editorial update of 14496-7/Amd.1 was made by request of the Singapore NB (see DoC in N5953). The new text is in N6050. Further, an input was brought by the Chinese NB pointing out that the description of the fast variable length decoder was missing in 14496-7/DAM1. This was resolved by a corrigendum (N5954). NCKU has provided another fast version of optimised reference software for Simple Profile. This is well acknowledged; they are asked to keep in contact with the Software Maintenance AHG Chair to unify efforts and use the independently developed packages for possible cross-check purposes.

Documents reviewed:M10002 Summary of Voting on ISO/IEC TR 14496-7/DAM 1 [SC 29 N

5559]JTC 1 Secretariat via SC 29 Secretariat

M10174 NCKU MPEG-4 Simple Profile Software Encoder Contribution Jing-Xin WangAlvin W.Y. Su

96

M10198 China NB comments on Text of ISO/IEC 14496-7/DAM1 Optimised Reference Software

Wen GaoFeng Wu

AVC related

One AVC-related input document was brought to the video group, providing a collection of speed-optimized AVC software modules (succeeding a previous contribution that had been reviewed in Trondheim). No presentation of this contribution was given by the time scheduled. As the development of the AVC reference software is in the hands of JVT, it is recommended to re-consider this issue in the December meeting.

Documents considered:M10101 MPEG-4 AVC Reference Software Optimization Bob Feng

Shiqiang Yang

Output documents related to MPEG-4

No. Title TBP Available14496-2 MPEG-4 Visual

5951 Text of ISO/IEC 14496-2:200X/DCOR1 N 2003/10/31

5952 MPEG-4 Visual: List of Problems Reported version 10.0

Y 2003/10/24

14496-7 MPEG-4 Optimized Reference Software

5953 Disposition of Comments on ISO/IEC 14496-7 DAM1 N 2003/10/24

6050 Text of 14496-7/Amd.1 Optimised Reference Software for Simple Profile and Visual Error Resilience

N 2003/10/24

5954 Text of ISO/IEC 14496-7/Amd.1 DCOR1 N 2003/10/24

MPEG-7

MPEG-7 related work in Brisbane

The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.

M9952 AHG on Core Experiments for Visual Descriptors and Visual-only Description Schemes in MPEG-7

Miroslaw BoberSang-Kyun Kim

M9953 AHG on Editing MPEG-7 Visual FPDAM1, DCOR1 and WD for 15538-8 DAM1

L. CieplinskiA. Yamada

M10069 Report of cross verification result of VCE-1, Perceptual 3D Shape Descriptor Soo-Jun Park

M10070 Report of Core Experiment result of VCE-2, Binary Representation of Visual Descriptors Soo-Jun Park

M10071 A proposal for feature based classification of MPEG-7 visual descriptors

Soo-Jun ParkMyung Gil JangChee Sun Won

M10093 Perceptual 3D shape descriptor: Result of core experiment (VCE-1)

In Kyu ParkDuck Hoon KimIl Dong Yun

97

M10102 Additional results of VCE-3 for DominantColor descriptor Leszek Cieplinski

M10107 Estimation of facial pose Lifang Wu

M10128 Cross verification results of the Dominant Color Descriptor (VCE-3)

Krzysztof KucharskiWladyslaw Skarbek

M10168 WD 1.1 of ISO/IEC TR 15938-9/AMD1 Akio Yamada Sang Kyun Kim

M10169 Editor's Study on ISO/IEC 15938-3/FPDAM1 Akio Yamada Leszek Cieplinski

M10171 A Proposed fix on GopGofFeature Binary Syntax Akio Yamada

M10172 Preliminary Study on the Categorization of Description Tools of Visual Signal Characteristics for Snapshots Akio Yamada

Only Core Experiments VCE-1 (evaluation of Perceptual 3D Shape descriptor) and VCE-2 (tools and DS for image/photo libraries) will be continued (N5956). A first version of a document "Meta-Data for Digital Photo Libraries using MPEG-7 and ISO File Format" (N6078) was edited; a study of EXIF was performed as the starting point. The purpose is to define a simple set of MPEG-standards based metadata, targeting the need of industry. This may also lead to further extensions of the Visual part of MPEG-7, e.g. defining metadata to describe camera settings or ambient lighting conditions.To improve the text of 15938-3/Amd.1, an FPDAM Study was released (N5957). Furthermore, the PDAM on Part 8 was issued, complementing all new Visual description elements that will be contained in 15938-3/Amd.1.

Output documents related to MPEG-7

No. Title TBP Available15938-3 MPEG-7 Visual

5955 Study Text of ISO/IEC 15938-3 FPDAM 1 N 2003/10/31

5956 Description of Core Experiments for MPEG-7 Visual Extensions N 2003/10/24

6078 Meta-Data for Digital Photo Libraries using MPEG-7 and ISO File Format

N 2003/11/07

15938-8 Extraction and Use of MPEG-7 Descriptions5957 Text of ISO/IEC TR 15938-8 PDAM1 N 2003/10/3

1

MPEG-21

Scalable Video Coding

It was originally planned to issue a preliminary CfP on new scalable video coding technology by the 66th MPEG meeting, with the final call to be produced in December. Considering the short timeline between the final call and the submission of test sequences due by mid of February, this situation was re-considered and it was decided to issue the official call already in the October 2003 meeting. The document number is N5958.Most of the input contributions on scalable video coding (10026, 10056, 10074, 10108, 10149, 10150) were related to the improvement of the Draft Call document that ha been issued in July (Trondheim). Different issues were brought up, including review of the time line, test sequences and test conditions, considering a more realistic application environment. After intense discussions

98

during the week, consensus was reached considering the review of the timeline as described above, which is accompanied by a simplification of mandatory tests to be performed. Two test scenarios are defined, where scenario 1 is related to a wider range of scalability, including each three spatial and temporal levels, and a bit rate range between 64 kbit/s and 6 Mbit/s. This is related to an application cluster which could roughly be defined as broadcast, storage and surveillance applications. In this scenario, random access is important. Scenario 2 defines a more reduced range of scalability, including two spatial and three temporal levels, and a rate range between 64 kbit/s and 2 Mbit/s (48 kbit/s up to 1 Mbit/s for sequences which are easier to encode). This is related to an application cluster of streaming and mobile communication applications. It is not mandatory to submit results on both test scenarios, but at least one scenario must be submitted by proponents with a complete set of sequences to enter the formal subjective tests. In addition, it will be possible to bring proposals about standalone scalable coding tools, such as quantizers, entropy coders etc., which will however not be subject to formal subjective evaluation, unless integrated in a fully working coding/decoding algorithm.The evaluation of proposals will be performed in the 68 th meeting (March 2004). Based on the outcome, the most promising proposals will be selected to define a set of core experiments starting a collaborative phase in scalable video coding development. Scalable video coding is planned as a new work item under MPEG-21 (21000-13), with a tentative timeline of WD-04/07; CD-05/10; FCD-06/03; FDIS 06/07.

Several joint meetings with the Test and Requirements subgroups were held on the issue of scalable video coding and the CfP.

4 technical contributions have been submitted that are related to the scalable video coding (10027, 10142, 10151, 10158). These contributions proposed technologies for:

– Intra coding with intraframe prediction– Test over error-prone channels – Deblocking in block-based MC– Encoder optimization for drift-free decoder operation at specific rate targets

Documents reviewed:

M9955 AHG on Scalable Video CodingMihaela van der Schaar C.J. Tsai

M10026

Contribution to the definition of the draft call for proposals on new tools for scalable video coding technology

MarquantViéronFrancoisBoissonRobert

M10027 An analysis of the bit error sensitivity of the MC-EZBC bitstream

Tamer ShanablehJonathan TehTony May

M10056 Contribution to Applications and Requirements for Scalable Video Coding (Reqs) Julien Reichel

Francesco ZilianiM10074 Comments on Draft Call for Proposals on Scalable Video Coding Technology Takahiro Kimoto

Yoshihiro Miyamoto

M10108

Comments on Draft Call for Proposals on new Tools for Scalable Video Coding Technology

Rene van der VleutenFons BrulsJan van der Meer

M10142 Intra-frame prediction of high-pass frames in MCTF

Leszek CieplinskiJordi CaballAndrew Secker

M10149 Comments on Draft Call for Proposals on Scalable Video Coding Technology Julien Reichel

Francesco ZilianiM10150

Investigation of Test Sequences for Call for Proposals on New Tools for Scalable Video Coding Technology

Markus BeermannKonstantin Hanke

99

Thomas RusertMathias Wien

M10151 Operating Point Adaptation in Interframe Wavelet Video Coding Thomas Rusert

M10158 An Overlapped Block Motion Compensation for MC-EZBC

John WoodsYongjun Wu Robert Cohen

Output documents related to MPEG-21

No. Title TBP Available21000-13 Scalable Video Coding

5958 Call for Proposals on Scalable Video Coding Technology

Y 2003/10/24

Explorations

3D AV Coding

In 3D AV coding, the following Exploration Experiments were performed before the Brisbane meeting: EE1 – Evaluation of usage of mesh objects for omni-directional video: Investigations were

performed which showed that it may not be necessary to use shape coding tools in encoding of the mesh-objects; moreover, when the non-mesh background is signalled by black pixels, rectangular-frame coding can be applied without significant penalty in coding efficiency. This means that highly efficient compression methods such as ASP and AVC can be used, and it is not necessary to use the Core Profile or define a higher level thereof. It is however necessary to further investigate methods for localized random access, which would allow to partially frames. Different methods available in MPEG-4 could be used for this purpose, such as sub-division of a frame into multiple VOPs or usage of mechanisms originally developed for re-synchronisation. The EE will hence continue for a limited amount of time, until a best practical solution is found, which will require as low standardization effort as possible.

EE2 – Free viewpoint video: First investigations were provided about the efficiency of inter-frame (motion compensated prediction) versus inter-view (disparity-compensated prediction) coding approaches. It was found by three independent contributors that the gain to be expected by disparity-compensated prediction in addition to motion-compensated prediction might only be marginal. As a consequence, it was discussed that conventional coding strategies which target at pixel-wise highest fidelity may not be appropriate for multi-view coding, where certain deficiencies (e.g. geometric distortion) can anyway be expected by synthetic view generation and may be tolerated. Hence, the challenge will be to find the best combination of encoding and methods for decoder-side view generation (e.g. depth-based interpolation) with optimum tradeoff concerning both rate and visual quality. Herein, the view interpolator could well be considered as part of a normative decoder, in order to enable optimization of encoders for best visual quality. The EE was re-defined to explore such solutions. It is appreciated that one of the participants will provide a sequence captured by a dense field of cameras in the near future.

Documents reviewed:

M10025 A Multi View Video Compression Scheme Based on Direct View Synthesis

George ChenKim NgHuisheng Wang

M10051 Comments on Model Based Video Streaming (Req) Raphaele BalterPatrick GioiaLuce Morin

100

Franck Galpin

M10054 Preliminary study on multiple view coding for the Ray Space representation (3DAV EE2) Hideaki Kimata

M10088 Real-time 3-D Imaging Method based on Integral Photography Makoto OkuiFumio Okano

M10095 Plan of JEITA for Omni-directional Video (Req)Kazumasa Yamazawa (NAIST)Hideaki Kimata (NTT)Takashi Matsuyama (Kyoto Univ.)

M10098 Study and experiments on the random access (partial decoding and rendering) of panoramic image

Euee S. JangSun Young LeeHyun Jong OhSung Won ParkWook-Joong KimMyungsuk KiKyuheon Kim

M10152 Study on View-Dependent Multitexturing for MPEG-4 AFX (SNHC)

Karsten MuellerAljoscha Smolic

M10178 Coding of multiple views using temporal and spatial prediction Masayuki TanimotoToshiaki Fujii

MPEG Intra-only coding

An input document on intra-only MPEG coding was brought to the requirements group, which was reviewed in a joint meeting. It is understood that the interlaced video coding tools of MPEG standards provide advantages in intra-coding of certain interlaced video sequences, as compared to still image coding methods such as JPEG, which do not provide specific mechanisms of adaptive frame/field switching. It is recommended to start a study on these items.

Documents reviewed:

M10075 Consideration on MPEG-intra

Kohtaro AsaiYoshihisa YamadaHirofumi NishikawaTokumichi Murakami

Output documents related to Explorations

No. Title TBP Available3D AV

5959 Description of Exploration Experiments in 3DAV

N 03/10/24

AHGs established by the Video Subgroup

No. Title Mtg

5960 AHG on Maintenance of MPEG-4 Visual DCOR, Reference Software and Conformance N

5961 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7 Y5962 AHG on Editing MPEG-7 Visual Documents N5963 AHG on 3DAV Coding Y5964 AHG on Scalable Video Coding Y

AHGs supported by the Video Subgroup No. Title Mtg6036 AHG on AVC Verification Tests Y

101

6056 AHG on MPEG-7 Interoperability and Profiling N

6060 AHG on Intra-only Coding in MPEG N

6072 AHG on MPEG Multimedia Test Bed N

102

Annex 8Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 OPENING OF THE MEETING...................................................................................................................... 3

2 ADMINISTRATIVE MATTERS.................................................................................................................. 3

2.1 APPROVAL OF PREVIOUS MEETING REPORT................................................................................................32.2 APPROVAL OF AGENDA AND ALLOCATION OF CONTRIBUTIONS...................................................................32.3 COMMUNICATIONS FROM THE CHAIR........................................................................................................ 3

2.3.1 Technology demonstrations at Hawaii MPEG meeting.....................................................................32.4 JOINT MEETINGS....................................................................................................................................... 32.5 RECEIVED NATIONAL BODY COMMENTS AND LIAISON MATTERS...............................................................32.6 TASK GROUPS.......................................................................................................................................... 4

3 RECORD OF AHG MEETINGS................................................................................................................. 4

3.1.1 MPEG-4 Audio Lossless Coding - Sun 19 Oct. 2003, 1400-1700......................................................4

4 RECORD OF AUDIO PLENARY, JOINT MEETINGS AND TASK GROUP ACTIVITIES..................5

4.1 REVIEW OF AHG REPORTS........................................................................................................................ 54.2 RECEIVED NATIONAL BODY COMMENTS AND LIAISON MATTERS.................................................................54.3 AUDIO PLENARY DISCUSSIONS.................................................................................................................. 7

4.3.1 Future of MPEG Audio.................................................................................................................... 74.3.2 Response to CfP on Lossess coding of 1-bit audio representations...................................................7

4.4 JOINT MEETINGS...................................................................................................................................... 74.4.1 With Systems on signaling of MPEG-4 profileandlevel by MPEG-2 Systems (m10147)....................74.4.2 With Systems on timestamps and AAC normative behaviour (m10143).............................................84.4.3 With Systems on Music Notation Application Requirements (m10068).............................................84.4.4 With Systems on Audio BiFS extensions (m10110, m10112, m10120, m10122).................................84.4.5 All on MPEG-7 profiles – Markus Cremer.......................................................................................94.4.6 With Requirements on Various......................................................................................................... 9

4.5 TASK GROUP DISCUSSIONS....................................................................................................................... 94.5.1 MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software.........94.5.2 MPEG-4 Extension 1, Bandwidth Extension...................................................................................104.5.3 MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)..............................................................104.5.4 MPEG-4 Extension 3, Lossless Coding...........................................................................................114.5.5 MPEG-7 Extension 1 Tools, Conformance and Reference Software – Markus Cremer....................124.5.6 Explorations on Scalable Coding of Audio.....................................................................................13

5 MEETING DELIVERABLES.................................................................................................................... 13

5.1 PRESS STATEMENT.................................................................................................................................. 135.2 DISPOSITIONS OF COMMENTS.................................................................................................................. 135.3 RESPONSES TO LIAISON AND NB COMMENTS...........................................................................................135.4 RECOMMENDATIONS FOR FINAL PLENARY................................................................................................135.5 ESTABLISHMENT OF AD-HOC GROUPS.....................................................................................................135.6 APPROVAL OF OUTPUT DOCUMENTS........................................................................................................ 13

6 FUTURE ACTIVITIES............................................................................................................................... 13

6.1 SCHEDULE OF FUTURE MEETINGS............................................................................................................ 136.2 AGENDA FOR NEXT MEETING.................................................................................................................. 136.3 ALL OTHER BUSINESS............................................................................................................................. 146.4 CLOSING OF THE MEETING...................................................................................................................... 14

103

ANNEX A PARTICIPANTS.......................................................................................................................... 15

ANNEX B AGENDA AND SCHEDULE.......................................................................................................16

ANNEX C TASK GROUPS........................................................................................................................... 20

ANNEX D OUTPUT DOCUMENTS............................................................................................................. 21

Annex E Agenda for the 67th MPEG Audio Meeting.....................................................................................22

104

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 66 th meeting of WG11, October 20-24, 2003, Brisbane, Australia. The list of participants is given in Annex A.

Administrative matters

Approval of previous meeting reportThe Audio Subgroup Trondheim meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting, shown in Annex B, was discussed, edited and approved. The documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary, are shown in the agenda and schedule. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Technology demonstrations at Hawaii MPEG meeting

The Chair announced that on Tuesday Dec 9, 2003 of the MPEG week, from 2PM to 7PM, there will be the opportunity for companies to demonstrate their MPEG-related technology (MPEG-2, MPEG-4, MPEG-7, MPEG-21, JPEG 2000 and JBIG). A table of approximately 30 by 60 inches will be available for each demonstration, and there will be space for approximately 15 tables. Interested companies should send a one-paragraph description to Mike Rubenfield (miker@nist.gov). The following will be provided at each demo table:

Network connection 110v power Table

The company must provide all other components of demonstration.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Groups What Where Day TimeAudio, Systems

Signaling of MPEG-4 profileandlevel by MPEG-2 Systems (m10147)

Audio Tue 1400-1430

Audio, Systems

Timestamps and AAC normative behaviour (m10143) Audio Tue 1430-1500

Audio Sys Music Notation Application Requirements (m10068) Audio Tue 1500-1600

Audio, Systems

Audio BiFS extensions (m10110, m10112, m10120, m10122)

Audio Tue 1600-1700

All MPEG-7 profiles Req Wed 1130-1300

Audio, Req Proposed profile for MPEG-4 Ext 2, Requirements for SLS, Requirements for Spatial Audio

Audio Thu 1400-1430

105

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response

From

10100 UKNB Position paper regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

S. Quackenbush

10032 USNB Contribution: Lossless audio S. Quackenbush

10048 SgNB Comments on Requirements for Scalable Lossless Audio Coding S. Quackenbush

10012IEC NP: Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958- Part 8: Non-linear PCM bitstreams according to the Windows Media Audio Professional [SC 29 N 5562]

No response needed

10023 IEC CDV 61883-6: Consumer audio/video equipment -- Digital interface -- Part 6: Audio and music data transmission [SC 29 N 5571]

No response needed

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

Record of AhG meetings

MPEG-4 Audio Lossless Coding - Sun 19 Oct. 2003, 1400-1700

The AhG meeting on Lossless Coding of Audio was convened at 14:00 hours on the Sunday prior to the MPEG meeting at the MPEG meeting location.Schuyler Quackenbush reviewed the status of the core experiments for ALS. The group agreed that all aspects of workplan N5719 have been completed, so that the CE1 on Block Gilbert-Moore Code is now complete. Tilman Liebchen presented

10079 MPEG-4 Audio Tilman LiebchenVerification Report on MPEG-4 ALS Core Experiment 1 (Improving Coding of Prediction Residual)

This report confirms that the CE1 data presented by Yuriy Resnik, Realnetworks, during the Trondheim meeting was correct, and m10079 constitutes an independent cross-check of CE1. With this cross-check, and contribution m10161 (draft WD1), all aspects of CE1are complete.Schuyler Quackenbush presented

10161 MPEG-4 Audio Yuriy A. ReznikProposed WD1 of ISO/IEC 14496-3:2001 /AMD 4 (Audio Lossless Coding - ALS)

Quackenbush noted that the changes to WD0 to support CE1 are primarily found in Section 3.2.6.2. This document will become ALS WD1. Schuyler Quackenbush presented

10162 MPEG-4 Audio Yuriy A. ReznikAdditional Improvements in MPEG-4 ALS CE1 (Coding of Prediction Residual)

106

Quackenbush noted that there is no requirement that reference model code be optimized for execution speed, and furthermore that estimating processor complexity from the execution speeds of compiled source code is typically quite imprecise. That said, this contribution presents several strategies for improving the execution speed of the decoder source implementing the CE1 technology. The overall conclusion of the contribution is that an optimized CE1 decoder has approximately 25% additional complexity relative to the complexity of RM0. Takehiro Moriya presented

10055 MPEG-4 Audio Moriya Dai Tracy YangProposal of Core Experiment for Lossless Coding of Audio in Floating-point Format

This proposes a Core Experiment for a method of representing audio signals stored in floating point format. This document has all necessary components for a CE proposal, and there was consensus in the Audio Subgroup to proceed with this Core Experiment.

The AhG was adjourned at 17:00 hours.

Record of Audio plenary, joint meetings and task group activities

Review of AHG reportsThere were no requests to review any of the AHG reports that were already presented in the opening MPEG plenary.

Received national body comments and liaison mattersThe Chair presented

10100 MPEG-2 Audio Tanton BBC

UKNB Position paper regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

This NB comment indicated the need for audio-related changes to the MPEG-2 Systems specification. There was no discussion.The Chair presented

10032 MPEG-4 AudioAndy Tescher for USNB

USNB Contribution: Lossless audio

There was considerable discussion on the last point (D) of this NB comment, which requested that intermediate bitrates (i.e. rates between that of the lossy core codec and the lossless reconstruction) of the Scalable to Lossless Coding architecture be tested for coding performance.Sang-Wook Kim, Samsung, observed that subjective assessment at rates approaching transparency is quite difficult, and that tools for objective measurement of quality are most likely not accurate at higher sampling rates and word lengths.Jim Johnston, Microsoft, observed that subjective assessment is best done with the MPEG-4 core run at e.g. between 16 kb/s/channel to 32 kb/s/channel. One could then compare the enhanced coder at rate X with AAC at rate X, where X is the intermediate rate for evaluation.Juergen Herre, FhG, observed that intermediate rates could be assessed via repeated tandem coding at rates above 64 kb/s/channel. The Chair noted that N5720, Workplan for Scalable Lossless Coding (SLS), stipulated as part of the Process, Goals and Performance Measurement Criterion for this work that the MPEG-4 core codec would operate at 64 kb/s for the purposed of measuring the performance of the SLS technology, and that this document represents the consensus of the Audio Subgroup, although that consensus was not unanimous.

107

The Chair presented

10048 MPEG-4 Audio CJ Lee for SgNB

SgNB Comments on Requirements for Scalable Lossless Audio Coding

The Chair noted that in it seems vital to have bitrate scalability, in terms of support for intermediate rates between the core lossy rate and the lossless reconstruction rate, in order to differentiate the SLS work from the ASL work, considering that the latter may simulcast an MPEG-4 lossy bitstream.There were no strong opinions against having scalability as an integral functionality of this work item. The response to these two NB comments was discussed later in the week. At that discussion, the Chair noted that there are conflicting requirements in the development of a scalable to lossless compression technology, namely that compression at lossless reconstruction trades directly against performance at scalable rates.Jim Johnston, Microsoft, presented the following figure that indicates his view of how a the SLS technology could be evaluated at scalable bitrates.

During subsequent discussions, two methods of measurement were proposed, those being: Comparative and/or MUSHRA methodolgy Tandeming in conjunction with Comparative and/or MUSHRA methodolgy

After considerable discussion, the Audio Subgroup had consensus on the following statement:“That the SLS work shall support finegrain scalability between the lossy core bitrate and lossless reconstruction bitrate.”

And that, for the SLS work, the Audio Subgroup defines “finegrain scalability” as Sampling Rate, kHz

Maximum bitrate increment (kb/s/channel)

Measured bitrate increment (kb/s/channel)

48 2 TBD96 4 TBD192 8 TBD

108

Where the measurement method is not yet determined. Audio Subgroup encourages contributions to the December MPEG meeting that detail methods for measuring the performance of the SLS technology at bitrates between the lossy core and lossless reconstruction.The Chair presented the following two liaison statements

10012 All Liaison SC 29 Secretariat

IEC NP: Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958- Part 8: Non-linear PCM bitstreams according to the Windows Media Audio Professional [SC 29 N 5562]

10023 All Liaison SC 29 Secretariat

IEC CDV 61883-6: Consumer audio/video equipment -- Digital interface -- Part 6: Audio and music data transmission [SC 29 N 5571]

There was no discussion of these items.

Audio plenary discussionsThe Chair called attention to

10170 MPEG-4 Systems David Singer Proposed ISO Amendment Working Draft Text

specifically the section on Static Metadata, which can be used to carry e.g. Artist, Album and Song Title MPEG-7 metadata in an MPEG-4 file.Fang-Chu Chen presented

10084 MPEG-4 Audio Te-Ming ChiuFang-Chu Chen SFBBS on BSAC system

This reported on a method for enhancing the performance of the MPEG-4 BSAC coding tool. MPEG experts are encouraged to talk to the authors to learn more about this work.

Future of MPEG Audio

The Chair presented

10021 All General/All The USMPEGCommittee US Contribution to the Future of WG 11

The Chair then proposed that the Audio Subgroup consider working on Spatial Audio Coding, and brought forward for review possible requirements for such work.

Response to CfP on Lossess coding of 1-bit audio representations

Werner Oomen, Philips, presented

10126 MPEG-4 Audio Werner Oomen Sound material for CfP on lossless coding of 1 bit oversampled audio

Philips has obtained approval to use 256 time oversampled original materials. Philips has converted this material to 128x and 64x oversampled representations. A set of such material was assembled that contains stereo and multi-channel signals for different music genre. The material is available in 10-second excerpts in the DSDIF format. See http://www.superaudiocd.Philips.com and http://www.superaudiocd.philips.com/Assets/Downloadablefile/wp-2323.pdf for more information on DSDIF and DSD formats.MPEG members that wish to participate in this CfP or in resulting collaborative work, should see the Terms of Usage letter attached to the contribution, execute and return to the Philips contact, and then can receive a copy of the test materials.

109

Joint Meetings

With Systems on signaling of MPEG-4 profileandlevel by MPEG-2 Systems (m10147)

Kristofer Kjörling presented

10147 MPEG-2 Systems

Heiko PurnhagenKristofer Kjörling

Proposed clarification for carriage of MPEG-4 Audio over MPEG-2 Systems

The input dealt with methods of enabeling signalling of the AAC Profile and the High Efficiency AAC Profile. Furthermore, it also added some clarifications on the usage of LATM. Olivier Avaro noted that the following COR and AMD have issued since the issue of 13818-1:2000

1 corrigendum N3844 3 amdendments N5867, N5604, N5771

After some discussion on the current status of the Systems specification, it was agreed that Audio experts need to start a new amendment, 13818-1:2000/AMD 4 “New Audio profileandlevel Signaling” that will add the AAC and HEAAC profile and level indications to the appropriate table in the MPEG-2 Systems specification.

Another issue raised in the contribution is that the current text in 13818-1:2000 in Section XXX (4on2), refers to LATM, whereas the MPEG-4 Audio specification defines LATM as a layer underneath LAOS and it is not clear which should be used. The consensus of those present was to add the candidate text to the MPEG-2 Systems specification to clarify this issueThe amendment text will issue with CD status at this meeting, and an Audio expert can be editor of this Systems amendment.Kate Grant, Nine Tiles, presented

10100 MPEG-2 Audio Tanton BBC

UKNB Position paper regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

The consensus of those present was to incorporate this simple change into the new amendment text as an extension to Table 2-53.

With Systems on timestamps and AAC normative behaviour (m10143)

Mohammed Zubair Visharam presented

10143 MPEG-4 SystemsMohammed Zubair VAli Tabatabai

Recommendation for the Interoperability issue related to the storage of AAC content in the MP4 File Format

This contribution reviews the issue that the behaviour of the following chain of operations: waveform file, AAC encode, storage in MPEG-4 File Format, AAC decode, waveform file

cannot guarantee that both waveform files contain time-aligned waveforms (relative to the start of the file). The contirbution recommends that MPEG should NOT:

mandate the use of new extensions defined to signal information that may solve this problem

recommend the use of a ‘default’ value for the number of silence frames to be inserted at the beginning of a file as a means to solve this problem

It was noted that 14496-12 AMD 1 (m10170), which progresses to CD at the December MPEG meeting, contains specification in Section 1.2.4.1 for a “pre-roll box” such that Systems can normatively discard the first “N” Composition Units that result from presentation of the Access Units in an MPEG-4 file. Audio experts recommend that the name in 14496-12 AMD 1 be changed from “visualRollRecoveryEntry” to “mediaRollRecoveryEntry”Alexander Cotarmanac’h, FranceTelecom R&D, observed that there might need to be similar specification to meet the needs of synchronization of streaming systems. After further discussion

110

during the MPEG week, there was consensus amongst Audio experts to continue to discuss this topic in an AHG.

With Systems on Music Notation Application Requirements (m10068)

Paolo Nesi presented

10068 All Requirements

Giorgio ZoiaPaolo NesiPierfrancesco BelliniJerome Barthelemy

Music Notation Application Requirements and MPEG Technology

This contribution proposes to standardize a method of music notation for MPEG-4. The consensus of those in attendance was to create an output document that can be reviewed and refined from one meeting to the next, and for Audio to sponsor an AHG to advance the work on the document, with the goal of expressing a precise plan of how this work related to existing MPEG standards, in what way existing MPEG standards might need to be expanded, and requirements for any proposed new MPEG work items.

With Systems on Audio BiFS extensions (m10110, m10112, m10120, m10122)

Juergen Schmidt presented

10120 MPEG-4 SystemsJuergen SchmidtJérôme Daniel

Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3

10122 MPEG-4 SystemsJuergen SchmidtJérôme Daniel

Comments on Update to WD 2.0 of ISO/IEC 14496-11:2003/AMD 3

One issue raised in the contributions is that currently it is difficult or impossible to manage the meaning of the various channels and the channel to speaker assignment as the signal is processed by the BiFS tree. The contribution proposes three solutions to the problem, in the tree, a child to a node or a sibling to a node. There was consensus among those attending the joint meeting that MPEG adopt the first solution, that of inserting the channelConfig node into the BiFS tree.Another issue raised relates to the Heterogeneous phaseGroup values.Juergen Schmidt presented

10112 MPEG-4 Systems Jérôme Daniel Proposal of a new SoundField node in MPEG-4 BIFS

The consensus of the group was to include the SoundField note into the BiFS version 3 text.

All on MPEG-7 profiles – Markus CremerDuring this meeting the signaling of profile and level information to a possible MPEG-7 decoding application has been thoroughly debated. A number of profiles and levels are already under investigation. Special emphasis has been expressed that only profiles and levels should be considered that target real application scenarios.

With Requirements on Various

Spatial audio requirements The Audio Subgroup will produce a document could be the basis for requirements for a possible work item on spatial audio coding. All MPEG members are invited to read the document and document their own view of application scenarios and associated requirements as contributions to the next MPEG meeting.Proposed profile for MPEG-4 Extension 2 The Audio Subgroup will integrate this proposal to a revised version of N5865, MPEG-4 profiles under consideration. What is missing is documentation of companies that would support this profile, and that work will be left as an AHG activity.

111

Scalable to Lossless Coding The Requirements Chair advised the Audio Subgroup that it would certainly be appropriate to

update the focus to of the Scalable to Lossless Coding work to reflect the Audio Subgroup’s better understanding of the market.

However any such changes in focus should be associated with Documentation of specific use cases Documentation of updated requirements

Requirements for Music Notations The Audio Subgroup will continue to study this topic in a AHG, in which the following topics will be addressed:

Who will use this (i.e. what is marketplace) Who will do the work (i.e. will experts in this area attend upcoming MPEG meetings) What components of Music Notation are supported by existing MPEG standards, potential

new MPEG standards, or are applications built upon existing or potential new standards.

Task Group discussions

MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software

Kristofer Kjörling presented

10116 MPEG-4 Audio

Kristofer KjörlingPierrick PhilippeEwen CamberleinKok SengNomura

Proposed additions to ISO/IEC 14496-3:200x/Cor.x.

The input deals with discrepancies between the text specification of 14496-3:2001/AMD1 and the corresponding reference software. All issues were resolved and added to the amendment 1 specific draft corrigendum output document.

MPEG-4 Extension 1, Bandwidth Extension

The Chair presented

10014 MPEG-4 General/All ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2001/FDAM 1 [SC 29 N 5566]

This document is the record of the FDAM ballot vote.Kristofer Kjörling presented

10113 MPEG-4 Audio Kristofer KjörlingAndreas Schneider

Proposed additions to the working draft on SBR conformance (N5724).

This contribution raised the issue of how to decouple SBR conformance from the core codec (e.g. AAC) performance. The problems with the conformance of the underlying AAC and the implications of this for the SBR conformance was discussed. The consensus was to not address that issue yet, but rather to generate the conformance streams as currently defined and then see if subsequent cross-check identifies unacceptable AAC decoder sensitivity. It was agreed to set up workplan for SBR conformance. The workitems currently in the workplan are

designing testsignals suitable for Low Power SBR Verifying the currently available conformance bitstreams on different platform.

A new WD and a workplan for conformance was produced.Kristofer Kjörling presented

10117 MPEG-4 Audio Kristofer KjörlingHeiko Purnhagen

Proposed modification of 14496-3:200X/Cor. X (N5712) in order to resolve the problems with LATM and explicit SBR signalling.

112

The implications of abandoning the audioMuxVersion 0 were discussed. It was also agreed that buffer fullness issues previously discssed in Fairfax should also be part of this LATM addition to corrigendum. The input was made part of the draft corrignedum output document.Kristofer Kjörling presented

10121 MPEG-4 Audio Kristofer KjörlingHeiko Purnhagen

Proposed addition to 14496-3:200x/Cor.x. (N5712) enabling DRC in combination with SBR.

This contribution raised a number of issues concerning DRC with AAC and DRC in combination with AAC and SBR. The usage of the current DRC with AAC was discussed, and it seems that no-one has ever used it or tested it properly. The fundamental problem is that it is not clear if the existing DRC architecture in AAC is the best solution for DRC. An additional problem is that MPEG-4 conformance clearly states that conformant decoders must parse the DRC syntax but need not implement the semantics. Given this it was decided to add the current proposal to the amendment 1 draft corrigendum output and to do further investigations of the DRC and SBR combination in the AHG period.Mat Fellers, Dolby Labs, observed that multiband DRC, as found in AAC may be quite useful in practice. He also confirmed that Dolby AC-3 supports both 5 ms and 30 ms resolution for DRC metadata, and that the Dolby system may uses 30 ms resolution as a default and switch to 5 ms resolution when signal statistics require.The Chair presented

10115 MPEG-4 Audio Kristofer KjörlingPierrick Philippe

(Proposed) Report on the Verification Tests of the new MPEG-4 Audio Profile, High Efficiency AAC

This document will be reviewed and edited to form the basis for the WG11 Formal Verification Report.

MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)

Werner Oomen presented

10130 MPEG-4 Audio Werner Oomen MPEG-4 Extension 2, proposed editorial changes

This contribution presents editorial changes primarily requested by SC29, e.g. changes to header, footer, etc. The document was not reviewed in detail.Werner Oomen presented

10129 MPEG-4 AudioAndy GerritsBert den BrinkerWerner Oomen

Core Experiment on ADPCM coding of sinusoidal parameters in MPEG-4 Audio Extension 2

This CE proposes coding the phase of the sinusoids via ADPCM and deriving frequency from the rate of change of phase. The consensus of the group is to accept the CE results of the check phase, and move on to the integration phase.Werner Oomen presented

10127 MPEG-4 Audio Werner OomenMPEG-4 Extension 2, Core Experiments on Low complexity decoding

This document proposes two core experiments: the first on a lower complexity method for doing parametric stereo coding; the second on a lower complexity method for monaural sinusoidal decoding. Because of the tight schedule, there will be a detailed workplan for the AHG period.Werner Oomen presented

10134 MPEG-4 Audio Werner Oomen MPEG-4 Ext.2 Verification test issues

113

The document proposes testing Ext. 2 technology at 24 kb/s for both mono and stereo signals. The reasons for this are two: first, due to the very nature of parametric stereo coding, the stereo rate is only slightly higher than the mono rate, and second, the mono coder (on which the parametric stereo result is based), has a subjective quality increases only asymptoticly as bitrate increases above approximately 32 kb/s.Audio experts agree that this fundamental behaviour was not anticipated when the Ext. 2 Acceptance Criterion were agreed upon, and that Ext. 2 technology might not pass the Acceptance Criterion for coding of stereo signals. Nevertheless, there is consensus that Ext. 2 technology has excellent performance, approaching a factor of two greater compression with relative to MPEG-4 AAC, but only at a operating point that is lower than that specified in the Acceptance Criterion. Hence it was the consensus of the Audio Subgroup that the Ext. 2 and MPEG-4 AAC be tested at rates close to those in the following table:

Rate of MPEG-4 Ext. 2 (kb/s)

Rate of MPEG-4 AAC (kb/s)

Mono signals

20, 24 30

Stereo signals

20, 24 30, 48, 60

The Audio Subgroup will draft the test plan for the MPEG-4 Extension 2 Verification Test at the December MPEG meeting.Marc Klein Middelink presented

10131 MPEG-4 Audio Marc Klein MiddelinkWerner Oomen

MPEG-4 Extension 2, proposal for a profile definition

This profile will be put in “MPEG-4 Audio Profiles under Consideration” document.

MPEG-4 Extension 3, Lossless Coding

The task group convened on Monday at 1800-1830 hrs. Tilman Liebchen presented

10080 MPEG-4 Audio Tilman Liebchen

Proposed Core Experiment for Supporting Multichannel, 32-bit PCM, and Arbitrary Input File Formats in MPEG-4 ALS

This document proposes the following topics for Core Experiment: Arbitrary file format 32-bit PCM word format Multi-channel audio

The multi-channel proposal organizes the input signal into designated “channel pairs” as a means to signal and realize joint channel coding gain. This document has all necessary components for a CE proposal, to the extent that evidence can be supplied (e.g. there are no mulit-channel test signals), and it was the consensus of the Audio subgroup is to move ahead with both sets of core experiments (10055 and 10080). The task group convened on Tuesday at 0930-1130 hrs. Ralph Geiger, FhG, presented

10078 MPEG-4 Audio Ralf Geiger Jürgen Herre

Technical Description of Improved IntMDCT

This document contains a detailed technical description of the IntMDCT used in SLS CE1. This completes all required components of CE1 with the exception of integration of syntax and supporting text into WD0 (to make WD1) and integration of associated CE1 source code into RM0 (to make RM1). A workplan as output of this MPEG meeting will indicate when these elements will be delivered.

114

Rongshan Yu, I2R, presented

10135 MPEG-4 Audio

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Technical Description of I2R’ Proposal for MPEG-4 Audio Scalable Lossless Coding (SLS): Advanced Audio Zip (AAZ)

This document will be the basis for the SLS WD0 text. Since I2R has already made the RM0 source code available, this completes the requirements for acceptance of I2R technology as RM0. Rongshan Yu, I2R, presented

10136 MPEG-4 Audio

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Proposed Core Experiment for improving coding efficiency in MPEG-4 audio scalable coding (SLS)

This proposes the a Core Experiment that investigates: Modifying Arithmetic Coding to make it Division-free Adding a “Silence Mode” coding tool.

This document has all necessary components for a CE proposal. There is consensus on proceeding with this CE. Sang-Wook Kim presented

10175 MPEG-4 Audio

Eunmi OhJung-Hoe Kim Miao Lei Sang-Wook Kim

Effects of lossy core components in audio scalable lossless coding

This presented evidence of how one could improve the performance of the lossless coding system by The possibilities are:

1. Specify the exact AAC bitstreams2. Specify that only one AAC encoder will be used in all CE work, and that it will be

accessible as an executable.3. That there is no restriction on what AAC encoder or encoder parameters that can be used in

the CE work.

All RM0 and subsequent CE AAC core bitstreams will be made available for subsequent CE collaborative work. The Audio Subgroup should revise the goals and procedures for SLS, currently in document N5720, to add this new procedure.The Chair noted that perhaps not all test items used in the Lossless Coding Call for Proposals needed to be used in future Core Experiment work. Reducing this number would simplify the CE process. It was agreed that future CE work need only support the Fs and Wd combinations indicated with “X” in the following table:

Sampling Rate48 96 192

Wor

d Le

ngt16 X - -

20 - - -24 X X X

How to combine the individual figures of merit (e.g. compression ratio) for each individual test item to for a global actual figure of merit is not yet decided. Furthermore, it was noted that one may want to add additional signals e.g. one signal to test the correct operation of the coding technology for 20-bit word lengths.

115

MPEG-7 Extension 1 Tools, Conformance and Reference Software – Markus Cremer

The MPEG-7 Audio Task Group has revised their proposal for a corrigendum on the first version of the MPEG-7 Audio standard that was drafted at the 62nd MPEG meeting in Shanghai. Documented proposed changes were found to be correct, and no further changes have been made to the document. The Task Group has revised the status of the audio contributions to MPEG-7 XM and Conformance. XM contributions and conformance both are not yet completed, but efforts will be increased to finalize this task before the 67th MPEG meeting. In the course of collecting new contributions for a possible Version 3 of MPEG-7 Audio, a core experiment has been initiated for AudioPatternDS, and AudioRhythmPatternDS, which are intended to serve as containers for patterns characteristic to musical pieces, such as underlying rhythm, melodic themes, or song structure.

Explorations on Scalable Coding of Audio

Later in the week the topic of exploration of new work, namely coding of multi-channel signals via e.g. “Binaural Cue Coding” techniques was discussed. The Chair acknowledged that this topic was not documented in a meeting contribution, and therefore it was decided to document the example technology, architecture and requirements in a Annex of a WG11 document, with the body of that document requesting that Audio experts bring their ideas on this topic to the December MPEG meeting as meeting contributions.

Meeting deliverables

Press statementThe Audio part of the press statement was prepared and reviewed.

Dispositions of CommentsThere were ballots processed at this meeting, and hence no DoC.

Responses to Liaison and NB commentsThe responses to liaison and NB comments were presented and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg

6024 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

No

6025 AHG on MPEG-4 Audio Conformance No

6026 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

No

6027 AHG on MPEG-4 Audio Extensions 1 and 2 Yes6028 AHG on MPEG-4 Audio Lossless Coding Yes6029 AHG on MPEG-7 Audio No6030 AHG on Music Notation Application Requirements Yes6031 AHG on Timestamps and Audio Codec Behavior No6032 AHG on Audio Explorations No

Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

116

Future activities

Schedule of future meetingsAd Hoc group meetings are indicated in the listing the Ad Hoc groups in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E.

All other businessThere was none.

Closing of the meeting The 65th Audio Subgroup meeting was adjourned at 13:30.

117

Annex A ParticipantsFirst Name

Last Name Country

Affiliation E-mail address

Kok Seng Chong SG Panasonic Singapore

kschong@psl .com.sg

Alexandre Cotarmanac’h FR France Telecom R&D

alexandre.cotarmanach@francetelecom.com

Bernhard Feiten DE Deutsche Telekom

bernhard.feiten@t -systems.com

Matt Fellers USA Dolby mcf@dolby .com Ralf Geiger DE FhG IIS

AEMTggr@emt .iis.fhg.de

Richard Gooch UK IFPI richard.gooch@ifpi .org Matthias Gruhne DE FhG IIS

AEMTghe @emt .iis.fhg.de

Jürgen Herre DE FhG IIS hrr@iis .fhg.de James Johnston USA Microsoft

Corporationjamesdj@microsoft.com

Sang-Wook

Kim KR Samsung swkim@samsungait .com

Kristofer Kjörling S Coding Technologies

kk@codingtechnologies .com

Marc Klein Middelink

NL Philips marc.klein.middelink@ philips .com

Tilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.deTakehiro Moriya JP NTT moriya.takehiro@lab .ntt.co.jp Paolo Nesi I UNIFI – DSI nesi@dsi.unifi.itToshiyuki Nomura JP NEC t-nomura@ccm .cl.nec.co.jp Werner Oomen NL Philips werner.oomen@philips .com Schuyler Quackenbush USA ARL srq@audioresearchlabs .com Susanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sgJean Bernard

Rault FR France Telecom R&D

jeanbernard.rault@francetelecom .com

Jeongil Seo KR ETRI seoji@etri .re.kr Ralph Sperschneider DE FhG IIS sps@iis .fhg.de Naoya Tanaka JP Panasonic natanaka@arl .drl.mei.co.jp Mark Vinton USA Dolby msv@dolby.comLin Xiao SG I2R linxiao@i2r.a-star.edu.sgRongshan Yu SG I2R rsyu@i2r.a-star.edu.sg

118

Annex B Agenda and ScheduleTime Agenda Item MPEG-1/2/4 BONumber Title Source Jacaranda CL4

Sunday1400-1700 AHG on Lossless Coding

MPEG-4 Extension 3, Lossless CodingALS

10079Verification Report on MPEG-4 ALS Core Experiment 1 (Improving Coding of Prediction Residual)

Tilman LiebchenX

10161 Proposed WD1 of ISO/IEC 14496-3:2001 /AMD 4 (Audio Lossless Coding - ALS) Yuriy A. Reznik X

10162 Additional Improvements in MPEG-4 ALS CE1 (Coding of Prediction Residual) Yuriy A. Reznik X

10055 Proposal of Core Experiment for Lossless Coding of Audio in Floating-point Format Moriya Dai Tracy Yang X

Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1700 Audio Plenary  Opening of the meeting Audio Chair

Administrative mattersApproval of agenda XApproval of Trondheim meeting report XCommunications from the Chair- Review of Sun Chairs meeting

X

Allocation of contributions to agenda and schedule

X

Joint meetings XReview of AhG reports X

9956 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 Jens Spille X

9957 AHG on MPEG-4 Audio Conformance Ralph Sperschneider X

9958 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Ralph SperschneiderHeiko Purnhagen

X

9959 AHG on MPEG-4 Audio Extensions 1 and 2 T. Nomura X9960 AHG on MPEG-4 Audio Lossless Coding Schuyler Quackenbush X

9961 AHG on MPEG-7 Audio Jan RohdenJoerg Bitzer

X

10067 AHG on Music Notation Requirements Giorgio ZoiaP aolo Nesi

X

Review of task groups and mandates XReceived national body comments

10100UKNB Position paper regarding the use of ISO 639 language descriptor in ISO/IEC 13818-1

Tanton BBCX

10032 USNB Contribution: Lossless audio Andy Tescher for USNB

X

10048 SgNB Comments on Requirements for Scalable Lossless Audio Coding CJ Lee for SgN B X

Received liaison matters

10012

IEC NP: Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958- Part 8: Non-linear PCM bitstreams according to the Windows Media Audio Professional [SC 29 N 5562]

X

10023

IEC CDV 61883-6: Consumer audio/video equipment -- Digital interface -- Part 6: Audio and music data transmission [SC 29 N 5571]

X

Plenary discussions

10170 Proposed ISO Amendment Working Draft Text David Singer X

10084 SFBBS on BSAC system Te-Ming ChiuFang-Chu Che n

X

10021 US Contribution to the Future of WG 11 The US MPEG Committee

X

Future of MPEG Audio X

1800-1830 ALS

10080Proposed Core Experiment for Supporting Multichannel, 32-bit PCM, and Arbitrary Input File Formats in MPEG-4 ALS

Tilman LiebchenX

119

Time Agenda Item MPEG-1/2/4 BONumber Title Source Jacaranda CL41830- HOD Meeting

Tuesday0900 Audio Plenary Audio Chair

Outline plan for the day

0900-0930 Lossless Coding1-Bit

10126 Sound material for CfP on lossless coding of 1 bit oversampled audio Werner Oomen X

0930-1130 SLS

10078 Technical Description of Improved IntMDCT Ralf Geiger Jürgen Herre

X

10135Technical Description of I2R’ Proposal for MPEG-4 Audio Scalable Lossless Coding (SLS): Advanced Audio Zip (AAZ)

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

X

10136Proposed Core Experiment for improving coding efficiency in MPEG-4 audio scalable coding (SLS)

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

X

10175 Effects of lossy core components in audio scalable lossless coding

Eunmi OhJung-Hoe Kim Miao Lei Sang-Wook Kim

X

1200-1300 MPEG-7 Conformance and Reference Software Ext 1

10103 First Draft of the syntax description for Rhythmic Pattern Representation

Jan RohdenMatthias Gruhne

X

1300-1400 Lunch

1400-1430 Joint meeting with Systems on Signaling of MPEG-4 profileandlevel by MPEG-2 Systems

10147 Proposed clarification for carriage of MPEG-4 Audio over MPEG-2 Systems

Heiko PurnhagenKristofer Kjörling

X

1430-1500 Joint meeting with Systems on Timestamps and AAC normative behavior

10143Recommendation for the Interoperability issue related to the storage of AAC content in the MP4 File Format

Mohammed Zubair VAli Tabatabai X

1500-1600Joint meeting with Systems at Audio onMusic Notation Application Requirements (m10068)

10068 Music Notation Application Requirements and MPEG Technology

Giorgio ZoiaPaolo NesiPierfrancesco BelliniJerome Barthelemy

X

1500-1600 MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software

10118 WD 3.0 of ISO/IEC 13818-4:2004/Amd.5 (Audio Conformance)

Ralph Sperschneider X

10156 Proposed ISO/IEC13818-7:2004 (AAC 3rd edition)

Ralph Sperschneider X

10133 Status on MPEG-4 Audio ConformanceRalph Sperschneider X

10157 Working Draft of Third Edition of ISO/IEC14496-3

Ralph Sperschnei der X

10116 Proposed additions to ISO/IEC 14496-3:200x/Cor.x.

Kristofer KjörlingPierrick PhilippeEwen CamberleinKok SengNomura

X

1730-1900 Audio PlenaryStatus for Chairs Meeting

1800-1900 Liaison Meeting1900- Chairs Meeting

120

Time Agenda Item MPEG-1/2/4 BONumber Title Source Jacaranda CL4

Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair

Report on Chairs meeting and outline of plan for the day

1200-1300 MPEG-4 Extension 1, Bandwidth Extension

10113 Proposed additions to the working draft on SBR conformance (N5724).

Kristofer KjörlingAndreas Schneider

X

10014 Table of Replies on ISO/IEC 14496-3:2001/FDAM 1 [SC 29 N 5566]

ITTF via SC 29 Secretariat

X

10117Proposed modification of 14496-3:200X/Cor. X (N5712) in order to resolve the problems with LATM and explicit SBR signalling.

Kristofer KjörlingHeiko Purnhagen

X

1300-1400 Lunch

10121Proposed addition to 14496-3:200x/Cor.x. (N5712) enabling DRC in combination with SBR.

Kristofer KjörlingHeiko Purnhagen

X

10115(Proposed) Report on the Verification Tests of the new MPEG-4 Audio Profile, High Efficiency AAC

Kristofer KjörlingPierrick Philippe

X

MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)

10127 MPEG-4 Extension 2, Core Experiments on Low complexity decoding Werner Oomen X

10129Core Experiment on ADPCM coding of sinusoidal parameters in MPEG-4 Audio Extension 2

Andy GerritsBert den BrinkerWerner Oomen

X

10130 MPEG-4 Extension 2, proposed editorial changes Werner Oomen X

10131 MPEG-4 Extension 2, proposal for a profile definition

Marc Klein MiddelinkWerner Oomen

X

10134 MPEG-4 Ext.2 Verification test issues Werne r Oomen X

1800-2200 Social

Thursday

0900-1300 Review list of deliverables XReview list of AHGs XDiscuss AAC and timestamps(defer to AHG)Discuss DRC and AAC/SBR(defer to AHG)

X

Discuss Req for Spatial Audio X1100- Draft NB responses (UK,US,SG)

- candidate proposal for testing bitrate scalability

1300-1400 Lunch1400-1430 Joint meeting with Req at Audio on

Profile for MPEG-4 Ext 2, Req for SLS, Req for Spatial Audio, Req for Music Notation

X

1500-1600 Review of Draft Technical Report on Persistent Association Technologies

X

Discuss DRC and AAC/SBR XDiscuss response to US and SG NB comments on SLS

X

1730-1800 Audio Plenary Audio ChairStatus for Chairs Meeting

1800- Chairs Meeting

Friday0900-1300 Audio Plenary

Report on Chairs meeting and outline of plan for the day Audio Chair

Discussion of unallocated contributions

121

Time Agenda Item MPEG-1/2/4 BONumber Title Source Jacaranda CL4

Meeting deliverablesPress statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documentsFuture activitiesAgenda for next meetingA.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

122

Annex C Task Groups1. MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software

Chair: Ralph Sperschneider, Heiko PurnhagenMandates:1.1. Review Proposed ISO/IEC 13818-7:2004 (3rd edition)

1.1.1. Consider Corrigendum to clarify “mandatory tools” e.g. DRC1.2. Review Proposed ISO/IEC 14496-3:2004 (3rd edition)1.3. Review ISO/IEC 14496-3:2001/DCOR 2

1.3.1. Consider 14496-3 Corrigendum to clarify “mandatory tools” e.g. DRC1.3.2. Consider 13818-1 Corrigendum on signaling MPEG-4 profileandlevel

1.4. Review and revise Status of MPEG-4 Audio Conformance

2. MPEG-4 Extension 1, Bandwidth ExtensionChair: Kristofer KjörlingMandates:2.1. Prepare Audio Contribution to MPEG-4 Conformance

2.1.1. Bandwidth Extension2.2. Prepare Status of MPEG-4 BWE Conformance2.3. Prepare Report on Formal Verification Test2.4. Prepare Request for Amendment 13818-1:2000/AMD 42.5. Prepare Text of 13818-1:2000/PDAM 4 “New Audio profileandlevel Signaling”

3. MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)ChairWerner OomenMandates:3.1. Revise Study on FPDAM …3.2. Consider Workplan for MPEG-4 Parametric Coding Formal Verification Tests3.3. Revise Status of MPEG-4 Extension 2 Core Experiments

4. MPEG-4 Extension 3, Lossless CodingChair: Schuyler QuackenbushMandates:4.1. Revise Workplan for Audio Lossless Coding 4.2. Prepare WD 1 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)4.3. Revise Workplan for Audio Scalable to Lossless Coding 4.4. Prepare WD 0 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable to Lossless Coding (SLS)4.5. Review current status of Lossless Coding CfP FTP site

4.5.1. consider reducing storage4.5.2. consider removing some points in the Fs/Wd matrix (e.g. 20-bit Wd and 96/16 and 192/16)4.5.3. consider use of scp or sftp tools for access to source code and/or signals.

4.6. Investigate industry use of IEEE floating point or other formats4.7. Review preliminary responses to Call for Proposals for lossless compression of 1-bit oversampled audio representations

5. MPEG-7 Extension 1 Tools, Conformance and Reference SoftwareChair: Markus CremerMandates:5.1. Propose new CEs for V35.2. Review Status and Workplan for MPEG-7 Audio Reference Software and Conformance

5.2.1. Prepare workplan to finish conformance descriptions5.3. Review and consider Corrigendum 1 on ISO/IEC 15938-4:2001 (see N5213)

6. Explorations on Scalable Coding of AudioChair: Schuyler QuackenbushMandates:6.1. Discuss possible new work items in MPEG Audio6.2. Prepare Proposed Requirements for Spatial Audio Coding

123

Annex D Output DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public).No. Title TB

PAvailable

13818-7 MPEG-2 Advanced Audio Coding 5998 Proposed ISO/IEC 13818-7:2004 N 03/10/245999 ISO/IEC 13818-7:2003/DCOR 1 N 03/11/30

14496-3 MPEG-4 Audio6006 Proposed ISO/IEC 14496-3:2004 N 03/10/246007 ISO/IEC 14496-3:2001/DCOR 2 N 03/11/306008 ISO/IEC 14496-3:2001/AMD 1:2003/DCOR 1 N 03/11/306009 Report on the Verification Tests of MPEG-4 High Efficiency AAC Y 03/11/306010 Study on ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio) N 03/10/246011 Workplan for MPEG-4 Extension 2 N 03/10/24

6012 WD 1 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)

N 03/10/24

6013 Workplan for Audio Lossless Coding (ALS) N 03/10/24

6014 WD 0 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable to Lossless Coding (SLS)

N 03/10/24

6015 Workplan for Scalable to Lossless Audio Coding (SLS) N 03/10/246033 Work Plan on Lossless Coding of 1-bit Audio Signals N 03/10/246016 3on4 – An MPEG Music Player N 03/11/07

14496-4 MPEG-4 Conformance6017 Status of MPEG-4 Audio Conformance N 03/10/246018 Workplan for MPEG-4 BWE Conformance N 03/10/24

6019 WD of Audio Contribution to MPEG-4 Conformance (Bandwidth Extension)

N 03/10/24

15938-4 MPEG-7 Audio

6020 Status and Workplan for MPEG-7 Audio Reference Software and Conformance

N 03/10/24

6021 Proposed Corrigendum 1 on ISO/IEC 15938-4:2001 N 03/10/246022 Workplan for MPEG-7 N 03/10/24

Scalable Audio Coding6023 Investigation on Spatial Audio Coding N 03/10/24

124

Annex E Agenda for the 67th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Brisbane meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG-2 Layer III Issues3.2. MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference

Software3.3. MPEG-4 Extension 1, Bandwidth Extension3.4. MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)3.5. MPEG-4 Extension 3, Lossless Coding3.6. MPEG-4 BiFS Extensions3.7. 3on4 Application Specification3.8. MPEG-7 Extension 1 Tools, Conformance and Reference Software3.9. Music Notation Requirements3.10. Explorations

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

125

Annex 9Report of SNHC meeting

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

o Review on-going core experimentso Start discussion on making applications with MPEG-4o Continue discussion on profiles using AFX tools

126

Schedule

Time Monday Tuesday Wednesday Thursday Friday08

:00:30

09:00

:30

10:00

:30

11:00

:30

MPEG Plenary

MPEG PlenaryPresentation reviewOutput docs review

Sys-SNHC: XMT updates10114, 10060

Req-Sys-SNHCMP4 profiles10166 - X3D profile

Req-SNHC: AFX profiles10132, 10141

10105 –Lossless 3DMC

10058 – CFR on OLGA10167, 10185 Discussion on OLGA, making apps with MPEG-4

Sys-SNHCMPEG-J for games

10059 – Avatar pref., in MDS

Req, SNHC, Sys – MP4 profiles

Demonstrations(Systems)

127

12:00:30

13:00

:30

14:00

:30

15:00

:30

16:00

:30

Lunch Break

MPEG Plenary

Lunch Break Lunch BreakLunch Break Lunch

Roll call, agenda

AFX FAQ

10139 – animation by morphing

AFX reference softwareAFX conformance, 10125

Req-Sys-SNHC: explorations10097, 10110, 10185

10093 - 3D Shape descriptor10094 - PointTexture syntax

10051 – comments on model-based video streaming

10152 - View-dependent multitexturing

Profiles

Output documentsreview

M3W

128

17:00

:30

18:00

:30

19:00

:30

20:00:30

21:00:30

22:00…

Chairs Meeting

Social Event

Chairs Meeting

Demonstrations Liaison

SNHC-Sys10167 – Scene controllers

129

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

Systems XMT updates10:30-11:00

Demos11:00-13:00

Requirements MP4 profiles, including X3D profile

9:00 – 10:30

Explorations: Simple scene descriptionMPEG-J rendering API

14:00-15:00

SNHC Profiles8:30-9:30

MP4 profiles10:00-11:00

Video 3D perceptual face descriptor14:00-14:30

MDS Graphics DIA11:00-11:30

Rooms allocationSNHC NorfolkSystems MonarchVideo Karrie-WebbRequirements Prince

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00 MPEG Gen.

9962 Report of AhG on AFX CE, VM, WD Marius Preda9963 Report of AhG on AFX reference software Patrick Gioia9964 Report of AhG on AFX Conformance Mahnjin Han9965 Report of AhG on AFX profiles Marius Preda

SNHC D1 15h00-18h00 SNHC Gen.

Agenda approval Mikaël 15h00SNHC FAQ Mikaël, All 15h30AFX reference software, conformance Mahnjin Han, All 16h00

10125 KNB on AFX conformance Mahnjin Han 16h00

130

N° Title Schedule ActivityD2 Tuesday D2

Requirements D2 09h00-13h00 MPEG-4 profiles

MP4 profiles All 9h0010166 X3D Interactive profile, bitstream update Mikaël

Systems D2 10h30-11h00 XMT

10114 The specifications for XMT-A compliant BitWrapper node and the encoding parameters used in its bitstream

James Kim 10h30

10060 Fixes to XMT-A Jean-Claude DufourdSNHC D2 14h00-17h00 AFX profiles

10094 Syntactic Description of PointTexture Compression

Shinjun Lee 14h00

10139 Animation by morphing Marius Preda 15h0010051 Comments on model-based video streaming Raphaele Balter 16h0010152 Study on View-Dependent Multitexturing in

AFXAljosha 16h30

Systems D2 17h00-18h00 MPEG-J

10187 Scene controllers for MPEG-J Mikaël 17h00D3 Wednesday D3

MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-13h00 SNHC

10058 Call for requirements on OLGA Yejin Kim 11h0010167 MPEG-J extensions to create applications Mikaël 12h00

Exploration D3 14h00 – 15h00 Requirements

10097 A Simpler, Efficient Binary Encoding for MPEG-4 Scenes

Jean-Claude Dufourd 14h00

10058 Call for requirements on OLGA Yejin Kim 11h0010185 New requirements for MPEG-J Renderer API Mikaël

15h00D4 Thursday D4

Requirements D4 8h30-9h3010132 Proposal for Simple Compressed 3D Profile James Kim 8h30

131

N° Title Schedule Activity10141 Proposal for Animated Character Profile Marius Preda

SNHC D2 11h30-13h00 AFX

10105 Results on lossless 3DMC Euee E. Jang 11h3010h00

MPEG-7 Video D4 14h00 – 17h00 Visual

10093 Perceptual 3D shape descriptor 14h00D5 Friday D5

SNHC D5 09h00-11h00 SNHC Gen.

Output documents review Mikaël 09h00Systems D5 12h00-13h00 MPEG Gen.

Demonstration of Chess game MikaëlMPEG Plenary D5 014h00-22h00 MPEG Gen.

132

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems/IM1" module (case sensitive).

The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.

Standards from SNHCISO/.IEC 14496-16 has reached International Standard status in August 2003. Congratulations everyone!

Due to missing implementations, the AFX reference software will be delayed of one meeting. AFX conformance will proceed to FCD stage at this meeting.

Std

Pt Edit. Project Description CfP WD CD FCD FDIS

4 4 2003 Amd.7 AFX Conformance 02/07 02/12 03/10 04/034 5 2003 Amd.7 AFX Reference SW 02/10 02/12 03/12 04/074 16 2003 AFX 03/074 16 2004 Amd.1 AFX extension 03/07 04/03 04/07 04/10

AFX activities

Conformance and reference softwareAfter months of no response from Light-field mapping proponents, MPEG has decided to remove Light-Field Mapping technology.

Using BitWrapper node with in-band stream (i.e. the compressed representation of the wrapped node is in the buffer field of BitWrapper) is problematic for the initialization of decoders. The solution could be to have the DecoderSpecificInfo in-band in the buffer or out-band in another field of BitWrapper. In both cases, a COR to ISO/IEC 14496-11/AMD1 will be started in December once a solution is approved.

IM1 will be first updated with a solution that will be added to the 14496-11/AMD1 COR.

133

M10114/M10060 - XMT updates (Systems)A new mandate is created in AhG on MPEG-4 Scene Representation to create an amendment to Part 11 that would define a modular XMT-A Schema. An Amendment to Part 16 will be created to add AFX related features in this new XMT-A schema.

M10155 – Mechanism to add a closed stream (Systems)Issue: reuse common BIFS structures among various sub-scenes. At the moment, the whole scene needs to be replaced, which waste bandwidth and resources.

Solution: signal a scene fragment that has no ReplaceSceneCommand. The fragment timestamp is 0 when received and it should be offset by the current scene timestamp.If the fragment doesn't correspond to current scene, the browser shall ignore the commands.

ResolutionA solution to re-opening closed BIFS streams is needed and the proposed solution needs to be studied in more details until next meeting.

M10094 - Syntactic Description of PointTexture CompressionThis proposal describes the syntax of the PointTexture stream. Depth and color fields of PointTexture node are compressed. The SDL syntax for the stream already in the WD is proposed.

ResolutionUpdate the text in the WD from the decoder point of view of PointTexture (this proposal) because the current WD text is focused on the encoder side. The current encoding explanation will be moved into the VM.

M10139 - Animation by morphingBasic morphing is from a source object to a target.Morphing is also a linear combination of a source and many target objects to create a new objects (blending of objects). The morphing can be defined on the object as a whole or locally.Morphing is very used in the industry for content creation and supported by many DCC tools.

Morphing is typically done with objects of the same topology but it is possible to morph between objects with different topology. Morphing is used to correct skinning effects from the bones, to correct deformations locally.

Realistic face animation is done with morphing. Face animation in MPEG-4 is from image analysis point of view.

Note: morphing was proposed at the beginning of AFX project. The node that was defined at that time might be useful for today's needs?

ResolutionStart a new CE

Define node syntax Investigate use of compression Design animation (blending) Respect current specifications and industry practice

134

M10051 – Comment on model-based video streaming (3DAV)Model-based video uses of 3D models and video to stream a video to a terminal enabling less data to be sent to the terminal.

Encoding of such representation needs: 3D mesh, 2D texture, others (camera positions & animation parameters)Parameters for position and texture coordinates are linked together but from camera position you can recover the texture coordinates. Likewise other parameters can be estimated… so to have 3 parameters to be sent to the client instead of 5.

The retroprojection of the texture on 3D model is view-dependent: the camera position enables retro-projection of the texture on the model.

This proposed to think about standardizing the interrelation between scalable encoders, leading to a more compact stream.

ConclusionThe proposal is interesting for model-based video. However, such applications are already covered by MPEG-4 and it is not clear if a specific encoding needs to be defined. More exploration is needed.

M10152 – View-dependent multitexturing in AFXIn the proposed applications, multiple textures from different cameras are linearly combined. Multitexturing pipeline in today's graphic cards is used for fast rendering.

In AFX VM, there is a description for multitexturing. This proposal reuses the node with a modification for TextureOp with a float factor to weight the contribution of the textures during the blending operation.

ResolutionIn the VM, we had 2 proposals Multitexture node and MultitextureTree/TextureOp. The proposal is to use the flexible notation (MultitextureTree) but we need to understand how this node can be used to cover all multitexturing operations for a set of meaningful applications.The blending factor needs to be controlled by an application.

SNHC will start a new CE on multitexturing with the following participants:- HHI (Aljoscha Smolic)- Mindego (Mikaël Bourges-Sévenier)- Hanyang Univ. (Euee Jang)- Samsung (Mahnjin Han)

M10105 – Results of mini CE on lossless 3DMCRequirement for lossless 3DMC has been adopted in July 65th meeting.Previously the results were done with constant significant value, now it is with a variable significant value.The proposal is to add a flag in the header of the compression tool for coordinates, normals, colors, and texture coordinates, to indicate if lossless is used or not. If lossless is used, then a significant value on 4 bits is specified.

The proposed changes do affect existing bitstreams; bitstreams will not be backward compatible.

135

ResolutionAdd this tool to the current SNHC AFX VM.As there is no current visual amendment and because the proposed changes will not be backward compatible, we need to explore the need for 3DMC in the industry, the need for MPEG-4 3DMC with or without the proposed changes, or the need for a new up-to-date 3D mesh coding algorithm. In any cases, more industry feedback is needed before proceeding on changing the specification.

M10093 – VCE-1 Perceptual 3D shape descriptor (MDS)This core experiment tests MDS' 3D Shape Descriptor using a database of 3901 VRML models in 102 categories. Shapes are modeled as a list of connected ellipsoids. The matching is done using these ellipsoids.

Using ellipsoids is believed to be the optimal between user interactivity and computations.

Demonstration of the matching with the database shows very good results.

ResolutionThe performance of the descriptor is acceptable for promotion to the specification. Technical demonstration based on application scenario will be provided for December meeting. After the review of the demonstration, it will be considered for promotion to XM.

M10059 - Avatar preferences (MPEG-21 Graphics DIA)This proposal defines preferences for adaptation of geometry, texture, animation. These preferences would help a server adapt contents to terminal or user preferences. At the moment, the current preferences are too general for fine-grained adaptation but it's a good start that would be refined later as industry needs show up.

ResolutionAvatar preferences accepted.

New requirements…

M10058 – Call for requirements on OLGAThe current trend: same game on multiple platforms.

For this we need: Flexible data format: Geometry, connectivity, sound, animation data, images, video…

For reuse of resources data

Platform independent network protocol The format must be platform/OS neutral This requirement seems already covered by MPEG-4 DMIF need to allow standard algorithms and proprietary algorithms for communication

between terminals and servers. This requirement might already be in MPEG-4.

Resolution

136

This proposal made us understand some requirements needed for online gaming and we need to check if some are already covered by MPEG-4, or not. We need more industry support before re-opening OLGA ad-hoc group.

M10185 – New requirements for a rendering scene APIThis proposal shows the need for a rendering scene API. Such API doesn't exist in MPEG-J. The current MPEg-J Scene API is focused on modeling BIFS structures and nothing exists from a rendering point of view. It is therefore proposed to define a rendering API so that programmatic applications can control what is sent to the renderer. It is also shown that VRML scene graph (which is what is really rendered) is not sufficient and not efficient for many applications. The proposal also shows what a more industry-aligned and more efficient scene graph should be.

NoteThe rendering scene API must be as minimal as possible for wider industry acceptance. The same rationale seems to be well received for the Simple compressed 3D profile.

ResolutionThis API is needed and until next meeting an ad-hoc group is created. The API should be defined in a generic way so to allow reuse of this API within MPEG-J framework and other frameworks.

Mandates of the AHG on Rendering Scene API Study and improve WD 1.0 of MPEG-J extensions Study and complete requirements on scene renderer APIs by the next MPEG meeting Draw attention from the industry on these new MPEG-J extensions Assess if/how such API can be designed in a platform independent way

Chair: Mikaël Bourges-Sévenir (Mindego), Vishy Swaminathan (Sun Microsystems)

Reflector: mpgj-sys@advent.ee.columbia.edu

Supporting companies during the meeting:

NB CompaniesKR Samsung, ETRIFR France Telecom, INTSP UPMBE VUBCH EPFLUS Intel, Sun Microsystems,

MindegoJP Hi Corp.

M10097 – Simpler BIFS encoding (Systems)Issue:

Quantization uses floating-point while fixed point is needed in mobile BIFS contextual coding uses too many bits PMF (PredictiveMFField) uses arithmetic coding which is too complex for phones. It

works on 3D but not 2D which typically uses small sequence of points (too big overhead).

137

List encoding forces many memory allocations while decoding V6 requires 5 escape sequences (21 bits). BIFSLC PROTO instances waste 7 bits BIFS lacks color palette. Useful in 2D and mobiles with terminal with few colors.

Solution for simpler encoding Simple Delta encoding of small point sets. NodePalette node to declare which nodes will be used in the scene. This allows using

a code for each node that uses fewer bits than SFWorldNode category.

ResolutionThe proposal is useful and needed, many companies support it. However, a solution must be studied. An Ad-hoc Group is created.Note that the proposal seems to be targeted at mobiles phones, is it sufficient?This format will be designed for a limited set of applications and it seems targeted at mobiles applications.

M10097 – New scene descriptionThis proposal describes the need for a new scene description and lower complexity algorithms. This proposal has been well received and many companies are supporting more investigations on a new scene description. The proposed description is essentially targeted at 2D applications but we believe some tools could be reused for 3D scenes as well.

Simple aggregation format (m10110): less interest but still quite a lot of companies

ResolutionAsk NB's and companies to voice support and bring requirements at next meeting.

M3W (MPEG's Multimedia Middleware APIs)M3W is an Ad-hoc group that was started at the previous meeting.

Context: usage of multimedia in/for (secure) multimedia players / browsers enterprise applications (e-learning, corporate information …) consumer applications (games, interactive DVD, …)

Current situation: fragmented market offering many choices multiple OS and versions of these OSs, many runtime environment (symbian,

pocketPC, smartphones, unix, brew, java vm) multiple application development formats and software development environments

(C++ compiled for specific OSs, Java (multiple versions), C#,…) multiple APIs definition (MHP, JSR, MPEG, Linux CE…)

Goal: Improve application portability and interoperability through the specification of a set of APIs dedicated to multimedia.

It is worth noting that the problem statement for M3W is similar to MPEG-4 and as such, these middleware APIs might define another MPEG-4-like framework from a programmatic point of view, which is similar to what we have in MPEG-4 with MPEG-J APIs. It is not clear at the moment how these APIs will interface with MPEG-J nor it is clear if Java will be the language

138

of choice for M3W; hence it is recommended to use IDL to specify the APIs and to study the links and reuse of existing MPEG-4 APIs. It is also recommended to study if IDL is sufficient to access a multimedia run-time and/or if specific language mapping are needed as well as interoperability between languages.

Profiles

MPEG-4 3D ProfilesSNHC proposes 4 new profiles, two graphics profiles and two scene graph profiles. They are built around the X3D Interactive profile proposed by Web3D Consortium.

Figure 1 – MPEG-4 Graphics and scene graph profiles. Simple compression and Animated Character profiles were proposed at this meeting.

Simple compression 3D profile:Provides the minimum number of tools for simple applications but enough when combined with MPEG-J for complex applications

Animated character profile:Provides more tools than the X3D Interactive profile, especially bone-based animation tools.

The scene graph profiles are defined from a complexity point of view of the compression tools available in these profiles: simple compression 3D uses 3D mesh coding and interpolator compression, animated character uses animation streams and bone-based animation. However, we need to assess the complexity of these tools to avoid definition of too many scene graph profiles.

Having 2 sets of profiles enable companies to mix graphics profiles with various scene graph profiles; this provides more flexibility for various applications.

Note

Animated Character Profile

Animation Stream,Animation Stream,BBABBA

Animated Character Profile

SBxxxxSBxxxx

SimpleCompression3D Profile

BitWrapper,BitWrapper,IC and 3DMCIC and 3DMC

X3D Interactive Profile

Sensors,Sensors,More LightsMore Lights

X3D Interactive Profile

Geometry Geometry primitivesprimitives

GraphicGraphicss

SceneScene GraphGraph

SimpleCompression3D Profile

Procedural TextureProcedural Texture

Minimal 3D toolset

Minimal 3D toolset

139

The minimal 3D toolset is not a profile but a set of tools shared by the X3D Interactive profile and the Simple compression 3D profile.

ResolutionThe 2 new graphics and 2 new scene graph profiles are added to the profiles under consideration document.

MPEG-4 ProfilesWe had a discussion with Systems and Requirements regarding the number of dimensions in the MPEG-4 profile landscape. It was decided to add a new dimension for Text profiles following a proposal from USNB.We also discussed about splitting the graphics dimension in two dimensions: 2D graphics profiles and 3D graphics profile. Some believe MPEG will benefits from allowing combination of 2D and 3D graphics profiles separately. At the moment, having only one dimension for graphics doesn't allow mixing 2D and 3D graphics profiles. Instead of splitting the Graphics profile dimension, a solution could also be to allow, in the object descriptor stream, to signal usage of 2 graphics profile for the same graphics dimension.

As no proposal for separate 2D and 3D graphics profile has been submitted at this meeting, the current MPEG-4 profile landscape is:

Text, graphics, scene graph, audio, visual, MPEG-J

M10166 - X3D Interactive Profile updateThe X3D Interactive profile proposal is almost complete but streams using BIFS Commands and QuantizationParameter node still need to be submitted. Cross-check of the streams has just started.

If all goes fine, this profile will be added to 14496-11/AMD2 which is FDIS in December.

Resolutions of SNHC

Output documentsNo. Title TBP Availabl

eEditor

14496-16 MPEG-4 Animation Framework eXtension (AFX)

5965

AFX CE description No 03/10/24 Marius Preda

5966

ISO/IEC 14496-16/AMD1 WD 2.0 No 03/10/31 Marius Preda

5967

AFX VM 12.0 No 03/10/31 Marius Preda

6066

ISO/IEC 14496-4/FPDAM7 AFX Conformance No 03/11/07 Mahnjin Han

140

Annex 10Report of Integration meeting

Opening of the Meeting

Allocation of contributionsMonday Plenary

9956 Jens Spille AHG on MPEG-2 Audio Ref. Soft. and Issues in MP3 on MP4

9957 Ralph Sperschneider AHG on MPEG-4 Audio Conformance9958 Ralph Sperschneider, Heiko Purnhagen AHG on MPEG-2 AAC and MPEG-4

Audio Text and Software9963 Patrick Gioia James D. K. Kim AHG on AFX SW Implementation

9964 Mahnjin Han, Alain Mignot, Mikael Bourges-Sevenier AHG on AFX Conformance

9972 Chun-Jen Tsai, Mihaela van der Shaar, Young-Kwon Lim AHG on MPEG Multimedia Test Bed

9992 Gerrard Drury, Christian Timmerer, Jeho Nam AHG on MPEG-21 DIA Reference Software

Joint MDS-Integration, Tuesday 14:00 to 15:30 in MDS Room

9975 Xin Wang et al AhG report on REL/RDD reference software implementation

10000 Xin Wang, Thomas DeMartini, Jaime Delgado, Eva Rodriguez, Silvia Llorente

Data Types for MPEG-21 REL Interpretation Conformance Software

10038 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL License Interpreter v.1.110039 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Schema Checker10040 Silvia Llorente, Jaime Delgado, Eva Rodriguez DMAG REL License Creator10041 Eva Rodriguez, Jaime Delgado, Silvia Llorente DMAG REL Validation Rules Checker

10001Xin Wang, Thomas DeMartini, Mai Nguyen , Edgar Valenzuela, Jaime Delgado, Eva Rodriguez, Silvia Llorente

MPEG-21 REL Validation Rules

10194 Roberto Garcia , Jaime Delgado RDDOnto, Rights Data Dictionary Ontology

10099 Christian Timmerer , Hermann Hellwagner, Eric Delfosse , Sylvain Devillers

Implementation of a Digital Item Adaptation Engine

Integration plenary, Thursday 14:00 to 16:00, Systems room

10042

Filippo Chiariglione (CRL), Panos Kudumakis (CRL), Claudio Alberti (EPFL), Antonio Romeo (EPFL), Massimo Balestri (TILAB), João Trindade (ADETTI), Ji Ming

MOSES implementation of MPEG-4 IPMP Messages - version 1.1

10133 Ralph Sperschneider Status on MPEG-4 Audio Conformance

141

10160Chia-Yang Tsai, Hsiao-Chiang Chuang, Jin-He Chen, Jau-Ching Ma, Chi-Yu Liu, Chen-Wei Fan, Chung-Neng Wang, Chun-Jen Tsai

Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

10163 Chun-Jen Tsai, Mihaela van der Scharr, Young-Kwon Lim

MPEG Multimedia Test Bed WD 3.0 for MPEG-21 DIA support

10179 Jing Liu, Ming Ji, Shengmei Shen Update of MPEG-2 IPMP Reference Software

10180 Jing Liu, Ming Ji, Shengmei Shen Progress Report of MPEG-2 IPMP Conformance Test

10199 Gregoire Pau Current status of the MPEG-7 Systems reference software

List of standards under developmentStd

Pt

Edit.

Project

Description CfP

WD CD FCD FDIS

2 4 2004 Amd.1 IPMP Conformance Ext. 03/03

03/07

03/12 04/03

2 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07

03/12

4 4 2003 Amd.4 IPMP Extension Conformance 02/07

02/12

03/07 03/12

4 4 2003 Amd.5 Error Resilience Scalable Profile Conformance

03/03

03/07 03/12

4 4 2004 Amd.6 AVC 03/07

03/12 04/03

4 4 2003 Amd.7 AFX Conformance 02/07

02/12

03/10 04/03

4 5 2003 Amd.4 IPMP Extension Reference SW 02/10

02/12

03/07 03/12

4 5 2003 Amd.5 Error Resilience Scalable Profile Reference Software

03/03

03/07 03/12

4 5 2004 Amd.6 AVC 03/03

03/07

03/12 04/07

4 5 2003 Amd.7 AFX Reference SW 02/10

02/12

03/12 04/07

7 6 2001 Amd.1 Reference software extensions 01/12

02/05

03/12 04/03

7 7 2004 Amd.1 Conformance extensions 03/03

03/07

03/12 04/03

21 8 200x 1st Ed. Reference software 03/03

03/12

04/07 05/01

21 12 200x 1st Ed. Test Bed for MPEG-21 Resource Delivery

02/12

03/12

04/07

21 14 200x 1st Ed. Conformance 03/10

04/03

04/07 05/01

Latest references

Project P.

Standard Issue No.

MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd

Ed.)02/12 Awaji N5457

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

142

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

MPEG-2 Conformance10180: discussed. Conformance checking on the implementation described in 10179 is described, including independent checking by Motorola and ETRI.

MPEG-2 Reference Software10179: discussed. The software is an extension of the MPEG-4 software to the MPEG-2 case. It provides a first integration with REL tools. 90% done, the tool will be completed soon. A first version has been demoed in IPMP seminar in Japan.

MPEG-4 Conformance (14496-4) 10133: presented in Audio

Font Compression reference software (ATG amendment): the due date is December, and it will be uploaded any day now, but definitely before December.

MPEG-4 Reference Software (14496-5) 10042: discussed. The document shows changes with respect to the Trondheim version of the software. It also concerns conformance, so a study document is requested. Bitstreams are still to be produced.

IM1: Zvi reports on the state of the IM1 CVS and suggests some guidelines. At regular points, Zvi will compile and run everything, and tag the CVS with a tag that will get published somewhere as the latest “safe” state. Nobody followed resolution 8 of Pattaya. A new resolution is discussed.Another point concerns the creation of new workspaces. The current complete workspace is too big and slow. As a consequence, Zvi will create and maintain a few lighter workspaces. Contributors needing different workspaces will have to create and maintain their own version(s) from an adapted copy of the current complete workspace.

MPEG-21 Conformancem10000-m10001: discussed. This software is going into the utility section of the MPEG-21 reference software. This is a start for the conformance work, so there will be a working draft.

143

MPEG-21 Reference Softwarem9975: discussed. A discussion about the form of the reference software document happened. Decision was made to continue this discussion in a later joint meeting.

m10038-10041 & m10194: the tools have been presented and added to the software implementation workplan.

m9992: presented in plenary.

m10099: discussed. It contains sensible recommendations for the reference software and naming conventions. It also presents meaningful utility software for BDS, gBSD, BSDLink…

DIA reference software: discussion after m10099.

Joint with MDS on Wednesday 17:00: the content of the wd2.0 of 21000-8 was edited on-line.

10160-10163: The two documents were quickly presented, about integration of DIA in the test bed, and a proposed update of the WD.

Unpublished Integration Standards

14496-4 2003 2nd Ed Conformance testing ITTF To be published

14496-4 2003 Amd.1

Conformance Testing (Conformance testing for MPEG-4)

ITTF FDAM to be issued by ITTF

14496-4 2003 Amd.2

Conformance Testing (MPEG-4 Conformance extensions for XMT and media nodes)

ITTF FDAM to be issued by ITTF

14496-5 2001 Amd.2

Reference SW2nd ed. (XMT, DMIF)

02/05/10 ITTF to be published

14496-5 2001 Amd.3

Reference SW2nd ed. (Visual new level and tools)

03/03/14?

15938-6 Reference Software 01/12 ITTF Under FDIS ballot (Closing 2003-04-04-27)

15938-7 Conformance testing 02/10/25 Editor

Prepare FDIS text

Documents

No. Title TBP Available

13818-4 MPEG-2 Conformance 606

1ISO/IEC 13818-4 MPEG-2 Conformance Testing 2nd Edition N 03/11/07

144

6062

Study Text of ISO/IEC 13818-4 / PDAM1 N 03/10/31

6063

WD 3.0 of ISO/IEC 13818-4 / AMD2 N 03/10/24

13818-5 MPEG-2 Reference Software 606

4Study Text of ISO/IEC 13818-5 / DAM1 N 03/10/31

No. Title TBP Available14496-4 MPEG-4 Conformance

6065 Study Text of ISO/IEC 14496-4 / FPDAM4 N 03/10/316066 ISO/IEC 14496-4 / FPDAM7 N 03/11/076067 DoC on ISO/IEC 14496-4 / PDAM7 N 03/10/24

No. Title TBP Available

21000-8 MPEG-21 Reference Software606

8WD 3.0 of ISO/IEC 21000-8 MPEG-21 Reference Software

N 03/10/31

21000-14 MPEG-21 Conformance606

9WD 1.0 of ISO/IEC 21000-14 MPEG-21 Conformance N 03/10/24

6070

Request for Subdivision of ISO/IEC 21000 N 03/10/24

145

IM1 workplan

Module Tasks Responsibility DateATG Font compression Agfa Monotype,

MicrosoftDecember

Synthesized Texture Vimatix next meeting

IPMP Extensions

Finalization Panasonic / Access Ticket / Optibase / Moses

next meeting

AFX Agreed workplan AFX next meeting

Elementary Stream Management

Integrate the implementation of SL-X France Telecom / Optibase

to be checked before next meeting

146

Annex 11Report of Test meeting

AgendaAVC test plan 9:00 Tuesday - Test roomJoint meeting with video on SVC CfP 14:00 Tuesday - Video roomAVC test material viewing 12:30 Wednesday - Test roomJoint meeting with video on Error Res. Verification test plan 14:00 Wednesday - Test roomJoint meeting with video on SVC CfP 15:00 Wednesday - Test roomAVC test plan 16:00 Wednesday - Test roomAVC/SVC output document approval 14:00 Thursday - Test roomJoint with video AVC/SVC output document approval 17:00 Thursday - Video room

Review Adhoc Group Reports and DocumentsAd Hoc reports

m9973 - AHG Report on coding efficiency analysis and testing of AVC codec Presented the Report. Analysis of the test logistics and resources Final list of companies volunteering in coding Final preparation of the source content Preparation of the Viewing of AVC coded test material A final table of the coding parameters prepared and presented Status of the HiQ material Bit streams generation and preparation status Recommendations for the finalization of the test plan

Work items during the week- Final version of the AVC Verification Test Plan document

Test conditions finalised for all the test conditions Analysis of the coded materials (mainly MPEG-2 HiQ)

- Joint meeting with video to approve the final AVC test plan.- Joint meeting with video to approve the CfP for SVC.- Test plan for the Error Resilient Functionality on the Simple Scalable Profile

Viewing and Verification of the final coded sequencesfor the AVC tests- Problems have been found in the MPEG-2 HiQ material provide by Cable Labs pool.- Contats have been established to solve the problem; solution is far to be solved at Cable

Labs, due to lack of time and to organization problems (they just coordinate a pool of companies that will not react in the short time available),

- Other volunteers to code all the MPEG-2 HiQ material are necessary.- A response came from ABC.- Others contacts are in progress to recode all the MPEG-2 material.

Adhoc Groups

AHG Report on coding efficiency analysis and testing of AVC codec

Output DocumentsAVC Video Verification Test Plan Version 3.0Plan for the Formal Verification Tests of Error Resilient Simple Scalable Profile

147

RecommendationsThanks to:

Hannover University for hosting the ftp-Server All companies working hard to prepare the coded material necessary to run the AVC

verification test Special thanks to Tobias Oelbaum and Thiow Keng Tan for his dedication and effort in

the decoding, preparation and selection of the test material NIST and FUB for their availability in the design and execution of the AVC verification

test FUB for the provision of the HW components used to visually verify, decode, prepare

and select the test material of the AVC verification test

148

Annex 12Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Brisbane are:

1. The advances in the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The extension of the support to the development of MPEG-4 Part 7 to the AVC optimized software.

3. The reviews of the contributions providing examples and results of complexity analysis methodologies, tool for AVC and SVC analysis and results of tool supported software optimization.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M5924 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli, Robert Turney

M10109

“Complexity Evaluation, in-depth Analysis and Possible Optimisations of Different Configurations of MPEG AVC and MPEG4Codec”

Christophe Clerc, Massimo Ravasi, Marco Mattavelli LTS-3 EPFL, Switzerland

M10203

“HDL Virtual Socket Platform Rev 0 MPEG-4 Part 9”

Robert Turney, Paul Schumacher,Xilinx Research Labs.

M10204

“C-to-gates Virtual Socket Platform Rev 0 MPEG-4 Part 9”

Robert Turney, Paul Schumacher,Xilinx Research Labs.

Detailed Report

Reference hardware description for MPEG-4

149

A review of contributions (M10203, M10202) concerning the definition of the virtual socket has been done during the meeting. Such review included past contributions and current meeting contributions. A consistent progress in the concept definition and clarification between software and hardware APIs and elements related to the hardware platform has been achieved. A preliminary mechanism for the automatic detection of a virtual socket for hardware acceleration and the automatic detection of the Part 9 modules actually present on the socket has been defined. The implementation of such mechanism implicitly requires the implementation of a “simple” HDL module in Part 9 providing the defined functionality. An integrated environment running the mixed software/hardware description using the chosen platform (Wildcard II) is ready to be distributed to the contributors for the development of Part 9. While for the moment it requires the input of VHDL modules without the support of integrated development tools, it is expected that soon it will include co-processing capabilities, HW debugging tools, ZBT and SDRAM support for modules requiring large memories such as motion estimation. Such extension is expected for next December 2003 MPEG meeting. The inclusion in the integrated environment of C to Gate (C2G) tools is also one important objective of the activity that will achieve the possibility to directly “transform” parts of the optimized reference software code into hardware modules without requiring an explicit input of HDL code. Such extension will be considered for the first half of 2004. An editing period for the new version of the WD of Amendment 1 of Part 9 has been agreed after the meeting. Part 9 editors will provide the WD text 3 weeks after the meeting.

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates, plus a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 3 telephone conferences before next meeting.

Complexity analysis for AVC and MPEG-4 video reference software

In contribution M10109 a detailed complexity analysis of MPEG-4 optimized reference software Part 7 and AVC codec is presented. Such analysis has been used to derive a list of possible video functions that for their nature and complexity are good candidate for hardware acceleration and therefore for the development of hardware modules to be included in MPEG-4 Part 9. Such lists of modules will be proposed to interested contributors to the development of Part 9.

ResolutionsThe above activities have led to the following resolutions and output document approval.

MPEG-4 part 9 related resolutions:

The Implementation Studies subgroup recommends to approve the following documents

No. Title TBP Available

14496-9 MPEG-4 Reference Hardware Description N5293 Working Draft of Amendment 1 to TR 14496-9 Information

Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description

N 07/11/25

150

The Implementation Studies subgroup recommends establishing the following Ad Hoc group:No. Title MtgN5294 AHG on MPEG-4 Part 9: Reference

Hardware Description Phase 1 and 2Phone conferences on 6th Nov., 20th

Nov., 4th Dec. at 3 p.m. GMT.

151

Annex 13Report of Liaisons meeting

Source: Jan Bormans

The Liaisons Group considered the following input documents:

Input Contr. No.

Title

M9994 Liaison Statement from TV-Anytime ForumM10012 IEC NP: Digital audio -- Interface for non-linear PCM encoded audio bitstreams

applying IEC 60958- Part 8: Non-linear PCM bitstreams according to the Windows Media Audio Professional

M10022 Liaison Statement from the Open Mobile Alliance (OMA) M10023 IEC CDV 61883-6: Consumer audio/video equipment -- Digital interface -- Part

6: Audio and music data transmissionM10057 SMPTE Liaison to WG11 regarding Microsoft VC-9 standardizationM10182 Liaison Statement from ITU-R SG 6/WP 6MM10195 CRF Liaison contribution on Event Reporting RequirementsM10196 CRF Liaison contribution on Usage EnvironmentsM10197 Liaison Statement from ISO TC 46/SC 9/WG 1

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: DVB CPT (on MPEG-21 RDD/REL), 3GPP (on extending the scope of the SC29 liaison), SC36 (on MPEG-21 REL), ATSC (on Font Compression and Streaming technology), and SMPTE (on new work item VC-9 Video Bitstream and Decoding Standard).

Additionally, a generic document on the “Issues in the development of audio and video compression standards” has been generated, which has been sent as attachment in Liaison Statements to DVB, ATSC, and 3GPP.

W3C WAI, OeBF and the Daisy Consortium have been contacted with a Liaison Statement inviting them for providing input on MPEG-21’s work on Auditory Impairment and Digital Item Adaptation.

The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.

152

Annex 14Output documents

5899 List of Documents from the Brisbane, Australia Meeting5900 Resolutions of the Brisbane, Australia Meeting5901 List of AHGs Established at the 66th Meeting in Brisbane, Australia5902 Report of the 66th Meeting in Brisbane, Australia5903 Guidelines for Electronic Distribution of MPEG and WG 11 Documents5904 Press Release of the 66th Meeting in Brisbane, Australia5905 Meeting Notice of the 67th Meeting in Waikoloa, Hawaii, USA5906 Guide for WG 11 Meeting Hosts5907 MPEG 1015908 Responses to National Body Comments5909 Liaison Statement to the Open Mobile Alliance (OMA)5910 Liaison Statement to SMPTE regarding Microsoft VC-9 standardization5911 Liaison Statement to ITU-R SG 6/WP 6M5912 Liaison Statement to the Content Reference Forum on Event Reporting Requirements5913 Liaison Statement to the Content Reference Forum on Usage Environments5914 Liaison Statement to ISO TC 46/SC 9/WG 15915 Liaison Statement to DVB CPT5916 Liaison Statement to 3GPP on extending the scope of the SC29 Liaison5917 Liaison Statement to 3GPP 5918 Liaison Statement to SC365919 Liaison Statement to ATSC5920 Liaison Statement to ITU-R SG 65921 Liaison Statement on Video Codec standardization5922 List of Organisations with which MPEG entertains liaisons

5923 Working Draft of Amendment 1 to TR 14496-9 Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description

5924 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 25925 Statement of Benefits from establishing a class C Liaison with 3GPP5926 MPEG-7 MDS Extensions II PDAM5927 MPEG-7 MDS Cor/1 WD v1.05928 MPEG-7 Industry Usage v2.05929 MPEG-7 Schema Definition CD5930 ISO/IEC 21000-2 DID 2nd Edition WD v.15931 MPEG-21 REL/RDD Software Implementation Plan v.45932 Study of Draft Comments on FCD – Digital Item Adaptation5933 Study of ISO/IEC 21000-7 FCD – Part 7: Digital Item Adaptation

153

5934 MPEG-21 Digital Item Adaptation AM v.75935 MPEG-21 DIA Software Implementation Plan v.55936 Overview of MPEG-21 DIA Core Experiments5937 Workplan for Core Experiment on BSD Transformation Instructions5938 Workplan for Core Experiment on Modality Conversion QoS5939 MPEG-21 Digital Item Processing WD v.35940 MPEG-21 Digital Item Processing TuC v.35941 Overview of MPEG-21 DIP Core Experiments5942 Workplan for Core Experiment on Object Map Technology5943 Workplan for Core Experiment on DIBO Exploration5944 AHG on MPEG-21 REL and RDD Reference Software5945 AHG on Editing MPEG-21 DIA Study of FCD & AM5946 AHG on Integration of DIA with REL and RDD5947 AHG on Virtual Resources in DIA5948 AHG on MPEG-21 Media Locators 5949 AHG on Core Experiments for MPEG-21 DIA5950 AHG on Editing MPEG-21 DID/DIP and Core Experiments for DIP5951 Text of ISO/IEC 14496-2:200X/DCOR15952 MPEG-4 Visual: List of Problems Reported version 10.05953 Disposition of Comments on ISO/IEC 14496-7 DAM1 5954 Text of ISO/IEC 14496-7/Amd.1 DCOR1 5955 Study Text of ISO/IEC 15938-3 FPDAM 15956 Description of Core Experiments for MPEG-7 Visual Extensions5957 Text of ISO/IEC TR 15938-8 PDAM15958 Call for Proposals on Scalable Video Coding Technology5959 Description of Exploration Experiments in 3DAV

5960 AHG on Maintenance of MPEG-4 Visual Draft Corrigendum, Reference Software and Conformance

5961 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-75962 AHG on Editing MPEG-7 Visual related Document5963 AHG on 3DAV Coding5964 AHG on Scalable Video Coding5965 AFX CE description5966 ISO/IEC 14496-16/AMD1 WD 2.05967 AFX VM 12.05968 AHG on AFX document editing and Core Experiments5969 AHG on AFX SW implementation5970 AHG on AFX conformance5971 AHG on AFX profiles5972 Request for ISO/IEC 13818-1:2000/Amd.45973 Text of ISO/IEC 13818-1:2000/PDAM4

154

5974 WD 1.0 of ISO/IEC 13818-1:2000/PDAM55975 DoC on ISO/IEC 14496-1:2001/FPDAM75976 Text of ISO/IEC 14496-1:2001/FDAM75977 DoC on  ISO/IEC 14496-11/FPDAM15978 Study Text of ISO/IEC 14496-11/DCOR15979 Study Text of  ISO/IEC 14496-11/FPDAM25980 Items for Cor. and Amd. on ExternProto Coding5981 WD 3.0 of ISO/IEC 14496-11/Amd.35982 Open Issues in WD3.0 of Audio BIFS Extensions5983 WD 1.0 of  ISO/IEC 14496-11/Amd.45984 WD 3.0 of  ISO/IEC 14496-12/Amd.15985 Request for ISO/IEC 14496-185986 Study of ISO/IEC 14496-18/FCD5987 Study Text of ISO/IEC 15938-1/FPDAM15988 Core Experiments for Systems Extensions5989 Technology under consideration for 15938-1/Amd.15990 MPEG-7 Systems reference software workplan5991 WD 4.0 of ISO/IEC 21000-95992 MPEG Multimedia Middleware5993 Ad Hoc Group on MPEG-7 Systems5994 Ad Hoc Group on MPEG-4 Scene Representation5995 Ad Hoc Group on IM15996 AHG on MPEG File format 5997 AHG on MPEG-J Extensions 5998 Proposed ISO/IEC 13818-7:20045999 ISO/IEC 13818-7:2003/DCOR 16000 Terms of Reference6001 MPEG standards6002 Table of unpublished standards at FDIS level6003 Table of standards under development6004 Work item assignment6005 List of Patent Statements Received6006 Proposed ISO/IEC 14496-3:20046007 ISO/IEC 14496-3:2001/DCOR 26008 Proposed ISO/IEC 14496-3:200X/DCOR X6009 Report on the Verification Tests of MPEG-4 High Efficiency AAC6010 Study on ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio)6011 Workplan for MPEG-4 Extension 26012 WD 1 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)6013 Workplan for Audio Lossless Coding (ALS)6014 WD 0 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable to Lossless Coding (SLS)

155

6015 Workplan for Scalable to Lossless Audio Coding (SLS)6016 3on4 – An MPEG Music Player6017 Status of MPEG-4 Audio Conformance

6018 Workplan for MPEG-4 BWE Conformance6019 WD of Audio Contribution to MPEG-4 Conformance (Bandwidth Extension)

6020 Status and Workplan for MPEG-7 Audio Reference Software and Conformance6021 Proposed Corrigendum 1 on ISO/IEC 15938-4:20016022 Workplan for MPEG-7 Audio6023  Investigation on Spatial Audio Coding6024 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP46025 AHG on MPEG-4 Audio Conformance6026 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software6027 AHG on MPEG-4 Audio Extensions 1 and 26028 AHG on MPEG-4 Audio Lossless Coding6029 AHG on MPEG-7 Audio6030 AHG on Music Notation Application Requirements  6031 AHG on Timestamps and Audio Codec Behavior6032 AHG on Audio Explorations6033 Workplan on Lossless Coding of 1-bit Audio Signals6034 Plan for the Formal Verification Tests of Error Resilient Simple Scalable Profile6035 AVC Video Verification Test Plan Version 3.06036 AHG on AVC Verification Tests6037 MPEG-4 Profiles under Consideration6038 Rationale and Draft Requirements for a Simple Scene Description Format6039 MPEG-7 Profiles under Consideration6040 Text of Committee Draft for ISO/IEC 15938-9 (MPEG-7 Profiles)6041 Requirements for Event Reporting6042 Working Draft of 21000-1 MPEG-21 Vision, Technologies and Strategy6043 Requirements for MPEG-21 Architecture and MPEG-21 IPMP 6044 Background to MPEG-21 Architecture and MPEG-21 IPMP 6045 Call for Requirements for the MPEG-21 Architecture and MPEG-21 IPMP6046 Timeline on MPEG-21 IPMP and the MPEG-21 architecture6047 Text of ISO/IEC 21000-11 WD 4.0 Evaluation Tools for Persistent Association

6048 Draft Requirements for ISO/IEC TR21000-12 Multimedia Test Bed for Resource Delivery, v. 3

6049 Proposed Requirements for Music Notation in Multimedia Applications

6050 Text of 14496-7/Amd.1 Optimised Reference Software for Simple Profile and Visual Error Resilience

6051 3DAV Call for Comments6052 Scalable Video Coding Requirements 6053 AHG on MPEG Multimedia Middleware (M3W)

156

6054 AHG on MPEG-21 Profiles and Extensions6055 AHG on MPEG-21 in Broadcasting 6056 AHG on MPEG-7 Interoperability and Profiling6057 AHG on Event Reporting 6058 AHG on MPEG-21 Architecture and IPMP Requirements6059 AHG on Persistent Association Technologies6060 AHG on intra-only coding in MPEG6061 ISO/IEC 13818-4 MPEG-2 Conformance Testing 2nd Edition6062 Study Text of ISO/IEC 13818-4 / PDAM16063 WD 3.0 of ISO/IEC 13818-4 / AMD26064 Study Text of ISO/IEC 13818-5 / DAM1 6065 Study Text of ISO/IEC 14496-4 / FPDAM46066 ISO/IEC 14496-4 / FPDAM76067 DoC on ISO/IEC 14496-4 / PDAM76068 WD 3.0 of ISO/IEC 21000-8 MPEG-21 Reference Software6069 WD 1.0 of  ISO/IEC 21000-14 MPEG-21 Conformance6070 Request for Subdivision ISO/IEC 21000-14 MPEG-21 Conformance6071 AHG on MPEG-21 DIA Reference Software6072 AHG on MPEG Multimedia Test Bed

6073 Liaison Statement to SMPTE regarding new work item VC-9 Video Bitstream and Decoding Standard

6074 Liaison Statement to DVB on Video Codec standardization6075 DELETE6076 Request for Subdivision ISO/IEC 15938-9 MPEG-7 Profiles6077 Liaison Statement to ATSC on Video Codec standardization6078 Metadata For Digital Photo Digital Library Using MPEG-7 and ISO File Format6079 Definition of MPEG-7 Description Profiling

157