INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N5318Awaji, December 2002

Source Leonardo Chiariglione, ConvenorTitle Report of the 63rd meetingStatus

Report of the 63rd meeting

1 Opening The 63rd WG11 meeting was held at Awaji from 2002/12/09T09:00 to 13T23:40 at the kind invitation of the Japanese National Body.

2 Roll call of participants The list of participants can be found in Annex 1.

3 Approval of agenda The approved agenda can be found in Annex 2

4 Allocation of contributions The list of input documents can be found in Annex 3.

5 Communications from Convenor There were no specific communications made.

6 Report of previous meeting This was approved.

7 Processing of NB Position PapersThe following NB Position Papers were considered and responses provided where appropriate

9196 UK Position on Meeting Locations and Fees 9195 KR KNB paper 9221 JP JNB comment for producing the FDIS of MPEG-4 AVC 9279 DE German National Body Position on MPEG-4 Conformance Completion 9258 DE GNB comment on the standardization schedule for 15938-1 Amd 1, 15938-3

Amd 1, 21000-7, and 21000-9 9135 NO Norwegian NB comment on meeting fees

1

8 MPEG Phase 2

8.1 Part 1 – Systems

8.1.1 Amendment 1 The following document was approved

DoC on ISO/IEC 13818-1:2000/FPDAM1 N5463

8.1.2 Amendment 3 The following documents were approved

DoC on ISO/IEC 13818-1:200/PDAM3 N5466Text of ISO/IEC 13818-1:200/FPDAM3 N5467

8.2 Part 4 – Conformance 8.2.1 Amendment 4The following document was approved

WD of 13818-4:1998/AMD 4 (New Audio LIII bitstreams) N5372

8.3 Part 7 – Advanced Audio Coding8.3.1 Standard The following document was approved

5374 ISO/IEC 13818-7:2003 (MPEG-2 AAC, Second Edition)

8.4 Part 11 – IPMP on MPEG-2 Systems8.4.1 Standard Even though the standard was ready for approval, this was delayed because there is an expectation that some organisations will publish their requirements on Digital Rights Management.

8.5 Workplan This was approved (N5400)

9 MPEG Phase 4

9.1 Part 1 – Systems 9.1.1 Amendment 4 – AFX & MUWThe following documents were approved

DoC on ISO/IEC 14496-1:2001/FPDAM4 N5470Text of ISO/IEC 14496-1:2001/FDAM4 N5471

9.1.2 Amendment 7 – Systems Extensions for AVCThe following documents were approved

2

DoC on ISO/IEC 14496-1:2001/PDAM7 N5473Text of ISO/IEC 14496-1:2001/FPDAM7 N5474

9.1.3 Amendment 8 – Advanced Text & GraphicsThe following document was approved

WD 3.0 of ISO/IEC 14496-1:2001/Amd.8 N5475

9.1.4 Amendment 9 – MPEG-7 in MPEG-4 Systems The following document was approved

WD 3.0 of ISO/IEC 14496-1:2002/Amd.9 N5478

9.2 Part 2 – Visual 9.2.1 Amendment 4 – Error Resilience in Scalable Enhancement LayerThe following documents were approved

Request for ISO/IEC 14496-2:2001/Amd.4 N5405Text of ISO/IEC 14496-2:2001/PDAM4 N5406

9.2.2 Corrigenda The following document was approved

MPEG-4 Visual: List of Problems Reported version 7.0 5407

9.3 Part 3 – Audio 9.3.1 Amendment 1 – Bandwidth ExtensionThe following document was approved

Workplan for MPEG-4 Extension 1 Verification Tests 5379

9.3.2 Amendment 2 – Parametric ExtensionThe following document was approved

Text of ISO/IEC 14496-3:2002/PDAM 2 (Parametric Coding for High Quality Audio)

5381

9.3.3 Amendment 3 – Lossless AudioThe following document was approved

Report on CfP of Audio Lossless Coding 5383

9.3.4 CorrigendaThe following document was approved

3

Some ideas on a new ISO/IEC 14496-3:200x corrigendum 5375

9.4 Part 4 – Conformance Testing

9.4.1 Standard The following document was approved

Text of ISO/IEC 14496-4 second edition 5447

9.4.2 Amendment 2 – XMTThe following document was approved

Text of ISO/IEC 14496-4/FDAM2 (XMT) 5438

9.4.3 Amendment 3 – Visual New L&TThe following documents were approved

DoC on ISO/IEC 14496-4:2002/PDAM3 (Visual New Levels and Tools) 5440Text of ISO/IEC 14496-4:2002/FPDAM3 (Visual New Levels and Tools) 5439

9.4.4 Amendment 4 – IPMP Extensions, MuW & AFXThe following documents were approved

Request for ISO/IEC 14496-4/AMD4 5442Text of ISO/IEC 14496-4/PDAM4 5441

9.5 Part 5 – Reference software 9.5.1 Amendment 4 – IPMP Extensions, MuW & AFX

Request for ISO/IEC 14496-5/AMD4 5444Text of ISO/IEC 14496-5/PDAM4 5443

9.6 Part 10 – Advanced Video Coding 9.6.1 Standard The following document was approved

Draft 0.2 AVC Verification Test Plan N5459

9.7 Part 11 – Scene Description and Application Engine 9.7.1 Standard The following documents were approved

Request for ISO/IEC 14496-11/Amd.1 N5479Text of ISO/IEC 14496-11/FDAM1 N5480

9.7.2 CorrigendaThe following document was approved

Items for corrections of 14496-11 N5481

4

9.8 Part 15 – AVC File Format 9.8.1 Standard The following documents were approved

DoC on ISO/IEC 14496-1:2001/PDAM7 N5482Text of ISO/IEC 14496-15/FCD N5483

9.9 Part 16 Animation Framework eXtension (AFX)9.9.1 Standard The following documents were approved

Request for ISO/IEC 14496-16 N5399Text of ISO/IEC 14496-16:2003/FDIS N5397

9.10 Workplan This was approved (N5400). In particular the plan of AVC-related standardisation is

Yr Mo Auspices Location Milestones2003 March JTC 1 Pattaya FDIS2003 May ITU-T Geneva2003 Oct JTC 1 TBD Verification Test Completion2003 Dec ITU-T TBD2004 March JTC 1 TBD Reference Software & Conformance Standardization

Completion

10 MPEG Phase 7

10.1 Requirements The following documents were approved

MPEG-7 Profiles and Levels under Consideration N5324Definition of MPEG-7 Description Profiling N5325

10.2 Systems

10.2.1 Amendment 1  The following documents were approved

Request for ISO/IEC 15938-1/Amd.1 N5485Text of ISO/IEC 15938-1/PDAM1 N5486

10.2.2 CorrigendaThe following document was approved

WD 2.0 of ISO/IEC 15938-1/Cor1 N5484

5

10.3 Visual 10.3.1 Amendment 1The following document was approved

MPEG-7 Visual Extensions WD 3.0 N5409

10.3.2 CorrigendaThe following document was approved

MPEG-7 Visual: List of Problems Reported version 2.0 N5408

10.4 Workplan This was approved (N5400).

11 MPEG phase 21

11.1 Requirements The following document was approved

MPEG-21 Requirements v1.4 N5333

11.2 Part 3 – Digital Item Identification 11.2.1 Standard  The following companies and organisations applied for the role of Registration Authority: CISAC (FR) EAN International (BE) National Computerization Agency (KR) SMPTE Registration Authority (US) Verisign (US)The following document was produced to guide in the selection process

Evaluation Criteria for Appointing the RA for ISO/IEC 21000-3 N5347

11.3 Part 5 – Rights Expression Language 11.3.1 Standard  The following documents were approved

DoC on ISO/IEC CD 21000-5 Rights Expression Language 5348Text of ISO/IEC FCD 21000-5 Rights Expression Language 5349

11.4 Part 6 – Rights Data Dictionary 11.4.1 Standard  The following documents were approved

DoC on ISO/IEC CD 21000-6 Rights Data Dictionary 5351Text of ISO/IEC FCD 21000-6 Rights Data Dictionary 5352

6

11.5 Part 7 – Digital ItemAdaptation 11.5.1 Standard  The following document was approved

Text of ISO/IEC CD 21000-7 Digital Item Adaptation 5353

11.6 Part 10 – Digital Item Processing11.6.1 Standard  The following documents were approved

Request for Subdivision ISO/IEC 21000-10 Digital Item Processing 5334Requirements for Digital Item Processing: DIM, DIME, DIBO and DIML 5330Final Call for Proposals on Digital Item Processing: Digital Item Base Operations and Digital Item Method Language

5329

11.7 Part 11 – Persistent Association11.7.1 Technical ReportThe following documents were approved

Request for Subdivision ISO/IEC 21000-11 Evaluation Methods for Persistent Association Technologies 5335

Evaluation Methods for Persistent Association Tools – Working Draft v1.0 5332

11.8 Test Bed for MPEG-21 Resource Delivery

11.8.1 Technical ReportThe following document was approved

WD of ISO/IEC 21000-12 N5494

11.9 Other MPEG-21 parts

11.9.1 Event reportingThe following documents were approved

Requirements for Event Reporting N5336Preliminary Call for Proposals on Event Reporting N5337

11.10 Workplan This was approved (N5400).

12 Overall WG11 workplan

This was approved (N5400).

13 Explorations

7

13.1 Scalable Video Coding The following documents were approved

Applications and Requirements for Scalable Video Coding 5327Draft Call for Evidence on Scalable Video Coding Advances 5412

13.2 Digital Cinema The following documents were approved

Requirements for Digital Cinema N5328Work Plan For Digital Cinema N5458

This exploratory activity was suspended.13.3 3D AV coding  The following documents were approved

5326 Applications and Requirements for 3DAV5416 Report on Status of 3DAV Exploration

14 Liaison matters The following liaison documents were approved

Liaison Statement to EDItEUR 5425Liaison Statement to TV Anytime Forum 5426Liaison Statement to DAISY consortium 5427Liaison Statement to SMPTE on Digital Cinema 5428Liaison Statement to Digital Media Device Association 5429Liaison Statement to ITU-T regarding the development of ITU-T Metadata recommendations 5431

Liaison Statement to ITU-T regarding video coding standardisation activities 5432Liaison Statement on Evaluation Methods for Persistent Association Technologies. 5433Liaison Statement to WG1 regarding font format representation and compression 5434Responses to National Body Comments 5435

A request to SC29 to begin a liaison with Daisy Consortium and ISO/IEC JTC1 SC37 was approved.

15 Administrative matters

15.1 Schedule of future MPEG meetings The following meeing schedule was approved

Meeting City Country Yr. Mo. Days63rd Awaji Is. JP 02 12 09-1364th Pattaya TH 03 03 10-1465th Trondheim NO 03 07 21-2566th Brisbane, QLD AU 03 10 20-2467th Waikaloa, HI US 03 12 08-1268th ? ? 04 03 15-1969th ? ES 04 07 19-23

8

70th ? ? 04 10 25-29

16 Organisation of this meeting

16.1 Joint meetings The following joint meetings were held

Group 1 Group 2 What Where Day TimeReq Tst Dcinema 307 Mon 15:00-17:00Sys Snh-Int AFX Ref SW Sys Mon 17:00-18:00Aud Sys Binarisation Aud Tue 09:30-10:30Req MDS MP21 Expl Req Tue 10:00-11:00Re’q Vid SVC Vid Tue 11:30-12:30Req Int Ref SW Req Tue 11:30-12:30Vid Int-Sys Test bed Vid Tue 14:00-14:30Req Vid-Snh 3DAV Req Tue 14:30-17:30Vid Tst ACV Test Vid Tue 17:30-19:00Vid Tst SVC test Vid Wed 11:30-12:30Req V-S-A-M MP7 Prof Req Wed 14:00-16:00‘ Snh AFX-ATG Sys Wed 14:00-16:00Req Sys Bin-MP21 Req Wed 16:00-17:00Aud Sys BIFS Aud Wed 16:00-17:00Snh Vid 3D Shape Descriptor BO403 Wed 16:00-16:30Mds Req DIA-REL Mds Wed 16:00-17:00Aud Int BWE conf Aud Wed 17:00-17:30Jvt Req AVC P&L Jvt Wed 17:00-18:00Int Mds MP21 Ref SW BO305 Thu 08:30-09:30Req Snh-Sys OLGA-AFX Profiles Req Thu 09:00-10:30Mds Sys MP7 Schema Ext. Mds Thu 10:00-10:30Mds Snh MP21 Graphics DIA Mds Thu 10:30-11:00Vid Int-Sys-Mds MM Test Bed Sys Thu 14:00-14:30Sys Req BiM Profiles Req Thu 14:00-15:00Aud Req MP4 Profiles Aud Thu 15:00-15:30

17 Planning of future activities The following ad hoc groups were established

5456 AHG on MPEG-4 AudioBIFS Extensions and MPEG-21 DIA for Audio5341 AHG on 3DAV Coding5404 AHG on AFX conformance5403 AHG on AFX SW implementation5402 AHG on AFX VM editing and Core Experiments5461 AHG on AVC Verification Test Plan5369 AHG on Core Experiments for MPEG-21 Digital Item Adaptation5418 AHG on Core Experiments for Visual Descriptors and Visual-only Description Schemes

in MPEG-75343 AHG on Digital Item Processing5368 AHG on Editing MPEG-21 Digital Item Adaptation CD & AM5419 AHG on Editing MPEG-7 Visual XM and WD 5417 AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software

9

5491 AHG on IM15363 AHG on Metadata Interoperability5339 AHG on MP4 Extensions 5446 AHG on MPEG Conformance Editing5493 AHG on MPEG IPMP Extension5448 AHG on MPEG Multimedia Test Bed5450 AHG on MPEG-2 AAC 5449 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP45345 AHG on MPEG-21 Event Reporting5344 AHG on MPEG-21 IPMP5447 AHG on MPEG-21 Reference Software5367 AHG on MPEG-21 REL Publishing Extension5366 AHG on MPEG-21 Rights Data Dictionary (RDD)5365 AHG on MPEG-21 Rights Expression Language (REL)5451 AHG on MPEG-4 Audio Conformance5453 AHG on MPEG-4 Audio Extensions and Core Experiments5452 AHG on MPEG-4 Audio Text and Software5454 AHG on MPEG-4 Lossless Coding5371 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 25490 AHG on MPEG-4 Scene Representation5455 AHG on MPEG-7 Audio5340 AHG on MPEG-7 Interoperability and Profiling5489 AHG on MPEG-7 Systems5342 AHG on Persistent Association5364 AHG on Preparing the Appointment of the RA for ISO/IEC 21000-35462 AHG on Production of Test Materials5420 AHG on Scalable Video Coding5492 AHG on the Carriage of MPEG-4 Content

18 Resolutions of this meeting These were approved

19 A.O.B There was no other business

20 Closing The meeting was closed on 2002/12/13T23:40 with thanks to the hosting organisation.

10

Annex 1Attendance list

Name Country1. Christian Timmerer AT2. Guillaume Potard AU3. Ian S. Burnett AU4. Ioannis Andreopoulos BE5. Rik Van de Walle BE6. Eric Delfosse BE7. Roberto Osorio BE8. Peter Schelkens BE9. Ioan Alexandeu Salomie BE10. Peter Haighton CA11. Anthony Joch CA12. Alex Luccisano CA13. Alain Mignot CA14. Seymour Shlien CA15. Demin Wang CA16. Lowell Winger CA17. Touradj Ebrahimi CH18. Chris Joslin CH19. Frederic Vexo CH20. Zhibo Chen CN21. Filippo Chiariglione CN22. Wen Gao CN23. Jiri Matas CZ24. Gero Base DE25. Ulrich Benzler DE26. Markus Cremer DE27. Martin Dietz DE28. Helge Drumm DE29. Christian Eckes DE30. Bernhard Feiten DE31. Ralf Geiger DE32. Andreas Graffunder DE33. Bernhard Grill DE34. Carsten Herpel DE35. Jorg Heuer DE36. Daniel Homm DE37. Hyoung-Gook Kim DE38. Tilman Liebchen DE39. Marcus Magnor DE40. Detlev Marpe DE41. Jose Manuel Martinez-Ibanez DE42. Tobias Oelbaum DE43. Jens-Rainer Ohm DE44. Marco Rittermann DE45. Jan Rohden DE

11

46. Martin Schlockermann DE47. Aljoscha Smolic DE48. Ralph Sperschneider DE49. Jens Spille DE50. Herbert Thoma DE51. Thomas Wiegand DE52. Miska Hannuksela FI53. Mauri Vaananen FI54. Olivier Avaro FR55. Eric Barrau FR56. Guillaume Boisson FR57. Cyril Concolato FR58. Alexandre Cotaritanac'h FR59. Dominique Curet FR60. Christophe Daguet FR61. Jerome Daniel FR62. Jean-Claude Dufourd FR63. Patrick Gioia FR64. Marc Guez FR65. Alain Le Guyader FR66. Remont Laurent FR67. Frederic Loras FR68. Pierre Marty FR69. Francois Xavier Nuttall FR70. Philippe Pierrick FR71. Francoise Preteux FR72. Claude Seyrat FR73. Abdellatif Benjelloun Touimi FR74. Aharon Gill IL75. Zvi Lifshitz IL76. Yuval Noimark IL77. Natan Peterfreund IL78. Nicola Adami IT79. Massimo Balestri IT80. Leonardo Chiariglione IT81. Roberto Flaiani IT82. Kiyofumi Abe JP83. Tadashi Abe JP84. Satoru Adachi JP85. Ichiro Ando JP86. Kohtaro Asai JP87. Tomohiro Azami JP88. Keiichi Chono JP89. Takeshi Chujoh JP90. Koichi Emura JP91. Toshiaki Fujii JP92. Seiichi Goshi JP93. Koiti Hasida JP94. Takaaki Hatanaka JP

12

95. Hiroyuki Honma JP96. Tsutomu Horioka JP97. Takahito Iida JP98. Tatsuhiko Ikeda JP99. Yohichi Ishibashi JP

100. Manabu Itoh JP101. Shinya Kadono JP102. Toru Kambayashi JP103. Toshio Kamei JP104. Itaru Kaneko JP105. Isao Karube JP106. Akihiro Katayama JP107. Miwa Katayama JP108. Sadaatsu Kato JP109. Yoshiaki Kato JP110. Ryoichi Kawada JP111. Masatoshi Kawarasaki JP112. Kimihiko Kazui JP113. Tan Thiow Keng JP114. Yoshihiro Kikuchi JP115. Hideaki Kimata JP116. Takuyo Kogure JP117. Mayumi Koike JP118. Takeshi Koyama JP119. Takayuki Kunieda JP120. Jiuhuai Lu JP121. Kazuaki Maeda JP122. Mitsuru Maeda JP123. Yoshinori Matsui JP124. Jun Matsumoto JP125. Yoshihiro Miyamoto JP126. Satoshi Miyata JP127. Hidenobu Miyoshi JP128. Soichiro Mori JP129. Takehiro Moriya JP130. Tokumichi Murakami JP131. Fumihiko Murase JP132. Shigeki Nagaya JP133. Sei Naito JP134. Takayuki Nakachi JP135. Akira Nakagawa JP136. Satoshi Nakagawa JP137. Koohji Nakashima JP138. Hirofumi Nishikawa JP139. Toshio Nomura JP140. Toshiyuki Nomura JP141. Takeshi Norimatsu JP142. Yukiko Ogura JP143. Takayuki Onishi JP

13

144. Hajime Oshima JP145. Daniel Monteiro de Barros Pinheiro JP146. Rosanne Possato JP147. Shinichi Sakaida JP148. Masanori Sano JP149. Mikio Sasaki JP150. Noriyuki Sato JP151. Craig A. Schultz JP152. Shun-ichi Sekiguchi JP153. Takanori Senoh JP154. Masahiro Shibata JP155. Yoshiaki Shibata JP156. Osamu Shimada JP157. Yoshinori Sugihara JP158. Maki Sugiura JP159. Kenji Sugiyama JP160. Mitsuyoshi Suzuki JP161. Teruhiko Suzuki JP162. Yoshinori Suzuki JP163. Koichi Takagi JP164. Toshiya Takahashi JP165. Youichi Takashima JP166. Junichi Takeda JP167. Hideki Takehara JP168. Akio Tanaka JP169. Naoya Tanaka JP170. Masayuki Tanimoto JP171. Yoshikazu Tanno JP172. Tadamasa Toma JP173. Tadashi Uchiumi JP174. Takafumi Ueno JP175. Mark Veltman JP176. Akihiro Watanabe JP177. Shuichi Watanabe JP178. Toshiaki Watanabe JP179. Zhixiong Wu JP180. Akio Yamada JP181. Masanori Yamada JP182. Ryozo Yamashita JP183. Kazumasa Yamazawa JP184. Dai Tracy Yang JP185. Mizuho Yano JP186. Yoshiyuki Yashima JP187. Yoshikazu Yokomizo JP188. Noriko Yonehara JP189. Gye-Sung Ahn KR190. Won-Sik Cheong KR191. Dae-Sung Cho KR192. Sukhee Cho KR

14

193. Jung Ho Choi KR194. Woong Il Choi KR195. Mahnijin Han KR196. Yo-Sung Ho KR197. Youngsik Huh KR198. Wonjon Hwang KR199. Byeong-Moon Jeon KR200. ByeungWoo Jeon KR201. Senator Jeong KR202. Seyoon Jeong KR203. Yong Ju Jung KR204. Hogab Kang KR205. Sang-Ug Kang KR206. Chul-Woo Kim KR207. Daijin Kim KR208. Do-Nyun Kim KR209. Hae Kwang Kim KR210. Hyoung Joong Kim KR211. Hyun-Cheol Kim KR212. Hyunwoo Kim KR213. In-Kwon Kim KR214. Jae-Gon Kim KR215. James D.K. Kim KR216. Jong-Nam Kim KR217. Kyeongsoo Kim KR218. KyuHeon Kim KR219. Munchurl Kim KR220. Myungdon Kim KR221. Sang-Kyun Kim KR222. Sang-wook Kim KR223. Sunjeong Kim KR224. Taek-Soo Kim KR225. Woo-Shik Kim KR226. Yong Han Kim KR227. Yong-Goo Kim KR228. Chang Yeol Lee KR229. Nam Yeol Lee KR230. Yung-Lyul Lee KR231. Jeongyeon Lim KR232. Young-Kwon Lim KR233. Jeho Nam KR234. Sang-Hoon Oh KR235. Seoung-Jun Oh KR236. Weom Geun Oh KR237. In Kyu Park KR238. Soojun Park KR239. Jeongil Seo KR240. Yong Seok Seo KR241. Joon-ho Song KR

15

242. Young Jo Song KR243. Young-Won Song KR244. Sang Oak Woo KR245. Kyoungro Yoon KR246. Kug Jin Yun KR247. Peter Mulder NL248. G.J. Dekker NL249. Jan van der Meer NL250. Jean H.A. Gelissen NL251. Marc Klein Middelink NL252. Werner Oomen NL253. Gisle Bjontegaard NO254. Tom-Ivar Johansen NO255. Andrew Perkis NO256. Wladyslaw Skarbek PL257. Fernando Pereira PT258. Marie Dahlqvist SE259. Per Frojdh SE260. Kristofer Kjorling SE261. Kok Seng Chong SG262. Teck Wee Foo SG263. Lee Men Huang SG264. Ming Ji SG265. Chong Soon Lim SG266. Jiunn Bin Lim SG267. Jing Liu SG268. Sua Hong Neo SG269. Susanto Rahardja SG270. Yu Rongshan SG271. Shen Sheng-Mei SG272. Lin Xiao SG273. Huang Zhongyang SG274. C. Barlas UK275. Miroslaw Bober UK276. Leszek Cieplinski UK277. A. Galuten UK278. Richard Gooch UK279. Catherine (Kate) Grant UK280. Brian Green UK281. K. Hill UK282. Paul Jessop UK283. Uwe Jost UK284. Panos Kudumakis UK285. Mike Nilsson UK286. G. Reid UK287. N. Rump UK288. G. Rust UK289. M. Steliaros UK290. Simon Watt UK

16

291. B. Wragg UK292. Ping Wu UK293. Hsueh-Ming Hang US294. Chun-Jen Tsai US295. Yi-Shin Tung US296. Giordano Beretta US297. Marina Bosi US298. Frank Bossen US299. Mikael Bourges-Sevenier US300. Jill Boyce US301. Wo Chang US302. Kwok Chau US303. Tihao Chiang US304. Greg Conklin US305. Thomas M. DeMartini US306. Mihaela Van der Schaar US307. Bob Eifrig US308. Charles Fenimore US309. Brad Gandee US310. Carlos Garza US311. Walter Gish US312. Jonathan Goldberg US313. Barry G. Haskell US314. William Helms US315. Dzung Hoang US316. Michael Horowitz US317. Walter Husak US318. Faisal Ishtiaq US319. Andrew W. Johnson US320. James D. Johnston US321. Jani Lainema US322. Shawmin Lei US323. Vladimir Levantovsky US324. Adam Li US325. Shu Lin US326. David Lindbergh US327. Brian Link US328. Sam Liu US329. Ajay Luthra US330. Tom McMahon US331. Daniel Miller US332. Iole Moccagatta US333. Debargha Mukherjee US334. Ajith N. Nair US335. Sam Narasimhan US336. John Nelson US337. M. Paramasivam US338. Schuyler Quackenbush US339. Majid Rabbani US

17

340. Eric Rehm US341. Yuriy A. Reznik US342. Justin Ridge US343. Arturo A. Rodriguez US344. Chris Russell US345. Pete Schirling US346. Jiandong Shen US347. Amnon Silberger US348. David Singer US349. John R. Smith US350. Gary J. Sullivan US351. Huifang Sun US352. Viswanathan Swaminathan US353. Ali Tabatabai US354. Andrew G. Tescher US355. Bob Thomas US356. Anthony Vetro US357. Toby Walker US358. Feng Chi Wang US359. Limin Wang US360. Xin Wang US361. John W. Woods US362. Fang Wu US363. Jay Yun US364. Sheng Zhong US365. Minhua Zhou US

18

Annex 2Agenda

1 Opening 2 Roll call of participants 3 Approval of agenda 4 Allocation of contributions 5 Communications from Convenor 6 Report of previous meeting 7 Processing of NB Position Papers8 MPEG Phase 1 8.1 Part 1 – Systems 8.2 Part 2 – Video 8.2.1 Corrigenda 8.3 Part 3 – Audio 8.4 Part 4 – Conformance 8.5 Part 5 – Reference software 9 MPEG Phase 2 9.1 Requirements 9.2 Part 1 – Systems 9.2.1 Standard 9.2.2 Amendment 1 9.2.3 Amendment 2 9.2.4 Amendment 3 9.2.5 Corrigenda 9.3 Part 2 – Video 9.4 Part 3 – Audio 9.5 Part 4 – Conformance 9.5.1 Standard 9.5.2 Amendment 1 9.5.3 Amendment 2 9.5.4 Amendment 3 9.5.5 Amendment 4 9.5.6 Corrigenda 9.6 Part 5 – Reference software 9.6.1 Standard 9.6.2 Amendment 9.6.3 Corrigenda 9.7 Part 6 – DSM-CC 9.8 Part 7 – Advanced Audio Coding 9.8.1 Standard 9.8.2 Amendment 9.8.3 Corrigenda 9.9 Part 9 – System extension RTI 9.10 Part 10 – Conformance extension - DSM-CC 9.11 Part 11 – IPMP on MPEG-2 Systems 9.11.1 Standard 9.11.2 Amendment 9.11.3 Corrigenda

19

9.12 Workplan 10 MPEG Phase 4 10.1 Requirements 10.2 Part 1 – Systems 10.2.1 Standard 10.2.2 Amendment 1 – FlexTime 10.2.3 Amendment 2 – XMT BIFS nodes 10.2.4 Amendment 3 – IPMP-X 10.2.5 Amendment 4 – AFX & MUW 10.2.6 Amendment 5 – MP4 base text 10.2.7 Amendment 6 – MP4 MPEG specific text 10.2.8 Amendment 7 – Systems Extensions for AVC 10.2.9 Amendment 8 – Advanced Text & Graphics 10.2.10 Amendment 9 – Use of MPEG-7 in MPEG-4 Systems 10.2.11 Amendment 10 – Use of AVC in MPEG-4 System 10.2.12 Corrigenda 10.3 Part 2 – Visual 10.3.1 Standard 10.3.2 Amendment 1 – Studio Profile 10.3.3 Amendment 2 – FGS 10.3.4 Amendment 3 – New Levels &Tools 10.3.5 Amendment 4 – Error Resilience in Scalable Enhancement Layer 10.3.6 Corrigenda 10.4 Part 3 – Audio 10.4.1 Standard 10.4.2 Amendment 1 – Bandwidth Extension 10.4.3 Amendment 2 – Parametric Extension 10.4.4 Amendment 3 – Lossless Audio 10.5 Part 4 – Conformance Testing 10.5.1 Standard 10.5.2 Amendment 1 – SP, FGS, FlexTime 10.5.3 Amendment 2 – XMT 10.5.4 Amendment 3 – Visual New L&T 10.5.5 Amendment 4 – AVC 10.5.6 Amendment 5 10.5.7 Corrigenda 10.6 Part 5 – Reference software 10.6.1 Standard 10.6.2 Amendment 1 – SP, FGS, FlexTime 10.6.3 Amendment 2 – XMT, DMIF 10.6.4 Amendment 3 – Visual New L&T 10.6.5 Amendment 4 – AVC 10.6.6 Amendment 5 10.6.7 Corrigenda 10.7 Part 6 – DMIF 10.7.1 Standard 10.7.2 Corrigenda 10.8 Part 7 – Optimised software 10.8.1 Technical Report

20

10.8.2 Amendment 1 10.9 Part 8 – 4 on IP Framework 10.9.1 Standard 10.9.2 Corrigenda 10.10 Part 9 – Hardware Reference Description 10.10.1 Technical Report 10.11 Part 10 – Advanced Video Coding 10.11.1 Standard 10.12 Part 11 – Scene Description and Application Engine 10.12.1 Standard 10.13 Part 12 – ISO Base Media File Format 10.13.1 Standard 10.14 Part 13 – IPMP Extensions 10.14.1 Standard 10.15 Part 14 – MP4 File Format 10.15.1 Standard 10.16 Part 15 – AVC File Format 10.16.1 Standard 10.17 Workplan 11 MPEG Phase 7 11.1 Requirements 11.2 Systems 11.2.1 Standard 11.2.2 Amendment 1 11.2.3 Corrigenda 11.3 Description Definition Language 11.3.1 Standard 11.3.2 Corrigenda 11.4 Visual 11.4.1 Standard 11.4.2 Amendment 1 11.4.3 Corrigenda 11.5 Audio 11.5.1 Standard 11.5.2 Amendment 1 11.5.3 Amendment 2 11.5.4 Corrigenda 11.6 Description Schemes 11.6.1 Standard 11.6.2 Amendment 1 11.7 Reference software 11.7.1 Standard 11.7.2 Amendment 1 11.7.3 Corrigenda 11.8 Conformance Testing 11.8.1 Standard 11.9 Extraction and use of visual descriptors 11.9.1 Technical Report 11.10 Workplan

21

12 MPEG phase 21 12.1 Requirements 12.2 Part 1 – Vision, Technologies and Strategy 12.3 Part 2 – Digital Item Declaration 12.3.1 Standard 12.3.2 Amendment 12.3.3 Corrigendum 12.4 Part 3 – Digital Item Identification 12.4.1 Standard 12.4.2 Amendment 12.4.3 Corrigendum 12.5 Part 4 – Intellectual Property Management and Protection 12.5.1 Standard 12.6 Part 5 – Rights Expression Language 12.6.1 Standard 12.7 Part 6 – Rights Data Dictionary 12.7.1 Standard 12.8 Part 7 – Digital ItemAdaptation 12.8.1 Standard 12.9 Part 8 – Reference software 12.9.1 Standard 12.10 Part 9 – File format 12.10.1 Standard 12.11 Other MPEG-21 parts 12.11.1 Digital Item Processing 12.11.2 Persistent Association 12.11.3 Event reporting 12.12 Workplan 13 Overall WG11 workplan 14 Explorations 14.1 Scalable Video Coding 14.2 Digital Cinema 14.3 3D AV coding 14.4 On line gaming 14.5 Test material 15 Liaison matters 16 Administrative matters 16.1 Schedule of future MPEG meetings 16.2 Promotional activities 17 Organisation of this meeting 17.1 Tasks for subgroups 17.2 Joint meetings 18 Planning of future activities 19 Resolutions of this meeting 20 A.O.B 21 Closing

22

Annex 3List of documents submitted

No Authors Title 9069 Wo Chang Document Register for SC29/WG11 Meeting Awaji, JP9070 Vittorio Baroncini

Xuemin ChenTK Tan

AHG on AVC Verification Tests

9071 Tobias Oelbaum AHG on Production of Test Material9072 Robert Turney

Marco MattavelliAHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

9073 Shih-Hao Wang Chung-Neng Wang Guan-Yi Lin Tihao ChiangHuifang Sun

AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software

9074 Miroslaw BoberSang-Kyun Kim

AHG on Core Experiments for Visual Descriptors and Visual-only Description Schemes in MPEG-7

9075 L. CieplinskiA. Yamada

AHG on Editing MPEG-7 Visual XM and WD

9076 Mihaela van der Schaar

C.J. TsaiTouradj Ebrahimi

AHG on Scalable Video Coding

9077 John R. SmithK. Hasida

AHG on Editing the MPEG-7 MDS Extensions FPDAM and XM

9078 Peter MulderEric RehmDave Singer

AHG on metadata interoperability

9079 Barney WraggThomas DeMartini

AHG on MPEG-21 Rights Expression Language

9080 Chris Barlas AHG on MPEG-21 Rights Data Dictionary9081 Martha Nalebuff

Brad GandeeAHG on MPEG-21 REL Publishing Profile and Extension

9082 Anthony VetroAndrew Perkis Hermann Hellwagner

AHG on Editing MPEG-21 Digital Item Adaptation WD & AM

9083 Ian BurnettJeho Nam

AHG on Core Experiments for MPEG-21 Digital Item Adaptation

9084 Jens Spille AHG on MPEG-2 Audio Reference Software9085 Ralph Sperschneider AHG Report on MPEG-2 AAC9086 Ralph Sperschneider AHG Report on MPEG-4 Audio Conformance9087 M. Vaananen

H. PurnhagenAHG on MPEG-4 Audio Text and Software

9088 Schuyler Quackenbush AHG on MPEG-4 Audio Extensions and Core Experiments9089 Schuyler Quackenbush AHG on MPEG-4 Lossless Coding

23

9090 Schuyler Quackenbush J. BitzerJuergen Herre

AHG on MPEG-7 Audio

9091 Guillaume PotardJens Spille

AHG on MPEG-4 AudioBIFS and MPEG-21 Digital Item Adaptation for 3D-Audio

9092 Mikael Bourges-SevenierHan

AHG on AFX FPDAM/VM editing and Core Experiments

9093 Michael SteliarosJames D. K. Kim

AHG on AFX SW Implementation

9094 Marius PredaMichael Steliaros

AHG on On-line gaming (OLGA)

9095 Mahnjin HanAlain MignotMikael Bourges-Sevenier

AHG on AFX Conformance

9096 Wo ChangEric Rehm

AHG on MPEG-7 Interoperability and Profiling

9097 Aljoscha SmolicRyozo Yamashita

AHG on 3DAV Coding

9098 W. Husak AHG on Digital Cinema9099 Niels Rump

Paul JessopAHG on Persistent Association

9100 Ian BurnettRik Van de Walle

AHG on Digital Item Processing

9101 Craig SchultzChris Russell

AHG on MPEG-21 IPMP

9102 FX NuttallAndrew Tokmakoff

AHG on MPEG-21 Event Reporting Requirements

9103 Claude SeyratCarsten HerpelAdam LindsayJan Van der MeerAli Tabatabai

AHG on MPEG-7 Systems and DDL

9104 Jean-Claude DufourdMichelle KimYuval Fisher

AHG on MPEG-4 Scene Representation

9105 Zvi Lifshitz AHG on IM19106 Jan Van der Meer

Carsten HerpelAHG on the Carriage of MPEG-4 Content

9107 Craig A. Schultz AHG on MPEG-2 and MPEG-4 IPMP Extension9108 Dave Singer AHG on MP4 Extensions9109 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Media Coding

Summary Database [SC 29 N 5073]9110 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Video Coding

Standardization Activities [SC 29 N 5074]9111 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Mediacom 2004 [SC

29 N 5075]9112 Jean-Claude Dufourd Integration Meeting Report9113 Olivier Avaro

Jean-Claude DufourdSystems Meeting Report

24

Jan Van der MeerCraig A. SchultzYoung-Kwon LimClaude SeyratDavid Singer

9114 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-6 [SC 29 N 5119]9115 Wael Badawy

Mehboob AlamG. Jullien

DCT

9116 Giorgio Zoia Proposed new test sequences for Audio nodes conformance9117 Zhibo Chen

Peng Zhou Yun HeYiDong Chen

Fast integer pel and fractional pel motion estimation

9118 Helge Drumm Shadow Node for MPEG-4 Applications9119 Niels Rump Answers to the RfC in MPEG-21 DII9120 Niels Rump

Paul JessopProposed Table of Contents for the Technical Report on “Evaluation of Persistent Association Tools”

9121 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 5|15444-3/FPDAM 1

9122 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 29123 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 13818-119124 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 29125 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 49126 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 14496-109127 Wo Chang MPEG-7 Profile Schemas for “Profiles under Consideration”9128 Zhibo Chen

Guoping LiYun He

Experiment Evaluation about Motion Compensation of MAC for stereoscopic

9129 Zhibo ChenGuoping LiYun He

Bit rate control algorithm for MPEG-4 MAC for stereoscopic video coding

9130 Vladimir Levantovsky Response to the CFP for font format representation9131 Debargha Mukherjee

Geraldine KuoAmir SaidShih-ta HsiangSam LiuGiordano Beretta

Structured Scalable Meta-formats (SSM) version 1.0 for content agnostic Digital Item Adaptation

9132 Wo Chang MPEG-7 Profiles and Levels Signaling9133 SC 29 Secretariat Liaison Statement from DVB to WG 11 [SC 29 N 5139]9134 Yu Rongshan

Lin XiaoSusanto Rahardja

Advanced Audio Zip - Scalable perceptual and lossless audio codec

9135 Andrew Perkis Norwegian NB comment on meeting fees9136 Jin Li

James D. JohnstonA Progressive to Lossless Embedded Audio Coder (PLEAC) with Multiple Factorization Reversible Transform

9137 Takehiro MoriyaAkio JinKazunaga Ikeda

Technical descriptions of lossless audio coding proposed by NTT

25

Dai Tracy Yang9138 Toby Walker Comments and Issues on the JVT File Format9139 Tom McMahon AVC/H.264 Level Harmonization Study and Proposal9140 Debargha Mukherjee

Amir Said Sam Liu Geraldine KuoGiordano Beretta

Tools for end-to-end fully content agnostic digital item adaptation

9141 Jeongyeon LimTruong Cong ThangMunchurl KimJongnam KimKyeongsoo KimJeho NamYong Man Ro

Report of CE on Presentation Preference

9142 Oelbaum Marie Dahlqvist

New HD Test Material

9143 Chiarotto AlessandroDifino AngeloNegro Barbara

MPEG-21 DIA Extensions for Personalization Activity

9144 Gus ReidPaola Hobson

Proposed changes to MoMuSys-1.0-001220_sony encoder software, implementing w5160

9145 Christian TheobaltBastian Goldluecke Marcus Magnor Ming Li

EE2 - Comparison of Model-based Scene Reconstruction and Rendering Methods

9146 Whoi-Yul KimHyun-Sun ParkJae-Ho Lee

The Results of Cross-check for Edge Histogram Descriptor (VCE-3)

9147 Soo-Jun ParkMyung Gil JangChee Sun WonHwang Hee Lee

Report of the Core Experiment of Definition and use of a new TimeSequence data container (VCE-3)

9148 Soo-Jun ParkMyung Gil JangChee Sun WonHwang Hee Lee

Proposal of new dataset for Edge Histogram of VCE-3

9149 Soo-Jun ParkDong-Kwon Park

Report of the core experiment result of binary representation of visual descriptors (VCE-2)

9150 Akio Yamada Update proposal of syntax tables of GofGopFeature container9151 Akio Yamada Cross-verification Result on VCE-3: Extension of Gof/Gop

Feature for Edge Histogram9152 Akio Yamada Report on the VCE-4: Visual DS framework9153 Akio Yamada An additional issue to be discussed on ISO/IEC 15938-3:20029154 Akio Yamada

Leszek CieplinskiMPEG-7 Visual part of eXperimentation Model Version 16.1

9155 LoretteDucloux

Evaluation of AVC/H.264 tools (CABAC, MB-AFF, and direct modes) on SD interlaced material

9156 Cyril ConcolatoJean Le FeuvreJean-Claude Dufourd

Request for a fix of the gradient nodes

26

9157 Rohden CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata

9158 Zoia Swiss NB comment on ISO/IEC 14496-4 (2nd edition)9159 Wragg

GalutenAn overview and requirements of the CR Forum and MPEG-21

9160 Jerome VieronChristine GuillemotStephane Pateux

Contribution to EE4 : Scalable Video Coding Based on Spatio-temporal wavelet decomposition

9161 James KingLeon SucharovPanos Kudumakis Claudio Alberti Massimo BalestriJW Seok

MOSES Progress report on MPEG-4 IPMPX

9162 Brian Green Liaison statement from EDItEUR9163 Dave Lindbergh

AppleBTBroadcomCiscoConexantDTEricssonFastVDOGlanceNokiaOn2PolycomRADVision

Support for JVT Royalty Free Baseline

9164 Dave LindberghDavid Singer

United States Support for H.264/AVC Royalty Free Baseline

9165 Bob Thomas Response to the Call for Proposal for MPEG-4 Systems font format representation and font compression technology

9166 Dave LindberghAppleBroadcomFastVDOGlancePolycomSiemensTandbergTelesUBVideoViXs

JVT and the Royalty-Free-Baseline Goal

9167 Sang-Kyun Kim Report of the Core Experiment result of "Time Series" data container

9168 Ophir Azulai Yuval Noimark

Modifications to the MoMuSys reference decoder implementing w5160

9169 Itaru KanekoJunya TsutsumiMark Callow

Proposal on requirements and a straw man architecture of 3D graphics for constraint devices.

27

9170 Itaru KanekoSatoshi MiyataKazuaki Maeda

Waseda-TOA experiment on Call for Proposal MPEG-4 Lossless Audio Coding (MPEG N5208)

9171 Guillaume PotardJeongil SeoJens SpilleDaeyoung Jang

Report of the second MPEG-4 AudioBIFS Sound Source Wideness Core Experiment

9172 Taka SenohTakafumi Ueno

WD3.0 of 14496-4:2002/AMD4 MPEG-4 IPMP Extension Conformance Testing

9173 Daeyoung JangKyeongok KangGuillaume Potard

Report of the Core Experiment on Soundfield Description for Audio Presentation Preference in MPEG-21 DIA

9174 Mikio SasakiFumihiko Murase

Proposed Text for User/Natural Environment Descriptions in MPEG-21 DIA

9175 Mikio SasakiFumihiko Murase

Applications using User/Environment Descriptions

9176 Minsub KimDaijin KimSangyoun LeeSunjeong KimJeong-Ho Choi

Face descriptor using nonlinear MRDF

9177 ZY HuangAndrew PerkisSM ShenMing JiTaka SenohTakuyo KogureTakafumi UenoTor HalvorsenDebargha Mukherjee

Report on Core Experiment for DIA Description Messages

9178 Toshio KameiAkio YamadaHyunwoo KimWonjun HwangTae-Kyun KimSeok Cheol Kee

CE report on Advanced Face Recognition Descriptor

9179 Jiri Matas Cross-verification results of Advanced Face Recognition Descriptor

9180 Shih-Hao WangChung-Neng WangGuan-Yi LinTiHao ChiangHuifang Sun

AHG report on editorial convergence of MPEG-4 reference software

9181 Chung-Neng WangYi-Shin TungTihao ChiangJens-Rainer Ohm

MPEG-4 Visual: Updated List of Problems Reported

9182 Chung-Neng WangChia-Yang TsaiYao-Chung LinHan-Chung Lin

FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments

28

Hsiao-Chiang Chuang Jin-He Chen Kin Lam Tong Chun-Jen Tsai

9183 Chun-Jen TsaiMihaela van der SchaarYoung-Kwon LIM

MPEG Media Streaming Reference Platform

9184 Kazumasa YamazawaHitoshi HabeToshio NomuraTakashi Matsuyama

Report of EE1 on Omni-directional Video

9185 Shuichi Watanabe Proposal on the construction of MPEG-7 BiM Profile9186 Sukhee Cho

Kugjin YunByungjun BaeYoungkwon HahmChieteuk AhnYongtae KimKawnghoon Sohn

Report for EE3 in MPEG 3DAV

9187 Senator JeongWeon-Geun OhKi-song Yoon

Proposal of Multilingual Registry for MPEG-21 Part 6 Rights Data Dictionary

9188 Benjamin de NeefIan S Burnett

Extending the Use of Digital Items

9189 Benjamin de NeefIan S Burnett

Digital Items in Universal Plug and Play

9190 Jeho NamTruong Cong ThangJaeil Song Yong Man RoJin-Woo Hong

Report of CE on Low Vision Impairment

9191 Yi-Shin TungJa-Ling Wu

Convergence of MS reference software

9192 Pierrick Philippe FNB Comments on N5203 (Text of FPDAM extension 1 MPEG-4 audio)

9193 Yi-Shin TungJa-Ling Wu

Report on status of conformance bitstreams evaluated using integrated MS reference software

9194 Pierrick PhilippeSchuyler Quackenbush

Cross check of MPEG-4 lossless proposals

9195 Kyuheon Kim KNB paper9196 Wragg UK National Body Position on Meeting Locations and Fees9197 Hyun-Cheol Kim

Kyuheon KimProposal of Applications and Requirements for Scalable Video Coding

9198 Claude SeyratGregoire Pau

Mixed content support in BiM V2

9199 Gregoire Pau CE-3 bis : Evaluation of a Codec Management Framework9200 Peter Mulder

Dave SingerEric Rehm

Report on the AHG on Metadata Interoperability

9201 Jens SpilleWalter Voessing

Proposed Text for ISO/IEC 13818-4 PDAM4

29

9202 Jens SpilleErnst F. Schroedere

Decoder Specific Information Descriptors and Access Unit definition for Non MPEG-4 Audio Decoders

9203 Jens Spille Proposed corrections for ISO/IEC 14496-19204 Jens Spille

Juergen SchmidtKlaus Eilts-Grimm

Proposals for Audio BIFS Version 3

9205 Mikio SasakiFumihiko Murase

Additional User/Environment Descriptions for MPEG-21 DIA

9206 Chris BarlasGodfrey Rust

MPEG-21 Rights Data Dictionary - Editors' Version

9207 Viswanathan SwaminathanGautam Gopinadhan

Using MPEG-J for DIP (DIML and DIME)

9208 Gyeong Ja JangJames D. K. Kim

The specifications for XMT-A compliant BitWrapper node and the encoding parameters used in its bitstream

9209 In Kyu ParkMahnjin HanIn-Wook SongChang-Su Kim

Result of Core Experiment on Depth Image-based Representation (AFX A8.3)

9210 In Kyu ParkJames D. K. KimDuck Hoon KimIl Dong YunSang Uk Lee

3D perceptual shape descriptor: Result of exploration experiments and proposal for core experiments

9211 Teruhiko SuzukiYoichi Yagasaki

Preliminary results of the verification test of MPEG-4 AVC

9212 Werner Oomen WD of MPEG-4 Audio Extension 2, Parametric Coding [RM3]9213 Erik Schuijers

Werner OomenSupport for changing parameter values in MPEG4 Extension 2 (parametric coding for HQ Audio)

9214 Erik SchuijersWerner Oomen

Decoding stereo base layer in MPEG4-Extension 2 (Parametric coding)

9215 Jérôme DanielRiitta VäänänenJean-Bernard Rault

Finalizing the production and crosschecking of 3D audio conformance bitstreams

9216 Brian Green Publishing Sector input to REL: Liaison statement from EDItEUR

9217 Ryoichi KawadaSei NaitoAtsushi KoikeMasahiro WadaShuichi Matsumoto

Requirements on stereo matching, compression of depth maps, and generation of new viewpoint video from the viewpoint of possible contribution and primary / secondary distribution of multiview television

9218 M. HannukselaTian

Sub-Sequences in AVC File Format

9219 Christoph FehnKlaas SchüürIngo FeldmannPeter KauffAljoscha Smolic

Distribution of ATTEST test sequences for EE4 in MPEG 3DAV

9220 Tsutomu Horioka Additional Requirements for Event Reporting9221 JNB JNB comment for producing the FDIS of MPEG-4 AVC9222 Michael Schuldt Preliminary Results on EE4 of the 3DAV AHG

30

Marco Rittermann9223 Masanori Sano

Rosanne Vasconcelos PossatoMasahiro Shibata

A Study on MPEG-7 Video Program Profile

9224 Peter SymesTom McMahonRich Mizer

Liaison to MPEG on Digital Cinema

9225 Peter SymesTom McMahon

Liaison to MPEG on Carriage of Metadata over MPEG2 Systems

9226 Merrill WeissPeter SymesTom McMahon

Response to MPEG CFP on RA for MPEG21

9227 Jan Bormans on behalf of the CE

Report of the CE on BSDL/gBSD, AdaptationQoS and SSM

9228 Tadamasa TomaYouji NotoyaYoshinori Matsui

Comments on 14496-15/FCD

9229 Tadamasa TomaYouji NotoyaYoshinori Matsui

Sample definition for AVC

9230 Wen Gao China NB comments on the AVC/JVT standard9231 Marc Emerit French NB comment on ISO/IEC 14496-4 (2nd edition)9232 Thomas Rusert

Konstantin HankePeisong ChenJohn Woods

Recent Improvements to MC-EZBC

9233 Nicola AdamiMarzia CorvagliaRiccardo Leonardi

Report of CE report on Metadata Adaptation - Integration

9234 Cyril ConcolatoJean Le FeuvreJean-Claude Dufourd

Improvements for WD 2.0 on ATG

9235 Gregoire PauClaude Seyrat

Improving Fragment Reference support within BiM V2

9236 Shlomo BirmanEhud Spiegelon behalf of the Israeli NB

Israeli NB Comment on N5285 (FPDAM of ISO/IEC 14496-1 / AMD4) and N5286 (CE on Synthesized Texture Coding)

9237 Shlomo BirmanEhud SpiegelAlexandre Cotarmanac’hCyril Concolato

Report on SynthesizedTexture CE (N5286)

9238 Masayuki TanimotoToshiaki Fujii

Quality Measure for Ray-Space Interpolation

9239 Vladimir Levantovsky Metric Compatibility and Resident Fonts in MPEG-4 terminals9240 Joerg Heuer

Andrea KoflerHarald KoschAndreas Hutter

Fast random access into BiM streams

31

9241 Joerg HeuerAndreas Hutter

BiM Extensions

9242 Leszek Cieplinski MPEG-7 Visual: List of Problems Reported9243 Deepak Turaga

Mihaela van der SchaarReduced complexity spatio-temporal scalable motion compensated wavelet video coding

9244 Andreas HutterJoerg HeuerUlrich Niedermeier

Report on MPEG-7 Systems CE-4: Evaluation of Schema Transmission Mechanisms

9245 Mihaela van der SchaarTsaiT. Ebrahimi

Ad-hoc Group Report on Scalable Video

9246 Deepak TuragaMihaela van der SchaarJohn ApostolopoulosSusie Wee

Applications and Requirements for Multiple Description Scalable Coding

9247 Ralph Sperschneider Proposed Second Edition on ISO/IEC 13818-79248 Cyril Concolato

Jean Le FeuvreJean-Claude Dufourd

Demonstration of Advanced Graphical BIFS content

9249 Joeri BarbarienYiannis AndreopoulosAdrian MunteanuPeter SchelkensJan Cornelis

Coding of motion vectors produced by wavelet-domain motion estimation

9250 Ralph Sperschneider Audio part of proposed Second Edition on ISO/IEC 14496-49251 Marc Klein Middelink

Ralph SperschneiderAndreas Hoelzer

Preparation for ISO/IEC 14496-3:2001/Cor2

9252 Ralph Sperschneider Status of MPEG-4 Audio Conformance9253 Yiannis Andreopoulos

Adrian MunteanuPeter SchelkensMihaela Van der SchaarJan Cornelis

Control of the distortion variation in motion compensated temporal filtering

9254 Rui J. LopesJoerg HeuerAZAMI Tomohiro

Report on MPEG-7 Systems CE-5: Evaluation of Multiple Description Streams

9255 Abdellatif Benjelloun Touimi

Rights Expression Languages Terminal Capabilities within MPEG-21 DIA

9256 Aljoscha SmolicDavid McCutchen

Requirement for very high resolution video in 3DAV

9257 Mariam KIMIAEI-ASADISouhila Boughoufalahjean-claude DUFOURD

Proposed additions to DIA WD 3.0

9258 Andreas Hutter on behalf of the GNB

GNB comment on the standardization schedule for 15938-1 Amd 1, 15938-3 Amd 1, 21000-7, and 21000-9

9259 Souhila BoughoufalahMariam KIMIAEI-

Proposal for adding user interaction support to terminal capabilities in DIA

32

ASADIjean-claude DUFOURD

9260 Abdellatif BENJELLOUN TOUIMI

Comments on MPEG-21 IPMP draft requirements

9261 Peter AmonJuergen PandelAndreas HutterGero Bäse

Evaluation of Adaptive Video Coding and Transmission Technologies

9262 Alain Mignot Scene partitioning using Volumic Space Partition (VSP)9263 Alain Mignot

Simon LavalleeReport on A12 - CE Scene Partition

9264 Enzo MaggiCedric Thienot

CE-4 bis: Proposal for a Schema Transmission Framework

9265 Oliver Baum Limited Usefulness of Sound2D node9266 Ziegler Martin Dietz

Daniel HommClarifications of bitstream restrictions for AAC+SBR

9267 H.A. Gelissen (editor) DNB Comments9268 Wo Chang Comments about Definition of MPEG-7 Description Profiling9269 Wo Chang Approach to Develop Formal Representation for MPEG-7

Profiles9270 Anthony Vetro

on behalf of AHGMPEG-21 DIA WD3.1

9271 Anthony Vetroon behalf of the AHG

MPEG-21 DIA AM3.1

9272 Sylvain DevillersEric Delfosse

New features for BSDL

9273 Dan LelescuFrank Bossen

Representation of Panoramic and Omnidirectional Images

9274 Kristofer KjörlingFredrik Henn

Additional information on how to handle 960 frame size for the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension

9275 Koiti Hasida Some Comments on MPEG-7 MDS FPDAM9276 David Singer Some thoughts towards simple meta-data in ISO (MP4) files9277 Kristofer Kjörling Inverse filtering bug fix for the reference software

corresponding to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension

9278 Kristofer KjörlingFredrik HennJonas Roden

Editorial changes to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension document

9279 Ralph Sperschneider German National Body Position on MPEG-4 Conformance Completion

9280 Abhijeet GolwelkarJohn W. Woods

Motion Compensated temporal filtering using longer filters

9281 Geiger JoachimDeguara JürgenHerre Gerald Schuller

Proposal for a Scalable Lossless Audio Codec based on MPEG-4 AAC

9282 Eric DelfosseJan Bormans

Improvements to AdaptationQoS

9283 Bernhard Grill Ralph Sperschneider

Comments on the AAC Profiles

33

9284 Ralph Sperschneider MPEG-2 AAC Conformance roll-up9285 Jerome Daniel Comments and add-ons on previously proposed 3D Audio DIA

descriptors, considering mature or emerging technologies9286 Dong Tian

Miska M. HannukselaFinnish National Body Comments on AVC File Format

9287 Wladyslaw Skarbek Face recognition experiments with fuzzy PCA and LDA9288 Miska M. Hannuksela Finnish National Body comments on AVC9289 CURET

DAGUETLORAS

AVT Acces Unit, OD Framework

9290 John WoodsPeisong ChenShih-ta HsiangDebargha MukherjeeGeraldine KuoAmir Said

Fully Scalable MC-EZBC in the Structured Scalable Meta-formats (SSM) Framework

9291 COTARMANAC'HCURET

SL Extension

9292 CURET FlexMux Conformance9293 CURET ESI Interface/SL layer coherence9294 RELIER

CURETROUX

RTP payload for FlexMux streams

9295 French National Body FNB comments for the 63rd MPEG meeting9296 Iver Grini Multi-User: Status report and plan9297 Uwe Jost

Michael AtkinsonFeasibility study on graph compression

9298 Hanspeter PfisterPaul BeardsleyHuifang SunAnthony Vetro

Proposed Evaluation Procedure for EE in MPEG 3DAV

9299 Casey et. al. Status of Audio Matlab XM (Version 1)9300 Hanspeter Pfister

Huifang SunAnthony Vetro

Image-Based Visual Hull as a Model Reconstruction Method for EE2 in MPEG 3DAV

9301 Marius PredaFrançoise PreteuxSon Tran

MPEG-4 for fun: demonstration of multimedia gaming

9302 Marius PredaFrançoise Preteux

BBA encoding hints in XMT

9303 Mikael Bourges-Sevenier

AhG on AFX FPDAM4 editing and ce

9304 Mikael Bourges-Sevenier

XMT corrections

9305 Yasser SyedMukta KarBill Helms

Consideration of possible delay of AVC to FDIS

9306 Robert TurneyPhil James-Roxby

MPEG-4 Virtual Socket Defn

9307 Hae-Kwang KimNam-Ik Cho

Proposal for Graphics DIA

34

Hyoung-Joong KimMan-Bae KimRin-Chul KimJeho NamJin-Woo Hong

9308 Shigeki NagayaTakehiro Fujita

Cross-verification results of MPEG-7 VCE-1

9309 Ian BurnettGerrard Drury

Additional Requirement for Digital Item Processing

9310 Gerrard DruryIan Burnett

Requirement for MPEG-21 XPointer scheme

9311 Eric Rehm Mapping ID3 Tags to MPEG-79312 Avaro Integration of AFX in Im19313 Jijun Zhang

Andrew PerkisEror log for DIA schema version 3.0

9314 Liebchen Technology for MPEG-4 Lossless Audio Coding9315 FX Nuttall Use case scenario for Event Reporting9316 William Berriss

Miroslaw BoberProfile for CCTV surveillance and related applications

9317 Rik Van de Walle Belgian NB comment on MPEG-4 AFX backchannel specification

9318 Thomas Phinney OpenType CFF font format9319 Alexandre

Cotarmanac'hstudy of the sl extension

9320 Quackenbush 62nd MPEG Audio Report9321 Robert Turney MPEG-4 Part 9 Platform Information9322 Robert Turney MPEG-4 Part 9 Proposed Integration Plan for Opt SW and HW

Accel9323 Robert Turney MPEG-4 Part 9 Study of N5153 PDTR9324 Robert Turney MPEG-4 Part 9 HDL coding guidelines9325 Robert Turney MPEG-4 Part 9 HW Platform memory controller information9326 Daniels MPEG Font Evaluation Criteria

35

Annex 4Report of Requirements meeting

Source: Fernando Pereira (Instituto Superior Técnico) Keith Hill (Rightscom) for MPEG-21

The activities under the Requirements subgroup’s responsibility were divided between Fernando Pereira (MPEG-4, MPEG-7 and Exploration issues) and Keith Hill (MPEG-21). MPEG-4 MPEG-4 AFX Profiling (Joint Meeting with the Systems and SNHC subgroups)This meeting addressed the issue of integrating the recently developed AFX tools in the MPEG-4 profiling framework in order clear interoperability points are provide to the industry. First, it was reaffirmed that profiles and levels are essential to provide interoperability at acceptable complexity for all application domains. It was also reminded that MPEG-4 considers 6 profiling dimensions: Visual, Audio, Graphics, Scene graph, Object descriptor and MPEG-J. The AFX tool-set provides coding tools/nodes for graphics objects and thus shall be integrated in the MPEG-4 framework by defining the Graphics and Scene graph profiles and levels adequate to the industry needs related to the applications domains where AFX tools may be useful. The Requirements subgroup welcomes proposals for AFX related profiles and levels following the guidelines set in document N4671. MPEG-4 AVC (Joint Meeting with JVT)Profiling for Part 10 AVC

According to the JVT Terms of Reference “The Baseline profile is the common set of features supported by all JVT decoder implementations, without exception.” Acknowledging that the AVC FCD presents a solution that does not follow this guideline (see figure), the Requirements subgroup reaffirmed at the Shanghai meeting that still believes that the profile hierarchy over the simplest profile called Baseline is a desirable target. Following the Shanghai meeting, JVT was asked to provide motivation to not follow the Terms of Reference profiling hierarchy guideline.

At this joint meeting, the possibilities to achieve a fully hierarchical (over Baseline) set of profiles was discussed at length. It was stated that the JVT compromise found in terms of interoperability, compression efficiency and complexity points to the inclusion of a Main profile which is not hierarchical to Baseline. There were no contributions on the table proposing a fully hierarchical structure and the two NBs that proposed to MPEG in Shanghai this solution did not make again the same proposal.

From the Requirements subgroup point of view, it was stated that although the guidelines in the Terms of Reference may not be fully followed, precise and strong reasons for that should be presented. In this case, this includes solid data in terms of evaluating the complexity burden associated to the inclusion in the Main profile of the (error resilience) tools which would make this profile hierarchical to Baseline.

Profile NamingAt the Shanghai MPEG meeting, the Requirements subgroup recommended that “AVC profiles are

named in a way that does not easily create confusion, for example avoiding naming with numbers or single letters, but also avoiding naming the profiles using names of applications. Naming profiles with application names may wrongly send the message that a certain profile can only be used for the application that gives it the name or that a profile cannot be used for the application that gives the name to another profile.”

36

Following this recommendation, the JVT decided to name the 3 AVC profiles as Baseline, Main and Extended as shown in the figure below.

MPEG-4 Audio Profiling (Joint Meeting with the Audio subgroup)m9283 Comments on the AAC Profiles, Bernhard Grill, Ralph SperschneiderMPEG-4 Audio profiling was discussed in a short joint meeting with the Audio subgroup. The contribution above proposed the inclusion of two additional audio object types in the AAC profile (ER_AA_ LC and ER_AAC_Scalable) currently under development in an amendment, and only including the AAC_LC object type, with the purpose to enlarge its application domains and have a AAC related profile able to decode all flavors of AAC content. No consensus was reached on the change of the AAC profile and further work is needed considering:

The importance of maximizing interoperability and thus minimizing the number of profiles The need to evaluate the complexity burden related to the two additional object types The needs and support by the industry

It was stressed that, from the Requirements subgroup point of view maximizing interoperability and thus minimizing the number of profiles is a very important objective. Thus consensus should be achieved regarding the complexity burden associated to the inclusion of these two additional object types in this profile. It was also stressed that levels should not be used to include new tools but only to change the complexity associated to the decoding complexity for that profile@level considering the same tools for all levels of the same profile. MPEG-7 MPEG-7 Description Profiling (Joint Meeting with the Video/Audio/MDS/Systems subgroups)Creation of Part 9 “Profiles and Levels”

Taking into account that MPEG-7 description profiles and levels will be defined across MPEG-7 parts, notably Visual, Audio and MDS

The convenience to have all MPEG-7 profiles and levels in a single partIt was decide that all MPEG-7 profiles and levels (for descriptions and BIM) be included in a separate part to be created named ‘Profiles and Levels’.

Process to Define Profiles and LevelsFollowing the various questions regarding the process to define profiles and levels, it was agreed that this process includes 2 stages:

1. Profile and level proposals are collected in the MPEG-7 Profiles and Levels under consideration document, through the following list of items for each profile or level:

Applications areas (notably new ones, that are enabled by the proposed profile/level);

37

Baseline

Main

Extended

BaselineBaseline

Main

Extended

Baseline

List of functionalities, compared to the closest existing profile(s)/level(s);

List of tools in the profile/level and corresponding profile/level schema (according to Section 3 below);

List of supporting companies; these companies are also committing to doing the conformance testing and providing adequate streams.

2. When a profile/level proposal is mature, a decision will be made about its inclusion in the standard (though an amendment). Such a choice will be made on the basis of the following criteria:

Identified functionality is not supported by already existing profiles/levels with an acceptable level of complexity; the verification of added functionality provided by a new profile/level may involve the performance of some tests.

Declared interest exists in the actual deployment of the profile/level in services and products by several companies;

Streams available to exercise all tools in the profile/level; these streams have been checked/validated by multiple, independent parties.

Profiles should get a name and levels a number.This process was included in document N5325, named Definition of MPEG-7 description profiling.

Description Profilingm9096 AHG on MPEG-7 Interoperability and Profiling, Wo Chang, Eric RehmThe activities and the recommendations of this AHG were reviewed.

m9127 MPEG-7 Profile Schemas for “Profiles under Consideration”, Wo ChangThis contribution includes profile schemas for the 5 MPEG-7 profiles under consideration (N5239, output document from Shanghai meeting, October, 2002): SimpleProfile, SummaryProfile, AudioVideoLoggingProfile, UserDescriptionProfile, and BibliographicalProfile. The progression of these profiles in terms of standardization will be made according to the process defined in N5325.

m9132 MPEG-7 Profiles and Levels Signaling, Wo ChangAs discussed at the last MPEG meeting, MPEG-7 profiles need to be signaled in the associated streams. While BIM Profiling signalling is solved since there is already a field for that, a solution for the signalling of description profiles and levels is needed. This contribution proposed some possible first solutions for this problem. The technical solution will be developed by the MDS and Systems (DDL) subgroups.All MPEG-7 profiles and levels (BIM and description) will be included in MPEG-7 Part 9: Profiles and Levels.

m9268 Comments about Definition of MPEG-7 Description Profiling, Wo ChangThis contribution makes some comments regarding document Definition of MPEG-7 Description Profiling (N5240) approved at the last meeting. The comments were discussed and some changes incorporated in the new version of this document. It is recognized that section 3.1.2.1 Prohibiting optional attribute or element needs to be more clear.

m9269 Approach to Develop Formal Representation for MPEG-7 Profiles, Wo ChangIn order to provide consistency in generating MPEG-7 profile schemas, an approach to develop a formal representation to generate MPEG-7 profile schemas is needed. With this in mind, this contribution has prototyped a web-based scripting program called MPEG-7 Profile Schema Generator (M7PSGen) which takes a list of MPEG-7 description tools and output a specific MPEG-7 profile schema.

38

m9223 A Study on MPEG-7 Video Program Profile, Masanori Sano, Rosanne Vasconcelos Possato, Masahiro Shibata

This contribution proposes a profile called ‘Video Program Profile’ designed for TV program management and material exchange in/among broadcasting company and video production companies. It was mentioned that some MDS related tools may be missing (as stated also by the AHG on metadata interoperability); the MDS subgroup is already aware of this claim.This contribution claims that description profiles shall be defined not only by a list of tools as stated in doc. N5325 but also, if needed, by some additional constraints regarding the use of the description tools for that profile. This issue will be further addressed in the context of the AHG on Interoperability and Profiling. The proposed profile will be included in the MPEG-7 Profiles and Levels under Consideration document (N5324) until the 31st December 2002. However the relation between this profile and other profiles already included in this document, notably the simple and the bibliographical profiles, have to be carefully studied in order the most adequate set of profiles and levels are defined.

m9316 Profile for CCTV surveillance and related applications, William Berriss, Miroslaw Bober

This contribution made a preliminary proposal for a profile addressing CCTV surveillance and related applications. A more complete proposal will be made in the future considering the process defined in N5325. It is important to notice that this is the first profile proposal including low-level video descriptors.

Metadata InteroperabilityFollowing a liaison from PRO-MPEG presented at last MPEG meeting requesting an MPEG-7 profile providing similar functionalities to the MXF solution for broadcasting production environments, and the acknowledgement that there was no mapping available between MPEG-7 and MXF tools and AHG was created with this task. Although this mapping is been developed under the auspices of the MDS subgroup, the Requirements acknowledge that MPEG-7 may be missing relevant tools, notably in terms of production environments. The MXF-MPEG-7 mapping was to be completed and reviewed because taking decisions regarding the tools MPEG-7 is missing and the possible tools that should be developed for inclusion in MPEG-7.The relation between the possible MPEG-7 profile resulting from the mapping of MXF targeting broadcasting environments and the current profiles under consideration was considered, specially the profile proposed by contribution m9223. These issues will be further addressed in the AHG on Metadata Interoperability and in the AHG on Interoperability and Profiling.

MPEG-7 BIM Profiling (Joint Meeting with the Systems subgroup)m9185 Proposal on the construction of MPEG-7 BiM Profile, Shuichi WatanabeFollowing the presentation of the contribution above asking for a Baseline BIM profile, it decided that:

At least one BIM profile and level will be defined to avoid confusion in the industry. With Version 2 BIM tools, it may be needed to define more than one BIM profile

depending on their decoding complexity. BIM profiles will be defined as sets of BIM tools addressing relevant application domains,

independently of the MPEG-7 version the tools belong to. BIM profiles will be defined following the guidelines defined in N4671.

MPEG-21MPEG-21 Requirements (General)N5333 MPEG-21 Requirements v1.4

39

The MPEG-21 Requirements Document was revised at this meeting to reflect the current status of requirements for each of the parts. New requirements were added for Digital Item Processing, Reference Software and Event Reporting. In addition, new terms were defined for Event, Event Report, Event Report Request and Peer.Digital Item ProcessingM9100 AHG on Digital Item Processing - Burnett, Avaro, Van de WalleM9207 Using MPEG-J for DIP (DIML and DIME) - Viswanathan (Vishy) Swaminathan, Gautam GopinadhanM9309 Additional Requirement for Digital Item Processing - Ian Burnett, Gerrard DruryN5329 Final Call for Proposals on Digital Item Processing: Digital Item Base Operations and Digital Item Method LanguageN5330 Requirements for Digital Item Processing: DIM, DIME, DIBO and DIMLN5331 Current Vision on MPEG-21 Digital Item ProcessingN5334 Request for Subdivision ISO/IEC 21000-10 Digital Item ProcessingN5343 Ad-hoc Group on Digital Item ProcessingFollowing the publication of a preliminary Call for Proposals at the Shanghai meeting, a final Call was published at this meeting (N5329) inviting submissions of technology for two components of Digital Item Processing – namely Digital Item Base Operations (DIBOs) and a Digital Item Method Language (DIML). No major changes to the Call were made. A resolution from the meeting was also agreed stating that, within the scope of Digital Item Processing, MPEG also intends to specify 2 further components - namely the interaction of Digital Item Methods with the Digital Item Declaration and a high-level architecture for a Digital Item Method Engine. As MPEG understands that it possesses the necessary expertise to develop these two components ‘in house’ MPEG experts are encouraged to make submissions to the next meeting.Input document M9100 that proposed a new DIP requirement was reviewed and approved:

Requirement:Digital Item Methods (DIMs) shall support the capability for editing (by textual or other means) and modifying of Methods by any User at any point in the value chain.

Note:Enforceable rights may govern access to such capability Input M9207 contained a proposal for using relevant parts of an MPEG-J application engine with appropriate extension and adaptation. The Requirements group heard how MPEG-J defines a framework for embedding programmatic control along with media using a Java Application Engine. The submitters of this input document were advised that they should consider resubmitting the document to the next meeting in response to the Call for Proposals as it contains a proposal for technology that could satisfy some of the DIP requirements.An ‘ad-hoc’ activity between Awaji and Pattaya has been created that will establish the evaluation criteria for responses and conduct the evaluation on 8/9th March 2003.Event Reporting M9102 AHG on MPEG-21 Event Reporting Requirements - F X Nuttall, Andrew TokmakoffM9159 Proposed Usage Scenarios for Event Reporting using a Secure Proof of Purchase - Galuten, Horton, Radbel, WraggM9220 Additional Requirements for Event Reporting – Tsutomu HoriokaM9315 Use case scenario for Event Reporting - FX NuttallN5336 Requirements for Event ReportingN5337 Preliminary Call for Proposals on Event ReportingN5338 Current Vision on Event Reporting in MPEG-21 N5345 Ad-hoc Group on Event ReportingSignificant progress was made during the Awaji meeting to understand the requirements for Event Reporting. The draft requirements produced in Shanghai were extensively expanded to provide for the envisaged functionality that will be required. This was made possible as a result of a significant

40

contribution (M9220) from NTT that provided explicit requirements for Event Reporting that were reviewed and incorporated into the Event Reporting requirements published at this meeting (N5336). Use case scenarios (M9159 and M9315) were also reviewed to further our understanding of the requirements.As the Event Reporting activity is new it merits a short description of the functionality that is envisaged. Every interaction with a Digital Item in the multimedia framework can be called an Event. Arising from each Event, there is the opportunity to describe what occurred. However, there are a number of difficulties in providing an accurate report about an Event. Different observers of an Event may have vastly different perspectives, needs, and focuses. They may emphasize certain elements to the detriment of others, or they may describe an Event in a way that others may find confusing. Currently, there exists no standardized means of reporting Events.

A major challenge for Event Reporting was identified during the discussions leading to the definition of the requirements. This is the problem of constraining the potentially vast number of Event Reports that may be triggered for different purposes on behalf of different Users when a Digital Item is processed by an MPEG-21 Peer. It was therefore suggested that it should be possible for parties responsible for the creation, production and distribution of Digital Items to specify which Event Reports they require to be produced. Such a concept is seen to be directly analogous to the approach taken for expressing the rights associated with a Digital Item and its contents. In this context a Rights Data Dictionary and a Rights Expression Language were identified as the tools that would be necessary to satisfy such an approach. Similarly, therefore, it is proposed that an Event Reporting Dictionary (ERD) and an Event Reporting Language (ERL) may need to be specified. The requirements that have been defined are based upon this assumption.Two processes relating to Event Reporting have been identified for which requirements are defined.

1. The first requires the creator, producer, distributor, or any other party that has the authority to specify Event Report Requests to express, using the ERD-ERL, their requirements for Event Reporting associated with a Digital Item and its parts

2. The second process, which occurs when a Digital Item and its parts are processed by an MPEG-21 Peer, requires the generation and delivery of a Digital Item containing the Event Report itself to a designated party/parties

The level of maturity of the Event Reporting requirements achieved during the meeting led to the decision to publish a draft Call for Proposals on Event Reporting. This will be finalized in Pattaya and submissions will be evaluated in Trondheim in July 2003. An Ad-hoc Group activity between Awaji and Pattaya has been created that will start to establish the evaluation criteria for responses.MPEG-21 IPMPM9101 AHG Report on MPEG-21 IPMP - Craig Schultz, Chris RussellN5344 Ad-hoc Group on IPMPThe study of requirements for MPEG-21 IPMP continued during the meeting although no input documents were received. Discussions during the meeting led to the suggestion that a new IPMP language (with a supporting dictionary of terms) might be necessary to support some of the functionality that is envisaged in MPEG-21 IPMP. A language could be used for:

Describing the functionality and behavior of Peers in respect of IPMP The declaration of IPMP capabilities (i.e. tools, etc) of a Peer Describing the IPMP characteristics of Digital Items Enabling resolution, through DIP, to the security elements of the system

Regrettably it was not possible to approve an output document from this meeting to reflect the discussion about MPEG-21 IPMP requirements. However, an Ad-hoc activity has been created and the informal notes and ideas of individuals will be discussed and consolidated into a document that will form part of the IPMP Ad-hoc group report to the Pattaya meeting.

41

Although the ideas discussed during the Awaji meeting were helpful in identifying some options for IPMP in MPEG-21 a significant amount of work still needs to be accomplished in order to advance this to a specification activity.Reference SoftwareFollowing the high-level principles for the development of Reference Software in MPEG-21 that were published as a Resolution to the Shanghai meeting, a joint meeting with the Integration Group was held to discuss how best to proceed.It was agreed that a different approach to reference software in MPEG-4 and MPEG-7 would be required for MPEG-21. The discussion led to the outline of a plan structured under the following headings:

For what Parts of MPEG-21 is Reference Software needed?Reference software is required for all parts of MPEG-21 (except Parts 1 & 8). The leaders/editors of each MPEG-21 specification should identify their requirements for reference software.For Normative Software:

Establish conformance points within each specification including:o Schema validationo Building software to validate an incoming DID to both the DID schema and the

corresponding validation ruleso Semantic conformance points

For Non-normative software:Develop applications based on use casesCreate a software library for example applications within each use caseCreate an inventory of Reference Software for each part (For DIA see M5180 as an example)

How do we organize Reference Software?Discuss and agree language issues verses web service interfacing

o Do we adopt one or more languages?Do we want contributions of Reference Software? Or do we want to develop code ‘in house’?

o If ‘in house’ do we have participants to do this?Agree a structure for an inventory of Reference Software

How is the development of Reference Software prioritized?This requires further discussion

Who will co-ordinates the development of Reference Software?Rik Van der Walle and Ian Burnett have agreed to co-ordinate the development of MPEG-21 Reference Software within the context of the Integration Group

Finally, it was agreed to adopt one Digital Item Declaration validating parser. Such a parser has already been developed by the Ian Burnett and University of Wollongong who have kindly agreed to make it available to MPEG.

Persistent AssociationM9099 AHG on Persistent Association – Paul Jessop, Niels RumpM9120 Proposed Table of Contents for the Technical Report on “Evaluation of Persistent Association Tools” – Paul Jessop, Niels RumpM9238 Basis Information for Persistent Association Evaluation Criteria - Peter Schirling, Norishige Morimoto, Masto Kurokawa, Ryuki TachibanaN5332 Evaluation Methods for Persistent Association Tools – Working Draft v1.0N5335 Request for Subdivision ISO/IEC 21000-11 Evaluation Methods for Persistent Association TechnologiesN5342 Ad-hoc Group on Persistent AssociationBased on the proposal made in the resolutions to the Shanghai meeting, it was decided to initiate the development of a Technical Report titled “Evaluation Methods for Persistent Association Technologies”.

42

The purpose of the Technical Report is to document best practice in this evaluation. It will allow such evaluations to be conducted using a common methodology. This is intended to give confidence to those relying on the results that they are:

1. Appropriate tests of the technology that will predict its performance under real-world conditions

2. Comparable with results obtained from other tests conducted using the same methodology.For this documentation to be published as a Technical Report by ISO will give credibility to the common methodology that could not be achieved if published by a private body.The main activity during the meeting was to agree on the structure of the Technical Report and its scope. It is proposed that the Technical Report will focus on the evaluation of watermarks and fingerprints when applied to video and audio. Video will include both material captured from real-world scenes and material generated synthetically, such as cartoons. It is expected that the scope of the Technical Report will be enhanced in future to cover other media types including still pictures and text. The Technical Report will describe evaluation methodologies for only some of the characteristics of watermarks and fingerprints. For example, it is not proposed to define methodologies for evaluating the resistance of these technologies to deliberate attack on an association.An Ad-hoc activity was created to further this work until the Pattaya meeting. One important mandate will be to conduct an outreach activity to communicate with organizations that might be interested in this work. Liaison statements will be issued to those organizations that have been identified, informing them about this new work activity within MPEG and asking them to contribute to it by attending a meeting. It is proposed to hold the meeting in the USA on a date to be arranged during February 2003. The following interest groups have been identified from which organizations will be invited:

Vendors of technologies (watermarking products, systems integrators, etc) Rights holders CE Manufacturers Delivery chain participants Academics Law enforcement associations Other standards bodies (AES, ITU-T, etc)

The Ad-hoc group will also identify existing public documents that describe testing methodologies relevant to Persistent Association and evaluate the potential role of testing software.A Resolution from the meeting was agreed to ask SC29 to create a further subdivision of the MPEG-21 standard, Part 11, for the Technical Report. A first Working Draft was produced and it is planned to publish a PDTR at the October 2003 meeting.Binarization in MPEG-21A joint meeting with the Systems subgroup was held to discuss how to proceed with binarization within MPEG-21. The meeting received an informative demonstration about the BiM which illustrated its excellent compression ratios for streamed video in comparison with XML-BiM and XML-ZIP. There was a discussion about what to binarize in MPEP-21 and the need to demonstrate that we can binarize MPEG-21 XML specifications such as the Digital Item Declaration, Rights Expressions, Digital Item Adaptations and so on. It was proposed to produce a test set to understand how the current XML format used in MPEG-21 specifications can be adapted to a binary format. A Resolution from the meeting was agreed recommending that the Systems subgroup initiate an activity to establish what may need to be specified within MPEG-21 in order for Digital Items to be represented in a binary format.Digital Item AdaptationM9140 Tools for end-to-end fully content agnostic digital item adaptation - Debargha Mukherjee, Amir Said, Sam Liu, Geraldine Kuo, Giordano Beretta

43

M9310 Requirements for MPEG-21 XPointer Scheme - Ian Burnett, Gerrard DruryA joint meeting with the MDS subgroup was held to discuss two input documents proposing MPEG-21 DIA requirements.M9140 proposed a new requirement for a Digital Item Adaptation engine supporting scalable bitstreams – “DIA shall support tools for fully content-agnostic efficient, flexible, adaptation of scalable bitstream resources”. There was a discussion about the need for the proposed new requirement that remained unresolved. There was difficulty amongst the group to understand the precise technological solution outlined in the submission from which a requirement is trying to be derived. It was agreed that the submitters will discuss their ideas further within the MDS group and come back to Requirements once the precise requirement has been established.M9310 proposed a requirement for an MPEG-21 XPointer Scheme. This submission further refined a previous submission to the Shanghai meeting (M8979) on the same subject. The requirement satisfies the need to address a specific location in a Resource of Digital Item B that is itself a Resource in Digital Item A. This adds an extra level of indirection to locate a point within a Resource, not just the Resource itself.It was agreed to add the following new requirement (4.6.4.6 in (N5333) to DIA:

Requirement:

Media resource location addressing: MPEG-21 shall support mechanisms allowing addressing of locations within a media resource.

Example:

This includes addressing of media resource locations from within the Digital Item containing the resource, as well as addressing of media resource locations of a resource in a Digital Item when the Digital Item itself may be a resource of another Digital Item.

Note:

A location within a media resource should only be restricted by what is meaningful for the media type of the resource. For example, for video media, a temporal location may be addressed, or a spatial location may be addressed. Also the addressing should support locations that may be either 'point' or 'range' if that has meaning for the type of location being addressed.MDS will consider the impact of the requirement on the existing and emerging specifications (particularly the Digital Item Declaration and Digital Item Adaptation).MPEG-21 ExplorationsM9188 Extending the Use of Digital Items - De Neef, BurnettM9189 Digital Items in Universal Plug and Play - De Neef, BurnettA joint meeting was held with the MDS subgroup to discuss some issues that are new concepts within the MPEG-21 domain. M9188 and M9189 were originally input documents to the Shanghai meeting where they were presented and reviewed by the Requirements subgroup. However, they were re-submitted to the Awaji meeting at the request of the chair of the MPEG-21 Requirements activity in order for them to be discussed in a joint meeting with MDS experts.M9188 - Extending the Use of Digital Items – discusses how Digital Items and Web services distribution language (WSDL) can be used to describe interfaces between MPEG-21 devices.M9189 - Digital Items in Universal Plug and Play - extends the concept of Device Plug and Play. Using the Digital Item Declaration, the owners of a Universal Plug and Play (UPnP) device can add their own descriptors and access permissions. Digital Items could also be used to represent UPnP Device descriptions.

44

No explicit recommendations are made at this time. However, it is always interesting to hear new ideas that can help us to understand the big picture of MPEG-21 and how it might also integrate with other standards. MPEG participants are strongly encouraged to bring these sorts of ideas and submit them for discussion at MPEG meetings.Explorations 3DAV Coding 3DAV SeminarA seminar on 3DAV with about 60 participants was held the Sunday before the 63rd MPEG meeting. The seminar included 7 invited talks and a discussion panel. The intention was to further promote the 3DAV activity by inviting well-known speakers from the relevant scientific fields to express their views in this event and maybe join 3DAV activities after. The programme of this seminar is included in N5241. The outcomes of the Seminar have been analyzed concluding that 3DAV requirements are already rather complete and no holes exist in terms of the needs of the relevant application domains.

Joint meeting with the Requirements, Video and SNHC subgroupsThis joint meeting addressed first the contributions related to requirements and after the contributions related to specific technology.

Requirements m9097 AHG on 3DAV Coding, Aljoscha Smolic, Ryozo Yamashita

m9217 Requirements on stereo matching, compression of depth maps, and generation of new viewpoint video from the viewpoint of possible contribution and primary/secondary distribution of multiview television, Ryoichi Kawada, Sei Naito, Atsushi Koike, Masahiro Wada, Shuichi Matsumoto

Since there were no new requirements proposed by this contribution, the application case addressed was included in the Applications and Requirements for 3DAV document.

m9256 Requirement for very high resolution video in 3DAV, Aljoscha Smolic, David McCutchenFollowing this contribution, a new requirement was included in the Applications and Requirements for 3DAV document:

Very high resolution videoVery high resolution video, i.e. 4000x4000 pixels, should be supported in order to provide sufficient resolu-tion of rendered views, e.g. in an omni-directional video scenario.

m9332 On requirements for 3DAV mobile communications, Ramona Zaharia, Leszek CieplinskiFollowing this contribution, some clarifications were added to some of the existing requirements in the Applications and Requirements for 3DAV document.

Exploration Experiment 1:m9184 Report of EE1 on Omni-directional Video, Kazumasa Yamazawa, Hitoshi Habe, Toshio Nomura, Takashi Matsuyama

m9273 Representation of Panoramic and Omnidirectional Images, Dan Lelescu, Frank BossenExploration Experiment 2:

m9145 EE2 - Comparison of Model-based Scene Reconstruction and Rendering Methods, Christian Theobalt, Bastian Goldluecke, Marcus Magnor, Ming Lim9238 Quantitative Evaluation of Ray-Space Interpolation, Masayuki Tanimoto, Toshiaki Fujii

45

m9298 Proposed Evaluation Procedure for EE in MPEG 3DAV, Hanspeter Pfister, Huifang Sun, Anthony Vetrom9300 Image-Based Visual Hull as a Model Reconstruction Method for EE2 in MPEG 3DAV, Hanspeter Pfister, Huifang Sun, Anthony Vetro

Exploration Experiment 3:m9128 Experiment Evaluation about Motion Compensation of MAC for stereoscopic, Zhibo Chen, Guoping Li, Yun Hem9186 Report for EE3 in MPEG 3DAV, Sukhee Cho, Kugjin Yun, Byungjun Bae, Youngkwon Hahm, Chieteuk Ahn, Yongtae Kim, Kawnghoon Sohn

Exploration Experiment 4:m9219 Distribution of ATTEST test sequences for EE4 in MPEG 3DAV, Christoph Fehn, Klaas Schaar, Ingo Feldmann, Peter Kauff, Aljoscha Smolicm9222 Preliminary Results on EE4 of the 3DAV AHG, Michael Schuldt, Marco Rittermann

The contributions above regard the results for the exploration experiments defined at last MPEG meeting and were presented in a joint meeting between the Requirements, Video and SNHC subgroups. These contributions propose new tools to address the 3DAV requirements or study the performance of already existing MPEG tools organized in 4 exploration experiments:1. Spherical/Omnidirectional Video2. Free Viewpoint Video - Ray Space Representation, Light Fields3. Stereo Video Coding4. Disparity-Based Intermediate View Interpolation

These experiments evaluated the suitability of available MPEG-tools and new tools for the envisaged applications; document N5169 from last MPEG meeting defined the experiments which results were presented at this meeting.

It was concluded that MPEG-4 already provides most tools needed at least for EE1, EE3 and EE4. Regarding EE2, MPEG-4 AFX seems to provide the solution for the light fields scenario, while the ray space scenario needs further study. Following these studies, new MPEG-4 profiles and levels may be needed to address the needs of the relevant application domains.

The 3DAV activities allowed concluding that there is a significant lack of knowledge inside and outside MPEG regarding some MPEG-4 capabilities, notably those related to 3D environments. For a lot of people MPEG-4 is only another video codec. For this reason, it was decided to start working towards the preparation of a promotional CD/DVD which should include documents explaining how MPEG-4 cane provide solutions for the 3D applications, software with some demo applications and test material. This task was included in the mandates for the AHG on 3DAV coding.Following the discussions, the Status of Exploration Experiments document was updated and the definition of the exploration experiments changed.Digital Cinema (Joint Meeting with the Test subgroup)m9098 Report of the AHG on Digital Cinema, W. HusakThe Digital Cinema break out group met to discuss the situation of Digital Cinema activities at light of recent relevant inputs/events, notably the Digital Cinema Initiative (DCI) feedback regarding this MPEG activity. Considering the available feedback, it was concluded that at this stage, there is no request/support to start any further technical work specific to digital cinema and thus MPEG waits for further developments.

The group considered that major outcomes of this first working period were:

The Digital Cinema Requirements document which is stable, did not need updating at this meeting.

The test methodology and workplan developed for digital cinema which needs to be finalized.

It was also considered that there are MPEG ongoing activities where digital cinema people/requirements may have an impact, e.g. scalable coding, MPEG-4 AVC. Following the conclusions, it was decided to discontinue the AHG on Digital Cinema.

46

Scalable Video CodingThe contributions related to applications and requirements for scalable video coding were discussed in two meetings one of them jointly with the Video subgroup.m9076 AHG on Scalable Video Coding, Mihaela van der Schaar, C.J. Tsai, Touradj EbrahimiThe activities and recommendations of the AHG were reviewed.

m9197 Proposal of Applications and Requirements for Scalable Video Coding, Hyun-Cheol Kim, Kyuheon Kim

This contribution proposed a region of interest based scalability requirement which was added to the Applications and Requirements for Scalable Video Coding (N5327) as:Region of interest scalabilityRequirement:Scalable coding shall support a mechanism that permits region of interest scalability. ExampleFor instance, a user may desire that a certain region of the video should be displayed at a higher quality than the rest of the display. Region of Interest scalability allows the user to preferably obtain the higher quality at the desired region on the screen under the available bandwidth.

m9246 Applications and Requirements for Multiple Description Scalable Coding, Deepak Turaga, Mihaela van der Schaar, John Apostolopoulos, Susie Wee

This contribution proposed various requirements associated to multiple description coding. It was decided to extract from this contribution the requirements associated to the functionalities requested, independently of the technology used. This led to the following new requirements: Robustness under “best-effort” networks Requirement:Scalable coding should support a mechanism that enables robustness under “best-effort” networks, where all packets are treated equally and may be lost with equal probability. ExampleFor instance, video streaming over the conventional best-effort Internet or video over 802.11b best-effort wireless networks. For instance, a video can be coded using multiple description scalable coding to provide robustness under “best-effort” networks.

Robustness under “best-effort” networks, specifically in the presence of server and path diversity Requirement:Scalable coding should support a mechanism that enables improved performance over “best-effort” networks when using server and/or channel diversity. ExampleFor instance, a video can be coded using multiple description scalable coding to provide robustness under “best-effort” networks and/or networks using server and/or path diversity. For example, the distributed infrastructure of a content delivery network may be used to stream video from multiple servers and over multiple paths to each client, thereby overcoming problems afflicting a single server or a single path.

m9335 Object Based Scalable Video Applications, Gus Reid, Paola HobsonThis contribution proposed a object based scalability requirement which was added to the Applications and Requirements for Scalable Video Coding (N5327) as:Object based scalabilityRequirement:Scalable coding should support a mechanism that enables object-based scalability. Objects can be arbitrary shapes, and may be supplied in separate bitstreams.

47

ExampleFor instance, a video scene may be composed of streams defining multiple objects that may be viewed on a variety of devices experiencing different network conditions.

It is important to highlight that having an object based scalability requirement does not mean that all decoders will be object-based as does not happen for MPEG-4 since different profiles will include different tools depending on the needs of the various relevant application domains.

m9261 Evaluation of Adaptive Video Coding and Transmission Technologies, P. Amon, J. Pandel, A. Hutter, G. Bäse

This contribution was briefly discussed because there was nobody available to present it. It was considered that this contribution provided relevant input in terms of the evaluation criteria to compare the answers to the next Call for Evidence on scalable video coding technology.

The workplan for this activity includes a Draft Call for Evidence on scalable video coding at this meeting, a Final Call for Evidence at the next meeting with the evaluation at the July MPEG meeting. As a result of this MPEG meeting, the Application scenarios and requirements document was significantly improved (N5327). Moreover the AHG on Scalable Video Coding will keep to complete and improve this document.

On-Line Gaming – OLGA (Joint Meeting with the SNHC & Systems subgroups)m9094 AHG on On-line gaming (OLGA), Marius Preda, Michael Steliaros

m9169 Call onProposal on requirements and a straw man architecture of 3D graphics for constraint devices, Itaru Kaneko, Junya Tsutsumi, Mark Callow

The topic of On-Line Gaming also known as OLGA was addressed in a joint meeting between Requirements, SNHC and Systems. Regarding the second contribution addressing mobile terminals, it was agreed that the existing MPEG-4 standard may already provide the solution for these applications notably if the necessary profiles (with an acceptable complexity) are specified and two additional requirements are addressed: MPEG-4 shall support APIs to access synchronization information related to elementary

streams MPEG-4 shall support APIs to access audio, video, BIFS and other data coming from

elementary streamsTechnical contributions addressing these requirements are requested from the next meeting. Contributions describing how MPEG standards can be used for on-line gaming applications are also welcome. However since no specific tasks regarding on-line gaming were identified at this stage, the AHG on OLGA was discontinued.

48

Annex 5Report of Systems meeting

Source: Systems Chair and Break-out group ChairsContributors: Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Jan Van der Meer (Philips), Craig A. Schultz (AccessTickect), Young-Kwon Lim (net&tv), Claude Seyrat (Expway), David Singer (Apple)

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title Subgroup Available TBP13818-1 Systems

N5463 DoC on ISO/IEC 13818-1:2000/FPDAM1 Systems No 2002/12/13N5464 Study DoC on ISO/IEC

13818-1:2000/FPDAM2Systems No 2002/12/13

N5465 Study Text of ISO/IEC 13818-1:2000/FPDAM2

Systems No 2002/12/13

N5466 DoC on ISO/IEC 13818-1:200/PDAM3 Systems No 2002/12/13N5467 Text of ISO/IEC 13818-1:200/FPDAM3 Systems No 2002/01/17

13818-11 Systems N5468 Study DoC on ISO/IEC 13818-11/FCD Systems No 2002/12/13N5469 Study Text of ISO/IEC 13818-11/FCD Systems No 2003/01/06

14496-1:2001/Amd.4 SL ExtensionN5470 DoC on ISO/IEC 14496-1:2001/FPDAM4 Systems No 2002/12/13N5471 Text of ISO/IEC 14496-1:2001/FDAM4 Systems No 2003/01/13N5472 Items for corrections of ISO/IEC 14496-1 Systems Yes 2002/12/13

14496-1:2001/Amd.7 AVC in MPEG-4 Systems

N5473 DoC on ISO/IEC 14496-1:2001/PDAM7 Systems No 2002/12/13N5474 Text of ISO/IEC 14496-1:2001/FPDAM7 Systems Yes 2003/01/13

14496-1:2001/Amd.8 ATGN5475 WD 3.0 of ISO/IEC 14496-1:2001/Amd.8 Systems Yes 2002/12/20N5476 Core Experiments on ATG Systems No 2002/12/13N5477 Results of the call for Proposal on Font

format representation and font compression technology

Systems No 2002/12/13

14496-1:2001/Amd.9 MPEG-7 in MPEG-4 Systems

N5478 WD 3.0 of ISO/IEC 14496-1:2002/Amd.9 Systems Yes 2002/12/2014496-11 Scene Description

N5479 Request for ISO/IEC 14496-11/Amd.1 Systems No 2002/12/13N5480 Text of ISO/IEC 14496-11/FDAM1 Systems Yes 2003/01/20N5481 Items for corrections of 14496-11 Systems Yes 2003/01/20

14496-15 AVC File FormatN5482 DoC on ISO/IEC 14496-1:2001/PDAM7 Systems No 2002/12/13N5483 Text of ISO/IEC 14496-15/FCD Systems Yes 2003/01/13

15938-1 SystemsN5484 WD 2.0 of ISO/IEC 15938-1/Cor1 Systems No 2002/12/13

49

N5485 Request for ISO/IEC 15938-1/Amd.1 Systems No 2002/12/13N5486 Text of ISO/IEC 15938-1/PDAM1 Systems Yes 2003/01/13N5487 Core Experiments for Systems Extensions Systems No 2002/12/13N5488 Technology under consideration for 15938-

1/Amd.1Systems No 2002/12/13

50

General issuesGeneralThe meeting report (M9113) has been approved.

M9203: Editorial comments (all accepted and to be taken into account in the 3 rd Edition). Technical comments: (1) AudioBuffer : re-buffering is done when length field is changed but not when it is updated to the same value. Changing the semantic of the length field would break the current BIFS model and the ref. soft. Add text clarifying how to force re-buffering (ex : changing the length 2 times or delete and re-insert the node). (2) Length is marked as exposed field in the node definition but at exposed field in Annex H. Change the text so that it reflects Annex H. In the exposedField level of the Hierarchical3DMesh node: default value is missing and should be set to 1. Comments sent to Yuval for introduction in the 3 rd edition (2002-12-10).

Discussion on event model: re-statement on the importance to have deterministic event model in MPEG-4. Contributions on non-pathological cases and solutions to improve determinism in such cases are welcomed.List of standards under development

Pr Pt Edit. Project Description CfP WD CD FCD FDIS2 1 2000 Amd.2 Support of IPMP on

MPEG-202/03 02/07 03/03

2 1 2002 Amd.3 Carriage of AVC 02/05 02/12 03/072 11 2002 1st Ed. IPMP on MPEG-2 Systems 02/03 02/07 03/034 1 2002 Amd.7 Use of AVC in MPEG-4

Systems02/07 02/12 03/07

4 1 2002 Amd.8 Advanced Text and 2D Graphics

02/07 03/03 03/07 03/12

4 1 2002 Amd.9 Use of MPEG-7 in MPEG-4 02/07 03/03 03/07 03/124 15 2003 1st Ed. AVC File Format 02/07 02/12 03/077 1 2002 Cor.1 Systems Corrigendum 02/12 03/03 03/077 1 2002 Amd.1 Systems extensions 02/03 02/07 02/12 02/03 03/0721 9 200x 1st Ed. File Format 02/07 03/03 03/07 03/12

Latest references

Pr Pt Standard Issue No. Published2 1 ISO/IEC 13818-1:2002 (MPEG-2 Systems 2nd

Edition)00/12 2000/12/01

2 1 ISO/IEC 13818-1:2000/COR1 01/01 Pisa N3844 2002/03/012 1 ISO/IEC 13818-1:2000/COR2 01/12 Pattaya N4404 2002/12/012 1 ISO/IEC 13818-1:2000/Amd.1 02/10

ShanghaiN5270 Not

4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) 02/10 Shanghai

N5277 Not

4 1 ISO/IEC 14496-1:2001/Amd.3 (MPEG-4 IPMP Extensions) 02/10 Shanghai

N5282 Not

4 1 ISO/IEC 14496-1:2003/Amd.1 (SL Extensions) 02/12 Awaji N5471 Not4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) 02/03 Jeju N4712 Not

51

4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description)

02/10 Shanghai

N5278 Not

4 11 ISO/IEC 14496-11/Amd.1 (Multi-user and AFX) 02/10 Awaji N5480 Not4 12 ISO/IEC 14496-12 (ISO Base Media File

Format) 02/10 Shanghai

N5295 Not

4 13 ISO/IEC 14496-13 (IPMP-X) 02/10 Shanghai

N5284 Not

4 14 ISO/IEC 14496-14 (MP4 File Format) 02/10 Shanghai

N5298 Not

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) 01/07 Sydney N4285 2002/07/067 2 ISO/IEC 15938-2 (MPEG-7 DDL) 01/07 Sydney N4288 2002/02/02

DemonstrationsThe following demonstrations have been made: M9248: Demonstration of cartoons coded in MPEG-4. Exploit the new graphical

capabilities developed in ATG. M9301: Game example implemented in MPEG-4. Claude Seyrat (Expway): BiM Software: BiM performances compared to XML or

XML+zip in various environments (broadcast, Web services). Filippo Chiariglione (MSRA): IPMP-X implementation: presentation of current

status of the reference software.Web siteVolunteers needed to develop and maintain Systems Web site.FAQThe FAQ were updated as needed.AOBNone.

MPEG-2 Systems (13818-1)13818-1:2000/Amd. 2Topics

IPMP1. IPMP Tool Representation and Communication Systems mapping on MPEG-2 Systems

ContributionsIPMP

M9122: See DoC. 13818-1:2000/Amd. 3Topics

Carriage of AVC Content in MPEG-2 SystemsContributions

Carriage of AVC Content in MPEG-2 SystemsNo contributions.AVC carriage issues addressed with AVC on MP4 and AVC in MPEG-4 Systems.

Issues:

52

Variable length coding of fields P&L : solved (will be fix length) : 8 bits. Create editing teams.13818-11Topics

IPMP Extensions in MPEG-2 SystemsContributions

IPMP Extensions in MPEG-2 SystemsAssessment of the opportunity to delay the IPMP-X/2 specification to accommodate more customers or to do a more complete job: Opportunity: DVB and TV-Anytime are completing their requirements; we could see

how we can accommodate them if we delay until march; Risk: a company will be hurt by the delay (no, no one will be hurt).Decision: We delay issue of MPEG-2 IPMP-X (ISO/IEC 13818-1, ISO/IEC 13818-11 until March). In March, we assess the requirements of DVB and TV-Anytime and see if something can be done to accommodate them.

M9123: See DoC.MPEG-4 Systems (14496-1)

14496-1:2001/Amd. 4Topics

Scene Description2. Multi-user applications3. Animation Framework Extension

Elementary Stream Management4. FlexMux Extensions

ContributionsScene Description

Decision on the organization of the work between SNHC and Systems:SNHC: Representation of 3D objects, specific animation mechanisms for those 3D objects, node interface and coding to integrate these 3D objects with the MPEG Scene Description, XMT representation of those nodes. This will be specified in Part 16 of the MPEG-4 standard.

Systems: Representation of 2D and 3D Scene Description, representation of 2D objects, generic animation mechanisms for 2D and 3D objects, node interface and coding to integrate these objects with the MPEG Scene Description, XMT representation of those nodes. This will be specified in Part 11 of the MPEG-4 standard.

Issues for Joint MeetingsOpportunity to define specific/generic Animation mechanismOpportunity of new node coding mechanisms

The Amd.4 will be split accordingly in:- 14496-1 Amd.4- 14496-11 Amd.1- 14496-16

53

M9125: See SNHC meeting report.

M9237, M9236: Results of the CE on synthesized texture. The Core Experiments on Synthesised Texture reports that Vimatix technology is 3 times better than standard BIFS coding for Synthesized Texture type of content. This is much less than the 12 times gain that was announced in Shanghai. The optimisation efforts performed by Vimatix between the Shanghai meeting and the Awaji meeting with the help of BIFS experts have proven to be successful. Still, it would be adventurous for MPEG to promote a technology to final stage knowing that it is still 3 times inferior than a proprietary technology already deployed on the market and that a 4 times optimisation gain has been reached during a 7 weeks period. The Systems sub-group, in accordance with Belgium NB, therefore recommends to:

Delay the promotion of this technology and further carry its development within ISO/IEC 14496-1 Amd.8 (Advanced Text and Graphics);

Continue the Core Experiments on Synthesised Texture with the purpose of assessing what technology is at the source of the remaining 3 times gain and assessing how this technology can be integrated in BIFS;

Propose a course of action at the next MPEG meeting based on the assessment done in the CE.

M9156: Comments accepted. Will be integrated in the ATG spec.

M9304: Corrigendum items for XMT (will go in a draft WD) and amendment items for XMT (will go in ATG).

M9265: Limited Usefulness of Sound2D node. 4 solutions to improve this. The second one (change the semantic of the y axis to z axis) is the best one: chip solution to achieve spatialisation using existing systems. Text to be provided by the audio group to Jean-Claude for inclusion in the items for corrigendum of ISO/IEC 14496-11.

M9204: Proposals for Audio BIFS Version 3. Will be developed further by the audio group. Opportunity to standardize this in the ATG amendment (CD in March).

M9234: Improvements for WD 2.0 on ATG. All accepted.

M9239: Metric Compatibility and Resident Fonts in MPEG-4 terminals. Check if AFM files is an ISO standard. If so, we will be able to include the AFM files as reference of the resident font metrics.

M9326: MPEG Font Evaluation Criteria. Could have been used if further CE had been needed. But not the case. No action needed.

Elementary Stream ManagementM9319: Study of the SL extension.+ Implementations are already integrated to IM1. + Proposing editorial corrections for the specifications. (accepted)+ Proposing a flag to signal the existence of extension description (accept second proposal in the contribution).+ Storing some number of dependency information could be useful for IPMP key management. This should be checked with IPMP people.

54

M9291: SL Extension. Proposing to have AUSeqNum for each SL packet. It could be useful for the case of loosing all the SL packets belong to one AU and the first fragment of the next AU. But this does not seems to be required always since codec layer itself can signal it. Current MPEG-4 video specification also supports it.

M9293: ESI Interface/SL layer coherence. Various misalignment between ESI and SL are identified. Proposing corrections and modifications to ESI. Accepted for the corrigendum or amendment.

M9294: Problem of synchronization between FlexMux RTP stream and other RTP stream was raised at the IETF meeting. Needs more clarification on the meaning of FCR and its relationship with DTS and CTS. IETF people are concerned about the possibility of loosing dynamic update of FlexMux configuration.

14496-1:2001 Amd.7Topics

Elementary Stream Management5. Use of AVC in MPEG-4 Systems

ContributionsElementary Stream Management

We processed all the NB comments, including those held over from the last meeting, and all the input contributions.  We have a number of difficult open design issues, which will be detailed in the revised document. We are agreed on how to split the current single document into a file-format specification, and a carriage in MPEG-4 specification. We have DOCR prepared and will prepare FCD by the end of January, presuming that that gives us enough time to read and reconcile with the JVT specification.

Signaling of P&L: We need to support the signaling of P&L of AVC (2 dimensional spaces). Currently we only have a one dimensional space.

Branding of AVC file format: It will be void and inherited from the systems layer in which the AVC content is used (ex:MP4, 3GPP). See specific text in the spec.

DSI and AU definition: It is preferable to have adaptation of AVC to MPEG-4 system including definition of AU and DSI as an annex of AVC specification itself. If it is not possible, those will be defined in AVC file format specification and AVC in MPEG-4 systems specification will refer it.

M9289+ Same size for all NALUs in the same ES seems not very efficient because NAUs not containing video data will be relatively small. Proposing variable length coding of NALU size field. It is hard to make a decision since we don't know the statistics of the size of NALUs. But the proposal seems to be more flexible and efficient. Needs more study.+ Proposing dynamic update of DSI. But it is not accepted because there are already sufficient ways of sending dynamic update of parameter sets.

M9228+ Since timing SEI messages are nor allowed to be stored in MP4 file, vcl_hrd_parameters_present_flag should be modified when it is stored. This may cause

55

conformance problem. Proposing to allow timing SEIs in MP4 file to solve this problem. But this may cause another problem because timing SEI message have not only HRD parameters but also display timing messages. We need to separate timing SEI messages to several specific SEI messages to solve this problem+ Currently only IDR pictures can be sync samples. But marking I-pictures as a sync sample is useful for random access. Generally this is acceptable but we need more investigation about sample type identification. And this problem is also related to RAP in SLPH.

M9229: Proposing to introduce Sample Header Box & AVCMultiAURecord to store multiple AUs as one sample. The rationale behind this is making seeking operation faster when it is stored in optical disk. Need more detailed investigation. This will be a mandate to the AHG.

Discussion on MPEG-2 carriage+ Currently AVCon2 specifies the order of various NALUs differently from AVCon4 specification. Major difference is the position of picture delimiter NALU. Basic ordering (semantics) of NALUs shall be common between MPEG-4 carriage and MPEG-2 carriage although syntax is not exactly same because of start codes in MPEG-2 and NALU size in MPEG-4. Harmonization work is needed.+ According to MPEG-2 specification, the first NALU of the current picture is the next one after the last one from the previous picture.+ Profile & Level indication should be fixed length. (Done.)+ Picture timing SEI contains HRD parameters. This is conflict with the rule not allowing picture timing SEIs in the AU for AVC in MPEG-4.

M9218: There is no referencing among the pictures in the same layer. Only the picture in the lower layers can be referenced. Accepted proposed modification on subsequence layering.

M9286: See DoC.

M9138: Withdrawn.

14496-1:2001 Amd.8Topics

Scene Description6. Advanced Text and 2D Graphics

ContributionsScene Description

M9130, M9165: Response to the CFP for font format representation.M9165 Open Issues: Compaction: Table comparison: we need to understand what exactly is in the

resulting PFR file and the size of the original size with the same information. Hints: where hints are stored? What types of hints and spec. of those hints. And spec. Advanced features: What features are supported and how? Glyph def. Data, Glyph

sub. data, as described in the Open Type Advanced Typographic Table. Rendering on interlaced screen: Post filtering. No need to standardize this.

See assessment in output doc. “Results of the call for Proposal on Font format representation and font compression technology”.

56

14496-1:2001 Amd.9Topics

Elementary Stream Management7. Use of MPEG-7 in MPEG-4 Systems

ContributionsElementary Stream Management

None. Document revisited. Input needed to complete the specification.14496-15 AVC File FormatTopics

Elementary Stream Management8. AVC File Format

ContributionsElementary Stream Management

See section on AVC in MPEG-4 Systems.

14496-11 Exploratory activityTopics

MPEG-J9. APIs to access sync. information and elementary stream data.

Items for CorrectionsContributions

MPEG-JM9169, Olga: See Requirements report. Contributions welcomed in the area of MPEG-J extension for synchronization and use media data in MPEG-J applets.

Items for CorrectionsM9337: Items for Cor. To be studied in AHG.

MPEG-7 Systems (15938-1)GeneralJoint with Audio – Binarization of audio descriptionsIt was agreed that uniform quantization will be included in the 15938-1/Amd 1. Other quantization method will continue to be evaluated under the framework of a core experiment.

Joint with Requirements – MPEG-7 Schema ProfilingThe profiling of MPEG-7 is based on a schema approach. Meaning one profile schema defines one profile. The group presented the first profile schemas and tools to help schema designers. The profile and level issue signaling remains an issue that must be tackled.

Joint with MPEG-21 Requirements – Binary encodingThe group decided to evaluate the use of BiM for MPEG-21 descriptions. For that purpose a first scenario (the encoding and use of binarized REL description) must be evaluated. The MPEG-21 group provided first testsets.

Joint with MDS - schema versioningThe MDS group has a versioning problem. It requires the help of the DDL group to evaluate the best strategy to manage schema evolution. A mandate will be added to the MPEG 7 systems and DDL AHG.

57

Joint with Requirements - BiM ProfilingProfiles must be defined in terms of application spaces and must exclude features based on their complexity. The process to define profiles and levels is described in N4671 (Jeju). Profiles are welcomed for the next meeting.15938-1/Cor1Topics

MPEG-7 Systems CorrigendumContributions

MPEG-7 Systems CorrigendumFew corrigenda items have been identified during the meeting. Moreover, few corrigendum items identified at the last meeting have been solved during the meeting. A new working draft has been produced including these improvements.15938-1/Amd 1Topics

MPEG-7 Systems extensionsProfiles

ContributionsMPEG-7 Systems extensions

M9199 - The contribution presents the results of the core experiment related to codec management framework. The core experiment didn’t prove the need for reconfiguration at element level and suggests adopting a reconfiguration mechanism occurring at FU Level, until further use cases are identified. The group decided to adopt the contribution. Moreover, the group decided also to adopt the Zlib codec as described in contribution m8699 as well as the uniform quantizer as described in m9157.

M9244 - The contribution presents a solution to transmit schema information with minimum decoder complexity. Both contributions present a solution to transmit schema information while minimizing decoder complexity. The solution has been merged with M9264. The merged contribution has been adopted in the technology under considerations document.

M9264 - The contribution presents a solution to transmit schema information with minimum decoder complexity. Both contributions present a solution to transmit schema information while minimizing decoder complexity. The solution has been merged with M9244. The merged contribution has been adopted in the technology under considerations document.

M9254 - The contribution presents the results of the multiple description stream core experiment. Several use cases have been identified: scalable descriptions (hierarchical, interleaved), multi source description, description fragment variations and shared descriptions and posteriori stream update. Several technical requirements have been proposed to satisfy these use cases, several open issues have been identified. The group decided to continue the core experiment. A technical solution must be provided BEFORE the next meeting due to time constraint.

M9240 - The contribution presents a stream indexing mechanism based on TV-Anytime approach but supporting in general MPEG-7 descriptions. The group agreed that the technology can provides enhanced functionalities to the MPEG-7 Systems specification. The

58

group decided to evaluate how the technology can be integrated in the overall MPEG-7 Systems framework. This evaluation must be completed before the 64th meeting and will be done under the framework of a core experiment.

M9297 - The contribution presents the results regarding the compression of graphs. It shows that the proposed technology works well on sparse graph but has a little benefit on very dense ones. Further work is required and the audio core experiment must continue.

M9157 - The contribution presents the results of the core experiment about quantization. The results show that the loss due to quantization has no impact on use of the descriptor. The group decided to adopt the uniform quantization in the systems specification with some slight modifications The core experiment will continue to evaluate other quantization schemes (non-uniform, logarithmic).

M9198 - The contribution presents the support of mixed content model in the FU payload. The proposed solution will be included in the technology under considerations document.

M9241 - The contribution presents the support of mixed content model in the FU context path. The proposed solution will be included in the technology under considerations document.

M9235 - The contribution presents an improved support of fragment references in the FU payload through the use of deferred nodes. The group reviewed the contribution and believes that the technology is more generic solution than the one being implemented into the CD. Because of this, and because the technology fits well into the ISO/IEC 15938-1 specification using deferred nodes, the group decided to evaluate the solution under the framework of a core experiment.

MPEG-7 Systems Profile

M9185 – The contribution proposes a BiM profile. The group confirmed that BiM profiles should be defined in terms of application scenarios not in terms of versions of the standard. The BiM profiles should be included into the MPEG-7 profile part of the standard. BiM profiles should be proposed according to the guideline defined in N4671.

MPEG-21 (21000)21000-9Topics

File FormatContributions

File FormatM9276: Static metadata for file format. Structural part accepted. Rationalization with IPI requested. Editor to upgrade the WD on MPEG-21 File Format accordingly.

59

21000 Exploratory ActivitiesTopics

ArchitectureBinarisation

ContributionsArchitecture

None.Binarisation

None. Issue discussed in joint meeting. Architecture implication to be studied. Inputs needed.

60

Unpublished Systems Standard

Standard Title Status Document with

Purpose TopicsNo.

MPEG-2 Systems

13818-1:2000/Amd.1

Generic coding of moving pictures and associated audio information: Systems Amendment 1

FDIS 2002-10-25 ITU-TFinal edits. Prepare FDAM text.

Elementary Stream Management Carriage of Metadata in MPEG-2 Systems.

MPEG-4 Systems

14496-1:2001/ COR1

Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM1

DCOR ballot : from ‘01-02-09 to ‘01- 05-09COR : ‘01-07-20

EditorTo be consolidated to 3rd Edition Miscellaneous correction to 14496-1

14496-1:2001/Amd.2

Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Textual Format

FDAM (Jeju w4698)2002-03[Editor's submission (FDAM and DOCR):2002-06]

EditorTo be consolidated to 3rd Edition

MPEG-4 Textual Format10. XMT-A11. XMT-

Scene Description12. Media Sensor13. MediaControl14. MediaBuffer15. MatteTexture

Elementary Stream Management16. OD Framework additions (OD execute,

Segment Descriptors)17. MP4 additions

Profiles and LevelsBasic2D, Core2D, Main2D, Advanced2D (Scene Graph and Graphics) profile.

14496-1:2001/Cor2

Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM2

Cor2 2002-10-25 EditorTo be consolidated to 3rd Edition Miscellaneous correction to 14496-1

14496-1:2003 Coding of audio-visual objects --Part 1: Systems Editor 3rd Edition

MPEG-4 Systems Edition 2003: Integration of 14496-1:2001, 14496-1:2001/Amd.1, 14496-1:2001 COR 1, 14496-1:2001/Amd;2, 14496-1:2001 COR2

61

Standard Title Status Document with

Purpose TopicsNo.

14496-1:2001/Amd.3

Coding of audio-visual objects --Part 1: Systems Amendment 3 FDAM 2002-10-25 Editor Final Edits IPMP Extensions

14496-1:2003/Amd.1

Coding of audio-visual objects --Part 1: Systems Amendment 1 FDAM 2002-12-13 Editor Final Edits SL Extensions

MPEG-4 Transport of MPEG-4 over IP Networks

14496-8 Coding of audio-visual objects --Part 8: Transport of MPEG-4 over IP Network (14496-8)

FDIS (w4712)2001-12-07

Young-Kwon

Integrate IETF comments

IETF RFC for transport of MPEG-4 over IPFramework for the carriage of MPEG-4 content over IP network.

MPEG-4 Scene Description and Application Engine

14496-11 Coding of audio-visual objects --Part 11: Scene Description and Application Engine 2002-10-25 Yuval 3rd Edition

BIFSXMTMPEG-J

14496-11/Amd.1

Coding of audio-visual objects --Part 11: Scene Description and Application Engine Amendment 1

2002-12-13 Editor Final editing Multi-user and AFXMPEG-4 ISO Base Media File Format

14496-12 Coding of audio-visual objects --Part 12: ISO Base Media File Format 2002-10-25 David Final Edits File Format

MPEG-4 IPMP Extension

14496-13 Coding of audio-visual objects --Part 13: IPMP Extension 2002-10-25 Craig Final Edits IPMP Extension

MP4 File Format

14496-14 Coding of audio-visual objects --Part 14 : MP4 File Format 2002-10-25 David Final Edits MP4 File Format

62

Published Systems Standard

Standard Title Status TopicsMPEG-2 Systems

13818-1/Amd.7Generic coding of moving pictures and associated audio information: Systems AMENDMENT 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1

Published 2000-12-01

Elementary Stream Management MPEG-4 Over MPEG-2

13818-1:2000Generic coding of moving pictures and associated audio information:Systems

Published 2000-12-01 MPEG-2 Systems Edition 2000

13818-1:2000/COR1Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 1

published on 2002-03-01

Elementary Stream Management FlexMux Descriptor

13818-1:2000/COR2Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 2

published 2002/12/01

Elementary Stream Management Buffer model for PID2.

MPEG-2 DSM-CC

13818-6/COR1Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 1

Published 1999-12-01

Elementary Stream Management Editorial correction

13818-6/Amd.3

Generic coding of moving pictures and associated audio information --Part 6: Extensions for DSM-CCAMENDMENT 3: Transport buffer model in support of synchronized user-to-network download protocol

Published 2001-12

Elementary Stream Management Transport buffer model in support of synchronized user-to-network download protocol.

13818-6/ COR2Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2

Published 2002 Q3

Elementary Stream Management Editorial correction

13818-6/ Amd.1:2000/COR1

Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2

Published 2002 Q3 Elementary Stream Management

Editorial correctionMPEG-4 Systems

14496-1 Coding of audio-visual objects – Part 1: Systems Published1999-12-15

Elementary Stream Management Systems Decoder Model Object Descriptor Framework Synchronization of Elementary streams Multiplexing of Elementary streams Object Content Information IPMP

Scene Description BIFS

Syntactic Description Language

63

Standard Title Status TopicsMPEG-2 Systems

Profiles and Levels

14496-1:1999/Amd.1 Coding of audio-visual objects –Part 1: SystemsAMENDMENT 1: Systems extensions

Published 2001-11

Elementary Stream Management MPEG-4 File Format (MP4)

Scene Description Application Window as a BIFS node Advanced Audio BIFS Material Keying Advanced coding (PROTO, Integration of Mesh, coding of Mfield).

Application Engine (MPEG-J)Profiles and Levels

14496-1:1999/COR1 Coding of audio-visual objects – Part 1: SystemsTECHNICAL CORRIGENDUM 1

Published 2001-11 Miscellaneous correction to 14496-1

14496-1:2001 Coding of audio-visual objects --Part 1: Systems

Published 2001-11

MPEG-4 Systems Edition 2001 Integration of 14496-1, 14496-1/Amd.1, 14496-1 COR 1

14496-1:2001/Amd.1Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Extended BIFS

Published2001-10

Elementary Stream Management Flextime Rebufering

Scene Description Flextime nodes ServerCommand ExternProto Advanced BIFS Coding

Profiles and LevelsMPEG-7 Systems

15938-1 Multimedia content description interface Part 1: Systems Published 2002-07/06

MPEG-7 ArchitectureMPEG-7 dynamic descriptionsMPEG-7 binary format

15938-2 Multimedia content description interface Part 1: DDL Published 02-02-2002 MPEG-7 DDL

64

Action Plan

N° What Who When Status Trace1. Check if the cascade

model is correctly implemented in the 3rd

Edition.

Cyril ASAP O

2. Create editing team for AVC/2

Jan ASAP O

3. Invent a mechanism for P&L signaling.

David for MP4 and MPEG-4 Sys. and Jan for MPEG-2

AHG O

Resolutions of Systems(Ref. WG11 Resolutions)

List of reviewed contribution

N° Title9113 Systems Meeting Report9122 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 29123 Summary of Voting on ISO/IEC FCD 13818-119125 Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 49130 Response to the CFP for font format representation9133 Liaison Statement from DVB to WG 11 [SC 29 N 5139]9156 Request for a fix of the gradient nodes9157 CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata9165 Response to the Call for Proposal for MPEG-4 Systems font format representation

and font compression technology9169 Proposal on requirements and a strawman architecture of 3D graphics for

constraint devices.9185 Proposal on the construction of MPEG-7 BiM Profile9198 Mixed content support in BiM V29199 CE-3 bis : Evaluation of a Codec Management Framework9203 Proposed corrections for ISO/IEC 14496-19204 Proposals for Audio BIFS Version 39218 Sub-Sequences in AVC File Format9225 Liaison to MPEG on Carriage of Metadata over MPEG2 Systems9228 Comments on 14496-15/FCD

9229 Sample definition for AVC

9234 Improvements for WD 2.0 on ATG9235 Improving Fragment Reference support within BiM V29236 Israeli NB Comment on N5285 (FPDAM of ISO/IEC 14496-1 / AMD4) and

N5286 (CE on Synth. Texture Coding)9237 Report on SynthesizedTexture CE (N5286)9239 Metric Compatibility and Resident Fonts in MPEG-4 terminals9240 Fast random access into BiM streams9241 BiM Extensions9244 Report on MPEG-7 Systems CE-4: Evaluation of Schema Transmission

Mechanisms9248 Demonstration of Advanced Graphical BIFS content9254 Report on MPEG-7 Systems CE-5: Evaluation of Multiple Description Streams

9264 CE-4 bis: Proposal for a Schema Transmission Framework9265 Limited Usefulness of Sound2D node9276 Some thoughts towards simple meta-data in ISO (MP4) files9286 Finnish National Body Comments on AVC File Format9289 AVT Acces Unit, OD Framework9291 SL Extension9293 ESI Interface/SL layer coherence

9294 RTP payload for FlexMux streams9296 Multi-User: Status report and plan

9297 Feasibility study on graph compression9301 MPEG-4 for fun: demonstration of multimedia gaming9304 XMT corrections9319 Study of the SL extension9326 MPEG Font Evaluation Criteria

9337 Media Control Issues

Annex 6Report of MDS meeting

Source: John R. Smith (on behalf of MDS sub-group)

Chair (contact):John R. SmithIBM T. J. Watson Research Center30 Saw Mill River RoadHawthorne, NY 10532 USAjrsmith@watson.ibm.com

The MPEG MDS sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items included the following:

MPEG-7:o MPEG-7 MDS Extensions (schema extension)o MPEG-7 Profiles (with Requirements, Systems, MDS, Audio, Video)

MPEG-21:o Digital Item Identification (Registration Authority)o Rights Expression Language (promotion from CD FCD)o Rights Data Dictionary (promotion from CD FCD)o Digital Item Adaptation (promotion from WD v3.1 CD)

MPEG- 21:• DI D (FDI S)• DI I (FDI S, RA)• REL (CD FCD)• RDD (CD FCD)• DI A (WD v3.1 CD)

MPEG- 7 v.2:• Extensions

(FPDAM)

MPEG- 7 v.1:• MDS (FDI S)• Conformance

(FDI S)• Extraction & Use

(TR)• Profiles

MPEG- 21:• DI D (FDI S)• DI I (FDI S, RA)• REL (CD FCD)• RDD (CD FCD)• DI A (WD v3.1 CD)

MPEG- 7 v.2:• Extensions

(FPDAM)

MPEG- 7 v.1:• MDS (FDI S)• Conformance

(FDI S)• Extraction & Use

(TR)• Profiles

Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for Awaji Island meeting.

Overview:The main MDS activities related to MPEG-7 during the week were as follows:

1. Reviewing contributions on MPEG-7 MDS Extensions2. Examining mechanisms for extension of MPEG-7 schema (wrt. Version 2 and profiles)3. Reviewing contributions on profiles & levels (with Requirements, Systems, Video, and

Audio).4. Editing and approving the documents (XM, AHGs)

The main MDS activities related to MPEG-21 during the week were as follows:

1. Analyzing recommendations of AHGs 2. Analyzing responses to RFC for MPEG-21 Digital Item Identification (DII) Registration

Authority (RA)3. Reviewing and disposing of national body comments on MPEG-21 Rights Expression

Language (CD); producing DoC on REL CD; producing MPEG-21 REL FCD4. Reviewing and disposing of national body comments on MPEG-21 Rights Data Dictionary

(CD); producing DoC on RDD CD; producing MPEG-21 RDD FCD5. Analyzing results of Digital Item Adaptation Core Experiments; producing DIA CD and

Adaptation Model v.4; defining Core Experiments for DIA6. Analyzing proposals on REL, RDD, and DIA7. Editing and approving the documents (WD, CD, AHGs, new CEs, etc.)

MPEG MDS Group activities

Num. Contributions  Agenda, Goals and Issues for the Week for MDS Sub-Group

Agenda, Goals and Issues for the Week for MDS GroupJohn R. Smith

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed: Organization of work into main MDS track with BoGs (REL/RDD/DII) Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday Plan for generating revised MPEG-7 XM Plan for evaluating responses for DII RA Plan for disposing of comments on REL CD, producing DoC on REL CD, producing REL FCD Plan for disposing of comments on RDD CD, producing DoC on RDD CD, producing RDD

FCD Plan for generating MPEG-21 Digital Item Adaptation CD and AM v.4 Plan for software development for MPEG-21 DIA Plan for software for MPEG-21 Rights Expression Language and Rights Data Dictionary Schedule of joint meetings

MPEG-7 activities: MPEG-7 MDS Extensions:

o Activity leaders: K. Hasida, J. R. Smitho Input:

Report on the AHG on Metadata Interoperability MXF/MPEG-7 Mapping Mapping ID3 Tags to MPEG-7 Some Comments on MPEG-7 MDS FPDAM

o Actions: Review AHG results and input contributions

o Output: MPEG-7 MDS XM v.16

MPEG-7 Profiles (Wed 14h00 – 16h00):o Joint with Requirements, Systems, Video, Audioo Profiles definitions work to be transitioned to MDS, Video, Audio, Systems groups

o MDS is likely focal point for MPEG-7 profiles MPEG-7 Version 2 Schema (Thurs 10h00 - 10h30):

o Consider MPEG-7 schema extension mechanisms

MPEG-21 activities: MPEG-21 Digital Item Identification (Part 3):

o Activity leaders: N. Rumpo Input:

Responses to RFC for RA for Digital Item Identificationo Actions:

Establish evaluation criteria Map responses to criteria Make recommendation for selection

MPEG-21 Rights Expression Language (Part 5):o Activity leaders: B. Wragg, T. DeMartini o Input:

NB Comments on REL CD Liaison Statement REL AHG report

o Actions: Review NB comments Produce DoC & REL FCD Produce REL reference SW plan v.1 Updates to MPEG-21 MDS FAQ

o Output: MPEG-21 REL FCD & DoC on REL CD

MPEG-21 Rights Data Dictionary (Part 6):o Activity leaders: C. Barlas, G. Rusto Input:

NB Comments on RDD CD RDD AHG report Proposal on MPEG-21 RDD

o Actions: Review NB comments Produce DoC & RDD FCD Identify modules for reference software Updates to MPEG-21 MDS FAQ

o Output: MPEG-21 RDD FCD & DoC on RDD CD

MPEG-21 Digital Item Adaptation (Part 7):o Activity leaders: A. Vetroo Input (20 documents):

DIA WD v3.1 & AM v3.1, AHG reports (2) CE reports (5) & Proposal documents (11)

o Actions: Review CE results and proposals DIA requirements Refine DIA spec. & define core experiments Update DIA reference software plan

o Output:

MPEG-21 DIA CD & AM v.4 MPEG-21 DIA Software Implementation Plan v.2

Break-out Groups (created at kick-off meeting): Rights Expression Language (REL):

o Room 308o Mandates:

Review NB comments Produce DoC & REL FCD Produce REL reference SW plan v.1

o Schedule: Tues 11-11:30 (308) Wed 14-16 (308) Thurs 10-11 (308) joint with RDD Thurs 2-4 (308)

Rights Data Dictionary (RDD):o Room 308o Mandates:

Review NB comments Produce DoC & RDD FCD Identify modules for implementation of RDD Updates to MPEG-21 MDS FAQ (to Niels Rump)

o Schedule: Tues 15-18 (308) Thurs 10-11 (308) joint with REL

Review of AHG resolutions and action points:

Num. Contributions9077 AHG on Editing the MPEG-7 MDS Extensions FPDAM and XM9200 Report on the AHG on Metadata Interoperability9079 AHG on MPEG-21 Rights Expression Language9081 AHG on MPEG-21 REL Publishing Profile and Extension9080 AHG on MPEG-21 Rights Data Dictionary9082 AHG on Editing MPEG-21 Digital Item Adaptation WD & AM9083 AHG on Core Experiments for MPEG-21 Digital Item Adaptation

9077 AHG on Editing the MPEG-7 MDS Extensions FPDAM and XMJohn R. Smith, K. Hasida

Topic: Presented results of Editing MPEG-7 MDS Extensions FPDAM and XM. Completed revisions of the following documents based on decisions taken at the

Shanghai meeting The documents were uploaded as follows on Nov. 8, 2002:

o Text of ISO/IEC 15938-5:2001/AMD1 FPDAM MPEG-7 MDS Extensions [5175]

o MPEG-7 Multimedia Description Schemes XM (v15.0) [5177] Generated a new MPEG-7 schema based on ver. 1 plus MDS Extensions FPDAM

schema:

o Validated the new MPEG-7 schemao Validated description examples in MDS Extensions FPDAM

Recommendations: Continue ongoing work on validating MPEG-7 MDS Extensions schema in context

of extensions of other parts of MPEG-7 standard Investigate issues of extension of MPEG-7 schema and compatibility across ver. 1

and ver. 2.

9200 Report on the AHG on Metadata InteroperabilityPeter Mulder, Dave Singer, Eric Rehm

Topic: Mandate: 1. Analyze interoperability of MPEG-7 with external metadata systems,

eg., MXF, 3GPP. o MXF: Two MXF adhoc meetings, Two doc’s to reflector o 3GPP: Document submitted on ID3-to-MPEG-7 mapping as an input

contribution (M9311). Mandate: 2. Analyze DMS1/MPEG-7 interoperabilty by attempting to map DMS1

sets/frameworks to MPEG-7 datatypes, Ds, and DSso (MXF DMS-1 Work Tabs MPEG-7 2002#29-11.zip)

Mandate: 3. Identify missing MPEG-7 datatypes, Ds, DSso The MPEG-7 work appears to be missing a complete production-oriented

schema. Mandate: 4. Propose additions and changes to MPEG-7.

o Simplistically adding the elements that are used in MXF and that are not in MPEG-7 does not currently make sense.

o Probably a better solution will be to be add a complete extra appendix production schema with a cross reference table

Mandate: 5. If time permits, identify MPEG-7 metadata useful for studio production applications that does not exist in MXF DMS1.

o For MXF we adopted some of the name set elements as used in MPEG-7 Mandate: 6. Propose other approaches for problem solving if applicable

o No discussion on this mandate up till now.Recommendations:

Review MXF/MPEG-7 mapping in detail in MDS session (Tues. 14:00-15:00)

9079 AHG on MPEG-21 Rights Expression LanguageBarney Wragg, Thomas DeMartini

Topic: During AHG period draft disposition was created for early unofficial comments on MPEG-21 REL CD. AHG results provided as input to Awaji meeting.Recommendations: Consider results of study of comment for disposition of comments on REL CD at Awaji meeting.

9081 AHG on MPEG-21 REL Publishing Profile and ExtensionMartha Nalebuff, Brad Gandee

Topic: AHG mandates to work with OeBF on extension of MPEG-21 REL for publishing industry. OeBF will be producing mapping of MPEG-21 REL to OeBF requirements and identifying need for extension. Held teleconference jointly with the Open eBook Forum on November 25, 2002 (attended by Brad Gandee, Leonardo Chiariglione, Bob Bolick, Nick

Bogaty, Brian Green, Chris Barlas). Study will be made of MPEG REL according to requirements of OeBF (use cases). An REL extension approach for OeBF will be investigated. Participants from Adobe and ContentGuard will produce mapping of use cases will goal of meeting specification target of April 2003. Recommendations: continue AHG, create shared document repository, document process through joint meetings.

9080 AHG on MPEG-21 Rights Data DictionaryChris Barlas

Topic: Meeting was held on Nov. 19th by video and phone conference to review unofficial comments on RDD CD. Tentative dispositions were discussed by participants. AHG results provided as input to Awaji meeting.Recommendations: Consider results of study of comment for disposition of comments on REL CD at Awaji meeting.

9082 AHG on Editing MPEG-21 Digital Item Adaptation WD & AM Anthony Vetro, Andrew Perkis , Hermann Hellwagner

Topic: DIA AHG completed following work on its four mandates: Mandate 1 [Schema]: posted and maintained schema for AM3.0 and WD3.0 at

http://www.midgardmedia.net Mandate 2 [IPMP/REL support]: Extensive discussion on reflector with conclusion

that IPMP/REL related descriptions not be included in the DIA specification at this time (but continue to study with IPMP experts).

Mandate 3 [WD Intro]: No text of figure produced (many discussions). Mandate 4 [WD/AM3.1]: uploaded AM3.1 and WD3.1 as input documents.

Recommendations: To adopt the changes indicated in the AM 3.1 and WD3.1. That any discussions on IPMP/REL in DIA take place in the IPMP group with

appropriate requirements and use cases to support the ideas being put forth. To further discuss DIA extensibility during the Awaji meeting

9083 AHG on Core Experiments for MPEG-21 Digital Item AdaptationIan Burnett, Jeho Nam

Topic: The AHG monitored the CEs conducted in the period after the Shanghai meeting. An AHG meeting was held on Sunday prior to Awaji Island meeting to review CE results and created recommendations.Recommendations: The CE AHG made the following recommendations:

Metadata Adaptation:o Continue the CE to attain the second objectiveo Extend “elementary unit” concept

BSDL/gBSD, AdaptationQoS, and SSMo At this meeting, find agreement on standardising parameter passing for

Adaptation QoS –gBSD/BSDLo At this meeting, establish consensus on need for both gBSD and BSDLo At this meeting, discuss new or missing functionality that may be offered by

SSM.

DIA Description Messageso Promote improved DIA Messaging tool to WD (CD out of this meeting)

according to input annex text.o Reference s/w to be contributed to DIA archive on promotion to CDo That DIARegistering messages should have the capability to contain DIA

descriptors. CE on Low Vision Impairment

o Promote LowVisionImpairmentType to WD (CD out of this meeting)o Promote improved full syntax set on VisualImpairment to WD (CD out of

this meeting)o Solicit input and further review from clinicians and other interest/advocacy

groups Presentation preferences

o Promote text on VisualPresentationPreference, TextPresentation and SoniferousSpeed to AM

o Make VisualPresentationPreference tool more general to address segments and rename accordingly

MPEG MDS BoG Mandates

Num. Contributions N/A Define BoGs and Mandates

N/A Define BoGs and Mandates (MPEG-21 REL and MPEG-21 RDD)John R. Smith, Barney Wragg, Chris Barlas

Recommendations: The following BoGs and respective mandates were discussed and established:

o MPEG-21 REL:o Review NB commentso Produce DoC & REL FCDo Produce REL reference SW plan v.1o Updates to MPEG-21 MDS FAQ (to Niels Rump)o Schedule:

Tues 11-11:30 (308) Wed 14-16 (308) Thurs 10-11 (308) joint with RDD Thurs 2-4 (308)

o MPEG-21 RDD:o Room 308 o Review NB commentso Produce DoC & RDD FCDo Identify modules for implementation of RDDo Updates to MPEG-21 MDS FAQ (to Niels Rump)o Schedule:

Tues 15-18 (308) Thurs 10-11 (308) joint with REL

MPEG-21 DIA CD4.0:

Num. Contributions9177 Report on Core Experiment for DIA Description Messages9190 Report of CE on Low Vision Impairment

9177 Report on Core Experiment for DIA Description MessagesZY Huang, Andrew Perkis, SM Shen, Ming Ji, Taka Senoh, Takuyo Kogure, Takafumi Ueno, Tor Halvorsen, Debargha Mukherjee

Proposal: Presented results of CE for DIA Description MessagesDiscussion: Discussed DIA CE AHG recommendationsRecommendations: Resolution to adopt for MPEG-21 DIA CD

9190 Report of CE on Low Vision ImpairmentJeho Nam, Truong Cong Thang, Jaeil Song , Yong Man Ro, Jin-Woo Hong

Proposal: Presented results of CE on Low Vision ImpairmentDiscussion: Discussed DIA CE AHG recommendations. Questions were raised about how well the proponents represent this particular user community and whether consideration has been given to other standards and existing practices around universal access. A presentation was given by Chris Barlas on the activities of the Daisy Consortium (blindness). Proponents agreed to work with Daisy and investigate other efforts including those in W3C.Recommendations: Resolution to adopt for MPEG-21 DIA CD

MPEG-21 DII Registration Authority Candidates:

Num. Contributions9119 Answers to the RfC in MPEG-21 DII

9119 Answers to the RfC in MPEG-21 DIINiels Rump

Proposal: Five responses to call for Registration Authority. Reviewed draft criteria for making recommendation to SC29.Recommendations: Establish BoG to refine criteria and compile table of candidates mapping to criteria. Report back to MDS.

MPEG-21 DIA AM4.0:

Num. Contributions9141 Report of CE on Presentation Preference

9141 Report of CE on Presentation PreferenceJeongyeon Lim, Truong Cong Thang, Munchurl Kim, Jongnam Kim, Kyeongsoo Kim, Jeho Nam, Yong Man Ro,

Proposal: Presented results of CE for Presentation PreferenceDiscussion: Discussed DIA CE AHG recommendations. Various revisions were discussed to make the proposed DS more general by not tying to specific MPEG-7 segment types and to accommodate multiple forms of multimedia segments.Recommendations: Resolution to adopt for MPEG-21 DIA CD

MPEG-21 Exploration/Requirements - DIP & DIA:

Num. Contributions9140 Tools for end-to-end fully content agnostic digital item adaptation

9140 Tools for end-to-end fully content agnostic digital item adaptationDebargha Mukherjee , Amir Said , Sam Liu , Geraldine Kuo, Giordano Beretta,

Proposal: Proponents discussed the SSM framework for adaptation of scalable media.Recommendations: Harmonize SSM with BSDL/gBSD at this meeting.

MPEG-21 DIA CD:

Num. Contributions9227 Report of the CE on BSDL/gBSD, AdaptationQoS and SSM9272 New features for BSDL9282 Improvements to AdaptationQoS

9131Structured Scalable Meta-formats (SSM) version 1.0 for content agnostic Digital Item Adaptation

9227 Report of the CE on BSDL/gBSD, AdaptationQoS and SSMJan Bormans , on behalf of the CE

Proposal: The proponents discussed harmonizing BSDL/gBSD and SSM. Little progress was made during the CE period since Shanghai, partly because of the limited time.Recommendations: Resolution for proponents to meet intensively at this meeting to complete harmonization.

9272 New features for BSDLSylvain Devillers, Eric Delfosse

Proposal: Proposed three small, new features for BSDL that were developed to solve some technical problems encountered during the Core Experiments (such as ignore, skip attributes).Recommendations: Resolution to adopt new features for MPEG-21 DIA CD.

9282 Improvements to AdaptationQoSEric Delfosse, Jan Bormans

Proposal: During the work on linking AdaptationQoS and BSDL/gBSD, as part of the CE on BSDL/gBSD, AdaptationQoS and SSM, the issue of providing a better consistency between

an AdaptationQoS descriptor and the resource it describes was investigated. By linking the different segments in the resource to customized Adaptation information, the accuracy of the description can be improved. Recommendations: Adopt adaptation data; discuss remaining in BSDL/gBSD and SSM harmonization BoG.

9131 Structured Scalable Meta-formats (SSM) version 1.0 for content agnostic Digital Item AdaptationDebargha Mukherjee, Geraldine Kuo, Amir Said, Shih-ta Hsiang, Sam Liu, Giordano Beretta

Proposal: Proponents discussed the SSM framework for adaptation of scalable media.Recommendations: Harmonize SSM with BSDL/gBSD at this meeting.

MPEG-7 & Metadata Interoperability:

Num. Contributions9200 Report on the AHG on Metadata Interoperability9334 MXF/MPEG-7 Mapping9275 Some Comments on MPEG-7 MDS FPDAM

9200 Report on the AHG on Metadata InteroperabilityPeter Mulder, Dave Singer, Eric Rehm

Proposal: (see above)

9334 MXF/MPEG-7 MappingPeter Mulder

Proposal: The results of MXF DSM-I & MPEG-7 mapping was presented. Although the mapping is not final, gaps were identified, especially around area of production oriented description.Recommendations: Continue mapping work; continue AHG after Awaji meeting to explore gaps in MPEG-7 and proposed new tools if necessary.

9275 Some Comments on MPEG-7 MDS FPDAMKoiti Hasida

Proposal: Proposed new attributes for Linguistic DS for MPEG-7 MDS XM. Proposed modification of Relation DS to allow multimedia references.Discussion: Questions were raised about the compatibility problems by changing the definition of Relation DS.Recommendations: Adopt Linguistic tools for MPEG-7 MDS XM; Discuss RelationType in joint mtg. this week with Systems (MPEG-7) on schema extension mechanisms.

MPEG-21 DIA Software:

Num. Contributions5180 MPEG-21 DIA Software Implementation Plan

5180 MPEG-21 DIA Software Implementation Plan John R. Smith

Discussion: The MPEG-21 DIA Software Implementation Plan generated at the Shanghai meeting was reviewed and discussed. Information was updated and revised to reflect the status if DIA S/W development. New modules were added.Recommendations: A revised MPEG-21 DIA Software Implementation Plan shall be generated as output from Awaji meeting. Progress on DIA S/W development shall be monitored by MDS group and synchronized with Integration group. Joint meeting with Integration group to be held later in week.

MPEG-21 DIA Proposals:

Num. Contributions9331 Adaptation and Messaging in MPEG-21 DIA9259 Proposal for adding user interaction support to terminal capabilities in DIA9257 Proposed additions to DIA WD 3.0

9174Proposed Text for User/Natural Environment Descriptions in MPEG-21 DIA

9175 Applications using User/Environment Descriptions9205 Additional User/Environment Descriptions for MPEG-21 DIA9307 Proposal for Graphics DIA

9331 Adaptation and Messaging in MPEG-21 DIAIan Burnett

Proposal: Identified “application” issues on the access of and sending of DIA messages. For example, DIA information can be located on the device performing the adaptation, contained within the DID of the CDI to be adapted, or transmitted in an XDI from a 'peer' to the device performing the adaptation.Discussion: Discussed whether application protocol could address these issues.Recommendations: Create CE for period after Awaji to further study.

9259 Proposal for adding user interaction support to terminal capabilities in DIASouhila Boughoufalah, Mariam KIMIAEI-ASADI, jean-claude DUFOURD

Proposal: Proposed new terminal capabilities descriptors for user interaction support. Discussion: Questions were raised about the proposed categorization of devices and user interface tools.Recommendations: Resolution to adopt for MPEG-21 DIA CD to allow further study.

9257 Proposed additions to DIA WD 3.0Mariam KIMIAEI-ASADI, Souhila Boughoufalah, jean-claude DUFOURD

Proposal: Proposed new terminal capabilities descriptors for modalities, enhancement of DIA resource adaptation concept to cover transmoding resource adaptation methods.

Discussion: The focus on “transmoding” was appreciated by the group and the new terminal capabilities descriptors seem to enhance the current definitions.Recommendations: Resolution for proponents to join CE on presentation preferences to further develop specific definitions of tools.

9174 Proposed Text for User/Natural Environment Descriptions in MPEG-21 DIAMikio Sasaki, Fumihiko Murase

9175 Applications using User/Environment DescriptionsMikio Sasaki, Fumihiko Murase

9205 Additional User/Environment Descriptions for MPEG-21 DIAMikio Sasaki, Fumihiko Murase

Proposal: Proposed DIA descriptors for user environment.Recommendations: Adopt information on user destination for AM for further study.

9307 Proposal for Graphics DIAHae-Kwang Kim, Nam-Ik Cho, Hyoung-Joong Kim, Man-Bae Kim, Rin-Chul Kim, Jeho Nam, Jin-Woo Hong

Proposal: Presented later in week in joint MDS/SNHC meeting (see below).

MPEG-21 DIA CD & AM:

Num. Contributions

9258GNB comment on the standardization schedule for 15938-1 Amd 1, 15938-3 Amd 1, 21000-7, and 21000-9

  DIA Intro text, definitions, figures & DIA work plan

9258 GNB comment on the standardization schedule for 15938-1 Amd 1, 15938-3 Amd 1, 21000-7, and 21000-9Andreas Hutter , on behalf of the GNB

Proposal: Comments pointed out the challenges in the current MPEG-21 DIA schedule in not allowing sufficient “study” periods. Other concerns were raised about potential dependencies on MPEG-21 DIP and the status of MPEG-21 reference software.Discussion:Recommendations: Workplan schedule to be revised for DIA (FCD in July, 2002)

N/A DIA Intro text, definitions, figures & DIA work planAnthony Vetro

Discussion: The introductory text, definition, and figures were discussed by the group. Many modifications were made to make the terminology more consistent and to clarify the presentation of DIA. Consensus could not be reached on the figures.Recommendations: Resolution to continue work on figures as mandate of DIA AHG.

MPEG-21 DIA CD & AM:

Num. ContributionsN/A DIA Root ElementsN/A Report of SSM, BSDL, gBSD

N/A DIA Root ElementsAnthony Vetro

Proposal: Several alternative designs for root element structure for DIA were proposed (continuation of discussion from DIA AHG)Discussion: Questions were raised about a “type” vs. “element”-centric approach for schema design and whether to strive to be compatible with MPEG-7’s design.Recommendations: Agreed to adopt MPEG-7 style definition for root elements and complete editing during period after Awaji meeting. Implications are such that many tools need to be redefined to extend from common base type.

N/A Report of SSM, BSDL, gBSDJ. Heuer

Proposal: Reported on interim results of SSM, BSDL, gBSD BoG.Discussion: Progress summarized in figure below:

1st night

2nd night

Recommendations: Continue working this meeting and report later in week. Draft a first approach of the low complexity transformation. Draft a workplan how to proceed until the next meeting.

MPEG-21 DIA & REL:

Num. Contributions9255 Rights Expression Languages Terminal Capabilities within MPEG-21 DIA

9255 Rights Expression Languages Terminal Capabilities within MPEG-21 DIA Abdellatif Benjelloun Touimi,

Proposal: Proposed descriptor of rights languages for DIA (i.e., MPEG-21 REL, OMA, etc.) Targeted functionality for translation and selection of rights languages (MPEG-21

REL and others)Discussion:

This proposal was related to AHG discussion between Shanghai and Awaji on the subject of interoperability of rights languages.

Additionally many discussions were held in context of REL BoG DoC work at Awaji meeting (see NB comments on REL/RDD interoperability also from proponents)

No requirement could be identified for translation of rights languages in MPEG-21 (DIA or REL).

Requirement was identified for description of REL support as component of IPMP terminal capability description in DIA.

Proponent was encouraged to work with MPEG-21 IPMP experts to determine how/where description for right language support should be defined (yet no progress was made prior to or at Awaji meeting).

Consensus could not be reached to adopt the proposed descriptor of rights languages for DIA given the lack of corresponding requirement and lack of progress by proponents to investigate in context of MPEG-21 IPMP.

Recommendations: To continue to study in context of IPMP capabilities description, which iincludes

terminal descriptors for REL, RDD, IPMP, etc.

MPEG-21 DII Registration Authority Candidates:

Num. Contributions9119 Answers to the RfC in MPEG-21 DII

9119 Answers to the RfC in MPEG-21 DII

Discussion: BoG reported on the results of evaluating the candidates responding to the RfC for Registration Authority for MPEG-21 DII. Established criteria for evaluating responses. Reviewed responses and started mapping to evaluation criteria (some information missing from responses).

Recommendations: Create AHG to work in period following Awaji meeting to gather additional information, complete evaluation and make recommendation.

MPEG-21 REL Software:

Num. ContributionsN/A MPEG-21 REL Software

N/A MPEG-21 REL SoftwareJohn R. Smith

Proposal: A first draft of the MPEG-21 REL Software plan was created. Discussion: Two modules were identified at this session. REL BoG will work further during this meeting.Recommendations: MPEG-21 REL Software plan will be produced as output from this meeting.

MPEG-7 Version 2 Schema:

Num. ContributionsN/A MPEG-7 Version 2 Schema

N/A MPEG-7 Version 2 SchemaJohn R. Smith

Proposal: Several issued were raised about MPEG- 7 schema extension mechanisms in joint MDS, Systems meeting as follows:

o MPEG-7 MDS AMD/1:o Addition of new types, e.g., Linguistic DS, TextualSegment DSo Addition of new attributes to existing types, e.g., channels in Audio D, Audio

DSo Version 1 types extend from these types

o How to define new schema?o Define new namespace for new toolso Define new namespace for all types (ver 1 & ver 2)o Add all new tools to ver. 1 namespace

o How does it impact BiM?

Audio DS(ver. 1)

Audio DS- channels(ver. 2)

Melody DS(ver. 1)

Melody DS(ver. 2)

Discussion: Understanding of the problem was achieved, but, a solution could not be chosen because not all implications were fully understood.Recommendations: Create AHG (Systems) to study schema extension mechanisms.

MPEG-21 Graphics DIA:

Num. Contributions9307 Proposal for Graphics DIA

9307 Proposal for Graphics DIAHae-Kwang Kim, Nam-Ik Cho, Hyoung-Joong Kim, Man-Bae Kim, Rin-Chul Kim, Jeho Nam, Jin-Woo Hong,

Proposal: Proposal was made of descriptors for graphics display prefernces for graphics quality; display preference for multiview; decoding/encoding capability etc., for constrained conditions such as limited memory, bandwidth, etc.Discussion: SNHC experts helped review the specific descriptors, and various questions were raised about whether the attributes were the best ones. Recommendations: Create CE to investigate further with joint participation monitoring by MDS and SNHC groups.

MPEG-21 DIA:

Num. Contributions9339 Report of Q.C Metadata ad hoc 9143 MPEG-21 DIA Extensions for Personalization Activity

 N/A Report of SSM, BSDL, gBSD

9339 Report of Q.C Metadata ad hoc rapporteur ITU-T SG16

Proposal: Reported on the activities of ITU-T SG16 on metadata.Recommendations: Draft Liaison statement to ITU-T SG16 thanking members of ITU-T SG16 for attending the MPEG and presenting an overview of its new activities on metadata. Recommend that ITU-T SG16 further explore the relationship of “MPEG-21 Digital Item Adaptation (DIA)” with the development of a ITU-T metadata framework for communications based on data or content oriented network functionalities.

9143 MPEG-21 DIA Extensions for Personalization ActivityChiarotto Alessandro, Difino Angelo, Negro Barbara

Proposal: Proposed demographic and personalization descriptors for DIA, including birth information, gender, marital status, etc.Recommendations: Adopt into AM; CE to validate specific elements

Report of SSM, BSDL, gBSDJ. Heuer

Discussion: Reported on final meeting of SSM, BSDL, gBSD harmonization, in which significant progress was made.Recommendations: Adopt definition for MPEG-21 DIA AM. Create CE on AdaptionQoS BSD Linking.

Results on MPEG Multimedia Description Schemes (MDS) work items:

Promotion of MPEG Multimedia Description Schemes (MDS) work items:

MPEG-7:

o MDS Extensions (XM v.16)

MPEG-21:o Rights Expression Language (CD FCD)o Rights Data Dictionary (CD FCD)o Digital Item Adaptation (WD v3.1 CD)

MPEG-7 Results:

MPEG-7 MDS Version 2:o Proposal for new attributes for Linguistic DS adopted to MDS XMo Identified and discussed issues in defining MPEG-7 schema extensions (with

Systems)o Impact on design of schemas/namespaces for MPEG-7 version 2 and MPEG-7

profileso Output: Systems MPEG-7 AHG to further study (with MDS)

Metadata Interoperability (MPEG-7 and MXF):o Identified and discussed gaps in mapping between MXF DMS-1 and MPEG-7

(production oriented descriptors)o Plan to continue mapping (with MXF, 3GPP, ID3 V2, EXIF) and identify new tools

for MPEG-7 where necessaryo Output: “AHG on Metadata Interoperability”

MPEG-21 Results:

MPEG-21 Digital Item Identification:o Received five responses to RFC for Registration Authority for MPEG-21

Identification Systemso Established criteria for evaluating responseso Reviewed responses and started mapping to evaluation criteria (some information

missing from responses)o AHG will gather additional information, complete evaluation, and make

recommendation o Output:

“Evaluation Criteria for Appointing the RA for ISO/IEC 21000-3” “AHG on Preparing the Appointment of the RA for ISO/IEC 21000-3”

MPEG-21 Rights Expression Language:o Reviewed and disposed of NB comments on REL CD (all dispositions agreed to by

NBs)o Some modifications include: o References for region, country codes; o More informative REL use-case examples; o Synchronization with RDD, etc.o Produced first REL software implementation plano Identified five modules (one implemented)o Output:

DoC on Rights Expression Language CD Rights Expression Language FCD (editing period) – looking forward to

comments on FCD REL software implementation plan v.1

MPEG-21 Rights Data Dictionary:o Reviewed and disposed of NB comments on RDD CD (all dispositions agreed to by

NBs)o Some modifications include:

Removing “copy” verb (accommodating with “adapt”) Reorganizing structure (dictionary terms first; modeling methodology as

normative annex) More examples and use cases Input on multilingual support for RDD: Exploring as possible software implementation around RDD (looking for

additional input on implementations for RDD)o Output:

DoC on Rights Data Dictionary CD Rights Data Dictionary FCD (editing period) – looking forward to comments

on FCD MPEG-21 Digital Item Adaptation (DIA):

o Reviewed Core Experiment results (5)o Reviewed input contribution documents (11)o Adopted tools for DIA Adaptation Model (AM):

Presentation Priority Segment presentation preference Demographic info User Destination Graphics related tools BSDL/gBSD, Adaptation QoS and SSM

o DIA Committee Draft (this meeting): Revised introduction text, created new overview figures, redefined tools with

respect to DIA base type definitionso Promotions:

DIA Description Messages Low Vision Impairment 3D Stereoscopic Video User Interaction Schema tools

o Output: MPEG-21 DIA CD, MPEG-21 DIA AM (v.4)o Defined following DIA Core Experiments:

CE on Modality Conversion Preferences CE on Adaptation Protocols and Messaging CE on Graphics CE on Personalization Information CE on AdaptionQoS BSD Linking CE on Adaptation Integration

New Core Experiments (CEs):

The following MPEG-21 experiments were approved during the Awaji meeting:

Technologies Organisations Application Reviewers

Digital Item AdaptationICUETRIENST

Modality Conversion Preferences

Andrew PerkisYoungsik HuhIan Burnett

Digital Item Adaptation

University of WollongongNTNUPanasonic Singapore LabsHP LabsENST

DIA Adaptation Protocols and Messaging

Do-Nyun KimYoungsik HuhRik Van de WalleMunchurl Kim

Digital Item Adaptation

Sejong UniversityETRISGDL systems inc.HP LabsSamsung ElectronicsENSTFrance Telecom

Graphics DIAMikael Bourges-SevenierEric Delfosse

Digital Item AdaptationTelecom Italia LabsICUKBS

Personalization Information

Youngsik HuhPeter Van Beek

Digital Item Adaptation

SiemensUniversity of KlagenfurtIMECHP LabsETRIPanasonic Singapore LabsColumbia University

AdaptationQoS BSD Linking

Anthony VetroRik Van de Walle

Digital Item Adaptation University of BresciaMitsubushi Electric Corp.

Metadata Adaptation Integration

Jeho NamIan BurnettMasanori Sano

List of MDS Output documents:

No. Title Subgroup TBP Available15938-5 MPEG-7 Multimedia Description Schemes

5346 MPEG-7 Multimedia Description Schemes XM (v16.0) MDS N 02/12/2021000-2 MPEG-21 Digital Item Identification

5347 Evaluation Criteria for Appointing the RA for ISO/IEC 21000-3 MDS N 02/12/13

21000-5 MPEG-21 Rights Expression Language5348 DoC on ISO/IEC CD 21000-5 Rights Expression Language MDS N 02/12/13

5349 Text of ISO/IEC FCD 21000-5 Rights Expression Language MDS Y 03/02/15

5350 MPEG-21 REL Software Implementation Plan v.1 MDS N 02/12/1321000-6 MPEG-21 Rights Data Dictionary

5351 DoC on ISO/IEC CD 21000-6 Rights Data Dictionary MDS N 02/12/135352 Text of ISO/IEC FCD 21000-6 Rights Data Dictionary MDS Y 03/01/31

21000-7 MPEG-21 Digital Item Adaptation 5353 Text of ISO/IEC CD 21000-7 Digital Item Adaptation MDS Y 03/01/225354 MPEG-21 Digital Item Adaptation AM v4.0 MDS N 03/01/225355 MPEG-21 DIA Software Implementation Plan v.2 MDS N 02/12/135356 Overview of Core Experiments for MPEG-21 DIA MDS N 02/12/135357 Workplan for CE on Modality Conversion Preferences MDS N 02/12/13

5358 Workplan for CE on DIA Adaptation Protocols and Messaging MDS N 02/12/13

5359 Workplan for CE on Graphics MDS N 02/12/135360 Workplan for CE on Personalization Information MDS N 02/12/135361 Workplan for CE on AdaptionQoS BSD Linking MDS N 02/12/135362 Workplan for CE on Metadata Adaptation Integration MDS N 02/12/13

List of AHGs approved by the MDS group:

N5363 AHG on Metadata InteroperabilityMandate: 1. Analyze interoperability of MPEG-7 with external metadata systems,

eg., MXF, 3GPP, ID3 V2, and EXIF.2. Analyze DMS1/MPEG-7 interoperabilty by attempting to map DMS1

sets/frameworks to MPEG-7 datatypes, Ds, and DSs.3. Analyze the profiles proposed for TV production (DMS-1) and TV

Programmes (NHK proposal) and explore what profiles and levels are needed to cover this in a generic way.

4. Propose additions to both schemas and DS’s to achieve harmonization.Co-Chairs Masanori Sano sano.m-fo@nhk.or.jp (NHK), Eric Rehm (Singingfish /

THOMSON) (rehm@singingfish.com), David Singer (singer@apple.com), Peter Mulder peter.mulder@nob.nl

Duration: Until 64rd meetingMeetings Week-end before the next meetingReflector: meta_interop@yahoogroups.comSubscribe Subscription: Send email message to meta_interop-

subscribe@yahoogroups.com (No subject or message body required.)

N5364 AhG on Preparing the Appointment of the RA for ISO/IEC 21000-3

Mandate: 1. Identify the contact person and their coordinates at each organisation that has responded to the Call for Candidates and circulate to the reflector if permission for this is granted

2. Interact with the five organisations to gather further information on how their organisation addresses the Evaluation Criteria (N5347) issued at the Awaji Meeting

3. Identify any constraints on the organisations being able to serve as the Registration Authority

4. If needed, organise and conduct telephone conference(s) with the five organisations to clarify any open issues

5. Create a report on the information gathered which will allow a decision to be taken at the 64th Meeting.

Chairmen: Niels Rump (niels.rump@rightscom.com)Paul Jessop (paul.jessop@ifpi.org)

Duration: Until 64th MPEG MeetingMeetings: No physical meeting.

All business will be conducted by email and telephone conferences.Reflector: mpeg-21-list@imec.be message titles prefixed [DII]

To subscribe, send an email to owner-mpeg-21-list@imec.beN5365 Ad Hoc Group on the MPEG-21 Rights Expression Language FCDMandate: 1. Edit the FCD to accommodate all actions arising from the DoC and Liaison

statements regarding the CD.2. Further develop requirements and implementation plans for REL Reference

software.Chairman: Barney Wragg (barney.Wragg@umusic.com)Co Chair Thomas DeMartini (Thomas.demartini@contentguard.com)Duration: Until 64th meetingMeetings Business will be conducted by E-mail or Telephone.Reflector: mpeg-21-list@imec.be

message titles prefixed [REL]N5366 AhG on Editing the MPEG-21 RDD FCDMandate: 1. Produce FCD text in accordance with Disposition of Comments made at Awaji and send

FCD to the SC29 Secretariat by Friday 31st January 2003 .

2. Produce new draft text on RDD for MPEG-21 MDS FAQ

3. Investigate and develop requirements for RDD Reference SoftwareChairman Chris Barlas ( chris.barlas@rightscom.com )Co-Chair: Godfrey Rust ( godfreyrust@wordsout.fsnet.co.uk)Duration: Until 64th meetingMeetings: Business will be conducted by E-mail or Telephone.Reflector: mpeg-21-list@imec.be

message titles prefixed [RDD]N5367 20.1.1 AhG on MPEG-21 REL Publishing Extension Mandate: 1. Liaise with OeBF and EDItEUR about development of a possible

publishing extension to the MPEG-21 REL2. To study the interoperability implications of extensions

Co-Chairs Chris Barlas chris.barlas@rightscom.com Brad Gandee brad.gandee@contentguard.com

Duration: Until the 64th MeetingMeetings:

a).1.1.1 The AhG will be conducted by email and phone conference(s), dates to be agreed with OeBF and EDItEUR

Reflector: MPEG_OeBF@openebook.org Subscribe: To subscribe, send email to: chris.barlas@rightscom.com N5368 20.1.2 AHG on Editing MPEG-21 Digital Item Adaptation CD & AMMandate: 1. Maintain schema for the CD and AM4.0 on http://www.midgardmedia.net.

2. Create a figure to reflect the relation between MPEG-7 and DIA to be included in the CD.3. Produce the CD and AM4.0 after a 5-week editing period and upload the documents no

later than Jan 22, 2002.4. Produce AM4.1 and Editors input on CD.

Chairman Anthony Vetro (avetro@merl.com)Co-chairman Andrew Perkis (andrew@tele.ntnu.no)

Christian Timmerer (christian.timmerer@itec.uni-klu.ac.at)Duration: Until the 64th Meeting.Meetings:

a).1.1.2 AHG Meeting to be held on the Sunday prior to 64th meeting.

Reflector: mpeg21-uma@merl.comN5369 Ad Hoc Group on Core Experiments for MPEG-21 Digital Item Adaptation

Mandate

1. Maintaining the MPEG-21 MDS CE Development process document.2. Carry out Core Experiments on DIA and make recommendations to modify

and improve the Committee Draft (CD v1.0) and Adaptation Model (AM v4.0).

3. Coordinate and encourage delivery (according to software implementation plan v2.0 N5355) of implementation software from participants.

Chairman Jeho Nam (namjeho@etri.re.kr)Co Chair Debargha Mukherjee (debargha@hpl.hp.com) Duration Until 64th MPEG meeting

Meetings A meeting will be held on 9th March before the Pattaya meeting. Other business will be conducted by E-mail or Telephone.

Reflector mpeg21-uma@merl.com

MDS Sub-Group Schedule

  MPEG-7 and MPEG-21 V.FINAL    

Number TITLE ROOM & SOURCE STD NOTES         Monday Morning (9h00-13h00)      

MPEG Plenary Plenary room    

         

Monday Afternoon (14h00-20h00)      

         

Kick-off of MPEG MDS activities (14h00-14h30) Reception Hall A ALL  

N/AAgenda, Goals and Issues for the Week for MDS Group John R. Smith    

         

Review of AHG resolutions and action points (14h30-15h30) Reception Hall A ALL  

9077AHG on Editing the MPEG-7 MDS Extensions FPDAM and XM John R. Smith, K. Hasida,    

9200Report on the AHG on Metadata Interoperability

Peter Mulder, Dave Singer, Eric Rehm,    

9079AHG on MPEG-21 Rights Expression Language

Barney Wragg, Thomas DeMartini,    

9081AHG on MPEG-21 REL Publishing Profile and Extension

Martha Nalebuff, Brad Gandee,    

9080AHG on MPEG-21 Rights Data Dictionary Chris Barlas,    

9082AHG on Editing MPEG-21 Digital Item Adaptation WD & AM

Anthony Vetro, Andrew Perkis , Hermann Hellwagner,    

9083AHG on Core Experiments for MPEG-21 Digital Item Adaptation Ian Burnett, Jeho Nam,    

9141 Report of CE on Presentation Preference

Jeongyeon Lim, Truong Cong Thang, Munchurl Kim, Jongnam Kim, Kyeongsoo Kim, Jeho Nam, Yong Man Ro,    

9177Report on Core Experiment for DIA Description Messages

ZY Huang, Andrew Perkis, SM Shen, Ming Ji, Taka Senoh, Takuyo Kogure, Takafumi Ueno, Tor Halvorsen, Debargha Mukherjee,    

9190 Report of CE on Low Vision Impairment

Jeho Nam, Truong Cong Thang, Jaeil Song , Yong Man Ro, Jin-Woo Hong,    

9227Report of the CE on BSDL/gBSD, AdaptationQoS and SSM

Jan Bormans , on behalf of the CE,    

9233Report of CE report on Metadata Adaptation - Integration

Nicola Adami none Marzia Corvaglia none Riccardo Leonardi,    

         

Define BoGs and Mandates (15h30-16h00) Reception Hall A ALL  

         

MPEG-21 DIA CD (16h00 - 17h00) Reception Hall A MPEG-21  9177 Report on Core Experiment for DIA

Description MessagesZY Huang, Andrew Perkis, SM Shen, Ming Ji, Taka Senoh, Takuyo Kogure, Takafumi Ueno, Tor

   

Halvorsen, Debargha Mukherjee,

9190 Report of CE on Low Vision Impairment

Jeho Nam, Truong Cong Thang, Jaeil Song , Yong Man Ro, Jin-Woo Hong,    

         

Tuesday Morning (09h00-13h00)      

       MPEG-21 DII Registration Authority Candidates (09h00 - 09h30) Reception Hall A MPEG-21  

9119 Answers to the RfC in MPEG-21 DII Niels Rump,    

     

MPEG-21 DIA AM4.0 (09h30 - 10h00) Reception Hall A MPEG-21  

9141 Report of CE on Presentation Preference

Jeongyeon Lim, Truong Cong Thang, Munchurl Kim, Jongnam Kim, Kyeongsoo Kim, Jeho Nam, Yong Man Ro,    

     MPEG-21 Exploration/Requirements - DIP & DIA (10h00 - 11h00) Requirements MPEG-21 Joint

9140Tools for end-to-end fully content agnostic digital item adaptation

Debargha Mukherjee , Amir Said , Sam Liu , Geraldine Kuo, Giordano Beretta,    

9188 Extending the Use of Digital ItemsBenjamin de Neef, Ian S Burnett,    

9189 Digital Items in Universal Plug and PlayBenjamin de Neef, Ian S Burnett,    

9310Requirement for MPEG-21 XPointer scheme Gerrard Drury, Ian Burnett,    

     

MPEG-21 REL BoG (11h00 - 11h30) 308 MPEG-21 BoG

9216Publishing Sector input to REL: Liaison statement from EDItEUR Brian Green,    

         

MPEG-21 DIA CD (11h00 - 13h00) Reception Hall A MPEG-21  

9227Report of the CE on BSDL/gBSD, AdaptationQoS and SSM

Jan Bormans , on behalf of the CE,    

9272 New features for BSDLSylvain Devillers, Eric Delfosse,    

9282 Improvements to AdaptationQoS Eric Delfosse, Jan Bormans,    

9131

Structured Scalable Meta-formats (SSM) version 1.0 for content agnostic Digital Item Adaptation

Debargha Mukherjee, Geraldine Kuo, Amir Said, Shih-ta Hsiang, Sam Liu, Giordano Beretta,    

         

Tuesday Afternoon (14h00-20h00)      

         

MPEG-7 & Metadata Interoperability (14h00-15h00) Reception Hall A MPEG-7  

9200Report on the AHG on Metadata Interoperability

Peter Mulder, Dave Singer, Eric Rehm,    

9334 MXF/MPEG-7 Mapping Peter Mulder    

9275Some Comments on MPEG-7 MDS FPDAM Koiti Hasida,    

         

MPEG-21 REL BoG (14h00 - 16h00) 308 MPEG-21 BoG

         

MPEG-21 DIA Software (15h00 - 16h30) Reception Hall A MPEG-21  

5180MPEG-21 DIA Software Implementation Plan Giordano Beretta    

         

MPEG-21 RDD BoG (15h00 - 18h00) 308 MPEG-21 BoG

9187Proposal of Multilingual Registry for MPEG-21 Part 6 Rights Data Dictionary

Senator Jeong, Weon-Geun Oh, Ki-song Yoon,    

9206MPEG-21 Rights Data Dictionary - Editors' Version Chris Barlas, Godfrey Rust,    

         

MPEG-21 DIA Proposals (16h30 - 19h30) Reception Hall A MPEG-21  

  Presentation Preference      

9331Adaptation and Messaging in MPEG-21 DIA Ian Burnett    

9259Proposal for adding user interaction support to terminal capabilities in DIA

Souhila Boughoufalah, Mariam KIMIAEI-ASADI, jean-claude DUFOURD,    

9257 Proposed additions to DIA WD 3.0

Mariam KIMIAEI-ASADI, Souhila Boughoufalah, jean-claude DUFOURD,    

9143MPEG-21 DIA Extensions for Personalization Activity

Chiarotto Alessandro, Difino Angelo, Negro Barbara,    

9174

Proposed Text for User/Natural Environment Descriptions in MPEG-21 DIA

Mikio Sasaki, Fumihiko Murase,    

9175Applications using User/Environment Descriptions

Mikio Sasaki, Fumihiko Murase,    

9205Additional User/Environment Descriptions for MPEG-21 DIA

Mikio Sasaki, Fumihiko Murase,    

9307 Proposal for Graphics DIA

Hae-Kwang Kim, Nam-Ik Cho, Hyoung-Joong Kim, Man-Bae Kim, Rin-Chul Kim, Jeho Nam, Jin-Woo Hong,    

         

Wednesday Morning (09h00-13h00)      

MPEG Plenary (9h00-12h30) Plenary room MPEG Plenary

         

MPEG-21 DIA CD & AM (11h30 - 13h00) Reception Hall A MPEG-21  

9258

GNB comment on the standardization schedule for 15938-1 Amd 1, 15938-3 Amd 1, 21000-7, and 21000-9

Andreas Hutter , on behalf of the GNB,    

 DIA Intro text, definitions, figures & DIA work plan Anthony Vetro    

         

Wednesday Afternoon (14h00-17h30)      

         

MPEG-21 DII RA BoG (13h00 - 14h00) Restaurant MPEG-21 BoG

         

MPEG-21 REL/RDD BoG (14h00 - 16h00) 308 MPEG-21 BoG

         

MPEG-21 DIA CD & AM (14h00 - 16h00) Reception Hall A MPEG-21  

  DIA Root Elements Anthony Vetro    

  Report of SSM, BSDL, gBSD J. Heuer    

         

MPEG-7 Profiles (14h00 - 16h00) Requirements MPEG-7  

9096AHG on MPEG-7 Interoperability and Profiling Wo Chang, Eric Rehm,    

9127MPEG-7 Profile Schemas for “Profiles under Consideration” Wo Chang,    

9132 MPEG-7 Profiles and Levels Signaling Wo Chang,    

9223A Study on MPEG-7 Video Program Profile

Masanori Sano, Rosanne Vasconcelos Possato, Masahiro Shibata,    

9268Comments about Definition of MPEG-7 Description Profiling Wo Chang,    

9269Approach to Develop Formal Representation for MPEG-7 Profiles Wo Chang,    

         

MPEG-21 DII RA BoG (16h00 - 17h00) 308 MPEG-21 BoG

       

MPEG-21 DIA & REL (16h00 - 17h00) Reception Hall A MPEG-21 Joint

9255Rights Expression Languages Terminal Capabilities within MPEG-21 DIA Abdellatif Benjelloun Touimi,    

         

Plenary MDS and Report of BoG (17h00 - 18h00) Reception Hall A MDS Plenary

  MPEG-21 RDD      

  MPEG-21 REL      

  MPEG-21 DIA      

     MPEG Social Event (18h00 - midnight)     

         Thursday Morning (9h00-12h30)       

         MPEG-21 Reference Software (08h30 - 09h30)  Integration (305) MPEG-21 Joint

         MPEG-21 REL/RDD BoG (09h00 - 12h00)  308 MPEG-21 BoG

         MPEG-21 DII Registration Authority Candidates (09h00 - 09h30) Reception Hall A MPEG-21  

9119 Answers to the RfC in MPEG-21 DII Niels Rump,    

         

MPEG-21 REL Software (09h30 - 10h00) Reception Hall A MPEG-21  

         

MPEG-21 REL & RDD BoG (10h00 - 11h00) 308 MPEG-21 BoG

         

MPEG-7 Version 2 Schema (10h00 - 10h30) Reception Hall A MPEG-7 Joint

         

MPEG-21 Graphics DIA (10h30 - 11h00) Reception Hall A MPEG-21 Joint

9307 Proposal for Graphics DIA

Hae-Kwang Kim, Nam-Ik Cho, Hyoung-Joong Kim, Man-Bae Kim, Rin-Chul Kim, Jeho Nam, Jin-Woo Hong,    

         

MPEG-21 RDD DoC (11h00 - 12h00) Reception Hall A MPEG-21  

         

MPEG-21 REL DoC (12h00 - 13h00) Reception Hall A MPEG-21  

         

Thursday Afternoon (14h00-19h00)      

         

MPEG Multimedia Testbed (14h00 - 14h30) Systems MPEG-21 Joint

         

MPEG-21 REL BoG (14h30 - 16h00) 308 MPEG-21 BoG

         

MPEG-21 DIA (14h30 - 16h00) Reception Hall A MPEG-21  

9339 Report of Q.C Metadata ad hoc rapporteur ITU-T SG16    

9143MPEG-21 DIA Extensions for Personalization Activity

Chiarotto Alessandro, Difino Angelo, Negro Barbara,    

  Report of SSM, BSDL, gBSD J. Heuer    

  UserDestination      

  DIA Root element      

         

Plenary MDS and Reports of BoG (16h00 - 17h00) Reception Hall A MDS PlenaryReview of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00) Reception Hall A    

         Friday Morning (09h00-13h00)       

Wrapping up (09h00 - 13h00) Reception Hall A MDS Plenary

 Approval of resolutions, AHGs and Output documents      

         

Friday Afternoon (14h00-21h00)      

MPEG Plenary Plenary room MPEG Plenary

Next targets for the Pattaya (64th) meeting:

MPEG-7 Review and dispose of NB comments on MPEG-7 MDS Extensions FPDAM Review early unofficial comments on MPEG-2 REL FCD, MPEG-21 RDD FCD, MPEG-21

DIA CD

MPEG-21 Review results of MPEG-21 DIA Core experiments approved during the Awaji Island meeting Produce Study of CD on MPEG-21 DIA Produce Study of FCD on MPEG-21 REL Produce Study of FCD on MPEG-21 RDD Advance MPEG-21 Software Implementation New MPEG-21 DIP work item

Annex 7Report of Video meeting

Source : Jens-Rainer Ohm, Miroslaw Bober

MPEG-4

New Levels and Tools AmendmentThe conformance FPDAM related to 14496-2:2001/Amd.3 was issued (N5440). The DoC on the PDAM is in N5439.

Error resilience in Scalable Enhancement LayerThe expected support for this work was shown by input contributions on Momusys software implementation. The final implementation has been stalled until the respective bug fixing in the latest release of video reference software will be done (see 1.3), to circumvent versioning problems which occurred in the past; it will be available until the March meeting. The text PDAM was issued, and the software and conformance PDAMs are planned for March 2003 now.

Documents reviewed: M9144 Proposed changes to MoMuSys-1.0-001220_sony encoder

software, implementing w5160Gus ReidPaola Hobson

M9168 Modifications to the MoMuSys reference decoder implementing w5160

Ophir Azulai Yuval Noimark

Software and Conformance fixing, List of Problems reported Significant work has been done in the cleanup of the video-related software problems, in particular bugs in the Microsoft package have been fixed, and cross-check between the newest versions of the Momusys and Microsoft packages is running. Further tests were made about compatiblity of existing conformance streams with software versions, and a number of problems identified which will probably require a later corrigendum of the conformance part.A new version of the 'MPEG-4 Visual: List of Problems reported' was produced (N5408) which mainly relates to the continuing documentation of software and conformance issues. It still includes some items related to the standard text, but none of these was identified as critical, most are concerned with desirable clarifications.

Documents reviewed:

M9181 MPEG-4 Visual: Updated List of Problems Reported

Chung-Neng WangYi-Shin TungTihao ChiangJens-Rainer Ohm

M9191 Convergence of MS reference software Yi-Shin TungJa-Ling Wu

M9193 Report on status of conformance bitstreams evaluated using integrated MS reference software

Yi-Shin TungJa-Ling Wu

New edition of MPEG-4 Part 2It was decided to issue a new edition of MPEG-4 Visual part by the March 2003 meeting, integrating Amendments 1-3 and Corrigendum 2 into the 2001 edition.

MPEG-4 AVCDocuments related to AVC which were input to the video group have been brought to the attention of the JVT for proper disposition.

A major issue in the context of AVC has been the preparation of the upcoming verification test which was done jointly with the JVT and the test group. A new version of the draft verification test description was produced and approved (N5459).

Output documents related to MPEG-4No. Title TBP Available5439 Text of ISO/IEC 14496-4:2002/FPDAM3 (Visual New Levels and

Tools)N 02/12/13

5440 DoC on ISO/IEC 14496-4:2002/PDAM3 (Visual New Levels and Tools)

N 02/12/13

5406 Request for ISO/IEC 14496-2:2001/Amd.4 N 02/12/135407 Text of ISO/IEC 14496-2:2001/PDAM4 N 02/12/135408 MPEG-4 Visual: List of Problems Reported version 7.0 Y 02/12/135459 Draft 0.2 AVC Verification Test Plan N 02/12/13

MPEG-7

MPEG-7 related work in Awaji

The work in MPEG-7 mainly concerned the following themes: Review and Approval of the Visual Ad Hoc Group Recommendations Inclusion of new technology into Visual Experimental Model (for version 2) Review of the input documents and planning of new Core Experiments for version 2 Review of the reports of problems with Visual version 1 specification and preparation of the

report including solutions. Work on MPEG-7 Profiles and Profiling mechanisms (jointly with Requirements, MDS,

Audio and Systems. XM software status review with ISG (for version 2)

Review and Approval of the Visual Ad Hoc Group RecommendationsAll AdHoc group recommendations were approved.

VCE- 1 Face Recognition Descriptor

The following contributions were submitted for the meeting.

M9176 – Face descriptor using nonlinear MRDF.

This document outlines a combined PCA/LDA method with pose compensation performed in the feature space. The algorithm reduces error rate for images with pose variation. Good results were presented (not cross-verified). However the test data was used for the derivation of the pose transformation coefficients, which means that the CE procedure was not followed.

M9178 – Advanced Face Descriptor using Fourier and Intensity LDA Features The technology presented at the previous meeting by NEC and SAIT (N8998) was properly cross-verified, based on the software distributed on the visual reflector (executable). Cross-

M9176 Face descriptor using nonlinear MRDFM9178 CE report on Advanced Face Recognition DescriptorM9179 Cross-verification results of Advanced Face Recognition

Descriptor M9287 Face recognition experiments with fuzzy PCA and LDAM9308 Cross-verification results of MPEG-7 VCE-1

verification results are presented in M9308 and M9179. This method achieved overall the best performance (from all the cross-verified results, where tests followed CE procedure) and was promoted to XM.

M9287 - Face recognition experiments with fuzzy PCA and LDA

The proposal if further improvement of the method presented in M9022. It proposes a technique based on a hierarchical fuzzy local PCA/LDA. The descriptor is extensible and adaptable while preserving the forward and backward compatibility. The results presented show good performance in face retrieval part with automatic eye localization (not cross-verified).

After reviewing all presented results, the group concluded that the overall best performance was achieved by the joint proposal by NEC and Samsung as described in document N8998. This technology was included into XM. XM software will be provided within two weeks of the meeting (by 27th of December 2002).

VCE-2: Binary Representation of Visual DescriptorsM9149 - Report of the core experiment result of binary representation of visual descriptors (VCE-2)

Very few new results were presented, as it was determined that the new BiM software was not integrated in the XM. Nevertheless, some discrepancies were detected between the BiM software and Visual XM software. The recommendation is to continue the CE with the unchanged objective provide a complete set of results obtained with the latest version of BiM.

VCE-3: Definition of a new "time-sequence" container

M9146 - The Results of Cross-check for Edge Histogram Descriptor (VCE-3)

M9147 - Report of the Core Experiment of Definition and use of a new TimeSequence data container (VCE-3)

M9148 - Proposal of new dataset for Edge Histogram of VCE-3

M9151 – Crossverification result on VCE-3

M9167 - Report of the Core Experiment result of "Time Series" data container

A new dataset with ground-truth was developed and approved on the visual reflector. The group concluded that the Edge histogram descriptor performs well in conjunction with the time-sequence container and it was promoted to the XM. XM software should be provided within two weeks of the meeting (by 27th of December 2002). This CE continues with experiments investigating other descriptors.

VCE-4: Description schemes for the visual toolsM9152 - Report on the VCE-4: Visual DS framework This contribution continues a theme of a media-centric Visual Description schemes. After discussion it was agreed that two main domain

3 Core Experiments were approved for continuation and one new created (see below).

Inclusion of technology into Visual Experimental Model (for version 2) Time-sequence container in conjunction with Edge Histogram layout Advanced Face Recognition

Inclusion of technology into Visual Working Draft (for version 2)

GOP-GOF-Feature

Review of the input documents and planning of new Core Experiments for version 2

4 Core experiments are defined (N5411): VCE-1: Perceptual 3D Descriptor VCE-2: Binary Representation of Visual Descriptors VCE-3: Definition of a new "time-sequence" container VCE-4: Description schemes for the visual tools

Review of the reports of problems with Visual version 1 specification The list of problems reported (M9242) with the current specification was reviewed. Some of the contributions proposed fixes, which were approved by the group. A list of known problems is maintained by Dr Cieplinski (Leszek.Cieplinski@vil.ite.mee.com), where problems can be reported by emiail. This document is public in order to help people currently implementing the visual specification.

Review of the remaining input documentsNew experimental results for the proposal on 3D perceptual descriptor were presented. The results were encouraging and the group decided to establish CE to determine the properties and performance of the proposed technology and what the level of improvement or additional functionalities offered over descriptor from version 1.

Doc Authors Title

9210 In Kyu Park et al.

3D perceptual shape descriptor: results of exploration experiments and proposal for Core Experiments

The report report of AHG on Editing MPEG-7 Visual XM and WD was reviewed and approved (M9075)

XM software status review with ISG New tools accepted should be delivered to Stephan Herrman by 27 th of December 2002. All software currently integrated are working correctly and the software is in a very good shape.

Output documents related to MPEG-7

No. Title TBP Available5408 MPEG-7 Visual: List of Problems Reported version 2.0 Y 02/12/135409 MPEG-7 Visual Extensions WD 3.0 N 02/12/135410 MPEG-7 Visual eXperimentation Model (XM) version 17.0 N 02/12/135411 Description of Core Experiments for MPEG-7 Visual Extensions N 02/12/13

Explorations

Scalable Video CodingAs input to the Awaji meeting, software and documents were received on the proposed multimedia streaming test bed (M9182, M9183). As originally developed for the purpose of testing scalable and non-scalable video streaming technology, it was identified that the potential usage of this framework is much wider, potentially integrating different parts from MPEG standards. The related

output document of the integration subgroup is WD of ISO/IEC TR21000-12 MPEG-21 Resource Delivery Test Bed (N5494).

The breakout group on Scalable Video Coding was active during the whole week. Jointly with requirements, a new version of the document "Applications and Requirements for Scalable Video Coding" was drafted (N5326), containing now 12 application scenarios and a refined list of requirements, clustered into 17 groups, which was produced based on a number of input documents (M9197, M9246, M9261) and further discussions in the group.

Another category of input documents was related to reports on further progress of scalable coding technology (M9160, M9232, M9243, M9249, M9253, M9280, M9290).

Based on the progress made so far it was decided to issue a "Draft Call for Evidence on Scalable Video Coding Advances" (N5412), with a tentative schedule to issue the call by March, and expect the evaluation of responses in July. Evidence shall be brought based on solid testing methodology for advanced scalable technology which is related to test scenarios drawn from application requirements. The goal is to allow fair and profound comparison versus state-of-art single layer coders. Partially, comparison versus existing scalable solutions will also be performed: The first group of the tests is to be run on the delivery test bed, which will in the first phase be

made by comparison versus MPEG-4 FGS (for which an implementation already exists). In a second phase, scalable technology shall be compared versus stream switching technology, which is still to be implemented for the server and client sides of the test bed (most probably for AVC eXtended profile).

The second group of the tests is related to testing of coding efficiency of new scalable technology based on more traditional methods of subjective assessment (comparison of short decoded sequences at fixed rate). Different application scenarios are envisaged here, where the comparison versus single layer at same data rate shall be mandatory, while other scenarios are related to available bit rate utilization and multicast.

Details can be found in N5412. To minimize the effort it will be tried to use as much as possible those materials as anchors which are produced for the AVC verification tests anyhow.

To prepare the expected evidence tests accordingly, three clusters of Exploration Experiments (EE) were newly defined: EE1 – Scalability in the context of Interlaced video EE2 – Streaming of Advanced Scalable Coded Video using Multimedia test-bed EE3 – Scenarios for Advanced Scalable Coding Comparison

Finally, a first version of a document "Draft Evaluation Criteria for Scalable Video Coding Technology" was drafted, which contains methodologies and criteria of assessment of potential new scalable technology. This will both be used later in drafting a questionnaire for incoming proposals, as well as for the evaluation along with viewing results.

Documents reviewed:M9160 Contribution to EE4 : Scalable Video Coding Based on

Spatio-temporal wavelet decompositionJerome VieronChristine GuillemotStephane Pateux

M9182 FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments

Chung-Neng WangChia-Yang TsaiYao-Chung LinHan-Chung LinHsiao-Chiang Chuang Jin-He Chen

Kin Lam Tong Chun-Jen Tsai

M9183MPEG Media Streaming Reference Platform

Chun-Jen TsaiMihaela van der SchaarYoung-Kwon LIM

M9197 Proposal of Applications and Requirements for Scalable Video Coding

Hyun-Cheol KimKyuheon Kim

M9232 Recent Improvements to MC-EZBC Thomas RusertKonstantin HankePeisong ChenJohn Woods

M9243 Reduced complexity spatio-temporal scalable motion compensated wavelet video coding

Deepak TuragaMihaela van der Schaar

M9246Applications and Requirements for Multiple Description Scalable Coding

Deepak TuragaMihaela van der SchaarJohn ApostolopoulosSusie Wee

M9249 Coding of motion vectors produced by wavelet-domain motion estimation

Joeri BarbarienYiannis AndreopoulosAdrian MunteanuPeter SchelkensJan Cornelis

M9253 Control of the distortion variation in motion compensated temporal filtering

Yiannis AndreopoulosAdrian MunteanuPeter SchelkensMihaela Van der SchaarJan Cornelis

M9261 Evaluation of Adaptive Video Coding and Transmission Technologies

Peter AmonJuergen PandelAndreas HutterGero Bäse

M9280 Motion Compensated temporal filtering using longer filters

Abhijeet GolwelkarJohn W. Woods

M9290 Fully Scalable MC-EZBC in the Structured Scalable Meta-formats (SSM) Framework

John WoodsPeisong ChenShih-ta HsiangDebargha MukherjeeGeraldine KuoAmir Said

3D AV CodingIn 3D AV coding, the following experiments had been performed until Awaji, and input has been received in each category: EE1 – Evaluation of usage of mesh objects for omni-directional video EE2 – Free viewpoint video EE3 – Stereoscopic video coding using MAC EE4 – Depth/disparity coding for 3D-TVBased on the results of the experimenst, it was concluded that in principle no ‘missing links' exist in MPEG-4 related to the experiments EE1, EE3 and EE4. EE3 was decided to be discontinued at this stage, as it had turned out in the experiments that the technique available in MPEG-4 (temporal scalability for left/right stereo encoding) is superior to the other techniques investigated. For EE1 and EE4, the experiments will further continue, and it was decided that integration of investigated technology in MPEG-4 compliant software will be part of upcoming exploration experiments. Only on this basis it can be finally determined if additional normative elements are needed, and correct interoperation of normative and non-normative elements can be proven. These experiments will

then also become the basis for production of a "promotional" CD or DVD to further promulgate the technology developed.The technology investigated in EE2 (Free viewpoint video) requires potentially major new definitions not existing in any MPEG standard so far. It is still further necessary to explore the benefits of generic approach for viewpoint adaptation from an arbitrary number of camera views in the continuation of this experiment. Progress has been made in definition of a unique test data set; ongoing definition of quality measures is also an important goal of the experiments.New version of the "EE description" and the “status of exploration” documents were produced.

Documents reviewed:M9128 Experiment Evaluation about Motion Compensation of

MAC for stereoscopicZhibo ChenGuoping LiYun He

M9129 Bit rate control algorithm for MPEG-4 MAC for stereoscopic video coding

Zhibo ChenGuoping LiYun He

M9145 EE2 - Comparison of Model-based Scene Reconstruction and Rendering Methods

Christian TheobaltBastian Goldluecke Marcus Magnor Ming Li

M9184 Report of EE1 on Omni-directional Video Kazumasa YamazawaHitoshi HabeToshio NomuraTakashi Matsuyama

M9186

Report for EE3 in MPEG 3DAV

Sukhee ChoKugjin YunByungjun BaeYoungkwon HahmChieteuk AhnYongtae KimKawnghoon Sohn

M9217 Requirements on stereo matching, compression of depth maps, and generation of new viewpoint video from the viewpoint of possible contribution and primary / secondary distribution of multiview television (Rq)

Ryoichi KawadaSei NaitoAtsushi KoikeMasahiro WadaShuichi Matsumoto

M9219 Distribution of ATTEST test sequences for EE4 in MPEG 3DAV

Christoph FehnKlaas SchüürIngo FeldmannPeter KauffAljoscha Smolic

M9222 Preliminary Results on EE4 of the 3DAV AHG Michael SchuldtMarco Rittermann

M9238 Quality Measure for Ray-Space Interpolation Masayuki TanimotoToshiaki Fujii

M9256 Requirement for very high resolution video in 3DAV (Rq)

Aljoscha SmolicDavid McCutchen

M9273 Representation of Panoramic and Omnidirectional Images

Dan LelescuFrank Bossen

M9298

Proposed Evaluation Procedure for EE in MPEG 3DAV

Hanspeter PfisterPaul BeardsleyHuifang SunAnthony Vetro

M9300 Image-Based Visual Hull as a Model Reconstruction Method for EE2 in MPEG 3DAV

Hanspeter PfisterHuifang SunAnthony Vetro

Output documents related to Explorations

No. Title TBP Available5326 Applications and Requirements for 3DAV Y 02/12/135327 Applications and Requirements for Scalable Video Coding Y 02/12/135412 Draft Call for Evidence on Scalable Video Coding Advances Y 02/12/135413 Draft Evaluation Criteria for Scalable Video Coding Technology N 02/12/135414 Description of Exploration Experiments in Scalable Video Coding N 02/12/135415 Description of Exploration Experiments in 3DAV N 02/12/135416 Report on Status of 3DAV Exploration Y 02/12/13

5494 WD of ISO/IEC TR21000-12 MPEG-21 Resource Delivery Test Bed

N

5495 Rationale for the Subdivision ISO/IEC 21000 Test Bed for MPEG-21 Delivery

N 02/12/13

AHGs supported by the Video Subgroup No. Title Mtg Sponsor(s)

5417 AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software

N Video

5418 AHG on Core Experiments for Visual Descriptors and Visual-only Description Schemes in MPEG-7

Y Video

5419 AHG on Editing MPEG-7 Visual XM and WD N Video

5420 AHG on Scalable Video Coding Y Video,Requirements

5341 AHG on 3D AV Coding Y Requirements,Video

5448 AHG on MPEG Multimedia Test Bed Y Integration, Video

5461 AHG on AVC Verification Test Plan Y Test, Video5462 AHG on Production of Test Materials Y Test, Video

Annex 8Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 63rd meeting of WG11, December 9-13, 2002 in Awaji Island, Japan. The list of participants is given in Annex A-1.

Administrative mattersApproval of previous meeting reportThe Audio Subgroup Shanghai meeting report had been previously distributed by email and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting, shown in Annex A-II, was discussed, edited and approved. The documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary, are shown in the agenda and schedule. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.

Group 1 Group 2 What Where Day Time Aud Sys Binarisation Aud Tue 09:30-10:30 Req V-S-A-M MP7 Prof Req Wed 14:00-16:00 Aud Sys BIFS Aud Wed 16:00-17:00 Aud Int BWE conf Aud Wed 17:00-17:30 Aud Req MPEG-4 Profiles Aud Thu 1500-1530

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response From9158 Swiss NB comment on ISO/IEC 14496-4 (2nd edition) S. R. Quackenbush9192 FNB Comments on N5203 (Text of FPDAM extension 1 MPEG-4 S. R. Quackenbush

audio)9231 French NB comment on ISO/IEC 14496-4 (2nd edition) S. R. Quackenbush9267 DNB Comments S. R. Quackenbush9279 German National Body Position on MPEG-4 Conformance

CompletionS. R. Quackenbush

9327 DMDA issues Call for Proposals S. R. Quackenbush

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.

Record of AhG meeting on Lossless Call for PropoalsRohgshan Yu, presented m9134, “Advanced Audio Zip - Scalable perceptual and lossless audio codec.” This technology is based on an AAC core, and assumes that MDCT coefficients have a geometric distribution. The model predicts that after a set of bit slices, PDF of subsequent slices is flat. Jim Johnston presented m9136, “A Progressive to Lossless Embedded Audio Coder (PLEAC) with Multiple Factorization Reversible Transform.” It uses four rotations for “lifting” operation in integer MDCT. An implicit masking permits perceptual ordering of bits in stream. It has a low complexity “parser” and decoder.Takehiro Moriya presented m9137, “Technical descriptions of lossless audio coding proposed by NTT.” This submission is based on MPEG-4 AAC core with additional time-domain predictors. It has an enhancement layer (or file) for each Fs and Wd enhancement with respect to 48/16.Itakura Keneko and Satoshi Miyata presented m9170, “Waseda-TOA experiment on Call for Proposal MPEG-4 Lossless Audio Coding (MPEG N5208).” The full data set was delivered during the MPEG week.Ralph Geiger presented m9281, “Proposal for a Scalable Lossless Audio Codec based on MPEG-4 AAC.” The proposal is based on an MPEG-4 AAC core.Tilman Liebchen presented “Technology for MPEG-4 Lossless Audio Coding.” Technical University of Berlin made two submissions, one as lossless only, and the other based on an MPEG-4 AAC core.

Record of Audio plenary, joint meetings and task group activitiesAudio plenary discussionsReceived national body comments and liaison mattersNational body comments 9158, 9192, 9231, 9267 and 9279 concerning

MPEG-4 Extension 1 signalling MPEG-4 Extension 1 bitstream restrictions Conformance of MPEG-4 BIFS nodes

were reviewed. A liaison contribution 9327 from the Digital Media Device Association Interoperability Working Group (DMDA-IWG) informing MPEG that they have issued a call for proposals for technology that will enable digital media devices to interoperate. The text of the Call is available at http://www.dmda.org/iwg-cfp1-d1.shtml

Proposed Text for ISO/IEC 13818-4 PDAM4Jens Spille presented m9201, “Proposed Text for ISO/IEC 13818-4 PDAM4.” This described new MPEG-2 Audio Layer III Low Sampling Frequency conformance streams and indicated that these streams were already available on FTP site.

ftp://mpeg4audio:<password>@ftp.iis.fhg.de.Joint MeetingsWith Systems on BiM(See section on MPEG-7 Task Group.)

With All on MPEG-7 Profiles(See section on MPEG-7 Task Group.)

With Systems on BIFSBernhard Grill presented m9265 “Limited Usefulness of Sound2D node.” This document noted that Sound2D node is visually oriented in that it reacts to changes in X and Y space, as delineated on a 2D visual presentation screen. In this respect it is not able to represent the attenuation of sound point sources as they recede into the distance. A simple fix was proposed, which subsequently was found to be inadequate. Continued study on this issue is needed.Jens Spille presented m9204, “Proposals for Audio BIFS Version 3.” This presented a long-term vision of how BIFS might be changed and added to so as to better support audio applications, and in particular, low-cost, resourse-limited consumer applications. This interesting proposal will continue to be studied.Jerome Daniel presented 9215, “Finalizing the production and crosschecking of 3D audio conformance bitstreams.” This reported on the availability of conformance streams for the 3D audio BIFS nodes.

With Integration on MPEG-4 ConformanceIn this meeting the Integration Chair and the Audio Subgroup members discussed a process that will insure the easiest and quickest integration of Audio conformance amendments into a unified conformance document. The plan is for the conformance amendment editor to maintain both the amendment text (which is typically a “from/to” delta document) and an updated version of the entire conformance specification that reflects the incorporation of all of the amendment changes. Note that the Audio Subgroup will take charge of obtaining document numbers for Audio contributions to conformance that are “Study on” or at Working Draft level, whereas the Integration Subgroup will take charge of obtaining document numbers for Audio contributions to conformance that are at CD level and beyond.

With Requirements on MPEG-4 ProfilesSince the Audio Subgroup could not gain consensus on any of the proposed changes to the AAC or High Efficiency AAC profiles, the Requirements Chair did not need to approve any text. However, the Requirements Chair did give the Audio Subgroup members guidance on how to formulate profiles. That being that promoting interoperability was of paramount importance, but that balancing that with an appropriate level of complexity so as to gain maximum support from industry was also important.

Task group discussionsMPEG-1/2 Layer IIIThe audio subgroup reviewed the input document m9202 concerning the transport of an mp3 bitstream via an MPEG-4 system. The audio group agreed, that the transportation is well defined in the MPEG-4 system document, using the objectTypeIndication 0x6B "Audio ISO/IEC 11172-3"

and 0x69 "Audio ISO/IEC 13818-3". Decoder Specific Information is not defined and is not necessary. The access units should be used as defined in MPEG-1/2, starting with the syncword and ending with the last byte before the next syncword. There was a request to define an additional objectTypeIndication for an easily "editable" mp3-stream, so that MPEG-4 editing systems need no specific bitstream knowledge. This issue will be discussed in the AhG on MPEG-2 Audio Reference Software.

MPEG-2 AAC, MPEG-4 Audio Text, MPEG-4 Conformance, MPEG-4 Reference SoftwareM9116, m9247, m9250, m9251, m9252 and m9284, were presented. Jean-Claude DuFoud was kind enough to include the text of m9116 into a Systems amendment on IPMP.

MPEG-4 Extension 1, BWE (FPDAM 02/10)Kristofer Kjörling presented m9274, “Additional information on how to handle 960 frame size for the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension.” This reviewed the changes to the FPDAM text necessary to support 960 block length. With regard to changes needed to the reference software, the MPEG-4 mp4mcDec does not support 960 block length, and this capability must be incorporated since MPEG-4 Extension 1 depends on this specific AAC decoder. In addition, the number of samples per block in each subband filter in the MPEG-4 Extension 1 decoder analysis filterbank must be as follows:

32 samples for 102430 samples for 960

The schedule for modifying the reference software to support the 960 block length is indicated in workplan.Kristofer Kjörling presented m9277, “Inverse filtering bug fix for the reference software corresponding to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension,” which describes an error found by NEC and how to fix it (it being a mis-match of band edges as specified in the text and implemented in the reference code). Both Coding Technologies and NEC did comparative tests on effect of this change, and at both test sites no listener detected any difference.Kristofer Kjörling presented m9278, “Editorial changes to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension document,” which presented an overview of many editorial changes, none of which change the performance of the current system. Pierrick Phillipe requested that the single rate mode reserved bit change not be implemented in the study on text, pending evidence that he hopes to bring to the next MPEG meeting. Daniel Homm presented “Clarifications of bitstream restrictions for AAC+SBR.” In the subsequent discussion, the Audio subgroup members agreed to keep the maxQMFChannels restriction, but to remove the AAC bitstream restriction (for AAC streams carrying SBR data).Bernhard Grill presented m9283, “Comments on the AAC Profiles.” This proposed several changes to the AAC profile that would enhance its interoperability. There was no consensus on the proposals, and so this will continue to be studied in the AHG period. However it is noted that since Extension 1 progresses to FDAM at the next meeting, profile discussions must be concluded at the next MPEG meeting.Triggered by the National Body Comments m9192 and m9267, the alternatives to signal and embed SBR data in MPEG-4 (see N5204) have been discussed extensively. There was no consensus w.r.t. signalling, and so this will continue to be studied in the AHG period. Especially, the handling of the embedded data descriptor (alternative 2 in N5204) within MPEG-2 and MPEG-4 Systems needs to be clarified. The proposed method for signalling SBR data in MPEG-4 is described in N5378. By means of resolution 3.3.2 in N5316, national bodies are invited to take this document into consideration when making comments on the FPDAM (N5203). It is noted that since Extension 1 progresses to FDAM at the next meeting, signalling discussions must be concluded at the next MPEG meeting.

MPEG-4 Extension 2, Parametric Coding (PDAM 02/12)Werner Oomen presented m9212, “WD of MPEG-4 Audio Extension 2, Parametric Coding [RM3].” The Audio subgroup agreed that this text be promoted to PDAM at this meeting. The new Reference Model code was uploaded to the Hannover ftp site.Werner Oomen presented m9213, “Support for changing parameter values in MPEG4 Extension 2 (parametric coding for HQ Audio).” This document outlines changes needed in the working draft text to support dynamic (i.e. changes on a per-frame basis) parameter values. The proposal does not change the bitstream syntax. Generally, more flexibility is a good thing, but the chair asked Philips to bring evidence to the next meeting (using bitrates, parameterizations and signals of their choosing) that motivate the utility of the increased flexibility. This process is outlined in the workplan on Extension 2 core experiments N5382. It was agreed to include the proposed textual changes in the PDAM.Werner Oomen presented m9214, “Decoding stereo base layer in MPEG4-Extension 2 (Parametric coding).” This requested to change the working draft. The Audio experts agreed that this is clearly the right thing to do, and so it was accepted. The proposed changes have been added to the PDAM.

MPEG-4 Extension 3, Lossless CodingThe work of the AhG continued in this task group. A report on the CfP of Audio Lossless Coding was generated, which included an Excel spreadsheet containing the compression performance of the submissions, and three charts giving various summary statistics on the performance of the submissions. Since the performance of the best submissions is comparable, and since the variety of music in the test set was limited, and since the submissions offer a great variety of functionality, the Chair did not feel that it was possible to identify the best submission at this meeting. A Workplan for Evaluation of Audio Lossless Coding Submissions was generated to guide the continued evaluation of submissions in the AhG period. As a means to inform the evaluation process, a document describing Application Scenarios for Audio Lossless Coding was generated. This document will continue to be added to in the AhG period.The Audio Chair notes that those proponents that are not already on the MPEG Audio Subgroup email list (mpegaudsg@uow.edu.au) and wish to be on this list should send a request, with contact information, to the the Audio Chair.

MPEG-7 Ext 1, Conformance and Ext 1 Reference Software (Markus Cremer)The status of the XM-software and conformance has been assessed and found to be progressing satisfactorily. The reorganisation of the FTP site has been successfully conducted and additional test signals have been collected. The group plans to complete the XM software and conformance by the start of the 64th MPEG meeting. Implementations for Version 2 have partly been uploaded but this work still has to be completed. A joint CE with systems on uniform quantization within BiM has been successfully completed. This CE will continue with non-uniform quantization. A CE on binary representation of directed and undirected graphs has been successfully concluded and MPEG-7 Audio investigates other use cases for this coding method within all of MPEG-7. Milestones for two CE's concerning Version 3 of MPEG-7 Audio have been shifted to the 64th meeting due to the absence of the involved parties. However, further possible additions to Version 3 of the standard were discussed. Also, MPEG-7 Audio welcomes new proposals for additional D/DS for the standard.Regarding the ongoing development of profiles and levels within MPEG-7 Requirements, MPEG-7 Audio has discussed several candidates for profiles within Audio and will continue to pursue this matter.

MPEG-4 BIFS, MPEG-21 DIA and 3D-AudioGuillaume Potard presented m9171, “Report of the second MPEG-4 AudioBIFS Sound Source Wideness Core Experiment.” In this CE, sound shapes could not be differentiated, so if was decided

that this component of the work will not be continued. In contrast, source wideness could be differentiated, and that work will continue. M9173, “Report of the Core Experiment on Soundfield Description for Audio Presentation Preference in MPEG-21 DIA” was presented. This CE assessed the effectiveness of the SoundField and PresetSoundField descriptions. It concluded that some individuals like SoundField processing, while others do not, and further proposed that the SoundField description would still be useful to serve the population that does prefer it. However, some members of the Audio group, including the Chair, felt that this work does not show sufficiently strong results, and so there was no concensus to promote it at this time.Jerome Daniel presented m9285, “Comments and add-ons on previously proposed 3D Audio DIA descriptors, considering mature or emerging technologies.” This work investigated higher order Ambisonics sound capture systems (having 32 distinct microphone capsules). It supports sound presentation on a variable number of speakers, such as stereo, 5.1 surround, or even hemispherical or spherical speaker arrays. In conclusion, the author proposes to have workplan on static room equalization.

Meeting deliverablesPress statementThere was not time to prepare an Audio part of the press statement.

Dispositions of CommentsThere were no DoC.

Responses to Liaison and NB commentsResponses to Liaison and NB contributions were prepared by the chair, but there was not time to review them.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

1. N5449: AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP42. N5450: AHG on MPEG-2 AAC 3. N5451: AHG on MPEG-4 Audio Conformance 4. N5452: AHG on MPEG-4 Audio Text and Software 5. N5453: AHG on MPEG-4 Audio Extensions and Core Experiments6. N5454: AHG on MPEG-4 Lossless Coding 7. N5455: AHG on MPEG-7 Audio 8. N5456: Ad-Hoc group on MPEG-4 AudioBIFS Extensions and MPEG-21 DIA for

Audio

Approval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are shown in the table listing the Ad Hoc groups.

Agenda for next meetingThe agenda for the next MPEG meeting, shown in Annex V, was reviewed and approved.

All other businessThere was none.

Closing of the meeting The Chair thanked the parties that responded to the Call for Proposals on Audio Lossless Coding. It is certainly gratifying to see new faces ready to contribute to Audio-related MPEG technical work. The Chair apologizes in advance for the lack of detail in this Audio report, but this was due to the high degree to which the Chair was engaged in facilitating task group activities as opposed to recording the details of such task group activities.

The Chair closed Audio plenary at 13:55 hrs. Sorry!

Annex A-I: Participants

First Name Last Name Country Affiliation e-mail addressTadashi Abe JP Matsushita tedabe@arl.drl.mei.co.jpKok Seng Chong SG Panasonic

Singaporekschong@psl.com.sg

Markus Cremer DE FhG IIS-A cre@emt.iis.fhg.deMartin Dietz DE Coding

Technologiesdiz@codingtechnologies.com

Seymour Shlien CA CRC Seymour.shlien@crc.caRalf Geiger DE FhG IIS-A ggr@emt.iis.fhg.deRichard Gooch UK IFPI Richard.gooch@ifpi.comBernhard Grill DE FhG IIS-A grl@iis.fhg.deDaniel Homm DE Coding

Technologieshomm@codingtechnologies.com

Hiroyuki Honma JP Sony Honma@av.crl.sony.co.jpHongtao Hu CN Samsung China huht@samsung.co.krJames Johnston US Microsoft

Corporationjamesdj@microsoft.com

Uwe Jost UK Canon uwe@cre.canon.co.ukItaru Kaneko JP Waseda Univ. itaru-k@acm.orgHyoung-Gook

Kim DE TU Berlin kim@nue.tu-berlin.de

Sang-Wook

Kim KR Samsung swkim@samsungait.com

Kristofer Kjörling SE Coding Technologies

kk@codingtechnologies.com

Marc Klein Middelink

NL Philips marc.klein.middelink@philips.com

Alain Le Guyader FR FTR&D alain.leguyader@francetelecom.comTilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.deXiao Lin SG I2R linxiao@i2r.a-star.edu.sgBrian Link US Dolby bdl@dolby.comKazuaki Maeda JP TOA maeda_kazuaki@toa.co.jpMitsuru Maeda JP Canon Inc. maeda.mitsuru@canon.co.jpJun Matsumoto JP Sony jun@av.crl.sony.co.jpSatoshi Miyata JP TOA miyata_satoshi@toa.co.jpTakehiro Moriya JP NTT moriya.takehiro@lab.ntt.co.jpSua-Hong Neo SG Panasonic shneo@psl.com.sgToshiyuki Nomura JP NEC t-nomura@ccm.cl.nec.co.jpTakeshi Norimatsu JP Matsushita norima2@arl.drl.mei.co.jpWerner Oomen NL Philips werner.oomen@philips.comPierrick Philippe FR France Telecom

R&Dpierrick.philippe@francetelecom.com

Guillaume Potard AU Univ of Wollongong

gp03@uow.edu.au

Schuyler Quackenbush US ARL srq@ieee.orgSusanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sgYuriy Reznik US Realnetworks yreznik@real.com

Jan Rohden DE FhG AEMT rou@emt.iis.fhg.deJeongil Seo KR ETRI seoji@etri.re.krOsamu Shimada JP NEC shimada@ccm.cl.nec.co.jpRalph Sperschneider DE FhG IIS-A sps@iis.fhg.deJens Spille DE Thomson Jens.Spille@thomson.netNaoya Tanaka JP Panasonic natanaka@arl.drl.mei.co.jpMauri Väänänen FI Nokia Res.

Centermauri.vaananen@nokia.com

Dai Yang JP NTT yang.tracydai@lab.ntt.co.jpRongshan Yu SG I2R rsyu@i2r.a-star.edu.sgJerome Daniel FR France Telecom

R&Djerome.daniel@francetelecom.com

Annex A-II: Agenda and Schedule for the Awaji Island MPEG Audio MeetingNOTE: This schedule (and the week’s schedule for every other Sub-Group) was available during the MPEG week at

http://10.20.200.14/MPEGschedule

Time Agenda Item Room311-A

Room202

Number Title Source

Sunday0900-1630 AHG on Lossless CfP9134 Advanced Audio Zip - Scalable perceptual and lossless audio codec Yu Rongshan

Lin XiaoSusanto Rahardja

X

9136 A Progressive to Lossless Embedded Audio Coder (PLEAC) with Multiple Factorization Reversible Transform

Jin LiJames D. Johnston

X

9137 Technical descriptions of lossless audio coding proposed by NTT Takehiro MoriyaAkio JinKazunaga IkedaDai Tracy Yang

X

9170 Waseda-TOA experiment on Call for Proposal MPEG-4 Lossless Audio Coding (MPEG N5208)

Itaru KanekoSatoshi MiyataKazuaki Maeda

X

9194 Cross check of MPEG-4 lossless proposals Pierrick PhilippeSchuyler Quackenbush

X

9281 Proposal for a Scalable Lossless Audio Codec based on MPEG-4 AAC Geiger Joachim Deguara Jürgen Herre Gerald Schuller

X

9314 Technology for MPEG-4 Lossless Audio Coding Liebchen X

Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1700 Audio Plenary 

Opening of the meetingAudio Chair X

Administrative matters XApproval of agenda XApproval of Shanghai meeting report X

9320 62nd MPEG Audio Report Quackenbush X

Communications from the ChairX

List of contributions XAllocation of contributions to agenda and schedule XJoint meetings XReview of AhG reports X

9085 AHG Report on MPEG-2 AAC Ralph Sperschneider X9086 AHG Report on MPEG-4 Audio Conformance Ralph Sperschneider X9087 AHG on MPEG-4 Audio Text and Software M. Vaananen X9084 AHG on MPEG-2 Audio Reference Software Jens Spille X9088 AHG on MPEG-4 Audio Extensions and Core Experiments Schuyler Quackenbush X9089 AHG on MPEG-4 Lossless Coding Schuyler Quackenbush X9090 AHG on MPEG-7 Audio Schuyler Quackenbush X9091 AHG on MPEG-4 AudioBIFS and MPEG-21 Digital Item Adaptation for 3D-

Au dio Guillaume Potard X

Review of task groups and mandates XReceived national body comments and liaison matters X

9158 Swiss NB comment on ISO/IEC 14496-4 (2nd edition) Zoia X9192 FNB Comments on N5203 (Text of FPDAM extension 1 MPEG-4 audio) Pierrick Philippe X9231 French NB comment on ISO/IEC 14496-4 (2nd edition) Marc Emerit X9267 DNB Comments H.A. Gelissen (editor) X9279 German National Body Position on MPEG-4 Conformance Completion Ralph Sperschneider X9327 DMDA issues Call for Proposals Whit e X1800- HOD Meeting1800-1900 Plenary issues

9201 Proposed Text for ISO/IEC 13818-4 PDAM4 Jens Spille X

Tuesday

Time Agenda Item Room311-A

Room202

Number Title Source0900-0930 Audio Plenary Audio Chair

Outline plan for the dayBreak into task group activity

0930-1000 Joint meeting with Sys on MPEG-7 Binarization9157 CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata Rohden

1000-1130 MPEG-7 Ext 1, Conformance and Ext 1 Reference Software9299 Status of Audio Matlab XM (Version 1) Casey et. al. N/A

0930-1130 MPEG-4 Extension 1, BWE (FPDAM 02/10)9266 Clarifications of bitstream restrictions for AAC+SBR Ziegler Martin Dietz

Daniel HommX

9274 Additional information on how to handle 960 frame size for the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension

Kristofer KjörlingFredrik Henn

X

9277 Inverse filtering bug fix for the reference software corresponding to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension

Kristofer Kjörling X

9278 Editorial changes to the ISO/IEC 14496-3:2001/FPDAM 1, Bandwidth Extension document

Kristofer Kjörling X

1100-1300 MPEG-4 Extension 2, Parametric Coding (PDAM 02/12)9212 WD of MPEG-4 Audio Extension 2, Parametric Coding [RM3] Werner Oomen X9213 Support for changing parameter values in MPEG4 Extension 2 (parametric coding

for HQ Audio)Erik SchuijersWerner Oomen

X

9214 Decoding stereo base layer in MPEG4-Extension 2 (Parametric coding) Erik SchuijersWerner Oomen

X

1200-1300 Lunch

1300-1500 MPEG-4 BIFS, MPEG-21 and 3D-Audio9171 Report of the second MPEG-4 AudioBIFS Sound Source Wideness Core

ExperimentGuillaume PotardJeongil SeoJens SpilleDaeyoung Jang

X

9173 Report of the Core Experiment on Soundfield Description for Audio Presentation Preference in MPEG-21 DIA

Daeyoung JangKyeongok KangGuillaume Potard

X

9285 Comments and add-ons on previously proposed 3D Audio DIA descriptors, considering mature or emerging technologies

Jerome Danie l X

1500-1700 MPEG-2 AAC, MPEG-4 Audio Text, MPEG-4 Conformance, MPEG-4 Reference Software

9116 Proposed new test sequences for Audio nodes conformance Giorgio Zoia X9284 MPEG-2 AAC Conformance roll-up Ralph Sperschneider on

behalf of the AHG on MPEG-2 AAC

9247 Proposed Second Edition on ISO/IEC 13818-7 Ralph Sperschneider on behalf of the AHG on MPEG-2 AAC

X

9250 Audio part of proposed Second Edition on ISO/IEC 14496-4 Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance

X

9252 Status of MPEG-4 Audio Conformance Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance

X

9251 Preparation for ISO/IEC 14496-3:2001/Cor2 Marc Klein MiddelinkRalph SperschneiderAndreas Hoelzer

X

1700-1730 MPEG-4 Extension 1, BWE (FPDAM 02/10)

9283 Comments on the AAC Profiles Bernhard Grill Ralph Sperschneider

1730-1800 MPEG-1/2 Layer III9202 Decoder Specific Information Descriptors and Access Unit definition for Non

MPEG-4 Audio DecodersJens SpilleErnst F. Schroedere

X

1800-1830 Audio Plenary Audio ChairStatus for Chairs Meeting

Time Agenda Item Room311-A

Room202

Number Title Source1800-1900 Liaison Meeting1900- Chairs Meeting

Wednesday0900-1100 MPEG Plenary1100-1130 Report on Chairs meeting and outline of plan for the day Audio Chair

Task group activity

1130-1300 MPEG-4 Extension 3, Lossless CodingCfP Report

1300-1400 Lunch

1400-1600 Joint meeting of All on MPEG-7 Profiles

1400-1600 MPEG-4 Extension 3, Lossless CodingCfP Report

1600-1630 Audio Plenary 1600-1630 Joint meeting with Systems on BIFS and 3D Sound 9265 Limited Usefulness of Sound2D node Oliver Baum X9204 Proposals for Audio BIFS Version 3 Jens Spille X9215 Finalizing the production and crosschecking of 3D audio conformance bitstreams Jérôme Daniel

Riitta VäänänenJean-Bernard Rault

X

1630-1700 Joint meeting with Integration on MPEG-4 Extension Conformance

1700-1800 Task group activity

1830-2200 Social

Thursday0900-0930 Outline plan for the day Audio Chair0930-1000 Joint meeting with Test on MPEG-4 Extension 1 Verification Test

1000-1300 Task group activityMPEG-4 Extension 1 Verification TestMPEG-4 Extension 1 Signalling

1300-1400 Lunch

MPEG-4 Profiles

1500-1530 Joint meeting with Req on new MPEG-4 profiles

Lossless Workplan

1700-1730 Audio Plenary Audio ChairStatus for Chairs Meeting

1800- Chairs Meeting

Friday0900-1300 Audio Plenary

Report on Chairs meeting and outline of plan for the day Audio ChairDiscussion of unallocated contributionsMeeting deliverables

Press statementDispositions of comments XResponses to NB commentsLiaison statements XRecommendations for final plenary XEstablishment of new Ad-hoc groups X

Time Agenda Item Room311-A

Room202

Number Title SourceApproval of output documents XReview of Audio MPEG plenary presentation X

Future activitiesAgenda for next meeting

A.O.B. XClosing of the Audio meeting At

13:551300-1400 Lunch1400- MPEG Plenary

Annex A-III: Task Groups1. MPEG-1/2 Layer III

ChairJens SpilleMandates:1.1. Prepare Working Draft of 13818-4:????/AMD ? (MPEG-2 Conformance)1.2. Discuss carriage of MPEG-1/2 in MPEG-4 file format

1.2.1. Consider preparing informative annex for MPEG-1/2 (that defines “access unit”)

2. MPEG-2 AAC, MPEG-4 Audio Text, MPEG-4 Conformance, MPEG-4 Reference SoftwareChairRalph SperschneiderMandates:2.1. Revise N4756 (Fairfax) “Text of ISO/IEC 13818-7:1997/COR2”2.2. Prepare ISO/IEC 13818-7:200x (MPEG-2 AAC, Second Edition)2.3. Review and Prepare MPEG-2 AAC Conformance Roll-up

2.3.1. Consult with Integration group2.4. Review headers in 13818-5/AMD1/Cor12.5. Review Audio part of ISO/IEC 14496-4:20022.6. Review proposed ISO/IEC 14496-3:200x (3rd edition)

2.6.1. Revise Proposed ISO/IEC 14496-3:200x/Cor x2.7. Review and revise Status of MPEG-4 Audio Conformance

3. MPEG-4 Extension 1, BWE (FPDAM 02/10)ChairSchuyler QuackenbushMandates:3.1. Review AHG recommendations and resolve outstanding issues, e.g.:

3.1.1. Method(s) for signaling BWE3.1.2. Restrictions in AAC compressed frame length when used in conjunction with BWE.

3.2. Prepare Study on ISO/IEC 14496-3:2001/FPDAM 13.3. Prepare Readers Lazy Dog for FPDAM 3.4. Prepare Proposed method for signaling SBR3.5. Prepare Workplan for MPEG-4 Extension 1 Verification Tests

4. MPEG-4 Extension 2, Parametric Coding (PDAM 02/12)ChairWerner OomenMandates:4.1. Prepare Rational for ISO/IEC 14496-3:2002/PDAM 24.2. Prepare Text of ISO/IEC 14496-3:2002/PDAM 2 (Parametric Coding for High Quality Audio)4.3. Prepare Workplan for MPEG-4 Extension 2 Core Experiments

5. MPEG-4 Extension 3, Lossless CodingChairSchuyler QuackenbushMandates:5.1. Review contributions5.2. Review recommendations of AHG5.3. Prepare Report on CfP of Audio Lossless Coding5.4. Discuss CfP evaluation process

5.4.1. Consider new test material and associated coded material5.5. Prepare Workplan for Evaluation of Audio Lossless Coding Submissions5.6. Prepare Application Scenarios for Audio Lossless Coding

6. MPEG-7 Ext 1, Conformance and Ext 1 Reference SoftwareChair Uwe Jost

Mandates:6.1. Review Status and Workplan for MPEG-7 Audio Ref Sw and Conformance6.2. Review methods for extension of BiM

7. MPEG-4 BIFS, MPEG-21 DIA and 3D-AudioChairGuillaume PotardMandates:

7.1. Review CE activity.7.2. Prepare Call for Requirements for new MPEG-4 Audio BIFS (“Version 3”)7.3. Revise Workplan for MPEG-4 AudioBIFS Sound Source Wideness Core Experiment

Annex A-IV: Output DocumentsOutput DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public).No. Title Subgroup TBP Available Available

13818-4 MPEG-2 Conformance 5372

WD of 13818-4:1998/AMD 4 (New Audio LIII bitstreams)

Audio No 02/12/13 02/12/13

5373

Study on MPEG-2 AAC Conformance Audio No 02/12/13 02/12/13

13818-7 MPEG-2 Advanced Audio Coding5374

ISO/IEC 13818-7:2003 (MPEG-2 AAC, Second Edition)

Audio No 03/01/15 03/01/15

14496-3 MPEG-4 Audio5375

Proposed ISO/IEC 14496-3:200x/Cor x Audio No 02/12/13 02/12/13

5376

Study on ISO/IEC 14496-3:2001/FPDAM 1 Audio No 02/12/13 02/12/13

5377

Guide to changes in ISO/IEC 14496-3:2001/FPDAM 1

Audio No 02/12/13 02/12/13

5378

Proposed Method for Signaling SBR Audio No 02/12/13 02/12/13

5379

Workplan for MPEG-4 Extension 1 Verification Tests

Audio No 02/12/13 02/12/13

5380

Rational for ISO/IEC 14496-3:2002/AMD 2 Audio No 02/12/13 02/12/13

5381

Text of ISO/IEC 14496-3:2002/PDAM 2 (Parametric Coding for High Quality Audio)

Audio No 02/12/13 02/12/13

5382

Workplan for MPEG-4 Extension 2 Core Experiments

Audio No 02/12/13 02/12/13

5383

Report on CfP of Audio Lossless Coding Audio No 02/12/13 02/12/13

5384

Workplan for Evaluation of Audio Lossless Coding Submissions

Audio No 02/12/13 02/12/13

5385

Application Scenarios for Audio Lossless Coding Audio No 02/12/13 03/01/15

5386

Draft Requirements for New MPEG-4 Audio BIFS (Version 3)

Audio No 02/12/13 02/12/13

5387

Workplan for MPEG-4 AudioBIFS Sound Source Wideness Core Experiment

Audio No 02/12/13 02/12/13

14496-4 MPEG-4 Conformance 5388

Status of MPEG-4 Audio Conformance Audio No 02/12/13 02/12/13

15938-4 MPEG-7 Audio5389

Status and Workplan for MPEG-7 Audio Core Experiments

Audio No 02/12/13 02/12/13

15938-6 MPEG-7 Conformance 5390

Status and Workplan for MPEG-7 Audio Conformance and Reference Software

Audio No 02/12/13 02/12/13

539 Workplan for Second Core Experiment on Audio No 02/12/13 02/12/13

117

1 Soundfield for MPEG-21 DIA

118

Annex A-V: Agenda for the 64th MPEG Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Shanghai meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG-4 Bandwidth Extension3.2. MPEG-4 Parametric Coding3.3. MPEG-4 Text, Ref. SW and Conformance3.4. Evaluation of Call for Lossless Proposals3.5. Call for Information and Interest on Lossless Audio

Coding for Oversampled One-Bit Representations3.6. MPEG-73.7. MPEG-4 BIFS, MPEG-21 Audio and 3D Audio

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

119

Annex 9Report of SNHC meeting

Source: Mikaël Bourges-Sévenier

Opening of the MeetingApproval of the agendaGoals for the weekThe goals of this week are:

Find a solution for MPEG-4 3D player Define a development work plan depending on the MPEG-4 3D player solution Answer the NB comments for ISO/IEC 14496-1:2001/FPDAM4 Promote ISO/IEC 14496-1/FPDAM4 to FDAM4 Create ISO/IEC 14496-16/FDIS "Animation Framework eXtension (AFX)" Evaluate the results of on-going Core Experiments and define new ones depending on the

contributions Understand relationships with MPEG-7 and MPEG-21 activities related to 3D Update the repartition of the work between SNHC and Systems Start the discussion on AFX profiles and levels Define requirements for On-Line Gaming (OLGA)

120

Schedule

Time Monday Tuesday Wednesday Thursday Friday08 :00

:30

09 :00:30

10 :00:30

11 :00:30

12 :00:30

13 :00:30

14 :00:30

15 :00:30

16 :00:30

17 :00:30

18 :00:30

19 :00:30

20 :00:30

21 :00:30

Chairs Meeting

MPEG Plenary

Lunch Break

MPEG Plenary

MPEG Plenary

Lunch BreakLunch Break

Social Event

Chairs Meeting

Lunch BreakLunch

Presentation reviewOutput docs review

Roll call, agendaAFX FAQ

AFX reference software

DemonstrationsLiaison

AFX FPDAM4 editingConformance and profiles

DIBR resultsScene partitioning resultsShadow node

BBA encoding hintsBitWrapper

3DAV requirementsFPDAM4 Systems issuesFPDAM4 DoC review

AFX software workplan review

AFX profiles

OLGA requirements

Reference software integration

AFX applications and profiles

9210 - MPEG-7 3D Shape

IM1 1019307 - MPEG-21

Reference Software integration

Reference software integration

Reference software

121

22:00…

Allocation of joint meetings

Sub-Groups Monday Tuesday Wednesday Thursday FridaySystems 17:00 – 18:00

AFX ref sw14:00 – 16:00

AFX-ATG issue3DAV

Requirements 14:30 – 17:303DAV requirements

9:00 – 10:30OLGA requirements

AFX profilesVideo

MPEG-7 16:00 – 16:303D Shape descriptor

MPEG-21 10:30 – 11:00Graphics DIA

Rooms allocationSNHC 302 up to 6pm after it's Liaison/HoDSystems 311-BVideo 405Requirements 301MPEG-7 403MPEG-21 Reception Hall A

103: who comes first!Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00 MPEG Gen.

122

N° Title Schedule ActivityReport of AhGs on AFX MikaëlReport of AhG on OLGA MariusSNHC D1 15h00-18h00 SNHC Gen.

Agenda 15h00SNHC FAQ 15h30AFX reference software, conformance, profiles

16h00

AFX DoC & FDAM4 editing9295 FNB comments9236 INB comments9317 BNB on backchannel9125 KNB/NNB comments

17h00

Systems D1 15h00-21h00 MPEG Gen.

9301 MPEG-4 for fun: demonstration of multimedia gaming

Marius Preda 18h00

Reference software integration Mikaël 19h00

D2 Tuesday D2SNHC D2 09h00-13h00 AFX

Reference software integration Mikaël 09h009118 Shadow Node for MPEG-4 Application Helge Drumm 11h009208 BitWrapper in XMT-A James 12h009302 BBA encoding hints in XMT Marius Preda 12h00

Requirements on 3DAV D2 14h00-17h00 OLGA

3DAV – SNHC interaction 14h00

D3 Wednesday D3MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-13h00 AFX

9209 DIBR results Mahnjin 11h00AFX applications and profiles Mikaël 12h00

123

N° Title Schedule ActivitySystems on FPDAM4 D3 14h00-16h00 Systems AMD4

9125 Summary of voting Olivier / Mikaël 14h009296 MU work plan Olivier 14h309304 XMT-A corrections Mikaël 15h009237 Report on SynthesizedTexture CE Shlomo Birman 16h009236 Israeli NB Comment AFX and

SynthesizedTexture CEIsraeli National Body 16h00

9156 Request for a fix of the gradient nodes Cyril Concolato 16h30MPEG-7 D3 17h00-18h00 MPEG-7

9210 MPEG-7 Shape descriptor 17h00

D4 Thursday D4Requirements on AFX profiles D4 09h00 – 09h45 AFX

AFX profiles Mikaël 09h00Requirements on OLGA D4 09h45 – 10h30 OLGA

9169 Proposal on requirements and a straw man architecture of 3D graphics for constraint devices

Itaru Kaneko 09h45

MPEG-21 D4 10h30 – 11h00 MPEG-21 DIA

9307 MPEG-21 Graphics DIA 10h309262 Scene partitioning using Volumic Space

Partition (VSP)Alain Mignot 11h00

SNHC D4 11h00 – 17h00 SNHC Gen.

9263 Report on A12 - CE Scene Partition Alain Mignot 11h00FPDAM DoC review Mikaël 14h00Player 3D workplan review Mikaël 15h00AFX profiles Mikaël 16h00

D5 Friday D5SNHC D5 09h00-11h00 SNHC Gen.

Output documents review Mikaël 09h00

124

N° Title Schedule ActivityMPEG Plenary D5 014h00-22h00 MPEG Gen.

125

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/SNHC/AFX" module (case sensitive)

FAQAs AFX becomes the new Part 16 of MPEG-4 standard and is FDIS at this meeting, the FAQ is being updated by all participants. Leonardo indicated in plenary that he will help describing what AFX is AFX activitiesM9118 - Shadow nodeiAvas project aims at integrating natural shaped video object casts shadows onto synthetic objects. A shadow is a lack of illumination from different light sources that can be point, directional and area light sources.Global illumination techniques such as ray-tracing and radiosity provide shadows inherently but they are not real-time, especially for complex scenes.For interactive scenes, it is proposed shadows are needed for better realism. However, what are needed are shadows good by physical correctness but not real-time i.e. fake shadows.

For simulation of real-time shadows, the following methods are proposed: Shadow maps Shadow volumes Projected shadows

Today's vertex shaders can tremendously accelerate shadow maps techniques at very cheap costs. This well-known technique is commonly used in games.Shadow volume is a complex technique that involves fast scene management. This technique provides soft shadows (penumbra).Depth shadow maps: render scene from the light's point of view, then render the scene from viewpoint's point of view. This technique is fast and provides penumbra. But artifacts may appear because you might not have enough precision for the shadow scene; filters might be used to smooth the final image.

In all these three cases, rendering shadows is done using multi-pass rendering of the same scene at each frame.

The proposed Shadow node enables many types of shadow methods and is designed for future algorithms. In a Group node, you can have multiple light sources but only one shadow node. The Shadow node defines the shadow properties for a set of surfaces.

CommentsIn the current definition of the node,

Softness is like radiant transparency: transparent at the outside of the shadow and opaque inside the shadow.

127

The level field cannot ensure a deterministic rendering across terminals because it is an implementation hint; we decide to remove this field.

ResolutionThe proposed node needs more investigation. A new Core Experiment is created with the following partners: SGDL, EPFL, Superscape, Univ. Ilmanau.M9208 – BitWrapper node in XMT-AAuthor should have ability to control the encoding of a bitstream. Using XMT, encoding hints are proposed, following the design of PredictiveMFField.New encoding parameters are proposed for Interpolator Compression. Other parameters will be proposed for MeshGrid and Wavelet Subdivision Surfaces.

ResolutionAdopt the proposed syntax. This will be included in a future Amendment to Part 16.M9302 – BBA encoding hints in XMT-AThe proposed BBA encoding hints follows the existing FBA encoding hints in XMT-A.

ResolutionAdopt the proposed syntax. This will be included in a future Amendment to Part 16.M9209 – DIBR resultsThis is an intermediate report using lossless coding of PointTextures. As depth information is very sensitive to lossy schemes, lossless compression has been envisioned. The proposed results show 10 times better compression than WinZip and 25% improvement compared to previous results in shanghai.

Notes regarding 3DAV experiment 2 (see section )In 3DAV, two methods are close to image-based representation techniques:

The visual hull method is similar to image-based representations in SNHC but it has too many voxels remaining in convex parts.

The polyhedral hull method enables to discard meaningless Voxels.

While SNHC defines the structure and rendering of image-based representations, 3DAV participants are interested in acquisition and compression. Therefore, the existing image-based representations tools in AFX specification are sufficient for proposed 3DAV applications reviewed in section .

ResolutionContinue the CE for lossless compression of PointTextures and add the technology into the VM.Start investigating lossy compression schemes.M9262 – Scene partitioning using Volumic Space Partition (VSP)The proposal evaluates the impact of VSP on view frustum culling and inclusion processing.The new node VSP is proposed. It defines a bounding volume for one or more 3D objects to accelerate rendering performance.

ResolutionThe technology goes in VM document and the CE continues for evaluation of relationships with cell & portals.Conformance & reference softwareChoosing a platform for MPEG-4 Player 3DM9312 proposes three solutions:

Update IM1-3D player, which is not maintained since 1999.

128

Blaxxun 4.3 with Web3D Community Source license BitManagement license and integration

BitManagement uses IM1 Core and adds a renderer to it. This solution would save lots of time and provides MPEG an integrated MPEG-4 3D software with no licensing issue. Therefore, we will be buying a platform that could be used for further developments in MPEG: AFX v.2, Systems, 3DAV.

Issue: the cost is too important for few MPEG companies. Technically, this solution doesn't provide any audio/video integration or scripting and very few VRML nodes would be supported; we need

Two other solutions were proposed: Add to IM1 Core an open source renderer. The CrystalSpace game engine, available under

LGPL license, could be used for this purpose but this engine can only be distributed in binary form due to ISO copyright restrictions.

A company contributes an MPEG-4 3D player to MPEG and ISO.

3DAV participants informed us about their needs to show internally and externally demonstrations of 3DAV tools in an integrated MPEG-4 3D player.

On Wednesday, during the MPEG plenary, a call for participation to this MPEG-4 Player 3D reference software has been made by Leonardo, Mikaël and Olivier. Following this call:

Sun Microsystems offered to donate the modifications they did to IM1-3D which includes MPEG-J. The IM1 Core used in this player corresponds to pre-Shanghai meeting version (2 months old). Apparently, the 3D rendering code doesn't seem to have been changed and might be pretty slow.

HHI may be able to contribute its reference software which implements DMIF and 3D BIFS: interactivity, text, 3D BIFS shapes, textures, MPEG-4 video, Arbitrary shaped videos, live video streaming. This code is not based on IM1 Core but has its own MPEG-4 systems and decoder implementation. MP4 file format support is being integrated. Further discussions are needed with HHI as some optimized parts of the code will be given as binary libraries not as source code. One of these libraries is the OpenGL renderer. The OpenGL renderer code is necessary for integration of current AFX tools, 3DAV group tools, and future graphic development in MPEG.

Work planSNHC participants will use Sun Microsystems's IM1-3D code to integrate their tools. Once the code is received, one week will be necessary to test the player and integrate it with the latest IM1 Core. The code will then be merged into NIST CVS repository.

Then, once the code is on CVS, each company will integrate their AFX tools

France Telecom Wavelet subdivision surfaceFrance Telecom / IMEC BackchannelINT Bone based animationIntel Light-field MappingMindego AnimatorsSamsung Depth Image-based representationSGDL SolidsSuperscape Procedural texturesSuperscape/Mindego Subdivision surfaceVUB MeshGrid

129

Note:With the performance of the rendering code of the HHI player, SNHC participants would prefer integrating their tools in HHI player. We hope to conclude discussions in the next couple of weeks. In any case, Sun's IM1-3D player will be re-integrated in the IM1 CVS repository.

ScheduleAs agreed in Shanghai,

Prototype available for 64th meeting in March 2003 Final version available for 65th meeting in July 2003.

SNHC – Systems activitiesSummary of voting on FPDAM4The National Body comments are all editorial and clarify the text and BIFS node coding. They are all accepted with the exception of Israel National Body concerning Synthesized Textures, see notes below.

Synthesized Texture CEThe on-going Synthesized Texture CE has been evaluated with Systems and the goals of the CE have been achieved. However, there still exists a compression ratio 3 times better in favor of Vimatix' proprietary technology, called vim, compared to BIFS tools. Systems experts would like to check, for this specific technology if BIFS can be ameliorated by defining new nodes close to vim technology, by using defining new compression technology, or by reorganizing the scene further. In case there is no significant gain, vim bitstream will be considered, as a separate stream potentially using BitWrapper functionality (the interaction between the BIFS scene and the vim stream would have to be investigated).

XMT contributionsThe XMT contributions relative to AFX technologies (m9208, m9302) are reviewed by SNHC, see sections and .The XMT-A corrections (m9304) will be part of a future corrigendum to XMT; this is handled by Systems as these are general corrections related to XMT-A Schema and XMT translators to IM1's BIFS text and Mux script formats.

Repartition of the work between Systems and SNHC groupsIt has been agreed that from this meeting onward (copied from MPEG resolutions):

SNHC deals with representation of 3D objects, specific animation mechanisms for those 3D objects, node interface and coding to integrate these 3D objects with the MPEG scene description, XMT representation of those nodes. This will be specified in Part 16 of the MPEG-4 standard.

Systems deals with representation of 2D and 3D scene description, representation of 2D objects, generic animation mechanisms for 2D and 3D objects, node interface and coding to integrate these objects with the MPEG scene description, XMT representation of those nodes. This will be specified in Part 11 of the MPEG-4 standard.

Conferences and tutorialsAFX tutorial proposal has been accepted for Web3D Conference, March 9-12, 2003. The final tutorial will be submitted by January 10, 2003 deadline.

130

The early proposal submitted to Siggraph Conference on a "Standardized support for producing, delivering and consuming multimedia content: the MPEG-4 approach" has been reviewed by 7 reviewers who give a positive feedback. However, an early feedback is not a final acceptance but provide suggestions that the Siggraph Course Committee believes may improve the final submission. The final proposal will be submitted before 8 January, 2003, 5 P.M. Pacific Coast time (9 A.M. GMT) deadline.

Francisco Moran kindly accepted to supervise the realization of these submissions.

3DAV and SNHC interactionThe following experiments were reviewed in a joint session with Requirements, Video, and 3DAV groups. In this report, we summarize only the proposals close to SNHC activities.

M9184 EE1 – Report on omni-directional videoDifferent projections of 360 degrees video were used with a large video test sequence. The tests involved using MPEG-4 video codec.The experiment will continue until next meeting.M9273 EE1 – Representation of panoramic omni-directional videoThe proposal shows 360-degree video mapped onto a spherical surface. The approach has a simple and correct mapping using existing MPEG-4 tools: the approach uses octahedron mapping (8 triangles) and a rectangular video texture.It is proposed that this sequence becomes the reference for EE1 experiments. M9145 EE2 – Model-based scene reconstructionTwo technologies are evaluated: image-based visual hull and polygonal hull.Voxel-based representations are not available in MPEG but should be part of the on-going SNHC's Scene Partitioning core experiment. Also, the technique is very close to image-based rendering techniques already available in MPEG-4 AFX.This experiment requires calibrated cameras. Therefore, camera calibration must be carried to the terminal along with the video, maybe using OCI?The experiment will continue until next meeting.M9300 EE2 – Image-based visual hull (IBVH)IBVH uses weakly calibrated cameras that capture videos in parallel. All the video fields are sent to a server that reconstruct a 3D volume in real-time.

DiscussionEE2 is very close to SNHC mandates as it deals with synthetic and natural scenes: video streams are used to create 3D objects. This is very similar to AFX' depth-image based rendering.After discussion between AFX' image-based representations experts with this experiments participants, it appears that the existing image-based representations tools in AFX specification are sufficient for proposed 3DAV applications.AFX profiles and levelsMPEG Profiles 101This section lists envisioned applications and tools for AFX profiles and levels. This is a discussion that has just started in SNHC and with Requirements group.Requirements reminded SNHC participants how important profiles are in MPEG: if a tool is not part of a profile, it cannot be used practically. The following types of profiles exist in MPEG:

Audio profiles Video profiles Systems profiles: Graphics, scene graph, object descriptor, MPEG-J

131

What is needed is a list of nodes for an application domain. Profiles can be created at any time in response of industry needs.

The goal is to have few profiles for a maximum interoperability. Profiles can be hierarchical.Document w4671 details the steps to define a profile in MPEG.

Decoder conformance is done for a profile at a certain level. So, bitstreams should be classified by profiles at a certain level (also denoted P@L).

For writing AFX conformance document, we should look at graphics and systems conformance documents. At the moment, we can start collecting bitstreams and also complex bitstreams for AFX tools (a complex bitstream should push a decoder to its limits). Note also that there is no 3D profile in MPEG so we might want to define profiles not only with AFX tools but only existing 3D BIFS tools.List of envisioned applications1. Geographic navigationIncluding cities, house, estate, and rooms … navigation; from earth to inside a building.Note that geodesic information is missing in MPEG-4.

Tools that might be needed:o 3D geometry including solidso Level of detailso Subdivision surfaces and Wavelet subdivision surfaceso Progressive transmissiono Scene partitioningo Backchannelo 3D Mesh Codingo VTC for scalable textures and using backchannelo Metadata

2. Applications on limited power connected devices3. Augmented reality4. "Nomad" applications5. CAD visualization6. Virtual TV7. (opposite of augmented reality)8. Virtual companions9. Games10. Computer-based training and simulation11. Virtual rehabilitation12. Medical

MPEG-7M9210 - Perceptual 3D Shape Descriptor in MPEG-7 Visual

A new 3D shape descriptor has been proposed, which facilitates the perceptual description of a 3D object using part-based representation.

The proposed description claims to support a new functionality based on query by editing.During the CE, it should be investigated how this new descriptor complements the existing 3D shape

descriptor, and what are the added benefits and functionalities that it brings.At the moment, SNHC participants won't be involved in this CE.

132

MPEG-21M9307 Proposal for graphics DIAThe proposal is about graphics usage environment description scheme.A measure in the MPEG-4 Requirements document is about polygons/second rate for example.

As graphic contents consist of object, camera, light, and animation, it is proposed to define the following description schemes (DS):

o Graphics related environments DS include terminal capabilities. It is proposed to have geometry quality, material quality and animation quality.

o Display preferenceo Graphics terminal capability for decoding and encoding capability.

The criterions for measuring the various qualities seems vaguely defined and may not take into account specificities of computer graphic scenes.

ConclusionMore investigation is needed and it is proposed to have a joint CE with SNHC. MDS will handle this CE. In this CE, participants will define the quality descriptors and the appropriate measures.

On-line gamingOLGA is at requirement stage. The following contributions were reviewed.M9169 – HI Corp. requirements proposalThe proposal defines a Target Graphics Framework (TGF) used in current mobile phones in Japan. Today, this is HI Corp's proprietary graphics engine but in the future it will be JSR184. In terms of design, it is important that the TGF be independent, cost-effective implementation, software friendly.

After analysis of the proposed TGF, its basic requirements are already covered by MPEG-4 requirements. But some tools are missing in MPEG-4: synchronization in terms of bitstreams is enough in Systems but more synchronization and timing is needed between streams and applet as an extension MPEG-J APIs.

Another requirement is that systems shall be able to carry non-MPEG-4 graphical objects.

In MPEG-4, it is possible to carry an MPEG-4 application consisting only of an MPEG-J applet. It is even possible to define a profile where BIFS is not required (which could be the case for usage of current mobile gaming technology).

Under investigation is using BIFS for gaming and more tools might be needed.

ResolutionProposed requirements:

MPEG-4 shall support APIs to access synchronization information related to elementary streams

MPEG-4 shall support APIs to access audio, video, BIFS, and other data coming from specific elementary streams.

133

For next meeting, proponents will make contributions about new Java APIs and, as MPEG-J is handled by Systems, it will also handle those new APIs. Participants will continue investigating usage of BIFS for gaming.

Resolutions of SNHCOutput documentsNo. Title Subgroup TBP Available Editor5392 AFX CE description SNHC No 12/13/02 Marius Preda5393 AFX VM 10.0 SNHC No 01/20/03 Marius Preda5394 SNHC FAQ 11.0 SNHC Yes 12/13/02 Chris Joslin5443 AFX/MUW reference software

CDSNHC No 01/20/03 Michael Steliaros

5441 AFX/MUW conformance CD SNHC No 01/20/03 Mahnjin Han5397 Text of ISO/IEC 14496-

16:2003/FDISSNHC No 01/20/03 Mikaël Bourges-

Sévenier5399 Request for ISO/IEC 14496-16 SNHC No 12/13/02 Mikaël Bourges-

Sévenier

Resolutions The SNHC subgroup recommends approval of ISO/IEC 14496-1/FDAM4 The SNHC subgroup recommends reorganizing ISO/IEC 14496-1/FDAM4 into new parts of

the MPEG-4 standard as follows:o Part 11 will contain SL extensions, Object Descriptors, 2D nodes, generic animation

tools and Multi-User Worlds.o Part 16 will contain all other technologies under the common name "Animation

Framework eXtension (AFX)." The SNHC subgroup recommends approval of ISO/IEC 14496-16:2003/FDIS The SNHC subgroup would like to thank Sun Microsystems for the generous donation of

their IM1-3D player to MPEG. The SNHC subgroup recommends using IM1-3D player as a new MPEG-4 3D Player and

recommends using this player for integration of AFX tools and future development of graphics tools within MPEG.

In order to promote AFX technologies, SNHC will be organising a tutorial at the Web3D Conference, March 9-12, 2003.

Establishment of SNHC Ad Hoc groupsNo. Ad-hoc Group Meeting Subgroup Chair5402 AhG on AFX document editing and

Core Experiments03/09/03 SNHC Mikaël Bourges-

Sévenier5403 AhG on AFX SW implementation 03/09/03 SNHC Michael Steliaros5404 AhG on AFX conformance 03/09/03 SNHC Mahnjin Han

Closing of the MeetingSee you in Saint Malo, France, in March at the Web3D Conference (the very same week as MPEG meeting in Pattaya). See you in MPEG in July's meeting in Trondheim, Norway

134

Annex 10Report of Integration meeting

Source: Jean-Claude Dufourd, Chair

Opening of the Meeting

Goals for the weekThe main outputs of the meeting from the Integration Sub-group perspective are:Title Available Editors14496-4 MPEG-4 Conformance Text of ISO/IEC 14496-4/FDAM2 (XMT) 02/12/13 MichelleText of ISO/IEC 14496-4:2002/FPDAM3 (Visual New Levels and Tools) 02/12/13 Jens

DoC on ISO/IEC 14496-4:2002/PDAM3 (Visual New Levels and Tools) 02/12/13 Jens

Text of ISO/IEC 14496-4/PDAM4 (IPMP Extensions, MuW & AFX) 02/12/31 Senoh,

MikeRequest for ISO/IEC 14496-4/AMD4 02/12/13 JCText of ISO/IEC 14496-4 Second Edition 02/12/20 JC14496-5 MPEG-4 Reference SoftwareText of ISO/IEC 14496-5/PDAM4 (IPMP Extensions, MuW & AFX) 03/01/20 Craig,

MikeRequest for ISO/IEC 14496-5/AMD4 02/12/13 JCMaterials related to MPEG Reference Software 02/12/13 JC21000-12 MPEG-21 Resource Delivery Test BedWD of ISO/IEC TR 21000-12 (MPEG-21 Resource Delivery Test Bed) 02/12/20 CJ Tsai

General discussionIntegration Joint with Systems and MDSThe subject was: Where to put the multimedia test bed ?The nature and development of the test bed was addressed in another meeting. It should become a part of an MPEG standard (technical report). We were trying to decide whether to put the test bed in MPEG-4 or MPEG-21. Placing this in MPEG-21 will encourage the integration between media streaming and MPEG-21 technologies. Some of the developments will become MPEG-21 reference software.So this should be considered as the “MPEG-21 resource delivery testbed”. MPEG-21 people, among others, are requested to help write the scope of this work. An AHG is setup for this purpose.Note: A commitment by AccessTicket to do the MPEG-21 IPMP part was recorded.

Integration Joint with SystemsIt was decided to merge the reference software PDAMs for IPMPX and AFX/MUW, as well as the matching conformance documents.The IPMPX part of the reference software PDAM was reviewed in detail, as well as the IPMPX part of the conformance PDAM.We then proceeded with the examination of the IM1 status and the creation of the IM1 workplan until next meeting. See Annex A. The integration group also welcomed the news that Sun contributed an updated version of the reference software for MPEG-J integrated both in the 2D and 3D players. This will be folded in the PDAM for reference software.

135

Allocation of contributions

Monday Plenary D1 9:00

9084 Jens Spille AHG on MPEG-2 Audio Reference Software D1 9:00

9086 Ralph Sperschneider AHG Report on MPEG-4 Audio Conformance D1 9:00

9087 M. VaananenH. Purnhagen AHG on MPEG-4 Audio Text and Software D1 9:00

9093 Michael SteliarosJames D. K. Kim AHG on AFX SW Implementation D1 9:00

9095Mahnjin HanAlain MignotMikael Sevenier

AHG on AFX Conformance D1 9:00

9180 Shih-Hao Wang…Huifang Sun AHG report on editorial convergence of MPEG-4 reference software D1 9:00

Integration Joint Meeting with Systems ad SNHC, Systems Room (1h) D1 17:00

9312 Olivier Avaro Integration of AFX in Im1 D1 17:00

Integration Joint Meeting with MPEG-21 Requirements, Room 306 (1h) D2 11:30

xxxx MPEG-21 Reference Software D2 11:30

Integration Joint Meeting with Video, Video Room (30mn) D2 14:00

9183Chun-Jen TsaiM. van der SchaarYoung-Kwon LIM

MPEG Media Streaming Reference Platform D2 14:00

9182Chung-Neng WangChia-Yang Tsai… Chun-Jen Tsai

FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments

D2 14:00

Integration Joint with Audio-Systems, Audio Room (1h30) D3 16:00

9215Jérôme DanielRiitta VäänänenJean-Bernard Rault

Finalizing the production and crosschecking of 3D audio conformance bitstreams

xxxx Bandwidth Extension Conformance

Integration Joint with MDS, Room 305 (1h) D4 8:30

xxxx JCD MPEG-21 RS

Integration Joint with Systems, Room 311-B D4 14:00

xxxx What should become of the test bed ? MPEG-4 Part 17 or MPEG-21 Part 11 D4 14:009161 MOSES Progress report on MPEG-4 IPMPX D4 14:00

xxxx Craig MPEG-4 IPMP reference software PDAM D4 14:00

xxxx Zvi IM1 workplan D4 14:00

xxxx Taka Senoh Text of ISO/IEC 14496-4/PDAM4 (IPMP Extensions) D4 14:00

9231 Marc Emerit French NB comment on ISO/IEC 14496-4 (2nd edition) D4 14:00

9292 Dominique CURET FlexMux Conformance withdrawn

136

List of standards under developmentStd Pt Edit. Project Description CfP WD CD FCD FDIS

4 4 2003 Amd.2 XMT 02/03 02/07 02/124 4 2002 Amd.3 Visual New Level and

Tools 02/07 02/12 03/07

4 4 2003 Amd.4 IPMP Extension, MUW & AFX

02/07 02/12 03/03 03/07

4 4 2004 Amd.6 AVC 03/07 03/12 04/034 5 2002 Amd.3 Visual New Level and

Tools 02/05 02/10 03/03

4 5 2003 Amd.4 IPMP Extension, MUW & AFX

02/10 02/12 03/03 03/07

4 5 2004 Amd.6 AVC 02/12 03/07 03/12 04/037 6 2001 Amd.1 Reference software

extensions01/12 02/05 03/03 03/07

21 8 200x 1st Ed. Reference software 02/12 03/03 03/07 03/12

Latest references

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2002 (MPEG-4 Conformance 2nd

Ed.)02/07 Klagenfurt

N5081

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

137

MPEG-4 Conformance (14496-4) 14496-4 CORTopics

- Fixing the bitstreams of old profiles

Contributions

9215

Jérôme DanielRiitta VäänänenJean-Bernard Rault

Finalizing the production and crosschecking of 3D audio conformance bitstreams

ReportWork is done finally. Hourra!14496-4:2002/Amd2Topics

18. Conformance for 14496-1:2001/Amd2 (XMT)

ContributionsNone

ReportDocument “Text of ISO/IEC 14496-4/FDAM2 (XMT)” will be reissued from the FPDAM2, since there are no negative votes. No DoC is necessary.14496-4:2002/Amd3Topics

19. Conformance for 14496-2 (Visual New Level and Tools)

Contributions

ReportDocument “Text of ISO/IEC 14496-5:2002/FPDAM3 (Visual New Levels and Tools)” will be issued at this meeting together with the DoC.

14496-4:2002/Amd4Topics

20. Conformance for 14496-1:2001/Amd4 (IPMPX, MUW and AFX)

Contributions

ReportThis is reported under the “general discussion” heading.MPEG-4 Reference Software (14496-5) 14496-5:2001/Amd4Topics

21. Reference Software for 14496-1:2001/Amd4 (IPMPX, MUW and AFX)

Contribution9312 Olivier Avaro Integration of AFX in Im1

138

9183

Chun-Jen TsaiM. van der SchaarYoung-Kwon LIM

MPEG Media Streaming Reference Platform

9182

Chung-Neng WangChia-Yang Tsai… Chun-Jen Tsai

FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments

Reportm9312: The document has been presented. The solutions outlined in the document have been compared. The third solution is the most attractive, but the most expensive too.No conclusion could be reached.

m9182/3: Description of offered test bed and software. There is a server, a client, implemented in C++ over Windows and a network simulator in C on Linux. The question came up again of what in this contribution may become reference software: some things in relation with Part 8.MPEG-21 Reference SoftwareContributions

ReportIn a joint meeting with Requirements, we discussed the organization of MPEG-21 reference software. We tried to list the pieces we need. We need reference software for all parts of MPEG-21. We need to discuss with the leaders/editors of each specification what their requirements are for reference software.For Normative Software:

Establish conformance points within each specification Schema validation Building software to validate an incoming DID to both the DID schema and the

corresponding validation rules Identify semantic conformance points

For Non-normative software: Develop applications based on use cases Create a software library for example applications within each use case Create an inventory of reference software for each part and agree a structure of that

inventory (for DIA see m5180 as an example)For the software organization, there were suggestions in two dimensions: choose one language for everyone to contribute in, or structure all pieces as web services. Do we want contributions of reference sofware? Or do we want to develop code ‘in house’? If ‘in house’ do we have participants to do this?In a second joint meeting, we examined the question of the DID validating parser and the language vs web services approach. We clarified that the DID validating parser does more than just schema validation, but not all of the needed validation. So this parser will need improvement.Since this parser is in Java, we discussed the equivalent in C/C++ and recognised that there is not yet such a parser in C/C++. The web service approach will be discussed on the reflector. The mandate includes:

- DID parsing with common parser and report- improve the parser validating functionality

139

- try to find a C++ version- think about other core (general or DIA only)- evaluate web service approach

Still to do:- find a champion per group: RDD, REL, DIA, DIP

140

Unpublished Integration Standards

Standard

Year Type Title Approved With To be done

13818-5 1997 Amd.1Cor 1

Reference Software (AAC to Amd.1)

02/07/26 Editor To be delivered

14496-4 2000 Amd 1

Conformance testing extensions

02/012/13 SC29 Check and submit to ITTF

14496-4 2000 Cor 1 Conformance testing

SC29 Check and submit to ITTF

14496-4 2000 Cor 2 Conformance testing

SC29 Check and submit to ITTF

14496-4 2002 2nd Ed Conformance testing

SC29 Check and submit to ITTF

14496-4 2002 Amd.1

Conformance Testing (Flextime, Studio, Streaming Video)

SC29 FDAM ballot to be issued after publication of 2nd

Edition

14496-5 2001 Amd 1

Reference SW2nd ed. (Studio profile, FGS and FlexTime)

02/03/10 ITTF To be published

14496-5 2001 Amd 2

Reference SW2nd ed. (XMT, DMIF)

02/05/10 ITTF Under FDAM ballot (closing 2002-12-09)Extension of ballot period at the request of ANSI

15938-6 Reference Software

01/12SC 29 To be submitted to

ITTF

141

Resolutions of IntegrationOutput documents

No. Title Subgroup TBP Available14496-4 MPEG-4 Conformance

5438 Text of ISO/IEC 14496-4/FDAM2 (XMT) Integration N 02/12/13

5439 Text of ISO/IEC 14496-4:2002/FPDAM3 (Visual New Levels and Tools) Integration Y 02/12/13

5440 DoC on ISO/IEC 14496-4:2002/PDAM3 (Visual New Levels and Tools) Integration Y 02/12/13

5441 Text of ISO/IEC 14496-4/PDAM4 (IPMP Extensions, MuW & AFX) Integration N 02/12/31

5442 Request for ISO/IEC 14496-4/AMD4 Integration N 02/12/135457 Text of ISO/IEC 14496-4 Second Edition Integration N 02/12/20

14496-5 MPEG-4 Reference Software

5443 Text of ISO/IEC 14496-5/PDAM4 (IPMP Extensions, MuW & AFX) Integration N 03/01/20

5444 Request for ISO/IEC 14496-5/AMD4 Integration N 02/12/135445 Materials related to MPEG Reference Software Integration Y 02/12/13

21000-12 MPEG-21 Resource Delivery Test Bed

5494 WD of ISO/IEC TR 21000-12 (MPEG-21 Resource Delivery Test Bed) Integration Y 02/12/20

Resolutions1. The integration subgroup thanks EPFL, FT R&D and HUT/IRCAM for their work on audio

BIFS bitstreams. Although some bugs have been found in the sequences, the integration subgroup recommends that the 3D audio profile is kept in the specification, while urging the above companies to fix the sequences as soon as possible.

2. Although the Systems subgroup made repeated pleas to finalize the production of conformance bitstreams for the Complete and Complete2D profiles, nothing has been done. As a consequence, the Integration subgroup request the removal of Complete and Complete2D profiles, in application of the rule that profiles for which the conformance test suite is incomplete be removed from the specification.

Establishment of Ad Hoc groups

N5446 AHG on MPEG Conformance EditingMandate: 1. Prepare SE on MPEG-2 Part-4 (13818-4) based on

a. 13818-4:1998b. 13818-4:1998/Amd.1:1999c. 13818-4:1998/Amd.1:1999/Cor.1:2002d. 13818-4:1998/Amd.2:2000e. 13818-4:1998/Amd.3:2000f. 13818-4:1998/Amd.3:2000/Cor1-2002g. 13818-4:1998/Cor.2:1998

2. Prepare Amd. on MPEG-2 Part-4 (13818-4/Amd.x): LFE Conformance Test Sequences for Audio Layer-3

3. Cross-check new conformance test sequences for MPEG-2 Audio Layer-3 4. Generate MPEG-2 Audio Layer-3 conformance test sequence with mixed

142

blocks5. Submit SE on 14496-4 no later than 2002-12-31 (subject to change) to

SC29 6. Continue provision and cross-check of MPEG-4 Audio conformance test

sequencesChairman: Ralph Sperschneider (sps@iis.fhg.de), Jens Spille (spillej@thmulti.com), Jean-Claude

Dufourd (jean-claude.dufourd@enst.fr)Duration: Until 64th Meeting Meetings NoneReflector: mpeg-conf@enst.frSubscribe: Send email to mpeg-conf-request@enst.fr with the word “subscribe” in the

body of the message

N5447 AHG on MPEG-21 Reference SoftwareMandate: 1. Facilitate the use of the UoW DIDL parser to validate the DID descriptions

(CDI, XDI) that are part of the respective MDS DIA software implementation in N53xx

2. Collect results and feedback of the DID validations 3. Maintain the MDS DIA reference software implementation document (N53xx), including tracking of the proposed deliveries of software to http://www.titr.uow.edu.au/mpeg/mpeg21/ref-sw

4. Propose an integration plan for the MDS DIA reference softwareChairman: Ian Burnett (i.burnett@elec.uow.edu.au), Rik Van de Walle (rik.vandewalle@rug.ac.be), Tor

Halvorsen (torhalv@tele.ntnu.no)Duration: Until 64th Meeting Meetings NoneReflector: mpeg-21-refsoft@uow.edu.auSubscribe: Send email with “Subscribe mpeg-21-refsoft” to majordomo@uow.edu.au

N5448 AHG on MPEG Multimedia Test BedMandate: 1. Define scope of this test bed.

2. Create working drafts that define APIs of modules that facilitate the use of this test bed.

3. Work with MPEG-21 reference software AHG for incorporating MPEG-21 modules into the test bed.

4. Work with Scalable Video Coding AHG for testing of scalable video coding technologies.

5. Incorporate IPMP modules into the test bed.6. Incorporate informative reference software of 14496-8 for testing of

signaling and carriage of MPEG-4 content over IP network.Chairman: Chun-Jen Tsai (NCTU), Mihaela van der Shaar (Philips), Young-Kwon Lim

(mp4cast)Duration: Until 64th Meeting Meetings NoneReflector: testbed @commlab18.ee.nctu.edu.tw Subscribe: Send an email to

testbed- request@commlab18.ee.nctu.edu.tw with subject ‘subscribe’

143

Annex A: MPEG-4 Systems Status and Workplan

Systems Core Code (Normative)GeneralThe Systems Core module provides the infrastructure for full implementation of MPEG-4 players. It includes demultiplexing, BIFS and OD decoding, scene construction and update. It manages synchronized flow of data between the multiplexer, the decoders and the compositor through decoding and composition buffers. It supports the API for Decoder, DMIF and IPMP plug-ins. It also provides the functionality of MediaObject, the base class for all specific node types.The Core module implements the IM1 Application Programming Interface (API)[1].The core module is the foundation layer for customized MPEG-4 applications. It contains hooks for plugging all kind of decoders and customized compositors. It is written in C++. Its code is platform independent and has been used by the group as the infrastructure for applications that run on either Windows or Unix.The core module is accompanied by a test application. The test application is a Windows “console” application that reads a multiplexed file containing scene description and media streams (output of Mux), and produces two text files. One file shows the “presentation” time of each composition unit (CU), i.e., the time when a plug-in compositor would receive the CU for presentation, compared to the composition time stamp attached to the encoded unit. The other file shows textual presentation of the decoded binary scene description (BIFS) and object description (OD).The Core code is normative in the sense that two conforming implementations of the core, taking the same conformant bitstreams, using the same output file format (see ), will output the same text file.Note - complying MPEG-4 implementations are not expected to follow the algorithms or the programming techniques used by the reference software.

Building the Test ApplicationThe core module and test application has been developed using Microsoft’s Visual C++ V6.0. To build the application, load _WorkSpaces/IM1.dsw as your workspace, set Im1Player to be the active project, and perform Build All.

Running the Test ApplicationTo run the test application you will need, as minimum, to:1. Build the Im1Player project and all the projects it depends on.2. Register all plug-ins by running _Registry/IM1.reg. You may need to edit this file if you run

Im1Player.exe from a different directory.3. Obtain the decoder/IPMP plug-ins required to run your test stream. You may register and use

NullDecoder.dll instead of decoders that are not available.4. Create or obtain test (.mp4 or .trif) files. Test files can be generated from files included in the

Test directory, using the BifsEnc utility.5. The Im1Player command line is described in [3].

Test Application OutputOnce the test application runs successfully on a valid test file, it would produce a file called Log.txt and a filed called Trace.txt. Log.txt includes a line for each composition unit that was processed by the simulating compositor. The line has the following format:Time: time(object_clock_time): node_name, ODid: ODid, CU size: size, Time stamp: cts

In this line, time is the application time of the composition. object_clock_time is the stream specific object-clock time of the composition.

144

The file also prints the value of some node fields (e.g. Circle), whenever the node has been updated through an update command or a Route.

The other file, Trace.txt, would show the parsed scene description in a textual format.

Extending the Core ModuleThe following steps are required in order to extend the core module and embed it in MPEG-4 player applications:1. Write a frame application.2. Derive an object class from Application and include it in the frame application.3. Derive an object class from PresenterBase.4. Extend the node objects as necessary.5. Obtain or create decoder plug-ins using the Decoder Development Kit [4].6. If necessary, obtain or create IPMP plug-ins using the IPMP Development Kit [5].7. If necessary, obtain or create additional DMIF plug-ins using the DMIF Development Kit [6].For more information about Core extension, see the API document Error: Reference source notfound.

Optional ComponentsThe MPEG-4 Systems standard includes specifications for Animation, Quantization and Predictive coding. Support for this at the Core code is optional. To include this feature ANIMATION (for Animation and Quantization) and PREDICTIVE (for Predictive coding) preprocessor definitions must be defined.

FlexTime supportThe IM1Player project described above does not support the FlexTime features. However, the IM1 workspace includes another project, FlexTime.dsp, which is identical to Im1Player except that it supports FlexTime.The MP4 Library (Normative)The MP4 library is collection of routines that support full access to MP4 files. The library can be used to created files, create tracks in a file, store samples in a file, and read data from files. The library is provided as source code in C. The libisomp4static project can be used to create a static lib file from these source files.The IM1-2D player (Informative)IM1-2D is a full-featured MPEG-4 player that extends the Core code described above. It partially supports the 2D nodes described in MPEG-4 Systems.

To build the player, load the same _Workspace/IM1.dsw workspace, and build the IM1_2D project.To run the player, register all plug-ins as required by the Core, i.e. run _Registry/IM1.reg, launch the player, and use its menu to open an MPEG-4 file (.mp4 or .trif).The BIFS/OD Encoder (Informative)The BIFS/OD encoder (BifsEnc) is an application that reads a textual description of a scene, scene updates and ObjectDescriptor stream commands (which may include ObjectDescriptor objects and IPMP objects), and produces two binary files - a BIFS file and an OD stream.The application is fully described in [9].The application can be built using the BifsEnc project.See also the files BifsEnc.doc and VersionNotes2.0.doc in this package.The MP4Enc Multiplexer (Informative)The MP4Enc multiplexer is an application that reads MPEG-4 elementary streams and multiplexes them into a single mp4 file. The tool is not standard. It is included in this package as a simple tool to create test stream for the test application described in chapter .

145

The application takes same command line parameters and input files as the TRIF multiplexer described in chapter .The application can be build using the MP4Enc project.See also the file MP4Enc.doc is this package.The TRIF Multiplexer (Informative)The TRIF (Trivial Format) multiplexer is an application that reads MPEG-4 elementary streams and multiplexes them into a single file in the non-standard TRIF format. The tool is not standard. It is included in this package as a simple tool to create test stream for the test application described in chapter .The application is fully described in [10].The application can be build using the Mux project.This also the file Mux.doc in this package.The BifsAnim EncoderSee info in BifsAnimEncoder.doc included in this package.The source code repositoryThe source code of the Core module and the test application is contained in [2]. That document includes also non-normative parts such as a BIFS/OD encoder (BifsEnc) and a non-standard multiplex application (Mux). The code is arranged in directory structure described by the following table.

Directory Name Description_Registry .reg files needed to register the plug-ins_WorkSpaces Workspace (.dsw) files the include the projects

necessary for building the applications2DPlayer-CSELT The main directory of the IM1-2D player..\2DPlayer-CSELT\HTML-Docs HTML files that describe the level of

implementation of each 2D node by the IM1-2D player

2DPlayer-CSELT\res Resource files for the IM1-2D player2DPlayer-CSELT\res\READDMEs Text files containing some useful information

regarding the IM1-2D implementationAnimation Extension to the Core code and BifsEnc for

handling Animation and QuantizationBase64 A utility to convert from binary to Base64 and vise

versaBifAnimEncoder Source code for a utility to create BifsAnim

streamsBifsEnc The BifsEnc tool that converts scene/OD

descriptions in textual format to BIFS/OD streams.Bitstreams .txt and .scr files for creating various conformance

bitstreams featuring various BIFS and OD optionsCore The main directory of the Core codeCorechangestotestflextime Contain a mutation of few Core files for emulation

of FlexTime conditions. This is helpful for testing FlexTime functionality.

Decoder Generic decoder code used to create decoder plug-ins.

DMIF Parent directory for the DMIF stack and plug-insDMIF\DMIFClientFilter Code for the static part of the DMIF stackDMIF\DMIFInclude Header files used by DMIF stack and plug-ins

146

DMIF\FileMP4Instance Code for the MP4 plug-inDMIF\FileTrifInstance Code for the TRIF file DMIF plug-inDMIF\RemoteInstance Code for a remote access DMIF plug-in and a

demo remote serverDMIF\Sl_mpeg4 Code for the SL-mpeg4 library that is used by

several DMIF plug-insDMIF\Transmux Code a TransMux instance that includes a

FlexMux implementationDocs Documentation files that describe the applications

and modules references in this documentFlexTime Files needed to build the test application that

supports FlexTimeIM1Decoders A parent directory for decoder plug-insIM1Decoders\AAC Wrapper code for the AAC plug-in. The decoder

itself is a DLL that is not included in the Systems reference software

IM1Decoders\G723 Wrapper code for a G.723 decoder (not an MPEG-4 standard) plug-in.

IM1Decoders\H263 Wrapper code for an H.263 decoder plug-in.IM1Decoders\H263K Wrapper code for a multithread-safe H.263 plug-

in. The decoder itself is a DLL that is not included in the Systems reference software

IM1Decoders\JPEG Wrapper code for a JPEG decoder plug-in.IM1Decoders\DLLs H.263 and G.723 DLLsInclude Header files shared by several projectsInclude\xerces-c1_5_1-win32 Contains several sub-directories with Xerces files

needed to build BifsAnimEncoder IPMP The code for IPMPManagerImp - the base class

for IPMP plug-ins insIPMP\IPMPNull A template for an IPMP plug-inLib Lib files required by several projectslibisomediafile Source code to create the MP4 library. Contains

several sub-directories for various operating systems. On Windows platforms the library is built as a DLL

MP4Enc Contains the MP4 multiplexer code.Mux Contains the TRIF multiplexer code.NullDecoder A template for a decoder plug-inPredictive A parent directory for code specific to Predictive

codingPredictive\decoder Predictive code used by the playersPredictive\encoder Predictive code used by the BIFS encoderscript A parent directory for extensions to the Core code

and BifsEnc for handling Scripts in BIFSscript\encoder Script code specific for the encoder sidescript\interpreter Script code specific for the decoder sidescript\tools Few source files to help debugging the Script codeTest Few test files to test BifsEnc, Mux, MP4Enc and

Core test applicationsZTL A general purpose template library used by most

projects

147

Zvi The main directory of the Im1Player test application. This application tests basic functionalities of the Core code

Zvi\MikeBS Files that can be added to the Im1Player project to test the functionalities of Quantization and Animation in the Core.

Revision notes for version 5.6Version 5.6 includes the following additions and modifications:

General bug fixes New code for animation streams A new MP4 library as a DLL Fixed implementation of InputSensor Implementation of Mattetexture. New implementation of BIFS-Anim.

Revision notes for version 5.7Version 5.7 includes the following additions and modifications:

OCI_Event is encoded (in BifsEnc) and decoded (in the Core) without a ‘tag’ field A bug that occasionally hung the player when a decoder was shut down was solved A bug in predictive coding implementation was fixed An implementation of BIFS-Anim encoder is included in the package

Revision notes for version 5.8Version 5.8 includes the following additions and modifications:

Routes are executed by the order of their insertion into the scene, according to the cascade model.

The player displays a warning on multiple use of same node, Route or Proto ID.Revision notes for version 5.9Version 5.9 includes modifications related to three topics: time fields, IPMP extensions and Multi User Worlds. Details as follows.

Implementation of time fields in Version 5.9Discussions held in Fairfax, VA concluded in agreement on the correct semantics of startTime and stopTime fields. The implementation in Version 5.9 has changed to comply with the agreement. Specifically, those fields, once inserted or modified, get offset by the value of the “current time”, unless they change as result of a Route or Script.Because the value of “current time” may be affected by the existence of a TemporalTransfer node, the implementation applies the offset during the first rendering iteration following the field update, when the temporal context is known. It does it by overloading the = operator, so that when a startTime/stopTime field is first read, a little piece of code checks if it has to be offset, and adds the offset if necessary. This trick will work correctly only if the field value is read immediately following its update. To guarantee this behavior, compositors that use this code shall read each startTime/stopTime field in the scene at every rendering iteration, even if they belong to inactive nodes.Im1Player “pseudo-compositor” performs the above correctly, but IM1-2D and IM1-3D correct behavior is not guaranteed. Implementers who use these implementations should check this point and correct it if necessary.

IPMP Extensions in Version 5.9The implementation of IPMPX (IPMP Extensions, i.e. MPEG-4 Systems Amendment 5) in Version 5.9 has focused on two aspects: parsing and encoding of IPMPX descriptors, and the integration of the IPMPX API.

148

In order to enable IPMPX parsing, few general classes and template classes has been added to the Core code, as follows:ZLongInt<int n>: Implements long integers of more than 32 bits. n is the number of bits.SDLLongInt<int n>: Implements SDL int fields of more than 32 bits. n is the number of bits (for array of integers one can still use SDLArray<int n>, even if n is greater than 32.SDLDescriptor: Implements an SDL class with no tag field. The constructor of SDLDescriptor accepts one argument: bool bIsExtended, whose default value is false. The parameter indicate whether the class is expandable or plain one.ACKNOWLEDGE: The IPMPX parsing code is known as not accurate yet. The code needs review and tests by exchanging streams with other implementations.

MUW in Version 5.9Version 5.9 provides the basic infrastructure for the integration of MUW (Multi User Worlds, i.e. MPEG-4 Systems Amendment 6). This includes two major additions: parsing and encoding code for version 5 nodes (including a new field type: Vec4f), and code for generating BIFS from a memory image of a scene sub-tree.The BIFS generation is implemented via a BifsGenerator class, derived from SysCoder. It is similar to BifsEncoder of BifsEnc, but it encodes from memory rather than from textual description. Like BifsEncoder, most of the encoding code is added directly to MediaObject, NodeField, Route etc. All of the BIFS commands are implemented, few in BifsGenerator, and the other in the appropriate classes.Revision notes for version 6.0Version 6.0 includes bug fixes and modifications related to three topics: MP4 file access library, IPMP extensions and Multi User Worlds. Details as follows.

Bug fixes in version 6.0The following bugs have been reported and fixed in the IM1 Core code: Bugs in encoding and parsing of version 3 or later nodes, that were still left after the

Klagenfurt meeting, have been fixed. The implementation of startTime and stopTime fields that was reported about in Klagenfurt

was not correct in all cases. This has been set. Handling of decoder setup, that was sometimes erroneous when IPMPX filters were present,

has been fixed. Node encoding/parsing has been aligned with the latest version of the BIFS template. Handling of hex numbers by BifsEnc has been corrected. Handling of the cascade model for ROUTEs has been corrected. There was a report that if an element is deleted by index from an MFNode field the node

referenced by the element was not deleted even if it was the single instance of the node. This has been fixed.

MP4 file access library in version 6.0There is a new experimental release of the ISO/MP4 library. It allegedly fixes all the outstanding items, and introduces the long-awaited IPMP support, donated by ResonateMP4.The software is at FTP index.apple.com, logon with your current user name and password (depends on whether you are MJ2 or MP4 people, WG1 or WG11). Look in /experimental. The passwords are current (the “n” Shanghai password, and the fantasy one).Contribution M8899 explains the new functionalities added in the libISO for a limited support of IPMPX. The new code also implements the track reference mechanism for the esID embedded the IPMPDescriptorPointer. Note that the implementation is based on the Klagenfurt IPMP specs. The code will be updated the code with the next Shanghai specs.The fixes are:

149

1. Free atoms can now be found and discarded almost anywhere; this means the software copes, for example, with files with free atoms inside edit atoms. The software is probably more liberal than the specification in this respect; be careful. Free atoms are now mostly discarded on reading.

2. Empty free atoms (8 bytes long) are also handled on reading and no longer cause a crash.3. Empty durations in movie fragments are believed to be handled correctly. This hasn’t been

fully verified.4. Edit lists can now be found in base movies with fragments, so that e.g. track start offsets can be

in the base movie.5. There is a fix to finding a sample by time (it was wrong when chunks had multiple samples).6. Edit atoms with no included list are correctly treated as if they were not present.7. The movie duration is now calculated in 64 bits, which means non-trivial-lengthed movies

should be OK.8. A nod of support: new3gppmovie9. No longer crash if asked for the IOD of a movie which doesn’t have one.10. The IPMP support, as noted above.11. Builds for CW5, 7, and 8 (carbon), and project builder under OS X.MP4 InsertMediaIntoTrack converts the mediaDuration to the Movie timescale now (as documented).

IPMP Extensions in Version 6.01. Implementation of interface between IM1 and IPMPX implementation completed as per the

IPMPX study document out of Klagenfurt. All interface methods tested and found to operate as desired.

2. Proposed changes due to National Body Late Comments to the IM1/IPMPX interface discussed and work is in progress.

3. Complete implementation of internal IPMP operations, messaging, not yet complete but well underway. Various bugs noticed causing the crash of the IM1 player although originating source has not yet been identified. Further testing is needed although determining the source and remedy is not expected to take an exceeding amount of time.

MUW in Version 6.0A MUBIFSEncoder derived from BIFSGenerator is implemented. This provides an interface for encoding of messages defined for the MUCommandStream. Similarly a MUBIFSDecoder is implemented derived from the MemBIFSDecoder class for handeling decoding of the MUCommandStream.A simple server implementation is provided for testing multi-user functionality. It has a server session controller implementation for basic control and synchronization of the multi-user session. A simple multi-user client is implemented based on IM1-2D. This, together with the server implementation, the implementation of the multi-user nodes and changes to the Route implementation demonstrates the multi-user functionality.

Revision notes for version 6.1Version 6.1 includes bug fixes and modifications related to two topics: IPMP extensions and Multi User Worlds. Details as follows.

MUW in Version 6.1MUW uses an approach of “tried access”. I.e. when a node that represents another user is manipulated, the fields are changed and the remote application is asked to confirm the change. If not confirm, the node is reverted to its original value. This also means that a node that has refused access should not activate routes. The mechanism to achieve that is now being implemented in the Core.

150

IPMP Extensions in Version 6.1All the changes lately accepted to the IPMP-X specifications have been implemented in version 6.1. Additionally, many bugs that existed in code related to IPMP-X in previous versions have been fixed.Systems software implementation workplanThe following table describes the workplan of the AHG on IM1 Software Platform for the period between the 63rd MPEG meeting (December 2002) and the 64th meeting (March 2003). This group implements the ISO/IEC 14496-1:2001 specifications.

Module Tasks Responsibility DateMUW Fix bugs and add features in

the core if necessaryOctaga / Optibase 2003

March 9ATG Update of the ATG nodes in

the Osmose playerENST 2003

March 9IPMP Extensions Fix bugs Panasonic / Access Ticket /

Optibase / Moses2003 March 9

Elementary Stream Management

Integrate the implementation of SL-X

France Telecom / Optibase 2003 March 9

151

Annex 11Report of Test meeting

AgendaJoint Meeting with Requirements on DC 3pm Monday – Requirements roomJoint Meeting with Video Group on AVC 5:30pm Tuesday - Video roomJoint Meeting with Video Group on SVC 11:30-12:30 Wednesday - Video roomJoint meeting with Video/JVT on Verification Test output document 9:30 - 10:00 Friday – JVT roomTest meeting on final resolutions 10:30 - 11:30 Friday in Test room

Review Adhoc Group Reports and Documents- 3 Ad Hoc reports

o m9070 - AHG Report on coding efficiency analysis and testing of AVC codec Presented the Report. Analysis of the input documents on SNR coding results Viewing of AVC coded test material Other coded materials will be made available during the week SRN presented showed good superiority on AVC, to be confirmed by tape

viewing. A first table of the coding parameters was prepared and presented Discussion was made on what to verify AVC; answer was state of the art

MPEG-2 products (at least for STV and HD) Some preliminary discussion on CIF nad QCIF test New test method based on presentation of progressive scanned material

presented by FUB; This requires new Test Method description, inclusive of site set-up, display selection and set-up criteria.

o m9701 - AHG on Production of Video Test Sequences Sequences available in public domain not for commercial use. Distribution has been done on D5, D1, DVD HD. Two tools are now available.

o m9098 - Digital Cinema AHG Report Good report on what is ongoing inside and outside the Hollywood

community, mainly related to initiatives on going in Brazil and China (basically HD MPEG-2).

DCI is not expecting to push for some result in the short term. No future activity are plannedComment: this AhG will not be renewed any longer.

Work items during the week- Output document for the AVC Verification Test Plan

New and better define test conditions Sequence selection for SD and low def. Decision to continue coding of all the material available to select which are really

critical and worth to be used. Test methodology: studies on “MM-Test” the new test method dedicated to progressive

material presentation are required to better define site and display set-up.- Joint meeting with Requirements on Digital Cinema requirements document; conclusions

are to live document internal for future use when necessary.

152

- Test Method and Work Plan will also remain internal; these will be the MPEG patrimony for future use.

Viewing of Test Sequences- Several viewing sessions have been organized on Wednesday 14:00 to 15:00 (AVC only)

and on Thursday 8:30 to 9:00 and 12:30 to 14:00 (MPEG-2.This was made possible thanks to the active contribution of T. Oelbaum that downloaded and decoded here in Awaji the MPEG-2 material coded.

Adhoc Groups

AHG Report on coding efficiency analysis and testing of AVC codecAHG on Production of Test Material

Output DocumentsDraft 0.2 AVC Video Verification Test PlanTest Plan For Digital CinemaRecommendationsThanks to:

Companies for coding sequences:o Chinese University for rate control software made available for AVC testingo Broadcom, InterVideo, Sony and Munich University of Technology

Companies for providing HD material free of copyrights Taurus Media Technik, BBC, Thomson, DemoGrafx, Teracom, SVT and IRT for providing

SD and HD material free of copyrights. Walt Husak (Dolby) for his activity in Digital Cinema.

153

Annex 12Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Awaji are:

1. The acknowledgement of the further revisions of HDL modules received for the MPEG-4 “Part 9 Reference Hardware Description”.

2. The reviews of the contributions on the definition of objectives, methodology and guidelines for Part 9 Phase 2.

3. The schedule for the integration of new descriptors in the reference software of MPEG-7.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M9072 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli, Robert Turney

M9115 Hardware Reference for DCT & its Specifications for MPEG-4

Mehboob Alam, G. Jullien and Wael Badawy

M9306 MPEG-4 Part 9 Virtual Socket Definition Phil James-Roxby, Robert Turney, Xilinx Research Labs

M9321 MPEG-4 Part 9 Platform Information Robert Turney, Xilinx Research Labs

M9322 MPEG-4 Part 9 Proposed Integration Plan for Opt SW and HW Accelerators

Robert Turney, Xilinx Research Labs

M9323 MPEG-4 Part 9 Study of N5153 PDTR Robert Turney, Xilinx Research Labs

M9324 MPEG-4 Part 9 HDL coding guidelines Robert Turney, Xilinx Research

[ 1] ISO/IEC JTC1/SC29/WG11 M3111, APIs for Systems Software Implementation, Contribution for San Jose, California, January 1998

[ 3] ISO/IEC JTC1/SC29/WG11 M5327, Im1Player - A Bitstream Compliance Verification Tool, Contribution for Maui, US, November 1999

[ 4] ISO/IEC JTC1/SC29/WG11 M6123, Decoder Development Kit for IM1 Version 2.0, Contribution for Beijing, China, June 2000

[ 5] ISO/IEC JTC1/SC29/WG11 M3860, IPMP Development Kit, Contribution for Atlantic City, New Jersey, August 1998

[ 6] ISO/IEC JTC1/SC29/WG11, DMIF Development Kit version 2.2, Contribution for Vancouver, Canada, June 1999

[ 10] ISO/IEC JTC1/SC29/WG11 M4599, TRIF multiplexer version 2.5, Contribution for Seoul, South Korea, March 1999

[ 2] ISO/IEC JTC1/SC29/WG11 M8525, IM1 Core code + authoring tools version 5.9, Contribution for Klagenfurt, Austria, July 2002

154

LabsM9325 MPEG-4 Part 9 HW platform memory

controller informationRobert Turney, Xilinx Research Labs

Detailed Report

Reference hardware description for MPEG-4

The revision of HDL modules for MPEG-4 part 9 “Reference hardware description phase 1” concerning conformance behavioral checks continued at the Awaji meeting. Documentation support and recommendations for module submissions and revisions have also been completed by new input contributions.

A new proposition of a “virtual socket” definition for the “phase 2” has been acknowledged. For the absence of most of the proposers, the discussion and final decision on the interface to be used in phase 2 will continue as ad-hoc activity and will be finalized at next March meeting. Information and tests on the candidate platforms for phase 2 have also been provided in contributions M9321 and M9325.Propositions and commitments for a work plan schedule of phase 2 have been received.

Comments on the improvements of the Part 9 text, content and documentation has been received and will be included in the Study document that will be ready after an editing period lasting until the 15th of January.

ISG reviewing the status of the optimized reference software (MPEG-4 Part 6) has proposed to support the activity by means of automatic software tools and appropriate methodology helps. A high quality status of Part 6 is in fact fundamental for achieving the results aimed by Part 9 Phase 2. The support will include the supply of simulations databases on MPEG-4 complexity and data flows and complete analysis of the obtained results.

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates et including 3 telephone conferences.MPEG-7 reference hardware

The inclusion of two new visual descriptors in the MPEG-7 reference software has been discussed and scheduled with the video group. New descriptors will be integrated by the end of January 2003.

155

Annex 13Report of Liaisons meeting

Source: Jan Bormans

Kate Grant chaired the Liaison meeting in Awaji because Jan Bormans was unwell and could not travel to Japan

The Liaisons Group considered the following input documents:

Input Doc. No.

Title

M9109 Liaison Statement from ITU-T SG 16 on Media Coding Summary Database

M9110 Liaison Statement from ITU-T SG 16 on Video Coding Standardization Activities

M9111 Liaison Statement from ITU-T SG 16 on Mediacom 2004M9133 Liaison Statement from DVB to WG 11M9162 Liaison statement from EDItEURM9224 Liaison to MPEG on Digital CinemaM9225 Liaison to MPEG on Carriage of Metadata over MPEG-2 SystemsM9226 Response to MPEG CFP on RA for MPEG-21M9327 DMDA issues Call for ProposalsM9330 Liaison Statement from JSR 184M9333 Liaison Statement from The DAISY on Collaboration

It was agreed to compile information for incorporation in the ITU-T media coding summary database and the Video and Audio chairs volunteered to provide information relevant to MPEG standards by the next MPEG meeting

The following recommendations were issued:

the approval of the following documents:Title No.Liaison Statement to EDItEUR N5425Liaison Statement to TV Anytime Forum N5426Liaison Statement to DAISY consortium N5427Liaison Statement to SMPTE on Digital Cinema N5428Liaison Statement to Digital Media Device Association N5429Liaison Statement to ITU-T regarding the development of ITU-T Metadata recommendations N5431

Liaison Statement to ITU-T regarding video coding standardisation activities N5432

Liaison Statement on Evaluation Methods for Persistent Association Technologies. N5433

Liaison Statement to WG1 regarding font format representation and compression N5434

the approval of following statements of benefits:Title No.

156

Statement of benefits from establishing a class C liaison with DAISY consortium N5436Statement of benefits from establishing internal liaison with ISO/IEC JTC1 SC37 N5437

the approval of the Liaisons with the Daisy Consortium and ISO/IEC JTC1 SC37

the approval of the Response to National Body Comments (N5435)

[ 9] ISO/IEC JTC1/SC29/WG11 M5450, BIFS/OD Encoder version 4.0, Contribution for Maui, US, November 1999

157