GLIF  opened  way    for  CESNET  applica8ons    

to  the  world  

Jiri  Navra(l  and  

Milos  Liska,  Michal  Krsek,  Jan  Ruzicka,    Sven  Ubik,  Zdenek  Travnicek,  Jiri  Melnikov,  Mar(n  Kolbe,  Pavel  Peciva  

 GLIF  mee(ng  Prague  29.  September  2015  

     

“Our  way  from  network  experiments    to  advanced  user  applica8ons”  

Jane  Butler,  CISCO    hOp://www.fi-­‐prague.eu/program/p/butler.pdf  

Internet around us (history and future)

CESNET  provides  wide  spectrum  services    on  na8onal  level  

but  also    ac8vely  par8cipates  on  many  important  Interna8onal  events    

•  SuperCompu8ng,  GLIF,  CineGrid,  NAB  Show  •  TERENA,  Internet2,  APAN  •  DEMOs  on  Professional    IEEE  conferences            Medical  (Healthcom,  Engineering  in  Medicine  and  Biology),                IT  (CDVE,COMNET,..    )    •  CESNET  is    oJen  partner  in  direct    events            organized  by  our  partners  from  EU  (ACONET,  SANET),    USA  (EVL,  UCLA,  SSF),  Japan  (KEK,  Tsukuba  University,    Kyushu  University,  Keio  University),  China  (CERNET),  Taiwan  (TWAREN,  ASGC),  Malaysia  (MYREN),  New  Zealand    (REANNZ).  

World  Map  of  CESNET  ac8vi8es  

MTI

GLIF – Global Lambda Integrated facility

hOp://www.glif.is/par(cipants/

-­‐  CESNET  could    join  VINI  project  (NGI)    -­‐    FZU  Prague  was  connected  to  BNL  and  Fermilab  (via  NetherLight)  -­‐  Opened  Prague  –Taiwan  IT  experiments  on  IPv6  and  DVTS  videotransmission  -­‐    Developers  par(cipated  on  SC2008  and  on  I2  mee(ngs  

CESNET    drama8cally  extended    Interna8onal  connec8ons  in  period  2007  -­‐  2010    

A  few  reminders  interes8ng  events    from  the  past    

to  show  trajectory  of  our  progress  on  the  way  from  network  experiments    

to  advanced  user  applica8ons        

 •  iGrid  2005    demo  in  San  Diego    CESNET  presented                modified  Ultragrid    1,5  Gbps  HD  stream  to  more  des(na(ons.              (BatonRouge,  Dan  Diego,  Brno  each  receive  4,5  Gbps]        

•  Supercompu(ng  2005  in  SeaOle              video  generated  in    LSU  in  Baton  Rouge,              sent  to  more  2  des(na(ons  (SC  venue,  Brno)              The  users  could  par8cipate  on  visualiza8on            and  remotely  changed  parameters      

2005  Grid  era    

2007  -­‐  year  of  Ultragrid  progress  •  Developing  team  from  Brno  (CESNET  and  MU)  focused  on              further  development    of  original  Ultragrid  (UG)  sogware              •  In  uncompressed  mode    with  the  data  flow  1,5  Gbps    and  internal    

latency  90  ms  was  able    to  work    as  effec(ve  visualiza(on  tool  •  UG  used  for  interac8ve  educa8on    inside  of  US  and  to  Brno  (CZ).    

The  content  “Introduc8on  to    High-­‐Performance  Compu8ng”  provided  LSU  

•  The  people  around  UG  started  first  experiments  with                DXT  compression  on  GPU  what  allow  to  decrease  bandwidth            demand  on  250  Mb/s  

2008:  CESNET  Na8onal  conference    •  In  frame  of  CESNET  conference    we  organized    together    

         with    Kyushu  University      Interna8onal  Endoscopy  seminar    •  On  Life  mul8point    DVTS  videoconference  driven  by  QUATRO  •  Par(cipated  9  sites  from  5  countries    in  full  SD  (CZ,  JP,  IT,  US,  ES)  

           

I2  mee8ng  in  New  Orleans    UG  used  in  wide  experiment  together  with  AutoBAHn  and  I2  DCN  with  the  goal  of  semiautoma(c  network  alloca(on  

     

SC08  Bandwidth  4K  challenge    UG  extended  displaying  mode  to  SAGE    DEMO  Post  produc(on  with  2K  video    

In 2010, appeared DVTS - Plus (developed by CERNET) Multipoint connection, princip Client-Server,  NO  compression,    No  internal  latency,    up  to  8  channels  each  FullHD  quality  

35 Mbps

Server MCU

Remote sites

Client site

Resolution DV NTSC ( 720 x 480 )

Collaboration with TEMDEC group operating in frame of APAN

In  that  8me  Medical  Community  was  sa8sfied  with  this  resolu8on  and    quality      

Prof. Fukushima in MNUL

TNC2011 in Prague

In last 5 years Explosion of pixels

In 3D (Right Eye) In 3D (Left Eye)

~NTSC

24x from NTSC to 4K

~  100x  for  8K  

Compressed video: smaller volumes/files: compress ratio from 1:2 to 1:50

lower video quality, low bandwidth, high latency ( hundreds ms to sec)

Uncompressed video: big volumes/files size: Hr x Vr x color depth x fps, video quality on camera level, high bandwidth, low latency (ms)

High resolutions creates higher demands for networking and storage

DVTS NTSC 345600 pixels Digital 4K camera 8 631360 pixels 25 times more pixels

Challenges of real applications

1) More complicated situations need more complex solutions:

-­‐  more  HD  signals  in  both  direc3ons  -­‐  3D  -­‐  on-­‐line  transmission  without  latency  -­‐   large  formats  (4K,  8K,  etc.)  -­‐     speed  lines  are  not    available  everywhere              (problem  of  last  mile,  quality  of  compression)              etc.  

 2) Organized user community accept only acceptable solutions for majority

CESNET offers two technologies for such applications

 •  UG  (Ultragrid)    sogware  solu(on,  with  many  instala(on  in  the  world    

 •  MVTP4K  HW  solu(on  based  on  FPGA  technology.  Fast  with  minimal  internal  latency  

 Both  solu(ons  passed  long  development  period      Each  has  own  advantages  which  predefined  them  for  special  types  of  applica(on.    

ULTRAGRID tool with wide scale of compression options

More details on http://www.ultragrid.cz/en https://www.sitola.cz/igrid/index.php/UltraGrid https://www.sitola.cz/igrid/index.php/Performance

1/10Gbps

Linux, OS-X, WINDOWS + Network and Media cards

4KGateway (commercial name used by Spin-off company) •  2x 4K or 8x 2K/HD•  unlimited distance over regular Internet•  full-duplex•  embedded audio•  no compression adds less than 2 ms to networking delay (latency)•  since 2013 JPEG 2000 compression with factor 1:10• output synchronization for 3D without clock source

More technical details on www.ces.net/project/qosip/hw/mvtp-4k.pdf http://www.infivision.cz/sites/infivision.cz/4KGateway-2014.pdf

IN: 8x HD-SDI OUT: 8x HD-SDI

Network ports

MVTP-4K result of CESNET technology research

MVTP4K  used  in  Medicine  

•  In  2010  we  used  MVTP4K  for  first  live  3D  HD  transmission  from  robot  daVinci.  First  session  from  MNUL  in  Us(  to  Brno  (  on  Interna(onal  Congress  of  Mini  Invasive  Surgery  ).    

•  In  2011  we  were  invited  by  TEMDEC  to  do  same  transmission  to  big  APRICOT/APAN  mee(ng  at  HongKong.  

H323 Video from ST

2 video signals Left and Right eye

Robot da Vinci

MVTP-4K

Life surgery from Robot da Vinci (simple transmission diagram)

Stereo projector F10AS3D

Video from ST

http://www.ces.net/project/qosip/hw/mvtp-4k.pdf Modular Video Transport Platform - codec

NETWORK 10Gbps

Conference Venue

Surgery Theatre

2x HD video signals Left and Right eye

3D video MVTP-4K

Robot da Vinci

MVTP-4k

KEK and Univ. Tsukuba Thu Nov 18th 2010

16:00 – 18:00

F10 AS3D

MVTP-4k

Tsukuba Problema8c  part  of  the  path  

3D video transmission from Czech to Japan via IP on 10G links

(test for APAN)

NOV    15th,  CESNET  -­‐  KEK  experiment  (back-­‐to-­‐back)  

CESNET  interface  

Clear  peak  

Clear  peak  

Lost  in  traffic  Problema8c  Geant    part  of  the  path    

GEANT  had  problems  to  support    our  advanced  applica8ons  via  IP  

?

3D  HD  transmission  from  CZ  to  Hong  Kong      (APAN meeting in February 2011)

•  da Vinci Surgery System •  approx. 11000 miles / 17600 km •  3 HD channels (3D surgery + videoconference)

Cinegrid 2010 demo

•  Remote 3D 2K post-processing•  2.5 Gb/s sustained bitrate

Cinegrid 2010 demo

UG takes new initiative on GLIF 2012 in Chicago

During  the  GLIF  workshop,    CESNET  streamed  an  8K  movie  from  the  Interna(onal  Center  for    Advanced  Internet  Research  at  NW  University  in  Chicago  to  the  SITOLA  CESNET  laboratory    in  Brno,CZ,and  to  the  site  of  the  demonstra(on—the  EVL  at  the  University  of  Illinois  at  Chicago.    Par(cipants  on  both  receiving  loca(ons  could  control  the  streaming  interac(vely.    UltraGrid  used  JPEG  compression  at  2  Gb/s,  on-­‐the-­‐fly  recompressed    to  DXT5-­‐YCoCg  compression  at  6.5  Gb/s  and  displayed  the  images  on  a  high-­‐resolu(on  (led-­‐display  walls  using  EVL’s  SAGE  middleware,  which  is  interoperable  with  UltraGrid.    

Some  Advanced  Applica8ons    needs  both  technologies    

to  work  together  

BR Salvador

CZ Prague

ES Barcelona

stage

APAN  36TH

APAN-36 Global Cyber Performance

KR Daejeon

Three continents networked music and dance performance

music

dancer

dancer

dancer

Stage  video  

Stage  video  

Stage  video  

4K music

Popularity  of  Xbox    Inspira3on  for  new  Cyber  Performance    

“Dance  of  AVATARS”  

Motion sensing input device

“Dance of AVATARS” Original Idea

AVATAR performance

music

remote site A

remote site B

remote site C SD SD

SD

Kinect

Kinect

Kinect

Musicians in Prague

4K camera

Dancers in

Barcelona (ES), Salvador (BR) and Daejeon (KR)

Converted into Avatars Converted into Avatars

16m

6.5m

Stage

Audience

Big screen

Daejeon (KR) the APAN venue (lobby)

16m

6.5m

9m 3m Stage

4K

Control Desk

15,000 Ansi(Avatar)

ES KR BR

Screen

4,000 Ansi

Kinect

Lighting Lighting

Dancer Ground Floor

2nd Floor

10m

Composition plan

To be filled Chicago

APAN38 NanTou

Amsterdam

Barcelona Miami

Prague

· ASGCNet · CESTNET · GEANT · Internet2 · KREONet2 · TWAREN

APAN-38 Network Topology

NanTou

Taipei

10G 20G

20G

20G

10G

10G 10G

Dancing with synchronized music

Piano Trio

4K GW

4K GW HDP2

JackTrip

JackTrip

JackTrip

Nantou TW

Audio Mixer

network audio video

UltraGrid

UltraGrid UltraGrid

30ms

330ms

140ms

220ms

320ms

Sync Control

CESNET video transporting tools used on all sites in APAN 2014 Global Performance

4KGateway and Ultragrid for video JackTrip for audio

Miami

Prague

Barcelona

Miami

Barcelona

Prague

Nantou

Dancing with synchronized music

APAN-38 closing ceremony

Result: illusion of one scene

What  is  situa8on  now  ?    

What  is  situa8on  now  ?    

Every  year    several    advanced  applica8ons  

for  totally  different  users  (sport,  medical,  culture)  

First  4K  Transmission    for  Medical  Community  

Internet2 summit in Denver, April 2014

CESNET, Prague I2 summit, Denver

MVTP-4K

•  Radical nefrectomy for tumor of the kidney surgery, captured on a 4K camera, commented by Marek Broul, MD., the vice-director of the Robotic center in Masaryk Hospital in Usti nad Labem, Czech Republic •  Streamed in 4K resolution using 4K Gateway devices

P2P link

via academic networks MVTP-4K

4K TV

https://meetings.internet2.edu/2014-global-summit/detail/10003127/

This TV size is not very convenient to show the advantages

Session “8K, 4K, HD NREN Surgeries Worldwide”

Briliant clear and sharp image

To be filled Chicago

APAN38 NanTou

Amsterdam

Prague

· ASGCNet · CESTNET · GEANT · Internet2 · KREONet2 · TWAREN

Network Topology

NanTou

Taipei

10G 20G

20G

20G 10G

4K on APAN38 Medical WG University of Nantou, Taiwan 2014

Partners:

4K on APAN Medical WG Taiwan

4K TV

hOps://www.youtube.com/watch?v=pLq4kXjLnQI  

Geant  Symposium  Athens  2015  

eMusic project

Joint  performance  Prague  -­‐    London  

NEAR  IN  DISTANCE  2    Network  Performance    based  on  UltraGrid  

Organized  by  ACONET  to  25  Anniversary  of  Internet  in  Austria        

Vienna  received  live  video  from:    Barcelona,  Prague,  Ljubljana,    Ludenburg,    (New  York  sends  video    from  the  street  via  WOWZA)    

NEAR  IN  DISTANCE  2  

CESNET  needs  GLIF  and  other  similar    experimental  networks  and  testbeds    

opera8ng  across  the  globe    

Geant  is  not  ready  to  provide  services  in  quality  which  we  need  for  our  advanced  applica8ons  

Conclusion  

Ques8ons  ?  

Thank  you  for    your  aien8on