Download - Going Beyond UDP Acceleration - SLide Deck
Webinar Feb 23, 2016Going Beyond UDP
Acceleration
John Tkaczewski, President of FileCatalystBlog: http://filecatalyst.com/blog/Past Webinars: http://filecatalyst.com/resources/webinars/
© Copyright FileCatalyst, 2015
?• FileCatalyst transfers files at full link speed:
• UDP with proprietary retransmission and congestion control
• Patented algorithm built from the ground up in-house
• Transfer rates up to 10 Gbps (with encryption) using commodity hardware
• Not affected by latency and speed degrades, linearly with packet loss
• Ability to fully leverage multi-core CPU architecture•
Integration with leading Cloud Storage like Amazon S3
© Copyright FileCatalyst, 2015
Issues with TCP• Flow control limits transmission window, causes dead air with high latency
• Very aggressive in response to network congestion, cannot tune in application layer
• Result is less than ideal performance on wireless, satellite, or long haul links
• Can be tuned but still not ideal for many-one, one-many
TCP is a very serial process. Each packet of data must be received before a new packet is sent = Decreased transfer speed
Source File Destination File
Acknowledgments
Data Packet
© Copyright FileCatalyst, 2015
Why Faster?
• Ideal for bulk file transfer• Predictable - Can send at a perfect rate• Not affected by latency or packet loss• Congestion Control implemented in application layer• Tunable congestion control aggression• Instantly detect link capacity
Source File Destination File
Acknowledgments
FileCatalyst completely saturates the pipe by sending multiple blocks of data = Increased transfer speed
© Copyright FileCatalyst, 2015
Demo
Method TimeFTP-Filezilla (no checksum) ~ 6 minutesPlain UDP (with checksum) ~ 24 sec
Single File: compressed video - 600 MBSample Link speed: 400Mbps, 160ms delay
Method TimeZIP, IZArc 4.1.6 ~ 45 secRAR, WinRar 4.01 64 bit ~ 25 sec
Dealing with multiple files.
Benchmark Compression Speed: 137MB, 71 files in 10 folders
Compression requires disk space and takes time.
Method TimeFTP-Filezilla (no checksum) ~ 2min 10 secPlain UDP (no checksum) ~ 1min 20 secPlain UDP (with checksum) ~ 1min 40 secMulti-Client (with checksum) ~42 secSingle Archive (with checksum, ) ~18 sec.Multi-Client (with checksum and zip compression)
~ 18 sec.
Sample Data set: 47 files, 261 MB, file sizes 1MB-50MB (compressed)Sample Link speed: 400Mbps, 160ms delay
Features Unique to FileCatalyst.No additional disk space required
Other Options:
• Transferring File Deltas (rsync) Moving only changes detected in the file• Save bandwidth (Savings for cloud and Satellite links)• Increased Processing time
• Directory Streaming (transferring n-files)
• File System Events, no need to scan complex folders
Questions?