Leveraging Existing Application Processors in Mobile Devices to Implement VoIP Client

VoIP Client Requirements Enabling Rich Telephony Features on Cellular Handset

• Standards Compliant and Interoperable with VoIP networkso Based on IETF RFC SIP 3261

• Support for standard audio compression formats used in VoIP networkso G.711, G.729A/B, G.723.1, G.726, GSM-AMR, G.722, G.722.1, G.722.2 (AMR-WB)

• Implement basic and advanced signaling and call control featureso Call Setup, Teardown, Hold/Resume, Transfer, Multi-Line appearanceo Local 3-Way conferencing (requires 2-channels), bridged-conferencingo Mid-Call DTMF, CPT, Polyphonic ring toneso Text Messaging and Presence (SIMPLE)o Authentication and Security mechanismso Proxy Discovery

• Support Hands-Free speakerphone operation (Acoustic Echo Cancellation)

• QoS: Noise Cancellation, Adaptive Jitter Buffer and Lost packet Concealment

• Configurable by provider and user in field

• Use the existing User Interfaces (MMI) on the cellular device

VoIP Client RequirementsDesign Considerations

• Co-Exist with current applications and OS

• Minimize Memory requirements for program and Data

• Minimize Processing requirements

• Minimize Power dissipation

• Use the existing User Interfaces (MMI) on the cellular device

• Field Upgradeable

• Deliver Better Voice Quality and an overall better Communication Experience to the Consumer

• And achieve ALL of the above without adding additional cost to the BOM

VoIP Client: Traditional ApproachHigh Cost, High Power, Complex Multi-Processor System

• Application processor: Non-Compute Intensive Software Moduleso OSo Network Stackso VoIP: Protocols, System Framework, System Software, Jitter Buffer, Conference Mixer,

Application, Management SW et..o UI/GUI/MMIo Productivity Applicationso Drivers

• DSP Processor: Compute Intensive Signal Processing Algorithmso Voice Coders, Echo Cancellers (AEC for Speaker Phone), Tone Generators, Lost

packet Compensation, Noise Canceller, Media Controller, Audio capture-playback.

• Complex multi-processor systemo Requires DSP processor which adds power and costo Software is more complex and DSP sub-system is a black-box, difficult to upgradeo Locked to proprietary DSP architecture (System is not Scalable)o Requires Separate Tool chains and Software development skill set

VoIP Client: SoftDSP ApproachSingle Processor Solution

• Application processor: All Software Modules including Media Algorithmso OS, Network Stacks, Driverso VoIP: Protocols, System Framework, System Software, Jitter Buffer, Conference

Mixer, Application, Management SW etc.o Voice Coders, Echo Cancellers (AEC for Speaker Phone), Tone Generators, Lost

packet Compensation, Noise Canceller, Media Controller, Audio capture-playback..o UI/GUI/MMIo Productivity Applications

• Simple and Flexible Designo Signal Processing Algorithms on general purpose RISC processoro Scalable for applications like Video over IPo An Elegant, Simple, low Cost, low Power solution for VoIP clients on Cellular

Handsetso Software requires only industry standard general purpose RISC Processor

Architecture.o Simply upgrading the Processor will achieve better system performance and the

SW will be reusable without changeso Unified Tool chains and Software development skill seto Extremely short time to market

Media Processing SubsystemRequires 90% of Processing Bandwidth (MHz / Channel)

PCMI/F

AEC

128 msVAD Speech

Encoder

CNGEncoder

PacketI/F

Adaptive Jitter BufferCNG

SpeechDecoder

PLC

PCM

Speech/Lost Pkt

Tones Rx

SID/DTX

Tx

DTMF Generator

Software Partitioning: Option1

Application Processor (RISC)

• Call Signaling • Call Control Manager, System and

Media Frameworks• RTP/RTCP, SDP• Application layer and UI• Call Conferencing Engine• Media Processing for Channels - 1 & 2• Acoustic Echo Cancellation• DTMF generation• CPT and Custom Tones• QOS: Adaptive Jitter Buffer and PLC• Automatic Gain Control• Noise Reduction• PCM Handler

• Implements complete 2-channel solutions including 3-way conferencing on AP

• Simple Software Integration on Existing Platform

• Short time to Market of 4 to 10 weeks

• Includes 3-Way conferencing, implemented on AP

• Requires less than 40 MHz/Channel (G.729A/B vocoder) on ARMv5TE

Software Added for VoIP

VoIP Signaling, Packetization Protocols

Call Manager, VoIP media and system

Frameworks, TCP/IP, UDP NW stack

Channel-1 Media Processing modules (AMR, AEC, Noise

Reduction) targeted on the Application

Processor (ARM RISC CPU)

3-Way Conferencing Mixer, Media Processing

for Channel-2 (AMR) targeted on the

Application Processor (ARM RISC CPU)

Software Partitioning: Option1

Software Partitioning: Option II

Existing RISC Microprocessor

• Call Signaling • Call Control Manager,

System and Media Frameworks

• RTP/RTCP, SDP• Application layer and UI• Encryption• Call Conferencing Engine• Media Processing for

Channel-2• DTMF generation• CPT and Custom Tones• QOS: Adaptive Jitter

Buffer and PLC

Existing DSP core

• Media Processing for Channel-1• Acoustic Echo Cancellation• Automatic Gain Control• Noise Reduction• PCM HandlerPlatform

Services

Software Added for VoP

Existing Software available on Platform

• Software Distributed between Host RISC Processor and DSP processor

• Media Processing for Channel- targeted on DSP Processor

VoIP Signaling, Packetization Protocols

Call Manager, VoIP media and system

Frameworks, TCP/IP, UDP NW stack

Channel-1 Media Processing modules (AMR, AEC, Noise

Reduction). Existing algorithms on Cellular

platform

3-Way Conferencing Mixer, Media Processing

for Channel-2 (AMR) targeted on the

Application Processor (ARM RISC CPU)

Software Partitioning: Option II

Press Release: HelloSoft Demonstrates Complete VoIP Solution on TI OMAP 1710 Cellular Platform

Hellosoft’s VoIP SolutionAvailable for ARM & MIPS Processors

• Complete Software Solution includes all necessary Protocols, Algorithms, Frameworks and System Software for a client device

• Highly Optimized VoIP Solution, designed for single RISC Processor-based designs, Eliminates the need of DSP (SoftDSP)

• Industry-best Performance for Media Processing Algorithms on RISC processors.

• Excellent Voice Quality (PESQ and PSQM Scores) comparable or better than DSP-based Solutions.

• Designed for Portability to Different OS/RTOS and Processor Architectures (Implements OS Abstraction).

• Modular System Architecture. • Shipping to major Semiconductor and ODM customers

VoIP Solution for HandsetsSoftware Blocks Licensed by Hellosoft

THANKS