middleware - fujitsu.com msm.pdfthe fr-v middleware is optimized to exploit the full range of...
TRANSCRIPT
Specifications are subject to change without notice. For further information please contact each office.
All Rights Reserved.The contents of this document are subject to change without notice. Customers are advised to consult with FUJITSU sales representatives before ordering.
The information, such as descriptions of function and application circuit examples, in this document are presented solely for the purpose of reference to show examples of operations and uses of Fujitsu semiconductor device; Fujitsu does not warrant proper operation of the device with respect to use based on such information. When you develop equipment incorporating the device based on such information, you must assume any responsibility arising out of such use of the information. Fujitsu assumes no liability for any damages whatsoever arising out of the use of the information.
Any information in this document, including descriptions of function and schematic diagrams, shall not be construed as license of the use or exercise of any intellectual property right, such as patent right or copyright, or any other right of Fujitsu or any third party or does Fujitsu warrant non-infringement of any third-party's intellectual property right or other right by using such information. Fujitsu assumes no liability for any infringement of the intellectual property rights or other rights of third parties which would result from the use of information contained herein.
The products described in this document are designed, developed and manufactured as contemplated for general use, including without limitation, ordinary industrial use, general office use, personal use, and household use, but are not designed, developed and manufactured as contemplated (1) for use accompanying fatal risks or dangers that, unless extremely high safety is secured, could have a serious effect to the public, and could lead directly to death, personal injury, severe physical damage or other loss (i.e., nuclear reaction control in nuclear facility, aircraft flight control, air traffic control, mass transport control, medical life support system, missile launch control in weapon system), or (2) for use requiring extremely high reliability (i.e., submersible repeater and artificial satellite).Please note that Fujitsu will not be liable against you and/or any third party for any claims or damages arising in connection with above-mentioned uses of the products.
Any semiconductor devices have an inherent chance of failure. You must protect against injury, damage or loss from such failures by incorporating safety design measures into your facility and equipment such as redundancy, fire protection, and prevention of over-current levels and other abnormal operating conditions.
If any products described in this document represent goods or technologies subject to certain restrictions on export under the Foreign Exchange and Foreign Trade Law of Japan, the prior authorization by Japanese government will be required for export of those products from Japan.
2003 FUJITSU LIMITED Printed in Japan
FUJITSU LIMITEDhttp://edevice.fujitsu.com/
Japan Marketing Div., Electronic DevicesShinjyuku Dai-ichi Seimei Bldg.7-1, Nishishinjuku 2-chome, Shinjuku-ku, Tokyo 163-0721Tel : +81-3-5322-3353 Fax : +81-3-5322-3386
AD07-00038-1E June, 2003
REALOS is trademark of Fujitsu Limited, Japan. axLinux is name of the Linux OS developed and provided by AXE, Inc. DivX is a trademark of DivX Networks, Ins. Microsoft, Windows and Windows Media are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.Other company names and brand names are the trademarks or registered trademarks of their respective owners.
FUJITSU SEMICONDUCTOR
Middleware
Media Solution
North and South AmericaFUJITSU MICROELECTRONICSAMERICA, INC.1250 E. Arques Avenue, M/S 333Sunnyvale, CA 94088-3470, USATel : +1-408-737-5600Fax : +1-408-737-5999http://www.fma.fujitsu.com/
EuropeFUJITSU MICROELECTRONICS�EUROPE GmbHAm Siebenstein 6-10, �D-63303 Dreieich-Buchschlag,�GermanyTel : +49-6103-690-0 Fax : +49-6103-690-122http://www.fme.fujitsu.com/
Asia PacificFUJITSU MICROELECTRONICSASIA PTE LTD.#05-08, 151 Lorong Chuan,New Tech Park,Singapore 556741Tel : +65-6281-0770Fax : +65-6281-0220http://www.fmal.fujitsu.com/
KoreaFUJITSU MICROELECTRONICSKOREA LTD.1702 KOSMO TOWER,1002 Daechi-Dong,Kangnam-Gu, Seoul135-280, KoreaTel : +02-3484-7100Fax : +02-3484-7111http://www.fmk.fujitsu.com/
Audio/videoaccessories
In-Vehicleaudio/video accessories
Internet printers
IP videophones
Digital video cameras
Digital camerasHome servers
Media PDAs
Surveillance cameras
Silicon viewers
The FR-V middleware is optimized to exploit
the full range of hardware capabilities in the
FR-V Media Solution product provided by
Fujitsu. In addition to a basic codec for media
processing including MPEG-1, MPEG-2,
and MPEG-4, it provides a rich suite of
products, including higher-level audio/video
recorder and audio/video player libraries.
These products give customers the tools to
embed media processes into their products
with ease.
ContentsWhat is the FR-V Media Solution?………………3Features of the FR-V Middleware…………………4Audio/Video Recorders and Audio/Video Players…5MPEG Visual Codec………………………………7Audio/Voice Codec………………………………11Still Picture Libraries……………………………132D Graphics Libraries……………………………15List of the FR-V Middleware Products…………17
1 2
middleware
A/V Player/RecorderMPEG-4
Visual
MPEG-2 ML
MPEG-1
JPEG
2D GraphicsWindows MediaTM
Video
Windows MediaTM
Aud io
ATRAC 3
MP3
MPEG -2/4 AA C
Fujitsu FR-V middleware for embedded use to meet a wide variety of media processing needs through advanced programming technologies
ADPCM(G.726)
Software solutions that ensure advanced functionality, high performance, and high quality.
We offer our rich variety of libraries developed by highly efficient program for embedded use. Depending on the users' purposes, they can be applied in flexible combinations to achieve a wide range of functions.
All middleware products achieve high-performance software solution that has been fully tuned to use of an FR-V processor. This optimized middleware and powerful FR-V processors realize hiher-quality image and sound.
A wide range of middleware products reduce development costs and time.
Our versatile range of middleware products include basic codecs such us for MPEG-1, MPEG-2, and MPEG-4 as well as libraries for audio/video recorders and players. These products enable easy incorporation of middleware functionality into customer products, enabling customers to reduce development costs and time.
Our software solution allows customers to conform their products to a new standard or upgrade them according to their new system simply by replacing the software.
Adopts an industry standard operating system to take full advantage of existing assets.
The FR-V middleware runs on Fujitsu's REALOS that is a real-time operating system compliant with Japanese embedded industry-standard µITRON specification. It also runs on Linux that is an industry-standard as open source software, therefore the customers can utilize their own applications and other assets.
From customization to system integration
Our staff specialists support customers' hardware, software and service from planning to development up to mass production. With this wide range of support including customization up to system integration consulting, customers can use our middleware products without any concern.
Features of the FR-V Middleware
FR-V Media Solution consists of hardware, software, and service.We provide an integrated platform consisting of high-performance media processing CPU FR-V processors, companion chips, boards equipped with peripheral devices, an operating system, device drivers, and FR-V middleware.To provide detailed support for customer from product planning up to the stage of volume production, we offer solution in which service products are added to the platform.
What is the FR-V Media Solution?
3 4
PlanningPlanning Development Massproduction
Hardware• CPU• Companion chips• Boards
Software• Operating system• Device drivers• Middleware
Platform
Service
Media Solution
Customers
Fujitsu
Total support
Audio/Video Recorder and Audio/Video Player
5 6
Trick Play (Audio/Video Player)
A wide range of player functions make it easy to incorporate various trick play functions such as play and stop.• Normal play, stop, and pause• Fast forward and rewind of I-picture search• Playback speed control�
(double, standard, 1/2 time, 1/4 time, �and 1/8 time speeds)
*Specifying a playback speed other than standard results in playback of the video image only.
The original image size of the video data stream can be enlarged or reduced for playback.• 200% enlargement or 50% reduction of
image size can be specified
Enlargement and Reduction Function (Audio/Video Player)
This function shows how much time passed since playback of the stream started and how much time is necessary tocomplete playback of the entire stream. With this function, customers can develop a playback progress bar or somethingthat shows playback progress status.• Information regarding time passed since stream playback started / total time to complete the stream playback can be acquired.
Playback Progress Status (Audio/Video Player)
Voice Control (Audio/Video Player)
This function supports bilingual streams and enables voice control that minimizes POP noises by filtering voice output at start and at end with software.• Switching between main and sub-voices, main voice only, and sub-voice only�• Mute on/off function�• Handy POP noise reduction function
Audio/videorecorders
n-times speedencoding
Customerapplications
Customerapplications
Various codecs
FR-V processors
Various codecs
FR-V processors
Audio/videoplayers
Trick play functionEnlargement/reduction
function
Table 1. Compatible Middleware and File Formats
Common Interface
Fast Encoding (Audio/Video Recorder)
Our audio/video recorder and player offer a variety of middleware library products (video, audio, and voice) and the interface common to various file formats (such as MP4). This allows customers to make expand product functionality without major modifications of existing applications, even in the event of a revised or new standard.
Our audio/video recorder realizes an encoding system with greater than 1x speed if it's a stored resource, with the high-processing FR-V processors and the high-speed middleware encoders.
Video
Audio
Voice
File format
MPEG-4 Visual SP
MPEG-2/4 AAC-LC
ADPCM (G.726)
MP4
MPEG-1, MPEG-4 Visual SP
MPEG-1 LayerI/II, MPEG-2/4 AAC-LC, MP3
ADPCM (G.726)
MP4, MPEG-1 System
Audio/Video Recorder Audio/Video Player
Features of the Audio/Video Recorder and Player
Product Specifications
Compatible codec
Compatible file format
System stream information
Video stream information
Audio stream information
Recording and playback
function
Recording and playback
information
Video input/output
Audio input/output
Audio mode switching
ROM capacity
RAM capacity
Operating environment
Compatible operating system
Audio/Video recorder
Video: MPEG-4 Visual SP
Audio: MPEG-2/-4 AAC-LC
Voice: ADPCM (G.726)
MP4
Recording start time, recording time
Image size/aspect ratio, frame rates, bit rates, picture structure
Channel configuration, sampling rates, and bit rates
Recording
Recording capacity notification
—
—
—
Approx. 480KB
Approx. 1.7MB*2
FR400 series
REALOSTM*3, axLinux*4
Audio/Video player
Video: MPEG-1, MPEG-4 Visual SP
Audio: MPEG-1 Layer I/II, MP3, MPEG-2/-4 AAC-LC
Voice: ADPCM (G.726)
MPEG-1 System, MP4
File format identification, time information
Image size/aspect ratio, frame rates, bit rates
Channel information, sampling rates, and bit rates
Normal play, pause, stop, fast forward, fast rewind,
double-speed play*1, and slow play (1/2, 1/4, and 1/8 time)*1
Playback progress time
50%, 100%, and 200% enlarged/reduced displays
Mute function
Handy POP noise reduction function using data filtering
Switching between main and sub-voices, main voice only,
and sub-voice only
Approx. 280KB
Approx. 1.7MB*2
*1: For a double-speed or slow-speed playback, only the video image is playbacked.*2: Approx. 1.7MB does not include the audio/video input/output buffer. When using MP4 in the audio/video recorder, a capacity of +356 × recording time (seconds) bytes is required in addition.*3: REALOS is a Fujitsu's real-time operating system compliant with µITRON 4.0 .*4: axLinux is the name of the Linux developed and supplied by AXE, Inc.
We offer audio/video recorder and audio/video player products so that customers can install the interface common to various codecs such as MPEG-1/-4, AAC, and ADPCM when developing applications. This allows customers to realize more efficient application development and easier functional expansion.
MP4
Audio/video recorders and players
Customer's applications
Common interface
Audio File format
MP3 AAC ADPCM
VoiceVideo
MPEG1
MPEG4
Trick play Voice control
*This is a product image. As GUI (Graphical User Interface) functionality is not included in this product, customers need to develop it by themselves if necessary.
Enlargement andReduction
Playback progress status
384Kbps bit rate 2Mbps bit rate
MPEG Visual Codec
* : Stream data that has been encoded at a high bit rate of 384Kbps or more requires a decoder supporting a bit rate of 384Kbps or more.
Responding quickly to the demand for high image quality (higher resolution and higher bit rates), we provide a functional expansion of MPEG-4 Visual Simple Profile (SP) (supporting higher bit rates) and our own proprietary algorithms to achieve high image quality. We also have MPEG-1 and MPEG-2 decoder products. In addition, we plan to introduce products compliant with MPEG-4 Visual Advanced Simple Profile (ASP), DivX, Windows Media Video, or H.264 standards. Supporting various codecs like this is an advantage of our software solution with middleware based on FR-V as its core. Moreover, this software-based middleware solution can flexibly meet customers' functional requirements and customization to create winning products together with customers.
MPEG-4 Visual Encoder and Decoder
High performanceThe FR-V processor's powerful media instructions are capable of performing the high-speed operation essential for image processing. These powerful operational instructions allow high-speed performance of processes such as motion estimation, motion compensation, and DCT/IDCT (discrete cosine transform/inverse discrete cosine transform) and encoding and decoding at very small CPU loads. This enables real-time processing under the following conditions, even with MPEG-4 AAC running simultaneously.
Handling higher bit rates (encoder)In addition to 384Kbps, the upper limit bit rate of the MPEG-4 Visual Simple Profile (ISO/IEC14496-2) standard bit rate, the MPEG-4 visual encoder supports bit rates of up to 2Mbps for high quality image . We can also provide custom solutions to handle bit rates to 2Mbps or more.
Conditions: With FR400 series MB93403, Stream ITE No. 16, and MPEG-4 AAC are running concurrently
Bit rate control function (encoder)Our proprietary bit-rate control algorithm is capable of accurate, automatic detailed bit rate control - for example, allocating fewer bits to a video scene with relatively stable content and more bits to a video scene with many movements, even in cases where the number of bits assignable within a certain time is fixed, as with constant bit rates (CBR). This permits high image quality even in scenes with a high rate of change.
Error concealment function (decoder)Our decoder products are even capable of handling bit errors or packet loss in streaming data. For example, when a packet loss occurs in a transmission line and the error concealment function is enabled, the decoders retrieve image information from a preceding frame near the frame area from which packets were lost to conceal the error parts. This enables extremely, high-quality video images.
Scene analysis and scene change detection function (encoder)The FR-V processors are capable of high-speed operations of sum-of-square differences. This means MPEG-4 visual encoder can instantly calculate differences between current and previous frames to accurately detect scene changes. When the first frame of a scene change detected at this time is allocated to an I-picture (I-VOP), disturbances in a video image at the scene change are eliminated for smooth scene transitions. Moreover, because the encoder can adjust the sensitivity of detecting a scene change, the user can make detailed user setup according to input video images.
7 8
High image quality
: I-picture. It holds data of one screen.
: P-picture. It holds only data for differences between preceding and succeeding frames.
P
I
Our encoder accurately detects a scene change and processes it with I-picture.
P P P I P P
Video image withrelatively stable content
Video image withmany movements
30 frames/second
Bit
rate
Fewer bits
More bits
Network transmission line
Transmission side Receiving side
Error concealmentfunction enabledPacket Packet
Packet
Packet loss takes place
* : This is an optional function. Note that enabling this function will reduce decoding performance somewhat. Customers can enable or disable this function, depending on their system requirements.
Deblocking filter (decoder)Usually, MPEG data encoded at a low bit rate generates block noise during decoding. The deblocking filter can remove this block noise by using it as a posttreatment of decoding.
Deblocking filterOFF
Deblocking filterON
Encoding performance
Decoding performance
QVGA 1Mbps 15fps, CIF 128Kbps 15fps, QCIF 128Kbps 30fps
QVGA 2Mbps 30fps, CIF 512Kbps 30fps, QCIF 128Kbps 30fps
Note: The images on this page are intended to illustrate typical effects.
Image size bit rate, and frame rate This decoder can decode various image sizes, including SQCIF, QCIF, CIF, QVGA, and VGA. In addition, it supports a wide range of bit rates, frame rates, and other parameters, giving you the power to reproduce stream data of various image sizes, bit rates, and/or frame rates.
Frame-by-frame processingWe offer an API that decodes MPEG video frames on a frame-by-frame basis. This makes it possible for the decoder to detect picture type, allowing you to extract only a single I-picture of high-quality video image for printing or for use as a thumbnail.
ResponseOur libraries can convert the number of video buffer planes into a parameter, which can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).
* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.
Load distribution function (encoder)System design needs to be done by taking account of load distribution according to the system in order to do encoding while multiple applications run concurrently. Our libraries can implement this functionality by inserting NOT_CODED (the instruction for using the previous block or frame in the event there are no differences in video data between current and previous blocks or frames) on a macro-block or frame-by-frame basis to reduce encoding loads.
MPEG-2 MP@ML Decoder
Image size bit rate, and frame rateThis decoder can decode various image sizes including SQCIF, QCIF, CIF, QVGA, and VGA. In addition, it supports a wide range of bit rates, frame rates, and other parameters, giving you the power to reproduce stream data of various image sizes bit rates, and/or frame rates.
Frame-by-frame processingWe offer an API that decodes MPEG video frames on a frame-by-frame basis. This makes it possible for the decoder to detect picture type, allowing you to extract only a single I-picture of high-quality video image for printing or for use as a thumbnail.
ResponseOur libraries can convert the number of video buffer planes into a parameter that can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).
* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.
Product Specifications
Complies with the MPEG-2 standard (ISO/IEC 13818-2)
The decoder can extract only an I-picture (I-VOP) of fine image to do video printout, etc.
P P P P P P P PI
(MPEG-4 video frames):I-picture PI :P-picture
9 10
Complies with the MPEG-1 standard (ISO/IEC 11172-2)
MPEG-1 Decoder
Image size bit rate, and frame rate (encoder and decoder)With these MPEG-4 visual encoder/decoder, various image size (16 × 16 to 8191 × 8191) such as size of SQCIF, QCIF, CIF, QVGA, or VGA standard can be set. You can also set bit rates (32Kbps to 2Mbps), frame rates (1 fps to 60 fps), and other parameters .
Response Real-time capability is a key ingredient of interactive two-way communication products. Our libraries can convert the number of video buffer planes into a parameter, which can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).
* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.
A rich feature set
*1: Up to 384Kbps due to the MPEG-4 SP standard. However, the MPEG-4 visual encoder and decoder support bit rates of up to 2Mbps for high image quality. We can also provide custom solutions to handle bit rates higher than 2 Mbps.
*2: When constrained_parameter_flag = 1, the bit rate is 1.856Mbps or less according to the standard.*3: The RAM size shown is provided when the image size is 320 × 240, vrfb = 3, and the deblocking filter is enabled.*4: The RAM size shown is provided when the image size is 320 × 240.*5: REALOS is a Fujitsu's real-time operating system compliant with µITRON 4.0 .
MPEG-4 SP decoder
Elementary stream
YUV 4:2:0 Frame Planer
16 to 8191 pixels
16 to 8191 lines
ROM 100KB/RAM 460KB*4
Deblocking filter
MPEG-1 decoder
ISO/IEC11172-2
Elementary stream
YUV 4:2:0 Frame Planer
16 to 768 pixels
16 to 576 lines
Up to 1.5Mbps*2
1 to 30 fps
ROM 32KB/RAM 470KB*4
FR400 series
MPEG-2 decoder (MP@ML)
ISO/IEC13818-2
Elementary stream
YUV 4:2:0
Field Planer/Frame Planer
16 to 720 pixels
16 to 576 lines
Up to 15Mbps
1 to 60 fps
—
FR550 series
MPEG-4 SP encoder
YUV 4:2:0 Frame Planer
Elementary stream
16 to 1920 pixels (16 pixels basis)
16 to 1088 lines (16 lines basis)
ROM 120KB/RAM 460KB*3
1) Single pass CBR
2) Variable packet size
3) Channel switching
32Kbps to 2Mbps*1
1 to 60 fps
FR400 series
REALOSTM*5, axLinux
MPEG-4 Visual Simple Profile (ISO/IEC14496-2)
Specifications
Decoding/coding system
Input format
Output format
Number of horizontal pixels for picture
Number of vertical lines for picture
Bit rate
Picture rate
Resources
Other
Operating environment
Compatible operating system
Frame-by-frame processing (decoder)We offer an API that decodes MPEG video frames on a frame-by-frame basis. This allows users (for example) to extract only a single high-quality I-picture (I-VOP) of a favorite scene for printing or for use as a thumbnail.
Our audio/voice codec is compatible with various standards including MPEG-2/-4 AAC LC, MPEG-1 layer I/II, MP3, and ADPCM, allowing you to efficiently develop application systems for portable audio equipment, terrestrial digital broadcasting/satellite broadcasting receivers, music distribution on the Internet, and other applications. This audio/voice codec is capable of high-speed encoding and decoding with high sound quality, even with a high efficient but compact program. The MPEG-2/-4 AAC LC encoder uses proprietary algorithms to achieve optimum compression encoding processing and sound quality. For the future, we will reinforce product differentiation based on our proprietary algorithms, with the goal of creating appealing products and introducing them in a timely manner. We also plan to offer middleware compatible with Windows MediaTMAudio, ATRAC3 and AMR.
The MPEG-1 Audio Layer I/II decoder is capable of decoding audio streams of ISO/IEC11172-3 standard-compliant MPEG-1 audio layers I/II at high speed and with high sound quality.• Because the MPEG-1 Audio Layer I/II decoder accepts a various ways of audio stream inputs, they
adopt memory input for input means.• Environment-independent memory management�
(libraries can be run in a wide range of environments, since they use user-provided memory allocation and memory deallocation functions.)
• Audio frame-basis decoding (easily dealing with audio streams transmitted in real-time)
Audio/Voice Codec
MPEG-2/-4 AAC LC Encoder/Decoder MPEG-1 Audio Layer I/II Decoder
• Header format: — ADTS (Audio Data Transport Stream) — ADIF (Audio Data Interchange Format) — Without header• Sampling frequency: 24/32/44.1/48kHz• Number of channels for coding (decoder only): — 5.1 channels maximum (5 channels + LFE (Low Frequency Enhancement) • Down mix (decoder only): — Audio information can be down-mixed from 3 - 5.1 channels to 2 channels.
The encoding/decoding performed by the MPEG-2/-4 AAC LC Encoder and Decoder meets the requirements of ISO/IEC14496-3 and the ISO/IEC13818-7 Low Complexity (LC) Profile. These middleware solutions enable high-quality, real-time music playback/recording.
• Realizing world's highest-speed encoding• High compression and high sound quality tuning depending on bit rates• These encoder/decoder incorporates our proprietary algorithms (swithing to optimum window length
switching and bit distribution) for low noise and high-quality sound.
Analog signal Audio signal (time domain)
Mapping conversionand psychologicalsensory analysis
Quantization Coding
Inverse mappingconversion
Inversequantization Decoding
Encoder
Decoder
Accumulated media/communication line
Overview of specifications
11 12
• CRC (Cyclic Redundancy Check) protection• Bilingual: main voice and sub-voice• Bit rate: fixed (CBR)• Number of quantized bits: 16bits• Memory data — Encoder: ROM: 104KB (library size) RAM: 190KB — Decoder: ROM: 130KB (library size) RAM: 130KB
Comparison of Encoding Performance(Music data of 44.1kHz, 128Kbps, and 4 minutes)
PC: Pentium II-800MHz Windows 2000 Minimum RAM: 192MB
FR-V: CPU: FR400 series MB93403
Encoding conditions: 128Kbps/44.1kHz/Stereo
Fujitsu (FR-V)
Fujitsu (PC)
Company A (PC)
Company B (PC)
Company C (PC)
1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 (times)Fast Slow
Note: The performance comparison is done by converting into MHz.
Minimum Requirements
Achieving high sound qualityin any environment
• Input format: 8-bit µ-law PCM/8-bit A-law PCM/ 14-bit uniform PCM• Output format: 16/24/32/40Kbps• Memory data: ROM: 20KB (library size) RAM: 500B
• Output: 16-bit signed integer type/32-bit signed integer type• Memory data: ROM: 18KB (library size) RAM: 30KB
The MP3 decoder can decode MP3 (MPEG audio layer III)-compliant audio streams at high speed and high-quality sound.
The ADPCM Encoder/Decoder performs encoding and decoding in compliance with the ITU-T Recommendation G.726 and ITU-T Recommendation G.726 Annex A standards. This middleware allows you to process high-quality audio data regardless of user environment.• Concurrent processing of compression and decompression• Supports diverse input/output formats• Flexible settings for audio data arrangements and processing sequences
• Sampling frequency: 8kHz• Data input/output interface: — Provides functions that process sampling data one by one for compression or decompression. — Input/output of audio data is processed only by arguments and return values of functions.
MP3 Decoder
ADPCM Encoder/Decoder
• Sampling frequency: 24/32/44.1/48kHz• Number of channels: 2 channels (stereo)• Bit rates: 32 to 448Kbps (layer I) 32 to 384Kbps (layer II)
• Output: 16-bit, signed integer type/32-bit, signed integer type• Memory data: ROM: 85KB (library size) RAM: 100KB
• Sampling frequency: 24/32/44.1/48kHz• Number of channels: 2 channels (stereo)• Bit rates: 32 to 384Kbps
Overview of specifications
Overview of specifications
Overview of specifications
CPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux
Operating Environment
MPEG Layer-3 audio coding technology licensed from Fraunhofer IIS and Thomson multimedia.
Complies with the JPEG standardThis library complies with the JPEG baseline process (DCT-based) specifications (ITU-T T.81, ISO/IEC10918-1), international standards for encoding of color still pictures, and are therefore data compatible with other JPEG-compliant image equipment.
High-speed compression/decompression processingThe processing speed achieved when the FR400 Series MB93403 (266MHz) performs encoding and decoding (24-bit RGB to YUV 4:1:1 and vice versa) of a still picture with VGA size (640 × 480 pixels) at 6% is as high as 52 ms for encoding and 50 ms for decoding.
A quantization table and Huffman table can be set as desired.Allows flexible control of image quality and compression rates according to the uses of a product to be developed.
Divided decoding is possible.Pictures can be devided and decoded on an MCU basis or specified bytes basis. This can reduce of required memory resources, enabling other processes to run while image decoding is performed. Since any decoding units can be set, this library is easily used on existing systems. Since the library is compatible with JPEG hardware IP decoding units, switching from JPEG hardware IP to this library is easy.
Still Picture Libraries
JPEG Baseline Encoder/Decoder Library
This library complies with the GIF standard (Graphics Interchange Format Version 89a Programming Reference). Thus, it is data compatible with other image equipment compliant with the GIF standard.
It is capable of decoding an image by dividing in smaller units. This enables use with applications even under low memory resource conditions.
This library complies with the TIFF 6.0 standard (TIFF Revision 6.0 Final - June 3, 1992).*1 Thus, it is data compatible with other image equipment compliant with the TIFF standard.
As with the GIF decoder library, it is capable of decoding an image by dividing in smaller units. This enables use with applications even under low memory resource conditions.
Multi-page images can be loaded into the library.
Provides functions capable of acquiring tag information. This allows use of user-defined tag information.
Saves system resources by high-efficient compact program. The required ROM size is 48KB.*2
*1: Supports only non-compression format of the TIFF 6.0 standard. *2: Not including image display memory and stack size.
Supports GIF animation format.
Supports interlaced loading.
Supports transparent images.
Saves system resources by high-efficient compact program. The required ROM size is 38KB.*2
*1: To use the GIF decoder library, you must obtain licenses for the image compression patent (LZW license), which is held by Unisys of the United States.
*2: Not including image display memory and stack size.
GIF Decoder Library*1
TIFF Decoder Library
13 14
Low compression(High image quality)
Medium compression (Medium image quality)
High compression(Low image quality)
Decoding can be performed at an arbitrary position.*1
Supports input and output function of extended APPn marker segments defined in the JFIF format, Exif standard, DCF standard, and G3 fax standard.Saves system resources by high-efficcient compact program. The required ROM size is 30KB or less for both encoder and decoder.*2
*1: Availabl only for the pictures encoded by this library. *2: Not including image display memory and stack size.
JPEG image Divided decoding Reproduced image
CPU: Fujitsu FR400 series OS: REALOSTM, axLinux
Operating Environment
Divided decoding
Quantization
Huffman coding
Interlace GIF
Multi-page image
The process of replacing signals sampled at specific frequency with data of a specified number of bits.
Encoding method that assigns shorter codes to information occurring more frequently and longer codes to information occurring at relatively low frequencies.
One of the GIF formats for displaying an image by first displaying a low-quality image, then improving this image over time.
Method for storing multiple images in a single file.
Explanation of Terms
We offer industry-standard JPEG codec and GIF/TIFF decoders. Compact packaging to be embedded as well as motion JPEG and animation GIF by the high-speed processing optimized for the FR-V processors. In addition, more effective drawing function can be realized by the combination with the 2-Dimension graphics library, and the functions corresponding to the customer product specification can be easily embedded in a short period of time.
Nearest neighbor
Bilinear
Bi-cubic
You can change the display position, sizes, and orientation of image data when displaying images or characters. The 2D Graphics Library allows you to make changes on a frame-by-frame basis to create your own animations, or display JPEG/MPEG codec output onto the screen according to screen layout. You can also select image interpolation processing to improve image quality when adjusting image dimensions or orientation.
Supports various image data formatsThe 2D Graphics Library outputs drawing graphics and image data according to a specified image data format. These products realize portions of a process dependent on hardware such as the image data format as independent modules. Simply replacing these modules lets you run applications on various hardware. The standard library modules support nine image data formats, including those displayable using FR400 companion chips. They also allow the customers to create their own modules.
Use of various font dataThese products implement independent modules that search for font data by character code and convert this data into character-drawing dot patterns. Creating these modules allows the customers to use any font data in character drawing. (Note: The products contain no font data.)
Use of logical coordinate systemsThe 2D Graphics Library allows logical, two-dimensional coordinate systems to be defined in a rectangular area at the drawing destination. This allows users to develop applications regardless of locations or sizes of a physical display region on the screen layout.
API for graphical data renderingThe 2D Graphics Library is provided with not only the function of converting drawing procedures into programs and making drawing by caling a series of elemental functions with single functionality, but also the function of converting a set of graphics data to be drawn into input parameters to make drawing. The latter functionality can be used in developing applications that perform various external data-based drawings without modifying programs.
Flexible Image Representation (Enlargement, Reduction, and Turning)
Inverse
Reduction Enlargement
Adjusting image sizes is easy - justspecify the sizes desired after the transformation.
Examples of three types of image interpolation forenlargement(the area of a clock in the image at the left is turned and enlarged)
The following minimum system resources are required to run the 2D Graphics Library.
2D Graphics Library
15 16
The 2D Graphics Library provides a rich set of graphics drawing functionality and high-quality image data manipulating functions. The 2D Graphics Library allows easy achievement of a functionality with graphical interfaces in a variety of equipment and devices the customers develop and design.
Merely call the functions to create a menu screen or graphical data-display screens.Image data can be enlarged, reduced, and/or rotated to fit the display screen.In conjunction with the JPEG/MPEG codec, this library can display video images in flexible screen layouts.
A wide range of graphic drawing capabilities offer diverse representations:
ROM size (program size)
RAM size
30KB to 154KB (depending on functions used)
20KB (not including the frame buffer size)
A Rich Set of Two-dimensional Graphic Drawing Capabilities Other Features
Resource Capacities Required
Imagequality
CPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux
Operating Environment
Straight line
Circle
Points
Polygon
Arc
Rectangle
Fan
Paint
Logicalcomputation
Tile
Line style
Color specification
Filling
Thick line
Frame drawing
Mask
Continued straight lines
Ellipse
Tertiary Bezier curve
Filling color Drawing color
Background color
One degree-basisturning angle
Rotation
17 18
Audio/Video Players or RecordersCompatible
OS
REALOSTM
axLinux
REALOSTM
axLinux
Product number
Evaluation License
SP366244818EVJ
SP406244918EVJ
SP366244618EVJ
SP406244718EVJ
Basic License
SP366244818QAJ
SP406244918QAJ
SP366244618QAJ
SP406244718QAJ
Target License
SP366244818RCJ
SP406244918RCJ
SP366244618RCJ
SP406244718RCJ
Maintenance
SP366244818MAJ
SP406244918MAJ
SP366244618MAJ
SP406244718MAJ
Still Picture LibrariesCompatible
OS
REALOSTM
axLinux
REALOSTM
REALOSTM
Product number
Evaluation License
SP366241118EVJ
SP366243718EVJ
**
Basic License
SP366241118QAJ
SP366243718QAJ
**
Target License
SP366241118RCJ
SP366243718RCJ
**
Maintenance
SP366241118MAJ01
SP366243718MAJ01
**
FR-V Middleware Operating EnvironmentCPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux
ServicesWe offer customization of our middleware products to meet the specifications required for customer products. We also offer consulting on tuning customer software applications or actual tuning services.
CustomizationConsultingTuning service
* : Contact our sales representative for product numbers available.
Product Name
JPEG Baseline Process Encoder/
Decoder Library �
JPEG Baseline Process Encoder/
Decoder Library
TIFF Decoder Library for FR400 V01
GIF Decoder Library for FR400 V01
Product Name
Media Recorde Master Library for
FR400 V01
Media Recorde Master Library for
FR400(axLinux) V01
Media Play Master Library for FR400 V01
Media Play Master Library for
FR400 (axLinux) V01
List of the FR-V Middleware Products
2D Graphics LibrariesCompatible
OS
REALOSTM
axLinux
Product number
Evaluation License
SP366241518EVJ
SP406245018EVC
Basic License
SP366241518QAJ
SP406245018QAC
Target License
SP366241518RAJ
SP406245018RAC
Maintenance
SP366241518MAJ
SP406245018MAC
Product Name
2D Graphics Library for FR400 V01
2D Graphics Library for FR400 (axLinux)
V01
MPEG Visual CodecsCompatible
OS
REALOSTM
axLinux
REALOSTM
axLinux
REALOSTM
Product number
Evaluation License
SP366242818EVJ
SP366242918EVJ
SP366241918EVJ
SP366242718EVJ
SP366241618EVJ
Basic License
SP366242818QAJ
SP366242918QAJ
SP366241918QAJ
SP366242718QAJ
SP366241618QAJ
Target License
SP366242818RCJ
SP366242918RCJ
SP366241918RCJ
SP366242718RCJ
SP366241618RCJ
Maintenance
SP366242818MAJ01
SP366242918MAJ01
SP366241918MAJ01
SP366242718MAJ01
SP366241618MAJ
Product Name
MPEG-4 Visual Simple Profile Encoder
Library for FR400 V01 �
MPEG-4 Visual Simple Profile Encoder
Library for FR400 (axLinux) V01
MPEG-4 Visual Simple Profile Decoder
Library for FR400 V01
MPEG-4 Visual Simple Profile Decoder
Library for FR400 (axLinux) V01
MPEG-1 Decoder Library for FR400 V01
(incl. DEMUX, Video, Audio Layer I/II)
File FormatsCompatible
OS
REALOSTM
axLinux
Product number
Evaluation License
SP366245118EVJ
SP406245218EVJ
Basic License
SP366245118QAJ
SP406245218QAJ
Target License
SP366245118RCJ
SP406245218RCJ
Maintenance
SP366245118MAJ
SP406245218MAJ
Product Name
MP4 File Format Library for FR400 V01
MP4 File Format Library for
FR400 (axLinux) V01
Audio/Voice CodecsCompatible
OS
REALOSTM
axLinux
REALOSTM
axLinux
Product number
Evaluation License
SP366243418EVJ
SP366244118EVJ
SP366243318EVJ
SP366244018EVJ
Basic License
SP366243418QAJ
SP366244118QAJ
SP366243318QAJ
SP366244018QAJ
Target License
SP366243418RCJ
SP366244118RCJ
SP366243318RCJ
SP366244018RCJ
Maintenance
SP366243418MAJ01
SP366244118MAJ01
SP366243318MAJ01
SP366244018MAJ01
Product Name
MPEG-4/2 AAC LC Encoder Library for
FR400 V01 �
MPEG-4/2 AAC LC Encoder Library for
FR400 (axLinux) V01
MPEG-4/2 AAC LC Decoder Library for
FR400 V01
MPEG-4/2 AAC LC Decoder Library for
FR400 (axLinux) V01