Template:Multimedia introduction capability

= Introduction =

TI's embedded processors such as AM57xx have following hardware accelerators.
 * IVA (Image and Video Accelerator) for accelerating multimedia encode and decode.
 * VPE (Video Processing Engine) for Scaling, Color Space Conversion and Deinterlacing.
 * C66x DSP cores for offloading certain image/video and/or voice/audio processing.

In order to make it easy for customers to write applications, and to leverage open source elements that provide functionality such as AVI stream demuxing, audio encode/decode, etc, TI's PROCESSOR-SDK supplies ARM based GStreamer plugins that abstracts the hardware accelerator offload.

This multimedia training page will cover the following topics.
 * Capabilities of IVA-HD, VPE, DSP, and ARM
 * Out of Box Multimedia Demos in PROCESSOR-SDK
 * Software Stack of Accerelated Codec Encoding/Decoding
 * Gstreamer Pipelines for Multimedia Applications
 * DSP C66x Gstreamer Plugin Internals
 * Rebuild IPUMM Firmware
 * Load and Unload Firmware

= Capabilities of IVA-HD, VPE, DSP, and ARM =

In PROCESSOR-SDK, IVA-HD, and hence the multimedia encoding and decoding applications, supports the following codecs.
 * Video Decode: H264, MPEG4, MPEG2, and VC1
 * Video Encode: H264, and MPEG4
 * Image Decode: MJPEG
 * Image Encode: MJPEG

Codec datasheet can be downloaded from git repository here - https://git.ti.com/ivimm/ipumm/trees/master/extrel/ti/ivahd_codecs/packages/ti/sdo/codecs

VPE supports video operations such as scaling, color space conversion, and de-interlacing.
 * Supported Input formats: NV12, YUYV, UYVY
 * Supported Output formats: NV12, YUYV, UYVY, RGB24, BGR24, ARGB24, ABGR24

DSP is a general purpose programmable core available for offloading signal processing kernels.
 * Sample Image Processing Kernels integrated in the DSP gstreamer plugin: Median2x2, Median3x3, Sobel3x3, Conv5x5, Canny

Demo applications also demonstrate the following ARM based coding capabilities.
 * Video decoding on ARM: H.265
 * Audio encoding and decoding on ARM: AAC, MPEG2 (leveraging open source codecs)