Home    News    Components    Get ViTooKi    Documentation    Community    Developers    @sf.net  

Info

Last update:
12 Feb 2007

Documentation

Doxygen LXR

MP4Decoder Class Reference

Implementation of Adaptor that returns YUVFrame objects <short description="">. More...

#include <MP4Decoder.hpp>

Inheritance diagram for MP4Decoder:

List of all members.

Public Types
typedef enum MP4Decoder::eCoderType	meCoderType
	Codec selection enumeration, currently available are XviD and FFMPEG.
enum	eCoderType { XVID = 1, FFMPEG }
	Codec selection enumeration, currently available are XviD and FFMPEG.
Public Member Functions
	MP4Decoder (VideoESInfo *pESInfo, bool enableSwitching=false, UncompressedVideoFrame::ColorSpace colorSpace=UncompressedVideoFrame::ColorSpaceYV12, meCoderType coderType=XVID)
	Creates an uninitialized MP4Decoder instance.
virtual	~MP4Decoder ()
	Destroys the MP4Decoder.
list< Frame * >	adapt (Frame *frm)
	Compressed frm in - uncompressed YUV12 frame out.
list< Frame * >	close ()
	Flush all buffered uncompressed Frame objects (if any).
Adaptor *	clone ()
	Not implemented.
void	initialize ()
	Initializes the Decoder.
void	setCoderType (eCoderType coderType=XVID)
	Codec selection.
u32	getTranscodingCosts () const
	returns adaptation costs (CPU only).
Static Public Member Functions
bool	isValidVisualFrame (const u8 *payload)
bool	isValidDecoderConfig (const u8 *payload)
xvidColorSpace	mapToXVIDColorspace (UncompressedVideoFrame::ColorSpace colorSpace)
	Mapping function between MP4Decoders colorspace (defined in UncompressedVideoFrame::ColorSpace) and XviD codec colorspace.
const char *	codecToString (CodecID codec_id)
int	stringToCodec (const char *codec_string)
ffmpegColorSpace	mapToFFMPEGColorspace (UncompressedVideoFrame::ColorSpace colorSpace)
	Mapping function between MP4Decoders colorspace (defined in UncompressedVideoFrame::ColorSpace) and FFMPEG codec colorspace.

---

Detailed Description

Implementation of Adaptor that returns YUVFrame objects <short description="">.

Author:

Bernhard Penz

Version:

Id

MP4Decoder.hpp,v 1.20 2005/12/21 11:00:43 mkropfbe Exp

Definition at line 76 of file MP4Decoder.hpp.

---

Constructor & Destructor Documentation

MP4Decoder::MP4Decoder (  VideoESInfo *  pESInfo, bool  enableSwitching = false, UncompressedVideoFrame::ColorSpace  colorSpace = UncompressedVideoFrame::ColorSpaceYV12, meCoderType  coderType = XVID )

Creates an uninitialized MP4Decoder instance. Parameters: pESInfo  Pointer to ESInfo containing VOS/VO/VOL headers enableSwitching  specifies if the decoder should reinit itself, when a new header is detected. set to false in the server, set to true in the client colorSpace  xvidColorSpace of output Frame objects. Defaults to ColorSpaceYV12. coderType  Video codec to use. See also: setCoderType Definition at line 121 of file MP4Decoder.cpp. References UncompressedVideoFrame::ColorSpace, and meCoderType. Referenced by clone(). { mpDecoder = NULL; mpOutBuf=NULL; this->enableSwitching=enableSwitching; es = pESInfo; mColorSpace = colorSpace; mFrameSize = 0; decConfig=NULL; decConfigSize=0; newDecConfig=NULL; meCoder = coderType; initialized = false; if(coderType==XVID) { dprintf_full("MP4Decoder::MP4Decoder-XVID\n"); strcpy(name,"MP4Decoder-XVID"); } else { dprintf_full("MP4Decoder::MP4Decoder-FFMPEG\n"); strcpy(name,"MP4Decoder-FFMPEG"); } auBuffer[0] = NULL; auBuffer[1] = NULL; muiWidth=0; muiHeight=0; mpBuffer = new char[1024*1024*1]; //1 MByte dprintf_full("MP4Decoder Construct colorSpace %s, bitDepth %i\n", colorSpace==UncompressedVideoFrame::ColorSpaceGRAY8?"RGB8gray": colorSpace==UncompressedVideoFrame::ColorSpaceRGB24?"RGB24": colorSpace==UncompressedVideoFrame::ColorSpaceRGB32?"RGB32": colorSpace==UncompressedVideoFrame::ColorSpaceRGB565?"RGB565": colorSpace==UncompressedVideoFrame::ColorSpaceI420?"I420": colorSpace==UncompressedVideoFrame::ColorSpaceYV12?"YV12": "UNKNOWN", UncompressedVideoFrame::mapColorSpaceToBitDepth(colorSpace)); }

---

Member Function Documentation

list< Frame * > MP4Decoder::adapt (  Frame *  frm  )  [virtual]

Compressed frm in - uncompressed YUV12 frame out. Parameters: frm  Pointer to compressed Frame Returns: List of YUVFrame objects Reimplemented from Adaptor. Definition at line 354 of file MP4Decoder.cpp. References Frame::getAU(), Frame::getMediaTimeScale(), Frame::getType(), initialize(), Frame::setAU(), Frame::setAUu(), Frame::setAUv(), Frame::setAUy(), UncompressedVideoFrame::setColorSpace(), and Frame::setMediaTimeScale(). { dprintf_full("MP4Decoder::adapt frame CTS %i size %i\n",frm->getAU()->cts,frm->getAU()->size); if(es && enableSwitching) { if(decConfigSize>0) { if(newDecConfig) { delete[] newDecConfig; newDecConfig=NULL; } u32 nSize=es->getHeaders(&newDecConfig); if(nSize != 0 && nSize != decConfigSize) { // we have a new decConfig if(decConfig) delete[] decConfig; decConfig=newDecConfig; newDecConfig=NULL; initialized=false; } else if(nSize == decConfigSize) { // same size but might be different if(memcmp(decConfig,newDecConfig,decConfigSize)!=0) { // is different if(decConfig) delete[] decConfig; decConfig=newDecConfig; newDecConfig=NULL; initialized=false; } } } } if (!initialized) initialize(); list < Frame * >frmList; if (!initialized) return frmList; if(mpOutBuf) { delete[] mpOutBuf; mpOutBuf=NULL; } #ifndef WINCE mpOutBuf = new u8[mFrameSize]; // The Decoder expects in case of BFRAMES_DEC enabled the // B-Frame together with the reference frame. Therefore one frame is // always buffered for this case. if (muiFrameNumber == 0) { //first send the header to the decoder ... lenDecoded = DecodeFrame((char *) mpDecoder, mpBuffer, muiLastFrameEnd,(char *) mpOutBuf, mColorSpace); if(lenDecoded <= 0) { lenDecoded = abs(lenDecoded); dprintf_err("MP4Decoder::adapt : muiFrameNumber==0, no decoder output for header frame!\n"); } // ... and then the first frame. memcpy(mpBuffer, (u8 *) frm->getAU()->payload, frm->getAU()->size); muiLastFrameEnd = frm->getAU()->size; //decode but don't return the output... this saves the first frame in the ffmpeg buffer.... lenDecoded = DecodeFrame((char *) mpDecoder, mpBuffer, muiLastFrameEnd, (char *) mpOutBuf, mColorSpace); dprintf_full("MP4Decoder::adapt : muiFrameNumber==0, decoder output1 len %i\n",lenDecoded); // ... and again first frame: required to cope with random access after stream switching memcpy(mpBuffer, (u8 *) frm->getAU()->payload, frm->getAU()->size); lenDecoded = DecodeFrame((char *) mpDecoder, mpBuffer, muiLastFrameEnd, (char *) mpOutBuf, mColorSpace); dprintf_full("MP4Decoder::adapt : muiFrameNumber==0, decoder output2 len %i\n",lenDecoded); lenDecoded = 0; // cause this frame to be decoded at next adapt() call if(auBuffer[1]) delete auBuffer[1]; auBuffer[1] = new AU(frm->getAU()); if(mpOutBuf) { delete[] mpOutBuf; mpOutBuf=NULL; } } else { // muiFrameNumber != 0 // int oldMuiLastFE = muiLastFrameEnd; if (lenDecoded > 0) { memmove(mpBuffer, mpBuffer + lenDecoded, muiLastFrameEnd - lenDecoded); } //copy input frame to mpBuffer (which is furthermore used by the decoder) //FIXME: check for BUFFER and frm->size!!! memcpy(mpBuffer + (muiLastFrameEnd - lenDecoded), (u8 *) frm->getAU()->payload, frm->getAU()->size); muiLastFrameStart = 0; // char *mpBufferToFrame = mpBuffer; // int currentFrameLen; muiLastFrameEnd = muiLastFrameEnd - lenDecoded + frm->getAU()->size; #endif if(auBuffer[0]) delete auBuffer[0]; auBuffer[0] = auBuffer[1]; //assert(auBuffer[1]); auBuffer[1] = new AU(frm->getAU()); #ifndef WINCE lenDecoded = DecodeFrame((char *) mpDecoder, mpBuffer, muiLastFrameEnd, (char *) mpOutBuf, mColorSpace); dprintf_full("MP4Decoder::adapt : later frames, decoder output len %i\n",lenDecoded); #else u8 *y,*u,*v; if (muiFrameNumber == 0) { lenDecoded = XVIDDecodeFrameCE(mpBuffer, //(char*)frm->getAU()->payload, //mpBuffer + (muiLastFrameEnd - lenDecoded), muiLastFrameEnd, y, u, v); muiLastFrameEnd = frm->getAU()->size; auBuffer[0] = new AU(frm->getAU()); } else { muiLastFrameEnd = muiLastFrameEnd - lenDecoded + frm->getAU()->size; } lenDecoded = XVIDDecodeFrameCE((char*)frm->getAU()->payload, //mpBuffer + (muiLastFrameEnd - lenDecoded), muiLastFrameEnd, y, u, v); #endif if(lenDecoded <= 0) { lenDecoded = abs(lenDecoded); dprintf_err("MP4Decoder::adapt Warning: no decoder output for frame %d\n", muiFrameNumber); // dprintf_full("MP4Decoder::adapt %x %x %x %x\r\n", // (char)mpBuffer[0],(char) mpBuffer[1],(char)mpBuffer[2],(char)mpBuffer[3]); } else { //copy result (decoded frame) to new access unit... AU * pAU = auBuffer[0]; auBuffer[0]=NULL; pAU->size = mFrameSize; pAU->payload = mpOutBuf; dprintf_full("MP4Decoder::adapt Decode Frame No %d uncompressed size %d CTS %i\n", muiFrameNumber, pAU->size, pAU->cts); Frame::FrameType type; switch (mColorSpace) { case UncompressedVideoFrame::ColorSpaceGRAY8: case UncompressedVideoFrame::ColorSpaceRGB565: case UncompressedVideoFrame::ColorSpaceRGB24: case UncompressedVideoFrame::ColorSpaceRGB32: type = Frame::RGB_VOP; break; case UncompressedVideoFrame::ColorSpaceYV12: // fall through case UncompressedVideoFrame::ColorSpaceI420: type = Frame::YUV_VOP; break; default: dprintf_err("MP4Decoder::adapt: Unknown colorspace\n"); exit(-1); } UncompressedVideoFrame * decFrame = new UncompressedVideoFrame(type, muiWidth, muiHeight); decFrame->setAU(pAU); dprintf_full("MP4Decoder::adapt(): created UncompressedVideoFrame with type=%d, width=%d, height=%d (ausize=%d)\n", type, muiWidth, muiHeight, decFrame->getAU()->size); dprintf_full("MP4Decoder::adapt(): frametype = %d , type = %d\n", decFrame->getType(), type); #ifdef WINCE decFrame->setAUy(y); decFrame->setAUu(u); decFrame->setAUv(v); #endif decFrame->setMediaTimeScale(frm->getMediaTimeScale()); decFrame->setColorSpace(mColorSpace); frmList.push_back(decFrame); mpOutBuf=NULL; } #ifndef WINCE } #endif muiFrameNumber++; return frmList; }

Adaptor * MP4Decoder::clone (   )  [virtual]

Not implemented. Returns: Defaults to NULL. Implements Adaptor. Definition at line 639 of file MP4Decoder.cpp. References MP4Decoder(). { return new MP4Decoder(es,enableSwitching,mColorSpace,meCoder); }

list< Frame * > MP4Decoder::close (   )  [virtual]

Flush all buffered uncompressed Frame objects (if any). Returns: List of YUVFrame objects Reimplemented from Adaptor. Definition at line 551 of file MP4Decoder.cpp. References Frame::getAU(), Frame::getType(), Frame::setAU(), Frame::setAUu(), Frame::setAUv(), Frame::setAUy(), UncompressedVideoFrame::setColorSpace(), and Frame::setMediaTimeScale(). { list < Frame * >frmList; if (!initialized) return frmList; if(mpOutBuf) { delete[] mpOutBuf; mpOutBuf=NULL; } mpOutBuf = new u8[mFrameSize]; #ifndef WINCE if (dec != NULL && muiFrameNumber != 0) #else if (muiFrameNumber != 0) #endif { #ifndef WINCE if (DecodeFrame((char *) mpDecoder, mpBuffer + muiLastFrameStart, muiLastFrameEnd, (char *) mpOutBuf, mColorSpace) == 0) { dprintf_err("MP4Decoder::close Error decoding frame %d\n", muiFrameNumber); delete[] mpOutBuf;mpOutBuf=NULL; if(auBuffer[1]) { delete auBuffer[1]; auBuffer[1]=NULL; } } else { AU * pAU = auBuffer[1]; pAU->size = mFrameSize; pAU->payload = mpOutBuf; dprintf_full("MP4Decoder::close Decode Frame No %d uncompressed size %d CTS %i\n", muiFrameNumber, pAU->size, pAU->cts); muiFrameNumber++; Frame::FrameType type; switch (mColorSpace) { case UncompressedVideoFrame::ColorSpaceGRAY8: case UncompressedVideoFrame::ColorSpaceRGB565: case UncompressedVideoFrame::ColorSpaceRGB24: case UncompressedVideoFrame::ColorSpaceRGB32: type = Frame::RGB_VOP; break; case UncompressedVideoFrame::ColorSpaceYV12: // fall through case UncompressedVideoFrame::ColorSpaceI420: type = Frame::YUV_VOP; break; default: dprintf_err("MP4Decoder::close: Unknown colorspace\n"); exit(-1); } UncompressedVideoFrame * decFrame = new UncompressedVideoFrame(type, muiWidth, muiHeight); decFrame->setAU(pAU); dprintf_full("MP4Decoder::close(): created UncompressedVideoFrame with type=%d, width=%d, height=%d (ausize=%d)\n", type, muiWidth, muiHeight, decFrame->getAU()->size); dprintf_full("MP4Decoder::close(): frametype = %d , type = %d\n", decFrame->getType(), type); #ifdef WINCE decFrame->setAUy(y); decFrame->setAUu(u); decFrame->setAUv(v); #endif decFrame->setMediaTimeScale(es->getMediaTimeScale()); decFrame->setColorSpace(mColorSpace); decFrame->setColorSpace(mColorSpace); frmList.push_back(decFrame); mpOutBuf=NULL;auBuffer[1]=NULL; } #endif } else { delete[] mpOutBuf;mpOutBuf=NULL; if(auBuffer[1]) { delete auBuffer[1]; auBuffer[1]=NULL; } } if (initialized) { DecoderClose((char **) (&mpDecoder)); initialized = false; } return frmList; }

u32 MP4Decoder::getTranscodingCosts (   )  const [virtual]

returns adaptation costs (CPU only). Decoding costs depend directly on the number of out YUV pixels and frames decoded per second (FIXME: codec not supported) Implements Adaptor. Definition at line 1504 of file MP4Decoder.cpp. { return (u32)(es->getWidth()*es->getHeight()*es->getFPS()); }

void MP4Decoder::initialize (   )  [virtual]

Initializes the Decoder. Is called when the first frame arrives Implements Adaptor. Definition at line 190 of file MP4Decoder.cpp. Referenced by adapt(). { if (!es) { initialized = false; return; } if(initialized) return; initializeMP4HeaderStruct(); if(decConfig) { delete[] decConfig; decConfig=NULL; } if(newDecConfig) { delete[] newDecConfig; newDecConfig=NULL; } if(mpOutBuf) { delete[] mpOutBuf; mpOutBuf=NULL; } if(auBuffer[0]) { delete auBuffer[0]; auBuffer[0]=NULL; } if(auBuffer[1]) { delete auBuffer[1]; auBuffer[1]=NULL; } if (mpDecoder) { DecoderClose((char **) (&mpDecoder)); mpDecoder=NULL; } initialized = true; //has to keep the old value for switching if (!enableSwitching) { muiWidth = 0; muiHeight = 0; muiLastFrameStart = 0; muiLastFrameEnd = 0; } muiFrameNumber = 0; decConfig=NULL; decConfigSize=0; newDecConfig=NULL; // muiLastFrameEnd = pESInfo->getHeaders((u8 *) mpBuffer); muiLastFrameEnd = es->getHeaders(&decConfig); decConfigSize=muiLastFrameEnd; memcpy(mpBuffer,decConfig,muiLastFrameEnd); dprintf_full("MP4Decoder::initialize() %s\r\n",es->getEncodedDecoderConfig()); #if VITOOKI_DEBUG_LEVEL >= 2 dprintf_full("MP4Decoder::initialize mpBuffer:: "); for (uint iiii = 0; iiii < muiLastFrameEnd; iiii++) printf("%02x ", (u8)mpBuffer[iiii]); dprintf("\r\n"); #endif if (muiLastFrameEnd == 0) { dprintf_err("MP4Decoder::initialize: failed to get header for ESInfo object\n"); } initializeParser((u8 *) mpBuffer, muiLastFrameEnd); if (!parseVOSHeader()) dprintf_small("No VOS Header found\n"); if (!parseVOHeader()) dprintf_small("No VO Header found\n"); if (!parseUserData()) dprintf_small("No UserData found\n"); if (!parseVideoObjectHeader()) dprintf_small("No VideoObject Header found\n"); if (!parseVOLHeader()) dprintf_small("No VOL Header found\n"); //on switching, ignore the arriving size, but scale to the very first ES // if (!enableSwitching || muiWidth == 0) { // only set for first time if (1==1) { if(es->getCodecID() == CODEC_ID_MPEG4) { muiWidth = mp4Header.video_object_layer_width; muiHeight = mp4Header.video_object_layer_height; #ifdef WINCE XvidSetHeight(muiHeight); XvidSetWidth(muiWidth); #endif if(es->getAspectRatio() <= 0.0) es->setAspectRatio((float)muiWidth/muiHeight); } if(muiWidth <=0 || muiHeight <= 0) { muiWidth = es->getWidth(); muiHeight = es->getHeight(); } } else { dprintf_full("MP4Decoder::initialize: stream switching: upscale %ix%i --> %ix%i\n", es->getWidth(),es->getHeight(),muiWidth, muiHeight); } dprintf_small("MP4Decoder::initialize: DecoderInit to codec %s (id %i) size %ix%i\n", es->getCodecID() == CODEC_ID_MPEG4?"MPEG4":"OTHER",es->getCodecID(), muiWidth, muiHeight); int ret = DecoderInit((char **) (&mpDecoder), es->getCodecID(), muiWidth, muiHeight); if ((ret != ERR_OK) || (mpDecoder == NULL)) { dprintf_err("MP4Decoder::initialize: Error creating decoder handle (ret=%d)\n",ret); exit(-1); } else { dprintf_small("MP4Decoder::initialize: ok, Decoder set to size %ix%i\n", muiWidth, muiHeight); //FIXME: hmm... should this be done after streamSwitching and upscale? es->setHeight(muiHeight); es->setWidth(muiWidth); dprintf_full("Mp4Decoder::init Aspect Info %i height %i width %i\n", this->mp4Header.aspectRatio.aspect_ratio_info, this->mp4Header.aspectRatio.par_height, this->mp4Header.aspectRatio.par_width); if (mp4Header.vop_time_increment_resolution > 0) { if (mp4Header.vop_time_increment_resolution < 61) { // treat as frame rate // most codecs use it as one u32 ti = es->getMediaTimeScale() / mp4Header.vop_time_increment_resolution; if(ti > 0) es->setVOPTimeIncrement(ti); } else if ((es->getMediaTimeScale() > mp4Header.vop_time_increment_resolution) && ((es->getMediaTimeScale() / mp4Header.vop_time_increment_resolution) < 61)) es->setVOPTimeIncrement(mp4Header.vop_time_increment_resolution); } // Process ONLY colorspaces defined in MP4Decoder.hpp switch (mColorSpace) { case UncompressedVideoFrame::ColorSpaceGRAY8: mFrameSize = sizeof(u8) * muiWidth * muiHeight; break; case UncompressedVideoFrame::ColorSpaceRGB565: mFrameSize = sizeof(u8) * muiWidth * muiHeight * 2; break; case UncompressedVideoFrame::ColorSpaceRGB24: mFrameSize = sizeof(u8) * muiWidth * muiHeight * 3; break; case UncompressedVideoFrame::ColorSpaceRGB32: mFrameSize = sizeof(u8) * muiWidth * muiHeight * 4; break; case UncompressedVideoFrame::ColorSpaceYV12: // fall through case UncompressedVideoFrame::ColorSpaceI420: mFrameSize = sizeof(u8) * muiWidth * muiHeight * 3 / 2; break; default: dprintf_err("MP4Decoder::initialize: Unknown colorspace\n"); exit(-1); } dprintf_full("MP4Decoder::initialize: Esinfo %llu BufferSize %i W %i H %i\n", es->getStreamId(), es->getBufferSize(), muiWidth, muiHeight); } }

ffmpegColorSpace MP4Decoder::mapToFFMPEGColorspace (  UncompressedVideoFrame::ColorSpace  colorSpace  )  [static]

Mapping function between MP4Decoders colorspace (defined in UncompressedVideoFrame::ColorSpace) and FFMPEG codec colorspace. See also: UncompressedVideoFrame::ColorSpace mapToXVIDColorspace Definition at line 1253 of file MP4Decoder.cpp. References UncompressedVideoFrame::ColorSpace. { ffmpegColorSpace ret = FFMPEGColorSpaceUnknown; switch (colorSpace) { case UncompressedVideoFrame::ColorSpaceYV12: ret = FFMPEGColorSpaceYV12; break; case UncompressedVideoFrame::ColorSpaceRGB24: ret = FFMPEGColorSpaceRGB24; break; case UncompressedVideoFrame::ColorSpaceI420: ret = FFMPEGColorSpaceI420; break; case UncompressedVideoFrame::ColorSpaceRGB32: ret = FFMPEGColorSpaceRGB32; break; case UncompressedVideoFrame::ColorSpaceRGB565: ret = FFMPEGColorSpaceRGB565; break; case UncompressedVideoFrame::ColorSpaceGRAY8: ret = FFMPEGColorSpaceGRAY8; break; default: ret = FFMPEGColorSpaceUnknown; break; } return ret; }

xvidColorSpace MP4Decoder::mapToXVIDColorspace (  UncompressedVideoFrame::ColorSpace  colorSpace  )  [static]

Mapping function between MP4Decoders colorspace (defined in UncompressedVideoFrame::ColorSpace) and XviD codec colorspace. See also: UncompressedVideoFrame::ColorSpace mapToFFMPEGColorspace Definition at line 1227 of file MP4Decoder.cpp. References UncompressedVideoFrame::ColorSpace. { xvidColorSpace ret = XVIDColorSpaceUnknown; switch (colorSpace) { case UncompressedVideoFrame::ColorSpaceYV12: ret = XVIDColorSpaceYV12; break; case UncompressedVideoFrame::ColorSpaceRGB24: ret = XVIDColorSpaceRGB24; break; case UncompressedVideoFrame::ColorSpaceI420: ret = XVIDColorSpaceI420; break; case UncompressedVideoFrame::ColorSpaceRGB32: ret = XVIDColorSpaceRGB32; break; default: ret = XVIDColorSpaceUnknown; break; } return ret; }

void MP4Decoder::setCoderType (  eCoderType  coderType = XVID  )

Codec selection. Parameters: coderType  Type of codec to use. Defaults to XviD See also: meCoderType Definition at line 1158 of file MP4Decoder.cpp. { meCoder = coderType; }

---

The documentation for this class was generated from the following files:

• MP4Decoder.hpp
• MP4Decoder.cpp

© ViTooKi 2003 :: [Lite version] Created with Doxygen