Multimedia data decoding apparatus capable of optimization capacity of buffers therein

A multimedia data decoding apparatus to decode multimedia data and method thereof includes a data information extracting unit extracting detail information from the multimedia data. An input buffering unit stores the multimedia data for a predetermined time. A decoding unit decodes the multimedia data from the input buffering unit into original signals of respective types. An output buffering unit stores the decoded multimedia data for a predetermined time. A control unit determines buffering capacities of the input buffering unit and the output buffering unit based on the detail information extracted by the data information extracting unit.