US20070067472A1 - Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format - Google Patents
Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format Download PDFInfo
- Publication number
- US20070067472A1 US20070067472A1 US11/230,734 US23073405A US2007067472A1 US 20070067472 A1 US20070067472 A1 US 20070067472A1 US 23073405 A US23073405 A US 23073405A US 2007067472 A1 US2007067472 A1 US 2007067472A1
- Authority
- US
- United States
- Prior art keywords
- timestamp
- audio
- chunks
- video
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Definitions
- the present invention relates to a video processing generally and, more particularly, to an accurate and error resilient time stamping method and/or apparatus for an audio-video interleaved (AVI) format.
- AVI audio-video interleaved
- the propagation of peer-to-peer networks has lead to the online sharing of video content similar to how MP3 audio files are shared and distributed.
- the catalyst for much of the online sharing of video content distribution has been the DivX format.
- the DivX format is based on the MPEG-4 video compression standard.
- the DivX encoding format is typically comprised of an MPEG-4 video elementary stream, along with an MP3 audio elementary stream, which is multiplexed into an Audio-Video Interleaved (AVI) file.
- AVI Audio-Video Interleaved
- the selection of the AVI file as the carrying format is in part due to simplicity of the AVI file, and the fact that the AVI file carrying format is available without any intellectual property restrictions.
- the AVI file can be ported to virtually any platform.
- the AVI file format has some known flaws.
- the AVI format adds limitations on the tools used for content creation (e.g., not all video and audio encoding methods can be used).
- the quality of the movie experience for the end user is not as perfect as other formats.
- a growing expectation for higher audio and video quality and robustness from end users is emerging. Such quality and robustness is not completely achievable with the AVI format.
- FIG. 1 a diagram illustrating a conventional AVI file format is shown.
- the AVI file format is constructed of a header section, followed by a multiplex of the audio and video data, and terminated with an index portion.
- the index portion lists the location of each audio and video frame in the multiplex.
- the AVI file (originally defined in the mid 1980s) is a special case of the RIFF file format.
- RIFF files use four-character codes to identify each of the file elements or chunks.
- a “chunk” is the primary building block of the AVI file format.
- AVI files typically comprise an RIFF form header, a list chunks (or sub-chunks), data sub-chunks and an index chunk.
- the RIFF Form Header is the primary file identifier.
- the list chunks and sub-chunks define the format of the overall stream (i.e., a header sub-chunk), as well as the individual components (i.e., a data sub-chunk).
- Data sub-chunks typically carry a single video frame, and are followed by the corresponding audio frames in a different chunk.
- the index chunk is used for random access into the file.
- timing in the data block there is no concept of timing in the data block.
- the only possible location for the detection of timing in the stream has to be derived from the index chunk.
- the index chunk pinpoints the location of each audio or video frame.
- the derivation of the timing for the purpose of determining the correct synchronization of the audio and video data is cumbersome and needs a large amount of memory. Timing is critical for a correct synchronization of different media when presenting audio, video, or subtitles. The user experience is diminished when the synchronization is not correct.
- FIG. 2 a diagram illustrating a typical audio and video multiplexing system 10 is shown.
- the system 10 shows a system clock 12 , a video encoder 14 , an audio encoder 16 and a multiplexer 26 .
- the video encoder 14 presents a compressed video stream 18 .
- the compressed video stream 18 shows a number of system timestamps 20 a - 20 n .
- the audio encoder 16 presents a compressed audio stream 22 .
- the compressed audio stream 22 comprises a number of system timestamps 24 a - 24 n .
- the multiplexer 26 transmits either the compressed video stream 18 or the compressed audio stream 22 .
- There are several existing implementations that maintain audio-video synchronization in a multimedia file or multiplex in addition to the system 10 The majority of these methods maintain the snapshot of a real-time clock and embed the clock within a multiplex, thus allowing the decoding system to recreate the presentation clock accurately.
- timestamps are not embedded in the video or audio streams.
- the timing information in the AVI format is basic and prone to error.
- the timing information in an AVI format can be derived from the AVI index chunk. If the stream is corrupted or missing the AVI index chunk, the entire stream (i.e., audio or video) is not playable.
- the timing information can also be derived from the stream. If the display duration of each chunk is known, the timestamp can be computed. For example, with a video running at 30 frames per second (fps), a first video chunk will have a timestamp of 0, then for the Nth video chunk, the Nth video chunk will have a timestamp of N/fps.
- the problem with obtaining the timestamp from the display duration of each chunk is that if some chunks are not decodable or are corrupted, the synchronization will be lost. The synchronization will be improper since the wrong timestamps will be used for the audio or video chunks.
- FIG. 3 a diagram illustrating a typical AVI de-multiplexing system 50 is shown. Each individual media element is decoded and presented based on snapshots of the real-time clock.
- the system 50 shows a de-multiplexer 52 , a video decoder 56 , an audio decoder 60 and a television 62 .
- a compressed video stream 54 is transmitted from the de-multiplexer 52 to the video decoder 58 .
- timestamps (not shown) are used by the encoded flow to properly multiplex a compressed stream. The timestamps are not carried inside the compressed stream (i.e., the compressed video stream 54 or the compressed audio stream 56 ).
- a compressed audio stream 56 is transmitted to the audio decoder 60 .
- the television 62 presents the audio video data to a user after a decompressed audio stream and the decompressed video stream are synchronized.
- the AVI file does not include any notion of an overall stream clock or a snapshot for each individual member (i.e., audio, video, etc.).
- the decoder 58 or 60 maintains an internal clock for each media when decoding either the compressed video stream 56 or the compressed audio stream 54 at an elementary stream level. A media clock is incremented for each unit decoded. If there are no errors, the media presentation will be free from audio-video synchronization issues.
- FIG. 4 a diagram illustrating an A/V synchronization drift with a corrupted AVI stream is shown.
- the main assumption with such an approach is that the file/stream is error free.
- an error free stream is not always the case.
- optical media can be scratched, or there can be errors in the stream transmission.
- the audio-video synchronization will drift, with little hope of recovery.
- VBR Constant Bit Rate
- VBR Variable Bit Rate
- CBR Constant Bit Rate
- VBR Variable Bit Rate
- New encoding technologies offer the possibility of going beyond traditional VBR encoding. Not only do such technologies offer a variable bit rate, but some offer a variable rate/duration (i.e., frame rate in the case of video).
- Video is typically sampled at a fixed frame rate with each “sample” (i.e., picture) having the same duration.
- samples i.e., picture
- Modern encoding technologies can take advantage of the fact that in a video scene there might be a period in which the movie is like a still picture.
- Such a picture can be encoded as a frame (i.e., only a single frame) for a presentation duration equal to the period of time the movie behaves like still picture.
- the number of audio samples per access unit varies from access unit to access unit.
- the AVI format can deal with both CBR and VBR encoding.
- VBR encoding the AVI format needs each and every access unit to be in one AVI chunk.
- An additional restriction with VBR encoding is that the presentation duration of the access unit must be the same for all access units. Because the presentation duration of the access unit must be the same for all access units, the inclusion of the most advanced encoding tools in the AVI file will lead to severe audio/video synchronization problems.
- a method and/or apparatus may (i) provide an accurate and error resilient time stamping system for the Audio-Video Interleaved (AVI) format, (ii) augment the possibilities of the AVI format in a non-invasive fashion pertaining to audio-video synchronization, and/or (iii) make the AVI format more attractive and/or flexible to implement.
- AVI Audio-Video Interleaved
- the present invention concerns an apparatus comprising a first circuit and a second circuit.
- the first circuit may be configured to embed one or more timestamp chunks into a compressed bitstream in response to one of a video data signal and an audio data signal.
- the second circuit may be configured to generate an output signal in response to decoding the compressed bitstream.
- Each of the one or more timestamp chunks comprises an error correction mechanism configured to detect and correct errors on the compressed bitstream prior to decoding the compressed bitstream.
- the objects, features and advantages of the present invention include providing a method and/or apparatus for an error resilient time stamping method for the audio-video interleaved (AVI) format that may (i) augment the possibilities of the AVI format, (ii) make the AVI format more attractive and flexible to a friendly device, (iii) protect all I-frames in an AVI stream by implementing an error detection/correction program, and/or (iv) allow a greater quality of service in a non-perfect transport medium.
- AVI audio-video interleaved
- FIG. 1 is a diagram illustrating an AVI file format presentation
- FIG. 2 is a diagram illustrating a typical audio and video multiplexer using timestamps
- FIG. 3 is a diagram illustrating AVI multiplexing and A/V presentation
- FIG. 4 is a diagram illustrating A/V synchronization drift with a corrupted AVI stream
- FIG. 5 is a diagram illustrating a adaptive variable frame rate
- FIG. 6 is a diagram illustrating an adaptive frame duration encoding and presentation
- FIG. 7 is a diagram of a decoder system in accordance with a preferred embodiment of the present invention.
- FIG. 8 is a diagram of an encoder system in accordance with a preferred embodiment of the present invention.
- FIG. 9 is a diagram illustrating an example of the decoder system.
- the circuit 100 generally comprises a block (or circuit) 104 , a block (or circuit) 108 , a block (or circuit) 112 , a block (or circuit) 114 , and a block (or circuit) 116 .
- the block 104 may be implemented as a de-multiplexer.
- the demultiplexer 104 may be implemented as an AVI de-multiplexer.
- the block 108 may be implemented as a video decoder.
- the block 112 may be implemented as an audio decoder 112 .
- the block 114 may be implemented as an A/V synchronization circuit.
- the block 116 may be implemented as a display.
- the AVI de-multiplexer 104 may receive a compressed video stream or a compressed audio stream on a signal 102 .
- the AVI de-multiplexer 104 may present a compressed video stream 106 to the video decoder 108 .
- the AVI de-multiplexer 104 may present a compressed audio stream 110 to the audio decoder 112 .
- the compressed video stream 106 generally comprises a number of encoded video chunks 105 a - 105 n in an AVI format and a number timestamp chunks 107 a - 107 n .
- the compressed audio stream 110 may comprise a number of encoded audio chunks 111 a - 111 n in an AVI format and a number of timestamp chunks 109 a - 109 n .
- the video chunks 105 a - 105 n and the audio chunks 111 a - 111 n may be defined as A/V chunks.
- the A/V synchronization circuit 114 may present decompressed video and/or decompressed audio data to the display 116 .
- Each timestamp chunk may provide timing information for the following A/V chunk.
- the timestamp chunk 107 a may specify a time T.
- the following encoded video chunk 105 a may be displayed at the time T specified by the timestamp chunk 107 a .
- the order of the timestamp chunks 107 a - 107 n in relation to the encoded video chunks creates a link with the encoded video chunks 105 a - 105 n .
- the following chunks C( 0 ), C( 1 ), C( 2 ), C( 3 ), C( 4 ) . . .
- C(N) may refer to the video chunks 105 a - 105 n , the audio chunks 111 a - 111 n , the timestamp chunks 107 a - 107 n , and the timestamp chunks 109 a - 109 n . If C(i) is a timestamp chunk, then the timestamp chunk C(i) provides all of the information (e.g., timestamp information, an error detection mechanism and an error correct mechanism) relevant to the audio or video chunk C(i+1). The error detection mechanism and the error detection mechanism will be discussed in more detail in connection with TABLE 1.
- the timestamp chunks 107 a - 107 n and the timestamp chunks 111 a - 111 n may be (i) fully compatible with the AVI chunk definition and (ii) safely ignored by systems currently not compatible of facilitating the present invention.
- the present invention may allow content creators to have the same file, which can be played back on legacy platforms and at the same time provide friendly systems with optimal multiplexing.
- the timestamp chunk may be inserted for each and every media chunk (e.g., video or audio). The insertion of the timestamp chunk into the compressed video stream 106 and the compressed audio stream 110 will be discussed in more detail in connection with FIG. 8 .
- the present invention offers optimal results at frequent intervals to provide a decoder an opportunity to resynchronize video and audio data.
- Each of the timestamp chunks 107 a - 107 n and the timestamp chunks 111 a - 111 n may include a timestamp chunk structure.
- the timestamp chunk structure is shown in the following TABLE 1: TABLE 1 TIMESTAMP CHUNK STRUCTURE typedef struct _timestampHeader ⁇ FOURCC fcc; DWORD cb; DDWORD timestamp; DWORD dwErrMode; DWORD dwErrLength; DWORD errData [N]; ⁇ TIMESTAMPHEADER;
- the variable fcc is the “fourCC” (e.g., in the AVI terminology) describing the AVI chunk.
- the variable fcc comprises a two digit stream id and may be followed by a two character code “ts”. For example, for a stream ID 3 , the fourCC may be set to “03ts”.
- the variable cb may be the total size in bytes of the timestamp header chunk.
- the variable timestamp may be the timestamp in microseconds for the next A/V chunk.
- the variable dwErrMode may be a fourCC describing the type of error detection used to protect the data stream integrity.
- the timestamp chunks 107 a - 107 n and the timestamp chunks 109 a - 109 n may include a built in error detection mechanism (e.g., CRC and/or checksum for the next AVI chunk(s) positioned after the corresponding timestamp chunk).
- the error detection mechanism may detect an error in the compressed video stream 106 and/or the compressed audio stream 110 .
- the error detection mechanism may apply a best error concealment in response to detecting an error on the compressed video stream 106 and/or the compressed audio stream 110 .
- the best error concealment may include skipping an element (or any one of the particular encoded video chunks 105 a - 105 n ) and/or muting any one of the particular encoded audio chunks 111 a - 111 n.
- the error correction mechanism may be implemented in the timestamp chunk structure to correct possible errors and deliver an error resilient channel coding (e.g., Viterbi, Reed-Solomon, Turbo code techniques may be used to correct errors).
- the variable dwErrmode may implement a ‘crc’ (Cycle Redundancy Check) or ‘rs’ Reed Solomon to correct errors in the compressed video stream 106 and/or the compressed audio stream 110 .
- the variable deErrLength may be the extra information length (e.g., stored in ‘errData’) needed for each and every error detection mode.
- a CRC errData may include the CRC computed.
- the errData may include redundancy bits.
- the error correction mechanism may (i) detect data corruption and (ii) allow the reconstructing of original data on the compressed video stream 106 and the compressed audio stream 110 .
- the error correction mechanism may detect data corruption and reconstruct original data for the next chunk C(i+1).
- the next chunk C(i+1) may include audio, video and/or subtitles.
- the reconstruction of the original data on the compressed video stream 106 and the compressed audio stream 110 may include constraints based on how much error has been introduced onto the compressed video stream 106 and/or the compressed audio stream 110 .
- a multiplexer may decide to have only some blocks protected (e.g., key frames of video) or all of the blocks protected.
- Implementing an independent timestamp for the AVI format may allow the use of the most advanced encoding tools available. The restrictions normally employed in the AVI format (used to maintain A/V synchronization) may no longer be necessary.
- the encoder system 150 generally comprises a block (or circuit) 152 , a block (or circuit) 154 , a block (or circuit) 156 , a block (or circuit) 158 , a block (or circuit) 168 , and a block 170 .
- the block 152 may be implemented as a video course.
- the block 154 may be implemented as an audio source.
- the block 156 may be implemented as a video encoder.
- the block 158 may be implemented as an audio encoder.
- the block 168 may be implemented as an error correction/detection encoder.
- the block 170 may be implemented as a multiplexer.
- the video source 152 may present a signal (e.g., VIDEO_DATA) to the video encoder 156 .
- the audio source 154 may present a signal (e.g., AUDIO_DATA) to the audio decoder.
- the video encoder 156 may present an intermediate compressed video stream 164 to the error correction/detection encoder 168 .
- the intermediate compressed video stream 164 generally comprises a number of timestamps 83 a - 83 n and the number of video chunks 105 a - 105 n .
- the audio encoder 158 may provide an intermediate compressed audio stream 166 to the error correction/detection encoder 168 .
- the intermediate compressed audio stream 166 generally comprises a number of timestamps 85 a - 85 n and the number of audio chunks 111 a - 111 n .
- the error correction/detection encoder may generate and embed (i) the timestamp chunk 107 a - 107 n into the compressed video stream 106 and (ii) the timestamp chunk 109 a - 109 n into and the compressed audio stream 110 .
- the error correction/detection encoder 170 may present the compressed video stream 106 to the multiplexer 170 .
- the error correction/detection encoder 168 may present the compressed audio stream 110 to the multiplexer 170 .
- the multiplexer 170 may present the compressed video stream 106 or the compressed audio stream on a signal 102 .
- the error correction/detection encoder 168 may encode the error detection and/or error correction information for the error correction mechanism by computing CRC and/or redundancy bits for Reed Solomon and/or Turbo.
- the error correction/detection encoder 168 may store the error correction information inside a timestamp chunk which precedes the audio chunk or the video chunk.
- the error detection mechanism and the error correction mechanism may be critical in protecting key elements in the compressed video stream 106 (e.g., in a video intra frame).
- the error correction mechanism may provide actual data which is capable of being decoded instead of data which is concealed due to the presence of corrupted data.
- the present invention may implement (i) the error correction mechanism on key chunks (e.g., a first set of timestamp chunks) and/or (ii) the error detection mechanism to other chunks (e.g., a second set of timestamp chunks).
- the error detection mechanism may consume less bytes (i.e., less costly) than the error correction mechanism.
- the present invention may provide the option of implementing only the error detection mechanism in the timestamp chunk to detect errors and to conceal errors during synchronization.
- the present invention may also provide the option of implementing only the error correction mechanism in the timestamp chunk to detect error and correct errors prior to decoding the compressed bitstream 102 .
- the present invention may also provide the option of implementing both the error correction and error detection in the timestamp chunk.
- the particular implementation of either the error detection mechanism and/or the error correction mechanism may be varied to meet the design criteria of a particular implementation.
- FIG. 8 a diagram illustrating the concealment of audio chunks based on the detection of errors is shown.
- the audio chunk 111 a may be presented or concealed based on whether any of one of the particular timestamp chunks 109 a - 109 n have detected any errors.
- the audio chunk 111 a may be passed through to the audio decoder 112 .
- the decompressed audio from the audio decoder 112 may be presented to a user until a corresponding error is detected. Since an error may be detected on the next timestamp chunk 109 b , the error detection mechanism may conceal (or mute) the audio data on the audio chunk 111 b until the next timestamp chunk is free of errors. Since the timestamp chunk 109 n may not have an error detected, the audio data on the audio chunk 111 n may be decoded by the audio decoder 112 and presented to the user.
- the present invention may use the timestamp and the error detection mechanism to allow the decoder (e.g., an audio decoder or a video decoder) to (i) detect that audio or video data is missing (via corrupted data), (ii) know how much of the audio or video data is missing and (iii) provide an appropriate error concealment method to fill gaps in the audio or video stream caused by the corrupted data.
- the decoder e.g., an audio decoder or a video decoder
- the decoder e.g., an audio decoder or a video decoder
- the compressed video stream 106 may be implemented similarly to the compressed audio stream 110 .
- the compressed video stream 110 may have any one of the particular number of timestamp chunks 107 a - 107 n positioned between any one of the particular video chunks 105 a - 105 n . Any one of the particular video chunks 105 a - 105 n may be presented or concealed based on whether any one of the particular timestamp chunks 107 a - 107 n have any errors which are detected.
- the present invention may (i) provide an error detection and correction mechanism built into the AVI format, (ii) provide an independent time stamping method regardless of the encoding tools for an AVI file, (iii) provide a backward compatible solution with existing deployed consumer electronics, (iv) enable the use of the most advanced encoding tools in the AVI format, (v) provide an AVI file format which is robust to transmission channel errors, (vi) allow an essentially perfect media synchronization, (vii) provide a 100% backwards compatibility with existing systems and/or (viii) provide a file that can be used on deployed and enabled systems where only the enabled system takes full advantage of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
- The present invention relates to a video processing generally and, more particularly, to an accurate and error resilient time stamping method and/or apparatus for an audio-video interleaved (AVI) format.
- The propagation of peer-to-peer networks has lead to the online sharing of video content similar to how MP3 audio files are shared and distributed. The catalyst for much of the online sharing of video content distribution has been the DivX format. The DivX format is based on the MPEG-4 video compression standard. The DivX encoding format is typically comprised of an MPEG-4 video elementary stream, along with an MP3 audio elementary stream, which is multiplexed into an Audio-Video Interleaved (AVI) file. The selection of the AVI file as the carrying format is in part due to simplicity of the AVI file, and the fact that the AVI file carrying format is available without any intellectual property restrictions. The AVI file can be ported to virtually any platform.
- The AVI file format has some known flaws. In particular, the AVI format adds limitations on the tools used for content creation (e.g., not all video and audio encoding methods can be used). Also, the quality of the movie experience for the end user is not as perfect as other formats. At the same time, a growing expectation for higher audio and video quality and robustness from end users is emerging. Such quality and robustness is not completely achievable with the AVI format.
- Referring to
FIG. 1 , a diagram illustrating a conventional AVI file format is shown. The AVI file format is constructed of a header section, followed by a multiplex of the audio and video data, and terminated with an index portion. The index portion lists the location of each audio and video frame in the multiplex. The AVI file (originally defined in the mid 1980s) is a special case of the RIFF file format. RIFF files use four-character codes to identify each of the file elements or chunks. A “chunk” is the primary building block of the AVI file format. AVI files typically comprise an RIFF form header, a list chunks (or sub-chunks), data sub-chunks and an index chunk. The RIFF Form Header is the primary file identifier. The list chunks and sub-chunks define the format of the overall stream (i.e., a header sub-chunk), as well as the individual components (i.e., a data sub-chunk). Data sub-chunks, typically carry a single video frame, and are followed by the corresponding audio frames in a different chunk. The index chunk is used for random access into the file. - In the AVI format, there is no concept of timing in the data block. In the AVI file, the only possible location for the detection of timing in the stream has to be derived from the index chunk. The index chunk pinpoints the location of each audio or video frame. However, due to the large size of the index-chunk, the derivation of the timing for the purpose of determining the correct synchronization of the audio and video data is cumbersome and needs a large amount of memory. Timing is critical for a correct synchronization of different media when presenting audio, video, or subtitles. The user experience is diminished when the synchronization is not correct.
- Referring to
FIG. 2 , a diagram illustrating a typical audio andvideo multiplexing system 10 is shown. Thesystem 10 shows asystem clock 12, avideo encoder 14, an audio encoder 16 and amultiplexer 26. Thevideo encoder 14 presents acompressed video stream 18. Thecompressed video stream 18 shows a number of system timestamps 20 a-20 n. The audio encoder 16 presents a compressed audio stream 22. The compressed audio stream 22 comprises a number ofsystem timestamps 24 a-24 n. Themultiplexer 26 transmits either thecompressed video stream 18 or the compressed audio stream 22. There are several existing implementations that maintain audio-video synchronization in a multimedia file or multiplex in addition to thesystem 10. The majority of these methods maintain the snapshot of a real-time clock and embed the clock within a multiplex, thus allowing the decoding system to recreate the presentation clock accurately. - In the existing AVI format, timestamps are not embedded in the video or audio streams. The timing information in the AVI format is basic and prone to error. The timing information in an AVI format can be derived from the AVI index chunk. If the stream is corrupted or missing the AVI index chunk, the entire stream (i.e., audio or video) is not playable. The timing information can also be derived from the stream. If the display duration of each chunk is known, the timestamp can be computed. For example, with a video running at 30 frames per second (fps), a first video chunk will have a timestamp of 0, then for the Nth video chunk, the Nth video chunk will have a timestamp of N/fps. The problem with obtaining the timestamp from the display duration of each chunk is that if some chunks are not decodable or are corrupted, the synchronization will be lost. The synchronization will be improper since the wrong timestamps will be used for the audio or video chunks.
- Referring to
FIG. 3 , a diagram illustrating a typicalAVI de-multiplexing system 50 is shown. Each individual media element is decoded and presented based on snapshots of the real-time clock. Thesystem 50 shows a de-multiplexer 52, avideo decoder 56, anaudio decoder 60 and atelevision 62. Acompressed video stream 54 is transmitted from the de-multiplexer 52 to thevideo decoder 58. With the typicalAVI de-multiplexing system 50, timestamps (not shown) are used by the encoded flow to properly multiplex a compressed stream. The timestamps are not carried inside the compressed stream (i.e., thecompressed video stream 54 or the compressed audio stream 56). Acompressed audio stream 56 is transmitted to theaudio decoder 60. Thetelevision 62 presents the audio video data to a user after a decompressed audio stream and the decompressed video stream are synchronized. The AVI file does not include any notion of an overall stream clock or a snapshot for each individual member (i.e., audio, video, etc.). Thedecoder compressed video stream 56 or thecompressed audio stream 54 at an elementary stream level. A media clock is incremented for each unit decoded. If there are no errors, the media presentation will be free from audio-video synchronization issues. - Referring to
FIG. 4 , a diagram illustrating an A/V synchronization drift with a corrupted AVI stream is shown. The main assumption with such an approach is that the file/stream is error free. However, an error free stream is not always the case. For example, optical media can be scratched, or there can be errors in the stream transmission. In such scenario, the audio-video synchronization will drift, with little hope of recovery. - Media can be either encoded in a Constant Bit Rate (CBR) or a Variable Bit Rate (VBR). VBR encoding may lead to a better compression ratio and better overall quality when compared with CBR encoding. However, the use of VBR encoding creates a more complex rate control program. New encoding technologies offer the possibility of going beyond traditional VBR encoding. Not only do such technologies offer a variable bit rate, but some offer a variable rate/duration (i.e., frame rate in the case of video).
- Referring to
FIGS. 5-6 , an example of adaptive variable frame-rate encoding and an adaptive variable frame-duration encoding example are shown. Video is typically sampled at a fixed frame rate with each “sample” (i.e., picture) having the same duration. Modern encoding technologies can take advantage of the fact that in a video scene there might be a period in which the movie is like a still picture. Such a picture can be encoded as a frame (i.e., only a single frame) for a presentation duration equal to the period of time the movie behaves like still picture. - In modern audio formats (i.e., Advanced Audio Coding (AAC), Windows Media Audio (WMA), and/or Vorbis), the number of audio samples per access unit varies from access unit to access unit. The AVI format can deal with both CBR and VBR encoding. However, for VBR encoding the AVI format needs each and every access unit to be in one AVI chunk. An additional restriction with VBR encoding is that the presentation duration of the access unit must be the same for all access units. Because the presentation duration of the access unit must be the same for all access units, the inclusion of the most advanced encoding tools in the AVI file will lead to severe audio/video synchronization problems.
- While some rudimentary error detection can be performed for each individual AVI chunk. The primary mode of error detection is very limited and occurs at the elementary stream level, assuming such a mechanism is even available in the particular standard (i.e., MPEG A/V). However, the trend for new encoding tools is to have the error detection performed at the transport layer and not at the elementary stream format level (i.e., WMA). Because the AVI format does not have a significant amount of error detection, the
video decoder 56 or theaudio decoder 60 will present corrupted reconstructed media, ultimately damaging the user experience. - It would be desirable to provide a method and/or apparatus that may (i) provide an accurate and error resilient time stamping system for the Audio-Video Interleaved (AVI) format, (ii) augment the possibilities of the AVI format in a non-invasive fashion pertaining to audio-video synchronization, and/or (iii) make the AVI format more attractive and/or flexible to implement.
- The present invention concerns an apparatus comprising a first circuit and a second circuit. The first circuit may be configured to embed one or more timestamp chunks into a compressed bitstream in response to one of a video data signal and an audio data signal. The second circuit may be configured to generate an output signal in response to decoding the compressed bitstream. Each of the one or more timestamp chunks comprises an error correction mechanism configured to detect and correct errors on the compressed bitstream prior to decoding the compressed bitstream.
- The objects, features and advantages of the present invention include providing a method and/or apparatus for an error resilient time stamping method for the audio-video interleaved (AVI) format that may (i) augment the possibilities of the AVI format, (ii) make the AVI format more attractive and flexible to a friendly device, (iii) protect all I-frames in an AVI stream by implementing an error detection/correction program, and/or (iv) allow a greater quality of service in a non-perfect transport medium.
- These and other objects, features and advantages of the present invention will be apparent from the following detailed description and the appended claims and drawings in which:
-
FIG. 1 is a diagram illustrating an AVI file format presentation; -
FIG. 2 is a diagram illustrating a typical audio and video multiplexer using timestamps; -
FIG. 3 is a diagram illustrating AVI multiplexing and A/V presentation; -
FIG. 4 is a diagram illustrating A/V synchronization drift with a corrupted AVI stream; -
FIG. 5 is a diagram illustrating a adaptive variable frame rate; -
FIG. 6 is a diagram illustrating an adaptive frame duration encoding and presentation; -
FIG. 7 is a diagram of a decoder system in accordance with a preferred embodiment of the present invention; -
FIG. 8 is a diagram of an encoder system in accordance with a preferred embodiment of the present invention; and -
FIG. 9 is a diagram illustrating an example of the decoder system. - Referring to
FIG. 7 , a block diagram of a decoder system 100 is shown in accordance with a preferred embodiment of the present invention. The circuit 100 generally comprises a block (or circuit) 104, a block (or circuit) 108, a block (or circuit) 112, a block (or circuit) 114, and a block (or circuit) 116. Theblock 104 may be implemented as a de-multiplexer. Thedemultiplexer 104 may be implemented as an AVI de-multiplexer. Theblock 108 may be implemented as a video decoder. Theblock 112 may be implemented as anaudio decoder 112. Theblock 114 may be implemented as an A/V synchronization circuit. Theblock 116 may be implemented as a display. - The AVI de-multiplexer 104 may receive a compressed video stream or a compressed audio stream on a
signal 102. The AVI de-multiplexer 104 may present acompressed video stream 106 to thevideo decoder 108. The AVI de-multiplexer 104 may present acompressed audio stream 110 to theaudio decoder 112. Thecompressed video stream 106 generally comprises a number of encoded video chunks 105 a-105 n in an AVI format and a number timestamp chunks 107 a-107 n. Thecompressed audio stream 110 may comprise a number of encoded audio chunks 111 a-111 n in an AVI format and a number of timestamp chunks 109 a-109 n. The video chunks 105 a-105 n and the audio chunks 111 a-111 n may be defined as A/V chunks. The A/V synchronization circuit 114 may present decompressed video and/or decompressed audio data to thedisplay 116. - Each timestamp chunk may provide timing information for the following A/V chunk. For example, the
timestamp chunk 107 a may specify a time T. The following encodedvideo chunk 105 a may be displayed at the time T specified by thetimestamp chunk 107 a. The order of the timestamp chunks 107 a-107 n in relation to the encoded video chunks creates a link with the encoded video chunks 105 a-105 n. The following chunks C(0), C(1), C(2), C(3), C(4) . . . C(N), may refer to the video chunks 105 a-105 n, the audio chunks 111 a-111 n, the timestamp chunks 107 a-107 n, and the timestamp chunks 109 a-109 n. If C(i) is a timestamp chunk, then the timestamp chunk C(i) provides all of the information (e.g., timestamp information, an error detection mechanism and an error correct mechanism) relevant to the audio or video chunk C(i+1). The error detection mechanism and the error detection mechanism will be discussed in more detail in connection with TABLE 1. The timestamp chunks 107 a-107 n and the timestamp chunks 111 a-111 n may be (i) fully compatible with the AVI chunk definition and (ii) safely ignored by systems currently not compatible of facilitating the present invention. The present invention may allow content creators to have the same file, which can be played back on legacy platforms and at the same time provide friendly systems with optimal multiplexing. The timestamp chunk may be inserted for each and every media chunk (e.g., video or audio). The insertion of the timestamp chunk into thecompressed video stream 106 and thecompressed audio stream 110 will be discussed in more detail in connection withFIG. 8 . The present invention offers optimal results at frequent intervals to provide a decoder an opportunity to resynchronize video and audio data. - Each of the timestamp chunks 107 a-107 n and the timestamp chunks 111 a-111 n may include a timestamp chunk structure. The timestamp chunk structure is shown in the following TABLE 1:
TABLE 1 TIMESTAMP CHUNK STRUCTURE typedef struct _timestampHeader { FOURCC fcc; DWORD cb; DDWORD timestamp; DWORD dwErrMode; DWORD dwErrLength; DWORD errData [N]; } TIMESTAMPHEADER;
The variable fcc is the “fourCC” (e.g., in the AVI terminology) describing the AVI chunk. The variable fcc comprises a two digit stream id and may be followed by a two character code “ts”. For example, for astream ID 3, the fourCC may be set to “03ts”. The variable cb may be the total size in bytes of the timestamp header chunk. The variable timestamp may be the timestamp in microseconds for the next A/V chunk. The variable dwErrMode may be a fourCC describing the type of error detection used to protect the data stream integrity. - The timestamp chunks 107 a-107 n and the timestamp chunks 109 a-109 n may include a built in error detection mechanism (e.g., CRC and/or checksum for the next AVI chunk(s) positioned after the corresponding timestamp chunk). The error detection mechanism may detect an error in the
compressed video stream 106 and/or thecompressed audio stream 110. The error detection mechanism may apply a best error concealment in response to detecting an error on thecompressed video stream 106 and/or thecompressed audio stream 110. The best error concealment may include skipping an element (or any one of the particular encoded video chunks 105 a-105 n) and/or muting any one of the particular encoded audio chunks 111 a-111 n. - The error correction mechanism may be implemented in the timestamp chunk structure to correct possible errors and deliver an error resilient channel coding (e.g., Viterbi, Reed-Solomon, Turbo code techniques may be used to correct errors). The variable dwErrmode may implement a ‘crc’ (Cycle Redundancy Check) or ‘rs’ Reed Solomon to correct errors in the
compressed video stream 106 and/or thecompressed audio stream 110. The variable deErrLength may be the extra information length (e.g., stored in ‘errData’) needed for each and every error detection mode. For example, a CRC errData may include the CRC computed. For Reed Solomon, the errData may include redundancy bits. The error correction mechanism may (i) detect data corruption and (ii) allow the reconstructing of original data on thecompressed video stream 106 and thecompressed audio stream 110. The error correction mechanism may detect data corruption and reconstruct original data for the next chunk C(i+1). The next chunk C(i+1) may include audio, video and/or subtitles. The reconstruction of the original data on thecompressed video stream 106 and thecompressed audio stream 110 may include constraints based on how much error has been introduced onto thecompressed video stream 106 and/or thecompressed audio stream 110. A multiplexer may decide to have only some blocks protected (e.g., key frames of video) or all of the blocks protected. Implementing an independent timestamp for the AVI format may allow the use of the most advanced encoding tools available. The restrictions normally employed in the AVI format (used to maintain A/V synchronization) may no longer be necessary. - Referring to
FIG. 8 , anencoder system 150 is shown in accordance with the present invention. Theencoder system 150 generally comprises a block (or circuit) 152, a block (or circuit) 154, a block (or circuit) 156, a block (or circuit) 158, a block (or circuit) 168, and ablock 170. Theblock 152 may be implemented as a video course. Theblock 154 may be implemented as an audio source. Theblock 156 may be implemented as a video encoder. Theblock 158 may be implemented as an audio encoder. Theblock 168 may be implemented as an error correction/detection encoder. Theblock 170 may be implemented as a multiplexer. Thevideo source 152 may present a signal (e.g., VIDEO_DATA) to thevideo encoder 156. Theaudio source 154 may present a signal (e.g., AUDIO_DATA) to the audio decoder. - The
video encoder 156 may present an intermediatecompressed video stream 164 to the error correction/detection encoder 168. The intermediatecompressed video stream 164 generally comprises a number of timestamps 83 a-83 n and the number of video chunks 105 a-105 n. Theaudio encoder 158 may provide an intermediatecompressed audio stream 166 to the error correction/detection encoder 168. The intermediatecompressed audio stream 166 generally comprises a number of timestamps 85 a-85 n and the number of audio chunks 111 a-111 n. The error correction/detection encoder may generate and embed (i) the timestamp chunk 107 a-107 n into thecompressed video stream 106 and (ii) the timestamp chunk 109 a-109 n into and thecompressed audio stream 110. The error correction/detection encoder 170 may present thecompressed video stream 106 to themultiplexer 170. The error correction/detection encoder 168 may present thecompressed audio stream 110 to themultiplexer 170. Themultiplexer 170 may present thecompressed video stream 106 or the compressed audio stream on asignal 102. - The error correction/
detection encoder 168 may encode the error detection and/or error correction information for the error correction mechanism by computing CRC and/or redundancy bits for Reed Solomon and/or Turbo. The error correction/detection encoder 168 may store the error correction information inside a timestamp chunk which precedes the audio chunk or the video chunk. The error detection mechanism and the error correction mechanism may be critical in protecting key elements in the compressed video stream 106 (e.g., in a video intra frame). The error correction mechanism may provide actual data which is capable of being decoded instead of data which is concealed due to the presence of corrupted data. - Since the present invention deals with A/V compression, quality and the compression ratio may be a concern. Adding extra information in the
compressed bitstream 102 may add more bytes to thecompressed bitstream 102. In particular, the error correction mechanism may add more bytes (e.g., redundancy bytes) to each timestamp chunk. To reduce the number of bytes added to thecompressed bitstream 102, the present invention may implement (i) the error correction mechanism on key chunks (e.g., a first set of timestamp chunks) and/or (ii) the error detection mechanism to other chunks (e.g., a second set of timestamp chunks). The error detection mechanism may consume less bytes (i.e., less costly) than the error correction mechanism. - The present invention may provide the option of implementing only the error detection mechanism in the timestamp chunk to detect errors and to conceal errors during synchronization. The present invention may also provide the option of implementing only the error correction mechanism in the timestamp chunk to detect error and correct errors prior to decoding the
compressed bitstream 102. The present invention may also provide the option of implementing both the error correction and error detection in the timestamp chunk. The particular implementation of either the error detection mechanism and/or the error correction mechanism may be varied to meet the design criteria of a particular implementation. - Referring to
FIG. 8 , a diagram illustrating the concealment of audio chunks based on the detection of errors is shown. For any of one of the particular encoded audio chunks 111 a-111 n positioned between any of one of the particular timestamp chunks 109-109 n, the audio chunk 111 a may be presented or concealed based on whether any of one of the particular timestamp chunks 109 a-109 n have detected any errors. For example, since thetimestamp chunk 109 a may not have an error detected in the next timestamp chunk 109 a-109 n, the audio chunk 111 a may be passed through to theaudio decoder 112. The decompressed audio from theaudio decoder 112 may be presented to a user until a corresponding error is detected. Since an error may be detected on thenext timestamp chunk 109 b, the error detection mechanism may conceal (or mute) the audio data on the audio chunk 111 b until the next timestamp chunk is free of errors. Since thetimestamp chunk 109 n may not have an error detected, the audio data on theaudio chunk 111 n may be decoded by theaudio decoder 112 and presented to the user. The present invention may use the timestamp and the error detection mechanism to allow the decoder (e.g., an audio decoder or a video decoder) to (i) detect that audio or video data is missing (via corrupted data), (ii) know how much of the audio or video data is missing and (iii) provide an appropriate error concealment method to fill gaps in the audio or video stream caused by the corrupted data. - The
compressed video stream 106 may be implemented similarly to thecompressed audio stream 110. Thecompressed video stream 110 may have any one of the particular number of timestamp chunks 107 a-107 n positioned between any one of the particular video chunks 105 a-105 n. Any one of the particular video chunks 105 a-105 n may be presented or concealed based on whether any one of the particular timestamp chunks 107 a-107 n have any errors which are detected. - The present invention may (i) provide an error detection and correction mechanism built into the AVI format, (ii) provide an independent time stamping method regardless of the encoding tools for an AVI file, (iii) provide a backward compatible solution with existing deployed consumer electronics, (iv) enable the use of the most advanced encoding tools in the AVI format, (v) provide an AVI file format which is robust to transmission channel errors, (vi) allow an essentially perfect media synchronization, (vii) provide a 100% backwards compatibility with existing systems and/or (viii) provide a file that can be used on deployed and enabled systems where only the enabled system takes full advantage of the present invention.
- While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the invention.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/230,734 US20070067472A1 (en) | 2005-09-20 | 2005-09-20 | Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/230,734 US20070067472A1 (en) | 2005-09-20 | 2005-09-20 | Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070067472A1 true US20070067472A1 (en) | 2007-03-22 |
Family
ID=37885524
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/230,734 Abandoned US20070067472A1 (en) | 2005-09-20 | 2005-09-20 | Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format |
Country Status (1)
Country | Link |
---|---|
US (1) | US20070067472A1 (en) |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070280490A1 (en) * | 2006-04-27 | 2007-12-06 | Tomoji Mizutani | Digital signal switching apparatus and method of switching digital signals |
US20080147700A1 (en) * | 2006-12-15 | 2008-06-19 | Fujitsu Limited | Method and device for editing composite content file and reproduction apparatus |
US20080219381A1 (en) * | 2005-07-26 | 2008-09-11 | Jeyhan Karaoguz | Method and system for redundancy-based decoding of video content in a wireless system |
US20080240168A1 (en) * | 2007-03-31 | 2008-10-02 | Hoffman Jeffrey D | Processing wireless and broadband signals using resource sharing |
US20090295992A1 (en) * | 2005-10-21 | 2009-12-03 | Thomson Licensing | Method and Apparatus for Audio and Video Synchronization Timestamp Rollover Correction |
CN100596185C (en) * | 2007-09-24 | 2010-03-24 | 凌阳科技股份有限公司 | Method for recording audio and video interlaced format file |
US20100249962A1 (en) * | 2009-03-26 | 2010-09-30 | Sony Corporation | Information processing apparatus, audio signal processing method, and program product |
CN102623040A (en) * | 2012-03-12 | 2012-08-01 | 四川和芯微电子股份有限公司 | Data synthesizing and playing system and method |
US20140129004A1 (en) * | 2012-02-28 | 2014-05-08 | Panasonic Corporation | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US20150035977A1 (en) * | 2013-08-02 | 2015-02-05 | Application Solutions (Electronics And Vision) Ltd | Video camera and a video receiver of a video monitoring system |
CN105208395A (en) * | 2015-09-16 | 2015-12-30 | 北京暴风科技股份有限公司 | Method and system for error correction on time stamps for Android system hardware video decoding |
US20180096706A1 (en) * | 2016-10-05 | 2018-04-05 | Samsung Electronics Co., Ltd. | Image processing apparatus and method for controlling the same |
CN108600816A (en) * | 2018-05-17 | 2018-09-28 | 上海七牛信息技术有限公司 | A kind of detecting method of media, device and media play system |
US10708521B2 (en) | 2003-12-08 | 2020-07-07 | Divx, Llc | Multimedia distribution system for multimedia files with interleaved media chunks of varying types |
US10856020B2 (en) | 2011-09-01 | 2020-12-01 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US10880620B2 (en) | 2013-05-31 | 2020-12-29 | Divx, Llc | Playback synchronization across playback devices |
US10893305B2 (en) | 2014-04-05 | 2021-01-12 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
US10902883B2 (en) | 2007-11-16 | 2021-01-26 | Divx, Llc | Systems and methods for playing back multimedia files incorporating reduced index structures |
US10904594B2 (en) | 2016-05-24 | 2021-01-26 | Divx, Llc | Systems and methods for providing variable speeds in a trick-play mode |
US10917449B2 (en) | 2013-03-15 | 2021-02-09 | Divx, Llc | Systems, methods, and media for delivery of content |
US10931982B2 (en) | 2011-08-30 | 2021-02-23 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US10979782B2 (en) | 2012-08-31 | 2021-04-13 | Divx, Llc | System and method for decreasing an initial buffering period of an adaptive streaming system |
US10992955B2 (en) | 2011-01-05 | 2021-04-27 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US11017816B2 (en) | 2003-12-08 | 2021-05-25 | Divx, Llc | Multimedia distribution system |
US11044502B2 (en) | 2016-05-24 | 2021-06-22 | Divx, Llc | Systems and methods for providing audio content during trick-play playback |
US11050808B2 (en) | 2007-01-05 | 2021-06-29 | Divx, Llc | Systems and methods for seeking within multimedia content during streaming playback |
US11064235B2 (en) | 2016-06-15 | 2021-07-13 | Divx, Llc | Systems and methods for encoding video content |
US11102553B2 (en) | 2009-12-04 | 2021-08-24 | Divx, Llc | Systems and methods for secure playback of encrypted elementary bitstreams |
US11115450B2 (en) | 2011-08-31 | 2021-09-07 | Divx, Llc | Systems, methods, and media for playing back protected video content by using top level index file |
USRE48748E1 (en) | 2011-06-29 | 2021-09-21 | Divx, Llc | Systems and methods for estimating available bandwidth and performing initial stream selection when streaming content |
US11134115B2 (en) | 2015-02-27 | 2021-09-28 | Divx, Llc | Systems and methods for frame duplication and frame extension in live video encoding and streaming |
USRE48761E1 (en) | 2012-12-31 | 2021-09-28 | Divx, Llc | Use of objective quality measures of streamed content to reduce streaming bandwidth |
US11178200B2 (en) | 2013-12-30 | 2021-11-16 | Divx, Llc | Systems and methods for playing adaptive bitrate streaming content by multicast |
US11178435B2 (en) | 2011-09-01 | 2021-11-16 | Divx, Llc | Systems and methods for saving encoded media streamed using adaptive bitrate streaming |
US11190497B2 (en) | 2011-08-31 | 2021-11-30 | Divx, Llc | Systems and methods for application identification |
US11245938B2 (en) | 2014-08-07 | 2022-02-08 | Divx, Llc | Systems and methods for protecting elementary bitstreams incorporating independently encoded tiles |
US11272232B2 (en) | 2013-05-31 | 2022-03-08 | Divx, Llc | Synchronizing multiple over the top streaming clients |
US11343300B2 (en) | 2017-02-17 | 2022-05-24 | Divx, Llc | Systems and methods for adaptive switching between multiple content delivery networks during adaptive bitrate streaming |
US11349892B2 (en) | 2015-01-06 | 2022-05-31 | Divx, Llc | Systems and methods for encoding and sharing content between devices |
US11438394B2 (en) | 2012-12-31 | 2022-09-06 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US11457054B2 (en) | 2011-08-30 | 2022-09-27 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US11470405B2 (en) | 2013-05-30 | 2022-10-11 | Divx, Llc | Network video streaming with trick play based on separate trick play files |
US11526582B2 (en) | 2012-01-06 | 2022-12-13 | Divx, Llc | Systems and methods for enabling playback of digital content using status associable electronic tickets and ticket tokens representing grant of access rights |
US11539780B2 (en) | 2016-03-30 | 2022-12-27 | Divx, Llc | Systems and methods for quick start-up of playback |
US11650562B2 (en) | 2019-08-26 | 2023-05-16 | Toyota Motor Engineering & Manufacturing North America, Inc. | Interface assemblies for manufacturing components |
US11825142B2 (en) | 2019-03-21 | 2023-11-21 | Divx, Llc | Systems and methods for multimedia swarms |
US11849112B2 (en) | 2013-03-15 | 2023-12-19 | Divx, Llc | Systems, methods, and media for distributed transcoding video data |
US11886545B2 (en) | 2006-03-14 | 2024-01-30 | Divx, Llc | Federated digital rights management scheme including trusted systems |
US12244660B2 (en) | 2016-09-08 | 2025-03-04 | Divx, Llc | Systems and methods for adaptive buffering for digital video streaming |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5511003A (en) * | 1993-11-24 | 1996-04-23 | Intel Corporation | Encoding and decoding video signals using spatial filtering |
US5841987A (en) * | 1994-08-19 | 1998-11-24 | Thomson Consumer Electronics, Inc. | Simple bus and interface system for consumer digital equipment |
US20030198256A1 (en) * | 2002-04-19 | 2003-10-23 | Wang Charles Chuanming | Apparatus and method for synchronization of audio and video streams |
US6754239B2 (en) * | 1997-03-28 | 2004-06-22 | Sony Corpration | Multiplexing apparatus and method, transmitting apparatus and method, and recording medium |
US20040170383A1 (en) * | 2003-02-13 | 2004-09-02 | Leszek Mazur | System and method for real-time data archival |
US20050234731A1 (en) * | 2004-04-14 | 2005-10-20 | Microsoft Corporation | Digital media universal elementary stream |
US20060129909A1 (en) * | 2003-12-08 | 2006-06-15 | Butt Abou U A | Multimedia distribution system |
US20070053658A1 (en) * | 2003-10-10 | 2007-03-08 | Sony Corporation | File reproduction apparatus, file reproduction method, file reproduction method program and recording medium for recording file reproduction method program |
-
2005
- 2005-09-20 US US11/230,734 patent/US20070067472A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5511003A (en) * | 1993-11-24 | 1996-04-23 | Intel Corporation | Encoding and decoding video signals using spatial filtering |
US5841987A (en) * | 1994-08-19 | 1998-11-24 | Thomson Consumer Electronics, Inc. | Simple bus and interface system for consumer digital equipment |
US6754239B2 (en) * | 1997-03-28 | 2004-06-22 | Sony Corpration | Multiplexing apparatus and method, transmitting apparatus and method, and recording medium |
US20030198256A1 (en) * | 2002-04-19 | 2003-10-23 | Wang Charles Chuanming | Apparatus and method for synchronization of audio and video streams |
US20040170383A1 (en) * | 2003-02-13 | 2004-09-02 | Leszek Mazur | System and method for real-time data archival |
US20070053658A1 (en) * | 2003-10-10 | 2007-03-08 | Sony Corporation | File reproduction apparatus, file reproduction method, file reproduction method program and recording medium for recording file reproduction method program |
US20060129909A1 (en) * | 2003-12-08 | 2006-06-15 | Butt Abou U A | Multimedia distribution system |
US20050234731A1 (en) * | 2004-04-14 | 2005-10-20 | Microsoft Corporation | Digital media universal elementary stream |
Cited By (105)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11509839B2 (en) | 2003-12-08 | 2022-11-22 | Divx, Llc | Multimedia distribution system for multimedia files with packed frames |
US11297263B2 (en) | 2003-12-08 | 2022-04-05 | Divx, Llc | Multimedia distribution system for multimedia files with packed frames |
US11735228B2 (en) | 2003-12-08 | 2023-08-22 | Divx, Llc | Multimedia distribution system |
US11159746B2 (en) | 2003-12-08 | 2021-10-26 | Divx, Llc | Multimedia distribution system for multimedia files with packed frames |
US11017816B2 (en) | 2003-12-08 | 2021-05-25 | Divx, Llc | Multimedia distribution system |
US11012641B2 (en) | 2003-12-08 | 2021-05-18 | Divx, Llc | Multimedia distribution system for multimedia files with interleaved media chunks of varying types |
US11355159B2 (en) | 2003-12-08 | 2022-06-07 | Divx, Llc | Multimedia distribution system |
US10708521B2 (en) | 2003-12-08 | 2020-07-07 | Divx, Llc | Multimedia distribution system for multimedia files with interleaved media chunks of varying types |
US11735227B2 (en) | 2003-12-08 | 2023-08-22 | Divx, Llc | Multimedia distribution system |
US8948309B2 (en) * | 2005-07-26 | 2015-02-03 | Broadcom Corporation | Method and system for redundancy-based decoding of video content in a wireless system |
US20080219381A1 (en) * | 2005-07-26 | 2008-09-11 | Jeyhan Karaoguz | Method and system for redundancy-based decoding of video content in a wireless system |
US20090295992A1 (en) * | 2005-10-21 | 2009-12-03 | Thomson Licensing | Method and Apparatus for Audio and Video Synchronization Timestamp Rollover Correction |
US8994879B2 (en) * | 2005-10-21 | 2015-03-31 | Thomson Licensing | Method and apparatus for audio and video synchronization timestamp rollover correction |
US11886545B2 (en) | 2006-03-14 | 2024-01-30 | Divx, Llc | Federated digital rights management scheme including trusted systems |
US8670849B2 (en) * | 2006-04-27 | 2014-03-11 | Sony Corporation | Digital signal switching apparatus and method of switching digital signals |
US20070280490A1 (en) * | 2006-04-27 | 2007-12-06 | Tomoji Mizutani | Digital signal switching apparatus and method of switching digital signals |
US8433678B2 (en) | 2006-12-15 | 2013-04-30 | Fujitsu Limited | Method and device for editing composite content file and reproduction apparatus |
US8090682B2 (en) * | 2006-12-15 | 2012-01-03 | Fujitsu Limited | Method and device for editing composite content file and reproduction apparatus |
US20080147700A1 (en) * | 2006-12-15 | 2008-06-19 | Fujitsu Limited | Method and device for editing composite content file and reproduction apparatus |
US12267380B2 (en) | 2007-01-05 | 2025-04-01 | Divx, Llc | Systems and methods for seeking within multimedia content during streaming playback |
US11050808B2 (en) | 2007-01-05 | 2021-06-29 | Divx, Llc | Systems and methods for seeking within multimedia content during streaming playback |
US11706276B2 (en) | 2007-01-05 | 2023-07-18 | Divx, Llc | Systems and methods for seeking within multimedia content during streaming playback |
US20080240168A1 (en) * | 2007-03-31 | 2008-10-02 | Hoffman Jeffrey D | Processing wireless and broadband signals using resource sharing |
US20080240005A1 (en) * | 2007-03-31 | 2008-10-02 | Hoffman Jeffrey D | Processing wireless and broadband signals using resource sharing |
US20080244357A1 (en) * | 2007-03-31 | 2008-10-02 | Hoffman Jeffrey D | Processing wireless and broadband signals using resource sharing |
US20080307291A1 (en) * | 2007-03-31 | 2008-12-11 | Hoffman Jeffrey D | Processing wireless and broadband signals using resource sharing |
CN100596185C (en) * | 2007-09-24 | 2010-03-24 | 凌阳科技股份有限公司 | Method for recording audio and video interlaced format file |
US11495266B2 (en) | 2007-11-16 | 2022-11-08 | Divx, Llc | Systems and methods for playing back multimedia files incorporating reduced index structures |
US10902883B2 (en) | 2007-11-16 | 2021-01-26 | Divx, Llc | Systems and methods for playing back multimedia files incorporating reduced index structures |
US8676363B2 (en) * | 2009-03-26 | 2014-03-18 | Sony Corporation | Information processing apparatus, audio signal processing method, and program product |
US20100249962A1 (en) * | 2009-03-26 | 2010-09-30 | Sony Corporation | Information processing apparatus, audio signal processing method, and program product |
US11102553B2 (en) | 2009-12-04 | 2021-08-24 | Divx, Llc | Systems and methods for secure playback of encrypted elementary bitstreams |
US12184943B2 (en) | 2009-12-04 | 2024-12-31 | Divx, Llc | Systems and methods for secure playback of encrypted elementary bitstreams |
US10992955B2 (en) | 2011-01-05 | 2021-04-27 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US11638033B2 (en) | 2011-01-05 | 2023-04-25 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US12262051B2 (en) | 2011-01-05 | 2025-03-25 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US12250404B2 (en) | 2011-01-05 | 2025-03-11 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
USRE48748E1 (en) | 2011-06-29 | 2021-09-21 | Divx, Llc | Systems and methods for estimating available bandwidth and performing initial stream selection when streaming content |
US11457054B2 (en) | 2011-08-30 | 2022-09-27 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US10931982B2 (en) | 2011-08-30 | 2021-02-23 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US11611785B2 (en) | 2011-08-30 | 2023-03-21 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US11716371B2 (en) | 2011-08-31 | 2023-08-01 | Divx, Llc | Systems and methods for automatically generating top level index files |
US11870758B2 (en) | 2011-08-31 | 2024-01-09 | Divx, Llc | Systems and methods for application identification |
US11190497B2 (en) | 2011-08-31 | 2021-11-30 | Divx, Llc | Systems and methods for application identification |
US11115450B2 (en) | 2011-08-31 | 2021-09-07 | Divx, Llc | Systems, methods, and media for playing back protected video content by using top level index file |
US10856020B2 (en) | 2011-09-01 | 2020-12-01 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US12244878B2 (en) | 2011-09-01 | 2025-03-04 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US11683542B2 (en) | 2011-09-01 | 2023-06-20 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US11178435B2 (en) | 2011-09-01 | 2021-11-16 | Divx, Llc | Systems and methods for saving encoded media streamed using adaptive bitrate streaming |
US11526582B2 (en) | 2012-01-06 | 2022-12-13 | Divx, Llc | Systems and methods for enabling playback of digital content using status associable electronic tickets and ticket tokens representing grant of access rights |
US20220392423A1 (en) * | 2012-02-28 | 2022-12-08 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus and method |
US20230395040A1 (en) * | 2012-02-28 | 2023-12-07 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus and method |
US12165618B2 (en) * | 2012-02-28 | 2024-12-10 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus and method for obtaining and displaying appliance photographic image and supplemental data |
US20190096369A1 (en) * | 2012-02-28 | 2019-03-28 | Panasonic Intellectual Property Management Co., Ltd. | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US9459606B2 (en) * | 2012-02-28 | 2016-10-04 | Panasonic Intellectual Property Management Co., Ltd. | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US20160365073A1 (en) * | 2012-02-28 | 2016-12-15 | Panasonic Intellectual Property Management Co., Ltd. | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US10978025B2 (en) * | 2012-02-28 | 2021-04-13 | Panasonic Intellectual Property Management Co., Ltd. | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US11430415B2 (en) | 2012-02-28 | 2022-08-30 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus and method |
US10170083B2 (en) * | 2012-02-28 | 2019-01-01 | Panasonic Intellectual Property Management Co., Ltd. | Display apparatus for control information, method for displaying control information, and system for displaying control information |
US11769470B2 (en) * | 2012-02-28 | 2023-09-26 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus and method for obtaining and displaying appliance photographic image and supplemental data |
US20140129004A1 (en) * | 2012-02-28 | 2014-05-08 | Panasonic Corporation | Display apparatus for control information, method for displaying control information, and system for displaying control information |
CN102623040A (en) * | 2012-03-12 | 2012-08-01 | 四川和芯微电子股份有限公司 | Data synthesizing and playing system and method |
US11528540B2 (en) | 2012-08-31 | 2022-12-13 | Divx, Llc | System and method for decreasing an initial buffering period of an adaptive streaming system |
US10979782B2 (en) | 2012-08-31 | 2021-04-13 | Divx, Llc | System and method for decreasing an initial buffering period of an adaptive streaming system |
USRE48761E1 (en) | 2012-12-31 | 2021-09-28 | Divx, Llc | Use of objective quality measures of streamed content to reduce streaming bandwidth |
US12177281B2 (en) | 2012-12-31 | 2024-12-24 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US11785066B2 (en) | 2012-12-31 | 2023-10-10 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US11438394B2 (en) | 2012-12-31 | 2022-09-06 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
USRE49990E1 (en) | 2012-12-31 | 2024-05-28 | Divx, Llc | Use of objective quality measures of streamed content to reduce streaming bandwidth |
US10917449B2 (en) | 2013-03-15 | 2021-02-09 | Divx, Llc | Systems, methods, and media for delivery of content |
US11849112B2 (en) | 2013-03-15 | 2023-12-19 | Divx, Llc | Systems, methods, and media for distributed transcoding video data |
US11470405B2 (en) | 2013-05-30 | 2022-10-11 | Divx, Llc | Network video streaming with trick play based on separate trick play files |
US12250420B2 (en) | 2013-05-31 | 2025-03-11 | Divx, Llc | Synchronizing multiple over the top streaming clients |
US11765410B2 (en) | 2013-05-31 | 2023-09-19 | Divx, Llc | Synchronizing multiple over the top streaming clients |
US11272232B2 (en) | 2013-05-31 | 2022-03-08 | Divx, Llc | Synchronizing multiple over the top streaming clients |
USRE50400E1 (en) | 2013-05-31 | 2025-04-22 | Divx, Llc | Playback synchronization across playback devices |
US10880620B2 (en) | 2013-05-31 | 2020-12-29 | Divx, Llc | Playback synchronization across playback devices |
US20150035977A1 (en) * | 2013-08-02 | 2015-02-05 | Application Solutions (Electronics And Vision) Ltd | Video camera and a video receiver of a video monitoring system |
US11178200B2 (en) | 2013-12-30 | 2021-11-16 | Divx, Llc | Systems and methods for playing adaptive bitrate streaming content by multicast |
US10893305B2 (en) | 2014-04-05 | 2021-01-12 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
US11711552B2 (en) | 2014-04-05 | 2023-07-25 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
US12010362B2 (en) | 2014-08-07 | 2024-06-11 | Divx, Llc | Systems and methods for protecting elementary bitstreams incorporating independently encoded tiles |
US11245938B2 (en) | 2014-08-07 | 2022-02-08 | Divx, Llc | Systems and methods for protecting elementary bitstreams incorporating independently encoded tiles |
US12250257B2 (en) | 2015-01-06 | 2025-03-11 | Divx, Llc | Systems and methods for encoding and sharing content between devices |
US11711410B2 (en) | 2015-01-06 | 2023-07-25 | Divx, Llc | Systems and methods for encoding and sharing content between devices |
US11349892B2 (en) | 2015-01-06 | 2022-05-31 | Divx, Llc | Systems and methods for encoding and sharing content between devices |
US11134115B2 (en) | 2015-02-27 | 2021-09-28 | Divx, Llc | Systems and methods for frame duplication and frame extension in live video encoding and streaming |
US11824912B2 (en) | 2015-02-27 | 2023-11-21 | Divx, Llc | Systems and methods for frame duplication and frame extension in live video encoding and streaming |
CN105208395A (en) * | 2015-09-16 | 2015-12-30 | 北京暴风科技股份有限公司 | Method and system for error correction on time stamps for Android system hardware video decoding |
US12041113B2 (en) | 2016-03-30 | 2024-07-16 | Divx, Llc | Systems and methods for quick start-up of playback |
US11539780B2 (en) | 2016-03-30 | 2022-12-27 | Divx, Llc | Systems and methods for quick start-up of playback |
US10904594B2 (en) | 2016-05-24 | 2021-01-26 | Divx, Llc | Systems and methods for providing variable speeds in a trick-play mode |
US11044502B2 (en) | 2016-05-24 | 2021-06-22 | Divx, Llc | Systems and methods for providing audio content during trick-play playback |
US11546643B2 (en) | 2016-05-24 | 2023-01-03 | Divx, Llc | Systems and methods for providing audio content during trick-play playback |
US11895348B2 (en) | 2016-05-24 | 2024-02-06 | Divx, Llc | Systems and methods for providing variable speeds in a trick-play mode |
US12126849B2 (en) | 2016-06-15 | 2024-10-22 | Divx, Llc | Systems and methods for encoding video content |
US11064235B2 (en) | 2016-06-15 | 2021-07-13 | Divx, Llc | Systems and methods for encoding video content |
US11483609B2 (en) | 2016-06-15 | 2022-10-25 | Divx, Llc | Systems and methods for encoding video content |
US11729451B2 (en) | 2016-06-15 | 2023-08-15 | Divx, Llc | Systems and methods for encoding video content |
US12244660B2 (en) | 2016-09-08 | 2025-03-04 | Divx, Llc | Systems and methods for adaptive buffering for digital video streaming |
US20180096706A1 (en) * | 2016-10-05 | 2018-04-05 | Samsung Electronics Co., Ltd. | Image processing apparatus and method for controlling the same |
US11343300B2 (en) | 2017-02-17 | 2022-05-24 | Divx, Llc | Systems and methods for adaptive switching between multiple content delivery networks during adaptive bitrate streaming |
CN108600816A (en) * | 2018-05-17 | 2018-09-28 | 上海七牛信息技术有限公司 | A kind of detecting method of media, device and media play system |
US11825142B2 (en) | 2019-03-21 | 2023-11-21 | Divx, Llc | Systems and methods for multimedia swarms |
US11650562B2 (en) | 2019-08-26 | 2023-05-16 | Toyota Motor Engineering & Manufacturing North America, Inc. | Interface assemblies for manufacturing components |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070067472A1 (en) | Accurate and error resilient time stamping method and/or apparatus for the audio-video interleaved (AVI) format | |
US7058815B2 (en) | Method and system for digitally signing MPEG streams | |
US5838678A (en) | Method and device for preprocessing streams of encoded data to facilitate decoding streams back-to back | |
US6034746A (en) | System and method for inserting data into a digital audio/video data stream | |
US7584495B2 (en) | Redundant stream alignment in IP datacasting over DVB-H | |
KR100983169B1 (en) | Frame level multimedia decoding with frame information table | |
US7826537B2 (en) | Systems and methods with error resilience in enhancement layer bitstream of scalable video coding | |
Gringeri et al. | Robust compression and transmission of MPEG-4 video | |
US20010005385A1 (en) | Multimedia information communication apparatus and method | |
US7369756B2 (en) | Method for decoding non-DV data stored in a DV format | |
JPH1174868A (en) | Information transmission method, coder/decoder in information transmission system adopting the method, coding multiplexer/decoding inverse multiplexer | |
KR20030061803A (en) | System and method of processing mpeg streams for file index insertion | |
US20080002776A1 (en) | Media Content and Enhancement Data Delivery | |
EP0944086A2 (en) | Data recording method and data recording system | |
JP2004096767A (en) | Decoding method and apparatus | |
US20060140281A1 (en) | Video coding apparatus and video decoding apparatus | |
KR100294663B1 (en) | MPEG decoder and decoding control method | |
EP1472880B1 (en) | Error correction of stream data | |
US6498809B1 (en) | Video bitstream error resilient transcoder, method, video-phone, video-communicator and device | |
CN102625989B (en) | For the transmission plan of access unit crossfire | |
US7839925B2 (en) | Apparatus for receiving packet stream | |
JP4242581B2 (en) | Data converter | |
KR0181082B1 (en) | PT encoding system of MPEG system | |
US8184660B2 (en) | Transparent methods for altering the video decoder frame-rate in a fixed-frame-rate audio-video multiplex structure | |
JP2001127726A (en) | Signal processor, signal processing method and recording medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LSI LOGIC CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MAERTENS, GREGORY R.;SOROUSHIAN, KOUROSH;REEL/FRAME:017020/0704 Effective date: 20050916 |
|
AS | Assignment |
Owner name: LSI CORPORATION, CALIFORNIA Free format text: MERGER;ASSIGNOR:LSI SUBSIDIARY CORP.;REEL/FRAME:020548/0977 Effective date: 20070404 Owner name: LSI CORPORATION,CALIFORNIA Free format text: MERGER;ASSIGNOR:LSI SUBSIDIARY CORP.;REEL/FRAME:020548/0977 Effective date: 20070404 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |