ES2356590T3 - PLAYBACK DEVICE, PLAYBACK METHOD, RECORDING MEDIA, RECORDING DEVICE AND RECORDING METHOD. - Google Patents

Abstract

A reproduction apparatus comprising: an acquisition unit (2, 3) that operates to acquire, from a recording medium (1), a flow of graphics that includes a data package (WDS, PDS, ODS) and a package control (PCS; ICS), including the data packet (WDS, PDS, ODS) graphic data and a decoding time stamp (DTS) and a first presentation time stamp (PTS), indicating the time stamp of decoding (DTS) a start time of a process for decoding graphic data, the first presentation time stamp (PTS) indicating the end time of said decoding process, including the control package (PCS) a second presentation time stamp (PTS) indicating the presentation time that is at the time of completion indicated by the first presentation time stamp or later; a processor (14) operating to (i) start said decoding process at the start time, and (ii) end said decoding process at said end time; and a controller (17) that operates to write the decoded graphics data in a graphics plane (8) for said presentation time, the graphics plane (8) being the area where the graph data is represented

Description

Technical Field

The present invention relates to a recording medium such as a BD-ROM, and a playback apparatus. The present invention particularly relates to a technology for making representations of 5 subtitles and interactive representations, by means of graphics.

Previous Technique

 The representation of subtitles by means of graphics has the important mission of transmitting the words pronounced by the characters of a work, to people in any area of the world. A conventional technology for performing subtitle representations is the application of subtitles of the ETSI EN 300 743 standard (ETSI: European Telecommunications Standardization Institute 10). The subtitles application is a video stream to be played along with the representation of subtitles by means of graphics. At this point, the graphics that correspond to the subtitles are represented as a data stream in the MPEG2 standard. The data flow is a sequence of PES packets, where each PES packet has a PTS (presentation time stamp). The ETSI EN 300 743 standard defines the timing of the representation of subtitles in a subtitle application. This regulation establishes the synchronization between moving images and graphics, in which graphics are represented when the corresponding images are represented in a video stream.

 When a subtitle application is provided for a BD-ROM, it is necessary to further improve the level of graphics resolution. To be more specific, it is desirable to improve the resolution level to the level of 1920 * 1080. However, the realization of such a high definition incurs an enormous amount of decoding load in the reproduction.

 The ETSI EN 300 743 standard defines the reproduction control to perform decoding at the time designated by the PTS, and to present it immediately. When this is applied, a huge amount of decoding load will be concentrated in the reproduction apparatus at the points immediately before the representation. Such a load concentration forces the hardware / software capacity of the reproduction apparatus to be high, so that it performs the representation of the graphics. If such a condition becomes essential for the reproduction apparatus, the production cost for the reproduction apparatus will increase markedly, which will prevent such reproduction apparatus from being commonly used.

 From US 6470460 a reproduction apparatus of the contiguous flow system is known. The conventional reproduction apparatus to which one or more system flows are introduced by interspersing with at least 30 moving image data and audio data, and the system flow connection information includes STC system clock generator to produce the system clock used as the reference clock of the flow reproduction system. The reproduction apparatus further includes one or more signal processing decoders that operate with reference to the STC system clock, buffers buffers for temporarily storing system flow data transferred to the corresponding signal processing decoders, and selectors of 35 STC to select an STC system clock referenced by signal processing decoders when decoding the first system flow, and another STC system clock referenced by signal processing decoders when decoding a second system flow reproduced in a manner contiguous with the first flow of the system.

 Reference document EP 0 924 934 A1 is known as an encoding apparatus, which generates a bit stream 40 composed of a reference clock value, time stamps and compressed data corresponding to audio, video and scene data. In this bit stream a time stamp representing a decoding instant is attached to the respective compressed data, and a time stamp representing the composition timing is attached to the compressed video data and the compressed scene data. The decoding and composition are then carried out with respect to the seed data that is the "non-video" data, and therefore the timing of the decoding and composition of the non-video data can be defined.

 Reference US 6580869 refers to the recording of video data, in which, once reproduced the flow data that is recorded while being attached with the time stamp information in packet units, time management is performed using the time stamp information. The moment of reproduction of the video seen by the user, which can be indicated by the time of representation of the image I-, B-, and P-, is different from the time of the information of the time stamp. For this reason, when the time management for the recorded stream data on the information storage medium is performed using only the time stamp information, the representation time control (video playback time control) for the User cannot be given precisely. In this invention, a time association table is provided indicating the relationship between the time stamp information recorded in the flow data at each instant start position of the I-image and the representation time information ( PTS or field information) for the user for a portion of the management information.

 Reference EP 0877377 refers to an apparatus and method for creating applications of films of a multi-version type and generating bit streams for continuous playback to be stored on optical discs. In order to produce a multi-version cinema application so that selective reproduction of a part of the images is possible, it is necessary to produce interleaving structure system flows depending on the previous and subsequent system flows. Once the playback order is determined, it cannot be changed during playback. Then, the correction according to the restrictions on the video objects depending on the order of reproduction is applied to the voice data whose relations with the video objects are shown. In this way, the time required to complete the cinema application by repeating the change and deleting part of the images can be shortened and the production of a multi-version cinema application can be made for a producer.

 Reference WO 0176256 refers to the methods and apparatus for recording and subsequent reproduction of 10 digital video data. The broadcast data received in the MPEG Transport Stream (TS) format is processed to produce a modified transport stream for recording onto an optical disc to record the content of a selected audiovisual program. Various techniques are described to allow random access within the recording, but without reconversion into packets or re-multiplexing of the elementary audio and video streams, for example within the program stream format. The received TS (DVIN) occasionally includes information on the flow mapping 15 (PAT / PMT) identifying an ID code of the transport package associated with each of the elementary flows, said flow mapping information being subject to changes through the TS received. The packet IDs in the modified transport stream can be re-mapped to a uniform set of values to allow random entry to the recorded stream. Alternatively, the current flow mapping information can be inserted at each potential entry point in the modified flow. The characteristic point information (CPI) that defines a set 20 of potential entry points through the flow is generated by analyzing the received flow, and recorded in a separate file to facilitate the location of entry points on the disk. The entry points may comprise, for example, all I-images, or a subset of them. Clock reference values (PCR) not transported in one of the searched streams are inserted into the modified transport stream using a separate packet ID. The recorded stream can be passed to a standardized decoder with a small or no additional modification. 25

 Therefore, the use of a decoding time stamp and the presentation time stamp to control the decoding of the graphics data and the presentation of the decoded data, respectively, are well known in the art. However, there remains a problem of coordinating the operation of the decoder responsible for decoding the graphic data with the graphics controller responsible for updating the decoded graphics. Conventionally, this coordination is achieved by communication between processes or by 30 hardware interruptions, depending on how the decoder and graphics controller are implemented. However, a certain amount of delay is associated with each of these coordination means, resulting in the problem that the graphics cannot be synchronized with the rendering rate of the moving image.

 It is therefore the object of this invention to provide a reproduction apparatus, a reproduction method, a recording medium having a graphic flow on it, as well as a recording apparatus and a recording method that exceeds the conventional problems described above.

 This is achieved by the characteristics of the appended claims.

 The period in which the graphics are decoded is indicated by the time stamp of the package that stores the graphics, and the representation of the graphics is defined by the value of the time stamp assigned to the corresponding control information. Therefore, in the present invention, the "status of already decoded but not yet represented" is defined on the playing timeline, in other words, a state in which the decompressed graphics are stored in a buffer.

 By defining such an intermediate storage period, it becomes possible to avoid the concentration of a huge amount of decoding load at one point. In addition, if the use of hardware resources for decoding simultaneously supports other processing, the intermediate storage period can be provided so that the graphics are relocated in the decoding period, thereby avoiding such containment.

 At this point, if this intermediate storage concept is introduced so that the object mentioned above is achieved, the technicians pursuing the development of such a reproduction apparatus will be in a dilemma about the extent of memory to be mounted, so that guarantee normal operation. Meanwhile, the technicians who produce the subtitle application will also be anxious about whether the subtitle application itself can be safely reproduced by the reproduction apparatus. All this is because the memory occupation of this buffer will change chronologically, in the course of reproduction over the timeline of reproduction. If the chronological change in memory occupancy remains unknown, the anxieties of these technicians will not be eliminated.

 To solve this problem, it is desirable to have a construction in which the control information includes information of the type that indicates the beginning of the memory management, the time stamp of the control package which is a time stamp of the presentation , and the control package which also includes a decoding time stamp whose value indicates a point of the digital stream's playing time line, which corresponds to the beginning of memory management, and the time at which the Control information is read for a memory.

 According to this construction, the beginning of memory management is indicated by a time stamp decoding the packet storage control information. Therefore, referring to the decoding time stamp it becomes possible to know on which point of the reproduction time line each of the buffers should be displayed for the decoder model. If the flash point is considered as the starting point of memory management, it is easy to narrow the chronological occupation transition of the buffer 5 that stores the control information, the buffer that stores the graphics before decoding and buffer that stores the graphics after decoding. By changing the value of this decoding time stamp, it is possible to adjust the chronological transition of the state of the buffers. According to such an adjustment, it becomes possible to avoid the overflow of buffers in the reproduction apparatus. Therefore, it becomes easy to implement the hardware / software at the development stage of the playback apparatus.

 In addition, as it becomes easy to narrow and adjust the chronological transition, verification is consequently easy as to whether the flow of graphics obtained by the edition satisfies the restrictions of the decoder model that assumes the BD-ROM regulations. Therefore the person in charge of editing can proceed with their editing operation under the condition that it is ensured that the graphics of their creation operate normally. fifteen

 Assuming the decoder model of the BD-ROM, an additional constituent element will be necessary so that the present invention is realized. In this BD-ROM decoder model, the main body of the graphics decoder (i.e. the processor) is independent of the main body of the controller (i.e., the controller) for updating the graphics. The reason why the main body of the decoder is provided independently of the main body of the update controller is to perform the advanced update 20 so that the graphics are represented and deleted gradually, which is useful for the case in which the graphics are subtitles, for example. When the main body of the update controller is a body independent of the main body of the decoder, the controller-processor connection needs to be closer. This is because, after the processor completes the decoding of the graphics data, the controller has to perform the update without delay. 25

 The way in which the termination of the decoding of the processor to the controller is notified depends on the mode in which the processor and the controller are implemented in the apparatus. If the processor and controller are implemented as programs, the notification will be made with a communication between processes. If the processor and the controller are implemented as independent hardware components, then the notification will be made by an interruption signal. The amount of time delay of such notification also depends on the mode of implementation in the apparatus. If the implementation requires a long delay of the notification, there will be a case in which the graphics update cannot be synchronized with the rendering rate of the moving image.

 Thus, to prevent this case from occurring, it is desirable to have a construction in which the value of the presentation time stamp is obtained by adding a predetermined value to the value of the time stamp of decoding, where the default value is based in, a longer period of the period required for screen erase and the period required to decode the graphic data; and the period required to write the graphic data on the screen.

 The presentation time stamp of a graphics storage package indicates the end time of the coding, and the time stamp of the presentation of the control information storage package 40 indicates the time obtained by adding a predetermined period to the time Completion of decoding. Therefore, referring only to the presentation time stamps, the controller can perform the update at a suitable timing without receiving from the processor any notification of termination of the decoding of the graphic data. If such an update is made, it becomes possible to ensure the update synchronized with the rate of representation of the moving image, regardless of the mode of implementation in the reproduction apparatus.

 As the connection of the narrowest controller-processor is made independently of the mode of implementation of the controller-processor, it becomes possible to maintain a degree of flexibility in device design, as well as to facilitate the manufacture of the apparatus at low cost.

Brief Description of the Drawings 50

FIG. 1 illustrates an example of using a recording medium in accordance with the present invention.

FIG. 2 illustrates a structure of a BD-ROM.

FIG. 3 is a diagram that schematically illustrates a structure of a video clip.

FIG. 4A illustrates a structure of a graph flow presentation.

FIG. 4B illustrates a PES packet obtained after the functional segments are converted. 55

FIG. 5 illustrates a logical structure that is formed from various kinds of functional segments.

FIG. 6 illustrates a relationship between the position of representation of a subtitle and an Epoch.

FIG. 7A illustrates the syntax for defining a Graphics Object in an Object Definition Segment (ODS).

FIG. 7B illustrates the syntax of a Palette Definition Segment (PDS). 5

FIG. 8A illustrates the syntax of a Window Definition Segment (WDS).

FIG. 8B illustrates the syntax of a Presentation Composition Segment (PCS).

FIG. 9 illustrates an example of a description of a Representation Set for subtitles.

FIG. 10 illustrates an example of a description of the WDS and the PCS in a DS1.

FIG. 11 illustrates an example of a description of the PCS in a DS2. 10

FIG. 12 illustrates an example of a description of the PCS in a DS3.

FIG. 13 is an example of a description of a Representation Set when a Cut-In / Out is performed, which is illustrated along a timeline.

FIG. 14 is an example of a description of a Representation Set when a Fading-In / Out is performed, which is illustrated along a timeline. fifteen

FIG. 15 is an example of a description of a Representation Set when the Offset is performed, which is illustrated along a timeline.

FIG. 16 is an example of a description of a Representation Set when an Erase-Entry / Exit is performed, which is illustrated along a timeline.

FIG. 17 is a diagram that compares two cases: a window that has four Graphics Objects, and a window that has two Graphics Objects.

FIG. 18 illustrates an example of an algorithm for calculating a decoding duration.

FIG. 19 is a flow chart of the algorithm of FIG. 18.

FIG. 20A and 20B are flow charts of the algorithm of FIG. 18.

FIG. 21A illustrates a case in which each window has an Object Definition Segment. 25

FIG. 21B and 21C are time diagrams showing the orders between the numbers referred to in FIG. 18.

FIG. 22A illustrates a case in which each window has two Object Definition Segments.

FIG. 22B and 22C are time diagrams showing the orders between the numbers referred to in FIG. 18. 30

FIG. 23A describes a case in which each of the two windows includes an ODS.

FIG. 23B illustrates a case in which a decoding period (2) is longer than the total erase period (1) and a writing period (31).

FIG. 23C illustrates a case in which the total erase period (1) and the writing period (31) is longer than the decoding period (2). 35

FIG. 24 illustrates the chronological transition of the update described in an example herein.

FIG. 25A illustrates four Representation Sets that are described so that they perform the update explained above.

FIG. 25B is a time chart showing the establishments of the DTS and PTS of the functional segments 40 included in the four Representation Sets.

FIG. 26 illustrates an internal structure of a reproduction apparatus according to the present invention.

FIG. 27 illustrates the sizes of the write rates Rx, Rc, and Rd, the Graphics Plane 8, the Coded Data Intermediate Memory 13, the Object Intermediate Memory 15, and the Composition Intermediate Memory 16.

FIG. 28 is a timing diagram illustrating a parallel processing (pipeline) by the reproduction apparatus. 5

FIG. 29 illustrates a timing diagram in a parallel processing of a case in which the decoding of the ODS ends before the erasing of the Graphics Plane is completed.

FIG. 30 is a timing diagram showing the chronological transition of the amount of accumulation in the Graphics Plane 8.

FIG. 31 is a flow chart illustrating a process of loading operation of a functional segment. 10

FIG. 32 shows an example of multiplexing.

FIG. 33 illustrates a way in which a DS 10 is loaded into the Coded Data Intermediate Memory 13 of the playback apparatus.

FIG. 34 illustrates a case in which normal reproduction is performed.

FIG. 35 illustrates the loading of a DS1, the DS10, and a DS20 in normal reproduction as performed in FIG. 3. 4.

FIG. 36 is a flow chart showing a process performed by the Graphics Controller 17.

FIG. 37 is a flow chart showing a process performed by the Graphics Controller 17.

FIG. 38 is a flow chart showing a process performed by the Graphics Controller 17.

FIG. 39 illustrates a parallel process of a reproduction apparatus based on the PDS PTS. twenty

FIG. 40 is a diagram describing a meaning of the END in a parallel process of the reproduction apparatus.

FIG. 41 is a diagram schematically illustrating a structure of a video clip according to the second embodiment.

FIG. 42A and FIG. 42B are diagrams about an interactive screen according to the second embodiment.

FIG. 43 illustrates a data structure of the Interactive Composition Segment.

FIG. 44 shows the relationship between an ODS included in a DSn, and the ICS.

FIG. 45 shows a screen composition in the representation timing of the arbitrary "pt1" image data. 30

FIG. 46 shows an example of setting for the button information in the ICS.

FIG. 47 illustrates a state transition from button A - button D.

 FIG. 48 illustrates the images of SDGs 11, 21, 31 and 41 as an example.

FIG. 49 illustrates images of SDGs 11-19 for button A, as an example.

FIG. 50 illustrates the status-button groups and the order of the SDGs in the Representation Set. 35

FIG. 51 illustrates a state transition of the interactive screen in which the button-state groups of FIG are arranged. fifty

FIG. 52 illustrates the order of the SDGs in the Representation Set.

FIG. 53 shows the difference in the provision of the SDGs in the S-SDGs, between the case of default_selected_button_number = 0, and the case of default_selected_button_number = button B. 40

FIG. 54A and 54B show a value of ΣSIZE (DSn [ICS.BOTON [i]]), in a case where the N-ODS include a plurality of ODS constituting the AD buttons, and the S-ODS include a plurality of ODS that constitute the AD buttons.

FIG. 55 shows a timing of a synchronized representation via the ICS.

FIG. 56 shows how the DTS and PTS are set in a case where the initial representation of an interactive screen is constituted by a plurality of ODS, and where the default_selected_select_ button is valid.

FIG. 57 shows how the DTS and PTS are set in a case where the initial representation of an interactive screen is constituted by a plurality of ODS, and where the default_selected_default_button is invalid. 5

FIG. 58 illustrates the contents of an Object Buffer 15 compared to the Graphics Plane 8.

FIG. 59 illustrates an operation performed by the Graphics controller 17 at the time of initial representation.

FIG. 60 illustrates an operation performed by the Graphics Controller 17 when updating 10 of the interactive screen is performed in accordance with the First User Action (Move Right).

FIG. 61 illustrates an operation performed by the Graphics Controller 17 when the interactive screen update is performed in accordance with the First User Action (Move Down).

FIG. 62 illustrates an operation performed by the Graphics Controller 17 when the interactive screen update is performed in accordance with the First User Action (On). fifteen

FIG. 63 is a timing diagram illustrating a parallel processing performed by the reproductive apparatus.

FIG. 64 is a timing diagram illustrating a parallel processing performed by the playback apparatus in a case where the default selected button changes dynamically.

FIG. 65 is a timing diagram illustrating the chronological transitions in the occupation of the Plane of 20 Graphs 8, the Object Intermediate Memory 15, the Coded Data Intermediate Memory 13, and the Composition Intermediate Memory 16.

FIG. 66 is a flow chart showing a process of the loading operation of a Segment.

FIG. 67 shows an example of multiplexing.

FIG. 68 illustrates a way in which a DS10 is loaded to the Coded Data Intermediate Memory 13 of the playback apparatus.

FIG. 69 illustrates a case in which normal reproduction is performed.

FIG. 70 illustrates the loading of a DS1, the DS10, and a DS20 in normal reproduction as performed in FIG. 69.

FIG. 71 is a flow chart illustrating a main processing routine performed by the Graphics Controller 17.

FIG. 72 is a flow chart illustrating a processing to perform the synchronism control using the time stamp.

FIG. 73 is a flow chart that shows a process of an operation to write to Graph Plane 8. 35

FIG. 74 is a flow chart illustrating an automatic activation processing for the button selected by default.

FIG 75 is a flow chart showing an animation representation process.

FIG. 76 is a flow chart illustrating a process of a UO operation.

FIG. 77 is a flow chart illustrating a process of the current button change operation. 40

FIG. 78 is a flow chart illustrating a process of the input operation of a numerical value.

FIG. 79 illustrates a method of manufacturing a BD-ROM that records the PCS explained in the first embodiment.

FIG. 80 illustrates a method of manufacturing a BD-ROM that records the PCS explained in the second embodiment. Four. Five

Best Way to Perform the Invention

(First Realization)

 Next, a First Embodiment of a recording medium according to the present invention is explained.

 FIG. 1 illustrates an example of using a recording medium. In the drawing, the BD-ROM is the recording medium according to the present invention. The BD-ROM 100 is used to provide movie play data to a Home Theater System structured by a playback apparatus 200, a television 300 and a remote controller 400.

 The recording medium according to the present invention is manufactured by an improvement in the application layer of a BD-ROM. FIG. 2 illustrates a structure of the BD-ROM. 10

 In the drawing, the BD-ROM is shown at the bottom of the drawing, and a clue is shown on the BD-ROM above the BD-ROM. The track really has a spiral shape on the disk, but it is shown as a line in the drawing. The track includes an entry guide area, a volume area and an exit guide area. The volume area in this drawing has a physical layer, a file system layer and an application layer. At the top of the drawing, a BD-ROM application format that uses a directory structure is illustrated. As illustrated in the drawing, the BD-ROM has a BDMV directory under the root directory, and the BDMV directory contains a file to store a Videoclip with an extension M2TS (XXX.M2TS), a file to store administrative information for the Video clip with a CPLI extension (XXX.CLPI), and a file to define a Logical Play List (PL) for the video clip with an MPLS extension (YYY.MPLS). By forming the above application format, it is possible to manufacture the recording medium according to the present invention. In a case where there is more than 20 files for each class, it is preferable to provide three directories called STREAM, CLPINF and PLAYLIST under the BDMV to store the files with the same extension in a directory. Specifically, it is desirable to store the files with the M2TS extension in STREAM, the files with the CLPI extension in CLIPINF, and the files with the MPLS extension in PLAYLIST.

 Below is an explanation about the Videoclip (XXX.M2TS) in the format of the previous application. 25

 The Videoclip (XXX.M2TS) is a digital stream in MPEG-TS format (TS is the Transport Stream) obtained by multiplexing a video stream, at least one audio stream, and a presentation graphics stream. The video stream represents the movie images, the audio stream represents the movie sound, and the presentation graphics stream represents the movie subtitles. FIG. 3 is a diagram that schematically illustrates a structure of the Videoclip. 30

  The Videoclip (XXX.M2TS) is structured as follows. The video stream composed of a plurality of video frames (image pj1, pj2 and pj3), and the audio stream composed of a plurality of audio frames (the top row of the drawing) are respectively converted into a line of PES packets (second row of the drawing), and then in a line of TS packages (third row of the drawing). The flow of presentation graphics (bottom row of the drawing) becomes a line of PES packages (second row at the bottom of the drawing) and then a line of TS packages (third row at the bottom of the drawing). The three lines of the TS packets are multiplexed, and then the Videoclip (XXX.M2TS) is constituted.

 In the drawing, only one flow of presentation graphics is multiplexed. However, in a case where the BD-ROM is compatible with a plurality of languages, a flow of presentation graphics for each language is multiplexed to constitute the Videoclip. The Videoclip constituted in the previous way is divided into more than one extension, 40 in the same way as ordinary computer files, and they are stored in areas in the BD-ROM.

 The flow of presentation graphics is explained below. FIG. 4A illustrates a structure of the presentation graphics flow. The top row indicates the line of TS packets to multiplex in the Video Clip. The second row at the top indicates the line of PES packets that constitutes a graphic flow. The PES packet line is structured by recovering data loads from TS packets that have a predetermined PID, and connecting the recovered data loads.

 The third row at the top indicates the structure of the graphics flow. The graphics flow is composed of functional segments called Presentation Composition Segments (PCS), a Window Definition Segment (WDS), a Palette Definition Segment (PDS), an Object Definition Segment (ODS) and a END of the Representation Set Segment (FIN). Among the previous functional segments, the PCS is called a 50 screen composition segment, and the WDS, PDS, ODS, and FIN are called definition segments. The PES package and each of the functional segments correspond one by one, or one to a plurality. In other words, a functional segment is any one recorded on the BD-ROM after converted into a PES package, or after divided into fragments and converted into more than one PES package.

 FIG. 4B illustrates a PES package obtained by the conversion of functional segments. As shown in the drawing, the PES package is composed of a header of the package and the data load, and the data load is a

substantial body of the functional segment. The header of the package includes a DTS and a PTS that correspond to the functional segment. The DTS and the PTS included in the package header are hereinafter referred to as the DTS and the PTS of the functional segment.

 The various classes of functional segments described above constitute a logical structure as illustrated in FIG. 5. FIG. 5 illustrates the logical structure that is composed of various kinds of functional segments. In the drawing, the top row illustrates the Epochs, the middle row illustrates the Representation Sets (DS), and the bottom row illustrates the functional segments.

 Each of the DS shown in the middle row is a group of functional segments that make up graphics for a screen, among all the plurality of functional segments that constitute the flow of graphics. The dashed lines in the drawing indicate the DS to which the functional segments in the bottom row belong, and show that a series of functional segments of PCS, WDS, PDS, ODS and FIN constitute a DS. The reproduction apparatus is capable of generating graphics for a screen by reading the functional segments that constitute the DS.

 The Times shown in the top row indicate periods of time, and the memory management is consecutive in the direction of time along the timeline of the Videoclip playback in an Epoch. An Epoch also represents a group of data that is assigned to the same period of time. The memory referred to in 15 this point is the Graphics Plane that stores the graphics for a screen, and an Object Buffer that stores the decompressed graphic data. The continuity of the memory management means means that there is no flash of the Graphics Plane or of the Object Intermediate Memory at the time, and the deletion and representation of the graphics is only done in a predetermined rectangular area on the Plane Graphics (the flash at this point indicates the deletion of all the contents of the data stored in a plane or a buffer 20). The size and position of the rectangular area are fixed during a Time. As long as the deletion and representation of the graphics are only carried out in the predetermined rectangular area on the Graphics Plane, synchronous reproduction between the image and the graphics is assured. In other words, the Epoch is a unit in the reproduction timeline, and in this unit, it is guaranteed that the image and graphics are reproduced synchronously. When the area is moved, in which the graphics are deleted and represented, to a different position, it is necessary to define a point on the timeline to move the area, and a period after the point becomes a new Epoch . Synchronous reproduction is not guaranteed in a boundary between two Epochs.

 Watching a real movie, an Epoch is a period of time in which subtitles are represented in the same rectangular area on the screen. FIG. 6 illustrates a relationship between the position of the subtitles and the Times. In an example illustrated by the drawing, the positions in which the five subtitles "Really ...", "I was hiding", "my feelings", "I always", and "I loved you" are shown in motion according to The image in the movie. Especially the subtitles "Really ...", "I was hidden" and "my feelings" appear at the bottom of the screen, while the subtitles "I always" and "I loved you" are shown at the top of the screen. The position of the rectangular area moves so that the subtitles are out of the way of the images when viewed on the screen, considering the visibility of the film. The period of time during which the 35 subtitles appear at the bottom is Period 1, and the period of time after which the subtitles appear at the top is Period 2. Epochs 1 and 2 each have a different area in which subtitles are represented. The area in Epoch 1 is Window 1 positioned at the bottom of the screen, and the area in Epoch 2 is Window 2 positioned at the top of the screen. Memory management is consecutive in each of Times 1 and 2, and therefore the representation of the subtitles in Windows 1 and 2 is synchronous 40 with the images.

 Details of the Representation Set (DS) are described below.

 The dashed lines hkl1 and hkl2 in FIG. 5 indicate which functional segment in the middle row belongs to which Period. A series of DS "Beginning of Time", the "Acquisition Point", and the "Normal Case" constitute the top row. The "Beginning of Epoch", the "Acquisition Point", the "Normal Case", and the "Continuous Epoch" are types of DS, and the order between the "Acquisition Point" and the "Normal Case" does not matter and any of them can go first.

 The Beginning of Epoch is a DS that has a "new representation" representation effect, which indicates the beginning of a new Epoch. Because of this, the Beginning of Epoch contains all the functional segments necessary to represent a new screen composition. The beginning of Epoch is provided in a position that is an object of a Videoclip jump operation, such as a chapter in a movie. fifty

 The Acquisition Point is a DS that has a "refreshment" representation effect and is identical in the content used for the representation of graphics with the Beginning of Time which is an earlier DS. The Acquisition Point is not provided as a starting point of the Epoch, but it contains all the functional segments necessary to represent the new screen composition. Therefore it is possible to represent the graphics without failure when performing a jump operation to the Acquisition Point. Therefore, with the Acquisition Point, it is possible to compose a screen in the middle of the Epoch.

 The Acquisition point is provided in a position that could be an objective for the jump operation. An example of such a position is a position that could be specified when performing a time search. The

Time search is an operation in response to the user's input of the time for the start of playback from a point of reproduction corresponding to the time specified by the user. The time is specified approximately, for 10 minutes or for 10 seconds for example, and therefore the points at which playback begins are provided in a 10 minute interval, or a 10 second interval, for example. By providing the Acquisition Point at the points where reproduction can begin, it is possible to perform the reproduction smoothly after the time search.

 The Normal Case is a DS that has a "rendering update" representation effect, and contains only elements that are different from the previous screen composition. Specifically, when the subtitles in a DSv are the same as the subtitles in a DSu but the screen is represented differently in the DSv and the DSu, the DSv is provided so that it includes only the PCS and makes the DSv the Normal Case . Therefore, it is unnecessary to provide an ODS with the same content as the content of the ODS in the preceding DS, and the size of the data in the BD-ROM can be reduced. On the contrary, because the DS as the Normal Case only contains the difference, it is not possible to compose the screen using only the Normal Case.

 The Continuous Epoch indicates that the Epoch continues through a Videoclips border. If the Composition Status of a DSn is set as Continuous Time, if the DSn exists on a Video clip different from that of, the DSn-1 15 positioned immediately before the DSn, the DSn and DSn-1 will belong to the same Period. Therefore even if the video clip fork occurs between two DSs, there will be no graphics plane flash / object buffer.

 Details of the Definition Segments (ODS, WDS, and PDS) are explained below. The Object Definition Segment (ODS) is a functional segment that defines the Graphics Object. First, an explanation of the Graphics Object is given. A sales incentive for the Videoclip recorded on the BD-ROM is its resolution as high as the high definition, and therefore the resolution for the Graphic Object is set at 1920x1080 image points. Due to the high resolution of 1920x1080 image points, it is possible to represent a specific character style for subtitles clearly on the screen. As for subtitle colors, the bit length of an index value for each of the image points (Red Cr Color Difference, Cb Blue Color Difference, Y Luminance, and 25 T Transparency) is 8 bits, and in this way it is possible to choose any 256 colors of the total range of colors (16,777,216 colors) for the subtitles. Subtitles made by the Graphics Object are represented by positioning the texts on a transparent background.

 The ODS syntax for defining the Graphics Object is shown in FIG. 7A. The SDG is composed of the segment_type that indicates that the segment is the SDG, the segment_length that indicates the SDG data length, the 30 object_id that uniquely identifies the Graphics Object corresponding to the SDG at the time, the item_version number that indicates a ODS version within the Epoch, the last_sequence_index and the object_data_ fragment that is a consecutive sequence of bytes that correspond to a part or all of the Graphics Object.

 The object_id is for the unique identification of the Graphics Object corresponding to the SDG at the time. The Time of the graphics flow contains more than one ODS that have the same ID. SDGs that have the same ID also have the same width and height, and are assigned with a common area in the Object Buffer. After one of the ODS having the same ID in the common area is read, the read ODS is overwritten by a subsequent ODS that has the same ID. By overwriting the ODS that is read for the Object Buffer by the subsequent ODS that has the same ID as the video stream continues to play, the graphics by the ODS 40 are updated accordingly. The size restriction that the width and height of the Graphic Objects that have the same ID should be the same applies only during a Time, and the Graphic Objects at different Times may have different sizes.

 The explanations about the last_sequence_segment and the object_data_ fragment are given below. In some cases, it is not possible to store the decompressed graphics that constitute the subtitle in an ODS due to the restriction of the data load of the PES packets. In such cases, the graphics are divided into a series of constituent fragments, and a fragment is fixed to the object_data_ fragment. When a Graphics Object is stored as more than one fragment, each fragment except the last fragment has the same size. The last fragment is less than or equal to the size of the previous fragments. The ODS that transports the fragments appears in the same sequential order in the DS, with an end of the sequence indicated by the ODS that 50 has the last_sequence_sequence indicator. Although the ODS syntax described above is based on the premise that the fragments are stored from the preceding PES, the fragments may be stored so that each of the PES contains a blank part.

 The Palette Definition Segment (PDS) is explained below. The PDS is used to define a palette for a color conversion. FIG. 7B shows the syntax of the PDS. The PDS is composed of a segment_type that indicates that the segment is the PDS, a segment_length that indicates the data length of the PDS, a pallet_id that uniquely identifies the palette contained in the PDS, the pallet_version number that indicates a version of the PDS within the Epoch, and the palette_entry_id that specifies a palette entry number. The palette_entry_ID indicates the Red Color Difference (Cr_value), the Blue Color Difference (Cb_value), the Luminance (Y_value), and the Transparency (T_value). 60

 An explanation is given below about the Window Definition Segment (WDS).

 The WDS is used to define the rectangular area on the Graphics Plane. As described above, memory management is sequential only when deletion and representation is performed within a certain area on the Graphics Plane. The area on the Graphics Plane is defined by the WDS and is called "Window". FIG. 8A illustrates the syntax of the WDS. As shown by the drawings, the WDS is composed of the segment_type that indicates that the segment is the WDS, the segment_length that indicates the data length of the WDS, the window_id that uniquely identifies the Window on the Graphics Plane, the window_horizontal_position that specifies the horizontal direction of the image point in the upper left of the Window in the Graphics Plane, the vertical_window_ position that specifies a vertical direction of the image point in the upper left of the Window on the Graphics Plane, the window_width that specifies a width of the Window on the 10 Graphics Plane, and the window_ height that specifies a Window height on the Graphics Plane.

 The ranges of values that can take the window_horizontal_position, the window_vertical_position, the window_width, and the window_ height are explained below. A coordinate system for these values is within an area on the Graphics Plane, and whose size is indicated in two dimensions by the height_window for the height and the width_window for the width. fifteen

 The window_horizontal_position specifies the horizontal direction of the upper left image point of the Window on the Graphics Plane, and is within a range of 0 to (window_width) - 1. Also, the window_vertical_position specifies the vertical direction of the upper left image point of the Window on the Graphics Plane, and is within a range of 0 to (window_height) - 1.

 The window_width specifies the width of the window on the Graphics Plane. The specified width falls 20 within the range of 1 to (video_width) - (window_horizontal_position). In addition, the window_ height specifies the height of the Window above the Graphics Plane, and the specified height is within a range of 1 to (video_ height) - (window_vertical_position).

 The position and size of the Window on the Graphics Plane for each Period are defined by the window_horizontal_position, the window_vertical_position, the window_width, and the window_height. Therefore, it is possible to adjust the position and size of the Window in editing, so that the Window in a Time appears in the position that does not fall in the path of the image when the movie is being watched. Therefore, the visibility of the subtitles becomes greater. As the WDS is defined for each of the Epochs, it is possible to adjust the position of the Window according to the image, even if the image changes over time. As a result, the quality of the film remains as high as in the case that subtitles are incorporated into the main body of the film.

 Next, the End of the Representation Set Segment is explained. The FIN provides an indication that the DS transmission was completed. The End is inserted into a stream immediately after the last SDG in a DS. The End consists of the segment_type that indicates that the segment is the END and the segment_length that indicates a data length of the END. The END does not include any other element that requires an additional explanation. 35

 An explanation is given below about the Presentation Composition Segment (PCS).

 The PCS is a functional segment that is used to compose an interactive representation. FIG. 8B illustrates the syntax of the PCS. As shown in the drawing, the PCS is composed of segment_type, segment_length, composition_number, composition_state, palette_Update_indicator, palette_id, and 1-m_composition object.

 The composition_number identifies the Graphics Update in the DS by values in a range of 0 to 15. If the Graphics Update exists between the Time header and the PCS, the composition_number is incremented each time the Graphics Update occurs. .

 The composition_state indicates the type of DS in which the PCS is contained, the Normal Case, the Acquisition Point or the Beginning of Time.

 The palette_Update_ indicator indicates that the PCS describes a Representation Update of only 45 Palette. The Palette Only Representation Update indicates that only the palette is updated from an immediately previous palette. The field of the palette_Update_ indicator is set to "1" if the Palette Only Representation Update is performed.

 The palette_id identifies the palette to be used in the Palette Only Representation Update.

 The 1-m_composition object indicates how to control each of the Windows in the DS to which the PCS belongs. 50 The dashed line wd1 in FIG. 8B is to detail an internal syntax for the composition_ object i. Composition_ object i is composed of the object_id, the window_id, the captured_object_ indicator, the object_horizontal_position, the object_vertical_position, and the rectangle_capture 1-n information.

 The object_id identifies the ODS in a Window corresponding to the composition_ object i.

 The window_id identifies the Window to which the Graphics Object is assigned in the PCS. Up to two Graphics Objects can be assigned to a Window.

 The captured_object_ indicator is used to switch between the representation and non-representation of a Graphics Object captured in the Object Buffer. When the captured_object_object is set to "1", the captured Graphics Object is represented in the Object Buffer, and if it is set to "0", the Graphics Object 5 is not represented.

 The horizontal_object_position specifies a horizontal direction of a top-left image point of the Graphics Object in the Graphics Plane.

 The object_vertical_position specifies a vertical direction of a top left image point of the Graphics Object in the Graphics Plane. 10

 The 1-n capture_rectangle information is the elements used when the captured_object_object is set to "1". The dashed line wd2 is to detail an internal syntax for the information rectangle_capture i. As shown by the dashed line wd2, the information rectangle_capture is composed of four fields, horizontal_position_capture_objects, vertical_position_capture_objects, width_capture_objects and height_capture_objects. fifteen

 The horizontal_object_capture_position specifies the horizontal direction of the upper left corner of a capture rectangle to be used during the representation of the Graphics Object in the Graphics Plane. The capture rectangle is a capture frame that is used to specify and capture a part of the Graphics Object, and corresponds to the Region in the ETSI EN 300 743 standard.

 The vertical_capture_object_point specifies a vertical direction of the upper left corner of the capture rectangle to be used during the representation of the Graphical Objects in the Graphics Plane.

 The width_capture_objects specifies a width of the capture rectangle.

 The height_capture_objects specifies a height of the capture rectangle.

 A specific example of the PCS is detailed below. In the example, the subtitles "Really ...", "I was hiding" and "my feelings" as shown in FIG. 6 appear gradually writing on the 25 Graphics Plane 3 times as the image progresses. FIG. 9 is an example of a description for making such subtitle representation. An Epoch in the drawing includes a DS1 (Beginning of Epoch), a DS2 (Normal Case), and a DS3 (Normal Case). The DS1 contains a WDS to specify the Window in which the subtitles are represented, an ODS to specify the line "Really ... I was hiding my feelings.", And a first PCS. The DS2 contains a second PCS, and a DS3 contains a third PCS. 30

 Fig. 10-12 illustrate examples of WDS and PCS contained in the DS. FIG. 10 shows an example of the PCS in DS1.

 In FIG. 10, the window_horizontal_position and the WDS_vertebral_position of the WDS are indicated by an LP1, the position of the upper left image point of the Window on the Graphics Plane. The window_width and window_height indicate the width and height of the Window, respectively. 35

 In FIG. 10, the horizontal_object_capture_position and the vertical_capture_object_point indicate a reference point ST1 of the capture rectangle in the coordinate system at which the origin is at the upper left image point of the Graphics Object. The capture rectangle is an area that is the width from the ST to the width_capture_objects, and the height from the ST to the height_capture_objects (the rectangle shown by a thick line box). The captured Graphics Object is positioned within a rectangle shown by a box 40 of dashed line cp1, with a reference point in the coordinate system with an origin in the horizontal_object_point position and the vertical_object_point position (the upper left image point of the Graphics) in the Graphics Plane. Therefore, the subtitle "Really ..." is written in the window on the Graphics Plane, and then combined with the moving image and represented on the screen.

 FIG. 11 shows an example of PCS in DS2. The WDS in the DS2 is not explained, because the WDS in the DS2 45 is the same as the WDS in the DS1. The description of the capture information in the DS2 is different from the description of the capture information shown in FIG. 10

 In FIG. 11, the horizontal_object_capture_position and the vertical_capture_object_point in the capture information indicate the upper left image point of the subtitle "I was hiding" from "Really ... I was hiding my feelings" in the Object Intermediate Memory. The width_capture_object and the height_capture_object 50 indicate a width and height of a rectangle that contains the subtitle "I was hiding". Therefore, the subtitle "I was hiding" is written in the Window on the Graphics Plane, and then combined with the moving image and displayed on the screen.

 FIG. 12 shows an example of PCS in DS3. The WDS in the DS3 is not explained because the WDS in the DS3

It is the same as the WDS in DS1. The description of the capture information in the DS3 is different from the description of the capture information shown in FIG. 10.

 In FIG. 12, the horizontal_object_capture_position and the vertical_capture_object_position in the capture information indicate a left upper image point of the subtitle "my feelings" of "Really ... I was hiding my feelings." in the Object Buffer. The width_capture_object and the height_capture_object 5 indicate a width and height of a rectangle that contains the subtitle "my feelings". Therefore, the subtitle "my feelings" is written in the Window on the Graphics Plane, and then it is combined with the moving image and represented on the screen.

 By describing DS1, DS2 and DS3 as explained above, it is possible to achieve a subtitle representation effect on the screen. It is also possible to achieve other kinds of effects, and the 10 description protocols for performing other effects are explained below.

 First, a description protocol for the Cut-In / Out effect is explained. FIG. 13 shows an example of the description of the DS when a Cut-In / Out is performed, illustrated along the timeline.

 In the drawing, x and y in the Window (x, y, u, v) indicate respectively the values of the vertical_window_position 15 and the_horizontal_window_ position, and u and v respectively indicate the values of window_width and window_height. Also in the drawing, a and b in the Capture Rectangle (a, b, c, d) respectively indicate values of the vertical_point_capture_objects and the horizontal_point_capture_objects position and c and d indicate values of the width_object_capture and the_capture_objects, respectively. Representation Sets DS11, DS12 and DS13 are at points t11, t12 and t13 on the reproduction timeline in the drawing. twenty

 The DS11 at point t11 includes a PCS Nº0 in which the state_composition is "Start of Time" and the indicator_captured_object is "0" (no_rectangle_visible_capture), a WDS Nº0 that has a declaration for a window in a width of 700 x height 500 in (100, 100) in the Graphics Plane, a PDS Nº0 and an SDG Nº0 indicating a subtitle "Credits:" and an END.

 The DS12 at point t12 includes a PCS Nº1 whose composition_state is the "Normal_Case" and which indicates a capture operation of the Graphics Object that will be in a size of 600x400 from (0,0) in the Object Intermediate Memory (rectangle_capture Nº0 (0, 0, 600, 400) and that positions the Graphics Object captured in the coordinates (0,0) in the Graphics Plane (on the window Nº0 (0, 0)).

 The DS13 at point t13 includes a PCS Nº2 whose composition_state is the "Normal_Case" and in which the captured_object_indicator is set to "0" so that it deletes the captured Graphics Object 30 (no_visible_capture_card).

 With the Representation Sets explained above, the subtitle "Credits:" is not represented in t11, appears in t12, then becomes unrepresentable in t13 again, and the Cut-In / Out effect is performed.

 Secondly, a description protocol is explained for a Fade-In / Out effect. 35 FIG. 14 shows an example of the description of the DS when the Fading-In / Out is performed, which is illustrated along the timeline. Representation sets DS21, DS22, DS23 and DS24 are at points t21, t22, t23, and t24 on the reproduction timeline in the drawing.

 The DS21 at point t21 includes a PCS Nº0 whose composition_state is "Start_Each" and which indicates the capture operation of the Graphics Object to be located in a size of 600x400 from (0, 0) in the Object Buffer 40 (rectangle_capture No.0 (0, 0, 600, 400)), and that positions the Graphics Object captured at the coordinates (0, 0) in the Graphics Plane (on Window Nº0 (0, 0)), a WDS Nº0 that has a declaration of a Window with a width 700 X height 500 in (100, 100) in the Graphics Plane, a PDS Nº0, an SDG Nº0 indicating a subtitle "End", and an END.

 DS22 at point t22 includes a PCS No. 1, whose composition_state is "Normal Case) and a PDS No. 1. 45 PDS No. 1 indicates the same level of Cr and Cb as PDS No. 0, but the luminance indicated by PDS No. 1 is greater that luminance in PDS Nº0.

 The DS23 at point t23 includes a PCS Nº2, whose composition_state is the "Normal Case", a PDS Nº2 and an END. PDS No. 2 indicates the same level of Cr and Cb as PDS No. 1, but the luminance indicated by PDS No. 2 is less than the luminance in PDS No. 1. fifty

 The DS24 at point t24 includes a PCS whose composition_state is "Normal Case" and the captured_object_object is at "0" (no_visible_capture_rectangle) and an END.

 Each of the DS specifies a different PDS from the previous DS, and therefore, the luminance of the Graphics Object that is represented with more than one PCS at a Time becomes gradually high, or low. For this, it is

possible to effect the Fading In / Out.

 Next, a description of a protocol for Displacement is explained. FIG. 15 shows an example of the description of the DS when the Displacement is carried out, illustrating itself along the timeline. Representation Sets DS31, DS32, DS33, and DS34 are at points t31, t32, t33, and t34 on the playing timeline in the drawing. 5

 The DS31 at point t31 includes a PCS Nº0 whose composition_state is set to "Start of Time" and the captured_object_ indicator is at "0" (no_visible_capture_rectangle), a WDS Nº0 that has a declaration for a Window in a width of 700 x a height 500 in (100, 100) in the Graphics Plane, a PDS Nº0, an ODS Nº0 indicating a subtitle "Credits: Company", and an END.

The DS32 at point t32 includes a PCS Nº1 whose composition_state is the "Normal_Case" and which indicates the capture operation of the Graphics Object to be placed in a size of 600x400 from (0, 0) in the Object Intermediate Memory (rectangle_capture Nº0 (0,0,600,400)) and positioning the Graphics Object captured at the coordinates (0, 0) in the Graphics Plane (on Window Nº0 (0, 0)). An area of size 600x400 from (0, 0) in the Object Buffer includes the "Credits:" part of the subtitle "Credits: Company" shown in two lines, and thus the "Credits:" part appears on the Plan of Graphics. fifteen

 The DS33 at point t33 includes a PCS Nº2 whose composition_state is the "Normal Case" and which indicates that the capture operation of the Graphics Object to be placed in a size of 600x400 from (0, 100) in the Object Intermediate Memory ( capture rectangle Nº0 (0, 100, 600, 400)), and positioning the captured Graphics Object at the coordinates (0, 0) in the Graphics Plane (on Window Nº0 (0,0)). The 600x400 size area from (0, 100) in the Object Buffers includes the "Credits:" part and the "Company" part of the subtitle "Credits: Company" 20 shown in two lines, and thus the parts " Credits: "and" Company "appear in two lines on the Graphics Plane.

 The DS34 at point t34 includes a PCS Nº3 whose composition_state is the "Normal Case" and which indicates that the operation of capturing the Graphics Object to be placed in a size of 600x400 from (0, 200) in the Object Intermediate Memory ( capture rectangle Nº0 (0, 200, 600, 400)), and positioning the captured Graphics Object in the 25 coordinates (0, 0) in the Graphics Plane (on Window Nº0 (0,0)). The 600x400 size area from (0, 200) in the Object Buffer includes the "Company" part of the subtitle "Credits: Company" shown on two lines, and thus the "Company" part appears on the Graphics Plane . From the previous description of the PCS, it is possible to scroll down the subtitle in two lines.

 Finally, a description of the protocol for the Delete-Entry / Exit effect is explained. FIG. 16 30 shows an example of the description of the DS when the Erase-Entry / Exit is performed, illustrated along a timeline. Display Sets DS21, DS22, DS23 and DS24 are at points t21, t22, t23, and t24 on the playing timeline in the drawing.

 The DS51 at point t51 includes a PCS Nº0 whose composition_state is set to "Start of Time" and the captured_object_operator is at "0" (no_visible_capture_frame), a WDS Nº0 that has a declaration for a Window in a width of 700 x a height of 500 in (100, 100) in the Graphics Plane, a PDS Nº0, an ODS Nº0 indicating a subtitle "End", and an END.

 The DS52 at point t52 includes a PCS Nº1 whose composition_state is the "Normal Case" and which indicates the capture operation of the Graphics Object to be placed in a size of 600x400 from (0, 0) in the Object Intermediate Memory (rectangle_capture Nº0 (0,0,600,400)) and positioning the Graphics Object captured at coordinates 40 (0, 0) in the Graphics Plane (on Window Nº0 (0, 0)). An area of size 600x400 from (0, 0) in the Object Buffer includes the subtitle "End" and thus the subtitle "End" appears on the Graphics Plane.

 The DS53 at point t53 includes a PCS Nº2 whose composition_state is the "Normal Case" and which indicates the capture operation of the Graphics Object to be placed in a size of 400x400 from (200, 0) in the Object Intermediate Memory (rectangle_capture Nº0 (200,0,400,400)) and positioning the Graphics Object captured in the 45 coordinates (200, 0) in the Graphics Plane (on Window Nº0 (200, 0)). Therefore, an area indicated by the coordinates (200, 0) and (400, 400) in the Window becomes a representation area, and an area indicated by the coordinates (0, 0) and (199, 400) is It becomes an area of non-representation.

 The DS54 at point t54 includes a PCS Nº3 whose composition_state is the "Normal Case" and which indicates the operation of capturing the Graphics Object to be placed in a size of 200x400 from (400, 0) in the Object Buffer 50 ( rectangle_capture Nº0 (400,0,200,400)) and positioning the Graphics Object captured at the coordinates (400, 0) in the Graphics Plane (on Window Nº0 (400, 0)). Therefore, an area indicated by the coordinates (0, 0) and (399, 400) becomes a non-representation area

 Therefore, as the non-representation area becomes larger, the representation area becomes smaller, and in this way the Delete-Entry / Exit effect is performed. 55

 As described above, various effects such as Cut-In / Out can be performed,

Fading-Entry / Exit, Erase-Entry / Exit and Offset using the corresponding source codes, and therefore it is possible to make various arrangements in the presentation of subtitles.

 The restrictions for the realization of the above effects are as follows. To perform the Scroll effect, the erase and redraw operations of the Window are necessary. Taking the example of FIG. 15, it is necessary to "delete window" to delete the Graphics Object "Credits:" in t32 of the 5 Graphics Plane, and then perform a "redraw window" to write the lower part of "Credits:" and the upper part of "Company" for the Graphics Plane during an interval between t32 and t33. Since the interval is the same as the interval of the video frames, the transfer rate between the Object Buffer and the desirable Graphics Plane for the Shift effect becomes an important point.

 At this point, there is a restriction on how large the Window can be. The Rc is the transfer rate between the Object Intermediate Memory and the Graphics Plane. The worst case scenario at this point is to erase both the Window and redraw the Window at the Rc rate. In this case, each of the tasks of deleting Window and redrawing Window is required to be performed at a half rate of Rc (Rc / 2).

 To erase Window and redraw Window in synchronization with the video frame, it is necessary to satisfy the following equation. fifteen

Window Size x Frame Rate = Rc / 2

 If the Frame Rate is 29.97, Rc is expressed by the following equation:

Rc = Window Size x 2 x 29.97

 In subtitle representation, the Window size represents at least 25% to 33% of the Graphics Plane. The total number of image points in the Graphics Plane is 1920 x 1080. Taking an index bit length 20 per image point of 8 bits, the total capacity of the Graphics Plane is 2 Mbytes (= 1920x1080x8).

 Taking a Window size of ¼ of the total capacity of the Graphics Plane, the Window size is 500 Kbytes (= 2 Mbytes / 4). Substituting this value in the previous equation, Rc is calculated to be 256 Mbps (500 kbytesx2x29.97). If the rate to erase Window and Redraw Window can be half or a quarter of the frame rate, it is possible to double or quadruple the size of the Window even if the Rc is the same. 25

 By maintaining the size of the Window from 25% to 33% of the Graphics Plane and representing the subtitles at the transfer rate of 256 Mbps, it is possible to maintain the synchronized representation between the graphics and the moving image, regardless of the effect class of screen to perform.

 The position, size and area of the Window are explained below. As explained above, the position and area of the Window do not change in a Time. The position and size of the Window are set to be the same during a Time because it is necessary to change an objective writing direction of the Graphics Plane if the position and size change, and changing the direction causes a control header that lower the transfer rate from the Object Buffer to the Graphics Plane.

 The number of Graphics Objects per Window has a limitation. The number limitation is provided to reduce the control headers in the transfer of Decoded Graphics Objects. The control header 35 at this point is generated when the direction of an edge of the Graphics Object is set, and the larger the number of edges, the more control headers are generated.

 FIG. 17 shows examples in comparison, an example in which a Window has four Graphics Objects and another example in which a Window has two Graphics Objects. The number of edges of the example with four Graphics Objects is twice the number of edges of the example with two Graphics Objects. 40

 Without the limitation on the number of Graphics Objects, it becomes unknown how many control headers could be generated in the transfer of the Graphics, and thus the load for the transfer increases and decreases dramatically. On the contrary, when the maximum number of Graphics Objects in a window is two, the transfer rate can be set taking into account up to 4 control headers. Therefore, it is easier to set the number of the minimum transfer rate. Four. Five

 Next, an explanation about how the DS that the PCS and the ODS have is assigned to the video clip's timeline. The Epoch is a period of time in which memory management is consecutive along the playing timeline. Since the Epoch is formed by more than one DS, it is important how to assign the DS to the video clip's timeline. The Videoclip playback timeline is a timeline for specifying the timings for decoding and playback of each of the elements of the 50 image data that constitute the multiplexed video stream for the Videoclip. The decoding and reproduction timings on the reproduction timeline are expressed with an accuracy of 90 KHz. A DTS and a PTS that are added to the PCS and ODS in the DS indicate timings for synchronization control over the playback timeline. The assignment of the Representation Set to the reproduction timeline means

performing synchronization control using the DTS and PTS added to the PCS and ODS.

 First, it is explained below how synchronism control is performed using the DTS and PTS added to the ODS.

 The DTS indicates, with the precision of 90 KHz, the moment at which the decoding of the ODS begins, and the PTS indicates the moment at which the decoding ends. 5

 The decoding of the ODS does not end immediately, and has a certain length of time. In response to the request to clearly indicate the start point and the end point of the decoding duration, the DTS and the PTS of the SDG respectively indicate the moments at which the decoding begins and ends.

 The value of the PTS indicates the termination point, and therefore it is necessary that the decoding of the ODS has been completed in the time indicated by the PTS and the decompressed Graphic Object is written in the Intermediate Memory 10 of Objects on the reproduction apparatus .

 The start time of the decoding of any ODSj in a DSn is indicated by a DTS (DSn [ODS]) with the accuracy of 90 KHz. Adding the maximum length of the decoding duration for the DTS (DSn [ODS]) is the time at which the decoding of the ODSj ends.

 When the size of ODSj is "SIZE (DSn [ODSj])" and the decoding rate of the SDGs is "Rd", the maximum time required for decoding indicated by seconds is expressed in "SIZE (DSn [ODSj]) // Rd. " The "//" symbol indicates an operator for a division with rounding up after a decimal place.

 By converting the maximum period of time into a number expressed with the precision of 90 KHz and adding it to the DTS of the ODSj, the instant is calculated when the decoding (90 KHz) indicated by the PTS ends.

 The PTS of the ODSj in the DSn is expressed in the following equation. twenty

PTS (DSn [ODSj]) =

DTS (DSn [ODSj]) + 90,000 (SIZE (DSn [ODSj]) // Rd)

Furthermore, it is necessary that the relationship between two successive SDGs, SDGs and SDGs + 1, satisfy the following equation.

PTS (DSn [ODSj]) ≤ DTS (DSn [ODSj + 1]) 25

Next, the establishments of the DTS and the PTS of the PCS are explained.

It is necessary that the PCS be loaded into the Object Buffer on the playback apparatus before the decoding start time (DTS (DSn [ODS1])) of a first ODS (ODS1) in the DSn, and before the instant (PTS (DSn [PDS1])) when the first PDS (PDS1) in the DSn becomes valid. Therefore, it is necessary that the DTS be set so as to satisfy the following equations. 30

 DTS (DSn [PCS]) ≤ DTS (DSn [ODS1])

 DTS (DSn [PCS]) ≤ PTS (DSn [PDS1])

In addition, the PCS PTS in the DSn is expressed in the following equation.

PTS (DSn [PCS]) ≥ DTS (DSn [PCS]) + decode_ duration

(DSn) 35

The "decoding_Duration (DSn)" indicates a duration for decoding all the Graphics Objects used for the PCS update. The decoding duration is not a fixed value, but does not vary according to the status of the playback device and the device or software mounted on the playback device. When the Object used to compose a screen of a DSn.PCn is a DSn.PCSn.OBJ [j], the decoding duration (DSn) is affected by the time (i) required to clear the Window, the decoding durations (ii) to decode a DSn.PCSn.OBJ, and the time (iii) needed to write about the DSn.PCSn.OBJ. When Rd and Rc are set, the decoding_duration (DSn) is always the same. Therefore, the PTS is calculated by calculating the lengths of these durations in the edition.

The calculation of the decoding_ duration is performed based on a program shown in FIG. 18. FIG. 19 and 20A and 20B are flow charts that schematically show program algorithms. An explanation about the calculation of the decoding_quality is given below referring to these drawings. In the flow chart shown in FIG. 19, first of all an INITIALIZE PLANE function is called (Step S1 in FIG. 19). The INITIALIZE PLANE function is used to call a function to calculate the period of time required to initialize the Graphics Plane to represent the DS. In Step S1 in FIG. 19, the function with the DSn arguments is called,

DSn.PCS.OBJ [0], and the decoding_duration.

The following explains the INITIALIZE FLAT function in reference to FIG. 20 A. In the drawing, the initialization_ duration is a variable that indicates a return value of the FLAT INITIALIZE function.

Step S2 in FIG. 20 is a statement for switching operations depending on whether the page_status in the PCS in the DSn indicates whether or not the Time Start. If the page_state indicates the Beginning of 5 Period (Dsn.PCS.status_page == start_time, Stage S2 = If in FIG. 18), the period of time required to clear the Graphics Plane is set to an initialization_stage (Stage S3) .

When the transfer rate Rc between the Object Buffer and the Graphics Plane is 256,000,000 as described above, and the total size of the Graphics Plane is set to width_video * height_video, the period of time required to erase is " video_width * video_height // 256,000,000 ". 10 When multiplying by 90,000 Hz so that the accuracy of the PTS time is expressed, the period of time required to erase the Graphics Plane is "90,000 x video_width * video_height // 256,000,000". This period of time is added to the initialization_ duration.

If the page_state does not indicate Start of Time (Stage S2 = No), the period of time required to clear the Window [i] defined by the WDS is added to the initialization_ duration for all Windows (Stage S4). When the Rc transfer rate between the Object Buffer and the Graphics Plane is 256,000,000 as described above and the total size of the Window [i] belonging to the WDS is ΣSIZE (WDS.WINDOW. [i]), the period of time required to erase is "ΣSIZE (WDS.WINDOW [i] // 256,000,000". When multiplied by 90,000 Hz so that it expresses the accuracy of the PTS time, the period of time necessary to delete the Window that belongs to the WDS is "90,000x ΣSIZE (WDS.WINDOW [i]) // 256,000,000". This period of time is added to 20 the initialization_ duration, and the initialization_ duration is returned as a result. It is the INITIALIZE FLAT function.

Step S5 in FIG. 19 is for switching operations depending on whether the number of Graphics Objects in the DSn is 2 or 1 (if DSn.PCS.num_of_objects == 2, or if DSn.PCS.num_of_objects == 1 in FIG. 18), and if the number is 1 (Step S5), the waiting time to decode the Graphics Object is added to the decoding_life (Step S6). The waiting time calculation is done by calling a STANDBY function (decoding_time + = WAITING (DSn, DSn.PCS.OBJ [0], decoding_life) in FIG. 18). The function is called using the arguments set for DSn, DSn.PCS.OBJ [0], decode_time, and the return value is the wait_distance.

FIG. 20B is a flowchart showing an operation of the WAIT function. 30

In the flowchart, the decoder_ duration of a summoner is set as the current_ duration. The_time_definition_list_object is a variable set for the PTS of the DS Graphics Object.

The current_time is a variable set to a total value of the current_ duration and the DTS of the PCS in the DSn. When the object_list_time_time is greater than the current_time (If for Step S7, if (current_time <object_list_time)), the expected_time as the return value is set to the difference between the_object_definition_list_time and the current_time (S8 + end_stop_spec - time_stop_stop_spec - time_stop_spec - time_stop_example current time). The duration_decoding is set to the time period of the return value of the STANDBY function added to the period of time required to redraw the Window, (90,000 * (SIZE (WINDOWS DSD.WINDOW [0])) // 256,000,000).

The above explanation is for the case where the number of Graphics Objects is one. In Step S5 at 40 FIG. 5, it is judged whether the number of Graphics Objects is two. If the number of Graphics Objects is greater than two. If the number of Graphics Objects in the DSn is more than two (if (Dsn.PCS.num_of_objects == 2) in FIG. 18), the WAIT function is called using OBJ [0] in the PCS as an argument and the return value is added to the decoding_type (Step S10).

In the subsequent Step S11, it is judged whether the Window to which the OBJ [0] of the DSn belongs is the same as the Window to which the Graphics Object [1] belongs (yes (DSn.OBJ [0]. window_id == DSn.PCS.OBJ [1] .id_window.) If the window is the same, the STANDBY function is called using the OBJ [1] as an argument, and the value returned is expected to be the duration_waiting to the decoding_stage (Step S12) , and the time needed to redraw the Window to which OBJ [0] (90,000 * (SIZE (DSn.WDS.OBJ [0] .id_window))) // 256,000,000 is added to the decoding duration (Step S13 ). fifty

If the windows are judged to be different (Step S11, "different"), the time required to redraw the window is added to which OBJ belongs [0] (90,000 * (SIZE (DSn.WDS.OBJ [0] .id_window )) // 256,000,000 to the decoding_time (Step S15), the STANDBY function is called using OBJ [1] as an argument, and the expected wait_back return value is added to the decoding_life (Step S16), and the time required to redraw the Window to which OBJ [1] (90,000 * (SIZE (DSn.WDS.OBJ [0]. window_id // 256,000,000) belongs to the 55 decoding_life (Step S17).

The duration_decoding is calculated by the previous algorithm. The specific mode in which the PTS of the OCS is set is explained below.

FIG. 21A illustrates a case in which an ODS is included in a Window. Fig. 21B and 21C are time diagrams showing values in the order of time referred to in FIG. 18. The bottom line "ODS Decoding" and the center line "Access to the Graphics Plane" in each diagram indicate two operations that are performed 5 simultaneously when playing. The above algorithm is described assuming that these two operations are performed in parallel.

Access to the Graphics Plane includes an erase period (1) and a writing period (3). The erase period (1) indicates either the period of time necessary to erase an entire Graphics Plane (90,000 x (size of the Graphics Plane // 256,000,000)), or the period of time necessary to erase all Windows in the 10 Graphics Plane (Σ (90,000 x (Window size [i]) // 256,000,000)).

The write period (3) indicates the period of time required to represent an entire Window (90,000 x (Window size [i] // 256,000,000)).

In addition, the decoding period (2) indicates a period of time between the DTS and the ODS PTS.

The lengths of the erase period (1), the decode period (2), and the write period (3) may vary depending on the interval to be deleted, the size of ODS to be decoded, and the size of the Graphics Object to Write on the Graphics Plane. For convenience, the start point of the decoding period (2) in the drawing is the same as the start point of the erase period (1).

FIG. 21B illustrates a case in which the decoding period (2) is long, and the decoding_ duration equals the total decoding period (2) and the writing period (3). twenty

FIG. 21C illustrates a case in which the erase period (1) is long, and the decode_ duration is equal to the total erase period (1) and the writing period (3).

FIG. 22a to 22C illustrate a case in which two SDGs are included in a Window. The decoding period (2) in both FIG. 22B and 22C indicate a total period of time necessary to decode two Graphics. Likewise, the writing period (3) indicates the total time period required to write two Graphics to the 25 Graphics Plane.

Even though the number of SDGs is two, it is possible to calculate the decoding_ duration in the same way as in the case of FIG. 21. When the decoding period (3) for decoding the two SDGs is long, the decoding_ duration is equal to the total decoding period (2) and the writing period (3) as shown in FIG. 22B. 30

When the erase period (1) is long, the decode_ duration is equal to the total erase period (1) and the write period (3).

FIG. 23A describes a case in which each of the two Windows includes an ODS. As in the previous cases, when the erase period (1) is longer than the decode period (3) to decode the two SDGs, the decoding_quality equals the total erase period (1) and the writing period (3 ). However, when the erase period (1) is shorter than the decode period (3), it is possible to write a first Window before the end of the decoding period (2). Therefore, the decoding_tring is not the same as the total erase period (1) and the writing period (3), nor the total decoding period (2) and the writing period (3).

When the period of time necessary to decode a first ODS is a write period (31) and the period of time necessary to decode a second ODS is a write period (32), FIG. 23B illustrates a case in which the decoding period (2) is greater than the total erase period (1) and the writing period (31). In this case, the decoding_ duration is equal to the total decoding period (2) and the writing period (32).

FIG. 23C illustrates a case in which the total erase period (1) and the writing period (31) is greater than the decoding period (2). In this case, the decoding_ duration is equal to the total erase period (1), the writing period (31), and the writing period (32).

The size of the Graphics Plane is known from the model of the reproduction apparatus in advance. Also, the size of the Window, and the size and number of ODS are known in the edition. Therefore, it is possible to find which combination of time periods is equal to the decoding duration: the erase period (1) and the 50 period of writing (3), the decoding period (2) and the period of writing ( 3), the decoding period (2) and the writing period (32), or the erase period (1), the writing period (3) and the writing period (32).

By setting the PDS of the ODS based on the calculation of the decoding_dime explained above, it is possible to synchronize the graphics with the image data with high precision. Such synchronous representation

with high precision it is possible to define the Window and limit an area to redraw for the Window. Thus, introducing a concept of Window into the editing environment has great significance.

The following is an explanation about the establishment of the DTS and the WTS PTS in the DSn. The WTS DTS can be set to satisfy the following equation.

DTS (DSn [WDS] [) ≥ DTS (DSn [PCS]) 5

On the contrary, the WTS OTS in the Dsn indicates a time limit to start writing in the Graphics Plane. As it is sufficient to write in the Window on the Graphics Plane, the time to start writing on the Graphics Plane is determined by subtracting a length of time indicated by the PCS PTS from the period of time required to write the WDS. When the total size of the WDS is ΣSIZE (WDS.WINDOW [i]), the time required to erase and rewrite is "ΣSIZE (WDS.WINDOW [i]) // 256,000,000". When expressed with a time accuracy of 90,000 KHz, the time is "90,000xΣSIZE (WDS.WINDOW [i]) // 256,000,000".

Therefore, it is possible to calculate the WTS PTS by the following equation.

 PTS (DSn [WDS]) =

PTS (DSn [PCS]) - 90,000 x ΣSIZE (WDS.WINDOW [i] // 256,000,000

 The PTS indicated in the WDS is the time limit, and it is possible to start writing to the Graphics Plane before the PTS, in other words, as shown in FIG. 23, once the SDG to be represented in one of the windows is decoded, the writing of the Graphics Object obtained by the decoding can begin at this point.

 As described above, it is possible to assign the Window to any point of time on the video clip's timeline using the DTS and PTS added to the WDS.

 Explanations about the example of DTS and PTS establishments in a Set of 20 Representation based on establishments are given below, referring to the specific example illustrated in FIG. 24-25. The example is about a case in which subtitles are represented by writing to the Graphics Plane four times, and an update is made to represent each of the two subtitles "what is blu-ray" and "blu-ray is in all parts. " FIG. 24 chronologically illustrates the transition of the update in the example. Up to point t1 is represented "what" and "what is" is represented after t1 through t2, and then "what is blu-ray" 25 is represented in t3. After the entire phrase of a first subtitle has appeared, the second subtitle "blu-ray is everywhere" is represented in t4.

 FIG. 25A illustrates four Representation Sets that are described so that they perform the update explained above. A DS1 includes a PCS1.2 to control an update in t1, a PDS1 for coloring, an ODS1 corresponding to the subtitle "what is a blu-ray", and an END as termination code of DS1. 30

 The DS2 includes a PCS1.2 to control an update on t2, and an END. A DS3 includes a PCS1.3 to control an update on t3 and an END. A DS4 includes a PCS2 to control an update on t2, a PDS2 for color conversion, an ODS2 corresponding to the subtitle "blu-ray is everywhere", and an END.

 Referring to the timing diagram in FIG. 25B, the DTS and PTS establishments for each of the functional segments in the four Representation Sets are explained. 35

 The playing timeline in the timing chart is the same as the timeline in FIG. 24. In the time diagram of FIG. 25A, PTS (PTS1), PTS (PCS1.2), PTS (PCS1.3) and PTS (PCS2), are set respectively at the representation point t1 to represent "what", the representation point t2 to represent "what is ", a point of representation t3 to represent" what is blu-ray ", and a point of representation t4 to represent" blu-ray is everywhere ". Each PTS is set as before, because it is necessary that the control as described in the capture on each of the PCS be performed at the point of representation of each of the subtitles.

 PTS (ODS1) and PTS (ODS2) are set so that they indicate points that are calculated by subtracting the decoding_time of the points indicated by PTS (PCS1.1) and PTS (PCS2), respectively, because it is required to set PTS (PCS) of so that it satisfies the following formula. Four. Five

  PTS (DSn [PCS]) ≥ DTS (DSn [PCS]) + decoding duration

  (DSn)

 In FIG. 25B, PTS (ODS2) is set to indicate a point t5 that comes before point t4, and PTS (ODS1) is set to indicate a point t0 that comes before point t1.

 DTS (ODS1) and DTS (ODS2) are set to indicate the points that are calculated by subtracting the 50 decoding_dime from the points indicated by PTS (ODS1) and PTS (ODS2), respectively, because it is required

set DTS (ODS) so that the following equation is satisfied.

  PTS (DS [ODSJ]) = DTS (DSn [ODSj]) + 90,000x (SIZE

  (DSn [ODSj]) // Rd)

 In FIG. 25B, PTS (ODS2) is set to indicate point t5 that comes before point t4, and PTS (ODS1) is set to indicate a point that comes before point t1. A ratio indicated by DTS (ODS2) = PTS (ODS1) 5 is satisfied at this point.

 By setting a PTS of an ODS immediately after a PTS of a previous ODS to be previously represented, the playback apparatus performs an operation in which the ODS is read from the memory so that it overwrites the previous ODS, and thus it is possible that the reproduction process is carried out for a small amount of memory. By performing such a reproduction process, the options for the memory size for a reproduction apparatus 10 are made wider.

 The DTS of PCS1.1 are set so that DTS (PCS1.1) = DTS (ODS1), because the value for the DTS of PCS1.1 can be any point before the point indicated by DTS (ODS1).

 The PTS of ODS1, the DTS of ODS2, and the PTS of PCS1.2, PCS1.3, and PCS2 are set at point t0 so that they satisfy a relationship indicated by the following equation 15

  PTS (ODS1) = DTS (ODS2) = PTS (PCS1.2) = PTS (PCS1.3) =

  PTS (PCS2)

 This is because the value for the DTS of PCS1.2 and PCS1.3 can be any points before the point indicated by PTS (PCS1.3) and the DTS of PCS2 can be any point indicated by DTS (PCS2).

 As explained above, it is possible to update a subsequent PCS as soon as the previous PCS update is completed, reading more than one PCS at the same time.

 It is sufficient that the DTS and the PTS of the PCS and the DTS and PTS of the ODS satisfy the relationships indicated by the above formula. Therefore, it is possible for the values to be set so that DTS (ODS2) = PTS (ODS1) or

  PTS (ODS1) = DTS (ODS2) = PTS (PCS1.2) = PTS (PCS1.3) =

  DTS (PCS2) 25

 For such establishments for time stamps, it is possible to adjust the length of time of a period in which the load on the decoding increases or more buffers are needed. Such adjustment expands the possibility of controls during playback, and is advantageous for those who perform the editing or manufacturing of playback devices.

 The data structures of the Representation Sets (PCS, WDS, PDS, ODS) explained above are an example of class structures described in a programming language. Producers performing the editing can obtain data structures on the BD-ROM describing the class structure according to the syntax provided by the Blu-ray Disc Pre-Recording Format.

 Next, a practical example of a reproduction apparatus according to the present invention is explained. FIG. 26 illustrates an internal structure of the reproduction apparatus according to the present invention. The reproduction apparatus according to the present invention is produced industrially based on the internal structure shown in the drawing. The reproduction apparatus according to the present invention is mainly structured in three parts: an LSI system, a control device, and a microprocessor system, and it is possible to industrially produce the reproduction apparatus by mounting the three parts in a receptacle and a appliance substrate. The LSI system is an integrated circuit in which various processing units are integrated to perform a function of the reproduction apparatus. The reproduction apparatus manufactured in the above manner comprises a BD 1 controller, a Reading Intermediate 2, a PID filter 3, Transport Intermediates 4a-4c, a peripheral circuit 4d, a Video Decoder 5, a Map of Video 6, an Audio Decoder 7, a Graphics Plane 8, a CLUT unit 9, an adder 10, a Graphics Decoder 12, an Intermediate Memory of Coded Data 13, a peripheral circuit 13a, a Graphics Flow Processor 14 , an Object Buffer 45 15, a Composition Buffer 16, and a Graphics controller 17.

 The BD 1 controller loads / reads / ejects the BD-ROM, and accesses the BD-ROM.

 Reading Intermediate 2 is a FIFO memory for storing the TS packets read from the BD-ROM in an order of first to enter first to exit.

 PID filter 3 filters more than one TS packet extracted from Reading Intermediate 2. Filtering by 50

PID filter 3 is for writing only TS packets that have the desired PID in Transport Intermediates 4a-4c. The introduction in the Buffer is not necessary for filtering by the PID filter 3, and therefore the TS packets introduced to the PID filter 3 are written in the Transport Buffers 4a-4c without delay.

 The Transport Intermediates 4a-4c are for storing the TS packets extracted from the 5 PID filter 3 in an order of first to first exit. The speed at which TS packets are extracted from Transport Intermediates 4a-4c is the Rx speed.

The peripheral circuit 4d is a wired logic to convert the TS packets read from the Transport Intermediates 4a-4c into functional segments. The functional segments obtained by the conversion are stored in the Intermediate Memory of Coded Data 13. 10

Video Decoder 5 decodes the more than one TS packets extracted from the PID filter 3 into a decompressed image and writes them to Video Plane 6.

Video Plane 6 is a memory of the plane for a moving image.

The Audio Decoder 7 decodes the TS packets extracted from the PID filter 3 and removes the decompressed audio data. fifteen

Graphics Plane 8 is a memory of the plane that has an area for a screen, and is capable of storing decompressed graphics for a screen.

The CLUT 9 unit converts the index color of the decompressed graphics stored in the Graphics Plane 8 based on the values of Y, Cr, and Cb indicated by the PDS.

Adder 10 multiplies the decompressed graphics for which the color conversion 20 has been performed by the CLUT unit 9 by the value T (Transparency) indicated by the PDS, adds the decomposed image data stored in the Video Plane by point of image, and then get and extract the composite image.

The Graphics Decoder 12 decodes the Graphics Flow to obtain the broken graphics, and writes the broken graphics as the Graphics Object for the Graphics Plane 8. Decoding the Graphics Flow, the subtitles and menus appear on the screen. The Graphics Decoder 12 includes the Coded Data Memory Intermediate 13, the peripheral circuit 13a, the Graphics Flow Processor 14, the Object Intermediate Memory 15, the Composition Intermediate Memory 16, and the Graphics controller 17.

The Coded Data Intermediate Memory 13 is an intermediate memory in which the functional segment is stored together with the DTS and the PTS. The functional segment is obtained by eliminating a control header of the TS packages and a header of the PES packages of each of the TS packages in the Transport Stream 30 stored in the Transport Intermediate Memory 4a-4c and arranging the data loads sequentially The PTS and DTS extracted from the control headers of the deleted TS packets and the control header of the PES packet are stored after correspondence between the PES packets.

The peripheral circuit 13a is a wired logic that makes a transfer between the Coded Data Intermediate Memory 13 and the Graphics Flow Processor 14, and a transfer between the 35 Coded Data Intermediate Memory 13 and the Composition Intermediate Memory 16. In the transfer operation, when the current time is the time indicated by the DTS of the ODS, the ODS is transferred from the Coded Data Intermediate Memory 13 to the Graphics Flow Processor 14. When the current time is the time indicated by the DTS of the PCS and the PDS, the PCS and the PDS are transferred to Composition Intermediate 16.

The Graphics Flow processor 14 decodes the ODS, and writes the unzipped graphics of the index color 40 obtained by decoding the Graphics Objects in the Object Buffer 15. The decoding by the Graphics Flow Processor 14 begins at the instant of the DTS corresponding to the ODS, and ends at the instant of completion of the decoding indicated by the PTS corresponding to the ODS. The decoding rate Rd of the Graphics Object is an output rate of the Graphics Flow Processor 14.

The Object Intermediate Memory 15 is an intermediate memory corresponding to an intermediate memory 45 of image points in the ETSI EN 300 743 standard, and has the Graphics Object obtained by the decoding performed by the Graphics Flow Processor 14. The Object Intermediate Memory 15 needs to be set at twice or four times greater than the Graphics Plane 8, because in the case that the Displacement effect is performed, the Object Intermediate Memory 15 needs to store the Graphics Object that is twice or four times larger than the Graphics Plane. fifty

Composition Intermediate Memory 16 is a memory in which PCS and PDS are arranged.

The graphics controller 17 decodes the PCS provided in Composition Intermediate Memory 16 and performs a control based on the PCS. The timing to perform the control is based on the PTS attached to the PCS.

The recommended values for the transfer rate and the size of the buffer to structure the PID filter 3, the Transport Intermediate Memory 4a-4c, the Graphics Plane 8, the CULT unit 9, the Intermediate Memory are explained below. of Encoded Data 13, and the Graphics controller 17. FIG. 27 illustrates the sizes of the writing rates Rx, Rc and Rd, the Graphics Plane 8, the Coded Data Intermediate Memory 13, the Object Intermediate Memory 15, and the Composition Intermediate Memory 16. 5

The transfer rate Rc between the Object Buffer 15 and the Graphics Plane 8 is the highest transfer rate in the reproduction apparatus of the present embodiment, and is calculated as 256 Mbps (= 500 Kbytes x 29.97 x 2) from the window size and frame rate.

Unlike Rc, the transfer rate Rd (Image Point Decoding Rate) between the Graphics Flow Processor 14 and the Object Buffer 15 does not need to be updated every cycle of the 10 video frame, and ½, or ¼ of Rc is sufficient for the Rd. Therefore, the Rd is either 128 Mbps or 64 Mbps.

The Leakage Rate of the Transport Intermediate Memory Rx between the Transport Intermediate Memory 4a-4c and the Coded Data Intermediate Memory 13 is an SDG transfer rate in a compressed state. Therefore, the transfer rate Rd multiplied by the compression rate is sufficient for the leakage rate of the Transport Intermediate Memory Rx. Given the ODS compression rate of 25%, 16 Mbps (= 64 Mbps x25%) is sufficient.

The transfer rates and buffer sizes shown in the drawing are the minimum standards, and it is also possible to set higher rates and larger sizes.

In the previous structured reproduction apparatus, each of the elements performs a decoding operation in a parallel structure. twenty

FIG. 28 is a timing diagram illustrating parallel processing by the reproduction apparatus. The fifth row in the drawing is a Representation Set in the BD-ROM, the fourth row shows reading periods from the PCS, WDS, PDS, and ODS for the Intermediate Memory of the Coded Data 13. The third row shows periods of decoding of each of the SDGs by the Graphics Flow Processor 14. The first row shows the operations performed by the Graphics controller 17. 25

The DTS (decoding start time) attached to ODS1 and ODS2 indicate t31 and t32 in the drawing, respectively. Because the decoding start time is set by the DTS, it is required to read each of the SDGs for the Intermediate Memory of Encoded Data 13. Therefore, the reading of SDG1 is completed before the decoding period dp1 in which ODS1 is decoded for the Coded Data Intermediate Memory 13. The reading of ODS2 is also completed before a dp2 decoding period in which ODS2 30 is decoded for the Coded Data Intermediate Memory 13.

In contrast, the PTS (decoding completion time) attached to ODS1 and ODS2, indicate t32 and t33 in the drawing respectively. Decoding of ODS1 by the Graphics Flow Processor 14 is completed by t32, and decoding of ODS2 is completed by the time indicated by t33. As explained above, the Graphics Flow Processor 14 reads the ODS for the Coded Data Intermediate Memory 13 35 for the instant indicated by the ODS DTS, and decodes the ODS read for the Coded Data Intermediate Memory 13 in the instant that indicates the PTS of the ODS, and writes the decoded ODS to the Object Buffer 15.

The cd1 period in the first row in the drawing indicates a period necessary for the Graphics controller 17 to erase the Graphics Plane. Also, the period td1 indicates a period necessary to write the Graphics Object obtained on the Object Intermediate to the Graphics Plane 8. The WDS PTS indicates the time limit to start writing, and the PCS PTS indicates the completion of writing and timing for representation. At the moment indicated by the PCS PTS, the decompressed graphics to compose an interactive screen is obtained on the Graphics Plane 8.

After the CLUT unit 9 performs the color conversion of the decompressed graphics and the adder 10 performs the composition of the decomposed graphics and the decomposed image stored in the Video Plane 45 6, a composite image is obtained.

In the Graphics Decoder 12, the Graphics Flow Processor 14 performs decoding continuously while the Graphics controller 17 deletes the Graphics Plane 8, by the previous parallel processing, it is possible to make a quick representation of the graphics .

In FIG. 28, a case is explained in which the deletion of the Graphics Plane ends before completing the decoding of the ODS. FIG. 29 illustrates a time diagram in a parallel processing of a case in which the decoding of the ODS ends before the erasing of the Graphics Plane is completed. In this case, it is not possible to write in the Graphics Plane at the time in which the SDG decoding is completed. When the deletion of the Graphics Plane is completed, it becomes possible to write the graphics obtained by decoding in the Graphics Plane. 55

A chronological transition in the occupation of the Intermediate Memory is explained below. FIG. 30 is a timing diagram showing the chronological transitions of the following components shown in FIG. 26: the composition buffer 16, the object buffer 16, the encoded data buffer 13, and the Graphics Plane 8. The first through fourth rows illustrate the chronological transitions in the occupation of the Graphics Plane 8, the object buffer 15, the encoded data buffer 13, 5 and the composition buffer 16, respectively. At this point a chronological transition is described using the line graph, in which the lateral axis represents the timeline, and the longitudinal axis represents the occupation.

The fourth row of FIG. 30 shows the chronological transition in the occupation for the composition buffer 16. As the fourth row shows, the chronological transition for the composition buffer 16 10 includes a "vfo" part, which represents a simple increase that is due to storage of the PCS extracted from the buffer of coded data 13.

The third row shows the chronological transition in the occupation for the buffer of encoded data 13. As the third row shows, the chronological transition for the buffer of the encoded data 13 includes two simply increasing parts vf1 and vf2, and two parts simply decreasing vg1 and vg2. 15 The gradients of the simply increasing parts vf1 and vf2 depend on the output rate Rx of the transport buffers 4a, b, ca of the encoded data buffer 13, and the gradients of the simply decreasing parts vg1 and vg2 represent the decoding performed by the graphics stream processor 14, which is done in an instant. In other words, decoding for the SDGs is done instantaneously, and the graphics stream processor 14 retains the decompressed graphics obtained by decoding. The write rate of the transmission path from the graphics stream processor 14 to the object buffer 15 is 128 Mbps. Therefore, the occupation of the object buffer 15 increases according to this write rate.

The second row represents the chronological transition in the occupation for the object buffer 15. As shown in the second row, the chronological transition for the object buffer 15 includes parts 25 simply increasing vh1 and vh2, which are due to the storage of ODS extracted from the graphics flow processor 14. The gradients of the simply increasing parts vh1 and vh2 depend on the transfer rate Rc from the graphics flow processor 14 to the object buffer 15. The periods during which the simply decreasing parts in the third row and the simply increasing parts that occur in the second row correspond to the "decoding period". The beginning of such decoding period is indicated by the SDG DTS, 30 and the end of the decoding period is indicated by the SDG PTS. If the decompressed graphics are stored in the object buffer 15 until the moment shown by the DDS of the ODS, this means the termination of the decoding directed to the ODS. As long as the decompressed graphics are stored in the object buffer 15 until the moment shown by the SDG PTS, the simply growing parts and the simply decreasing parts, during this decoding period, can take any form. 35

The first row represents the chronological transition in the occupation for the Graphics Plane 8. As the first row shows, the chronological transition for the Graphics Plane 8 includes a simply growing part vf3, which is due to the storage of the already decoded SDGs extracted. of the Object Intermediate Memory 15. The gradient of the simply increasing part vf3 depends on the transfer rate Rd from the Object Intermediate Memory 15 to the Graphics Plane 8. The end of the simply increasing part is shown by the SDG PTS . 40

The graphics as illustrated in FIG. 27 use: DTS and PTS assigned to the SDG; DTS and PTS assigned to the ICS; size and transfer rate of each of the buffers illustrated in FIG. 27. In addition, by creating the graphics as in this diagram, users can know how the status of each of the buffers changes, in the editing stage.

Since the state transition of each of the buffers can be adjusted by updating the DTS and the PTS, it becomes possible to avoid the decoding load, which would exceed the decoder specification, from that imposed on the reproduction apparatus, and would be avoided. the overflow incidents of the buffer in the reproduction. Accordingly, the hardware / software implementation will be made easy, in the development phase of the reproduction apparatus.

The following explains how the control unit 20 and the Graphics Decoder 12 are implemented. The 50 control unit 20 is implemented by writing a program that performs the operation shown in FIG. 30, and that has a general CPU to run the program. The operation performed by the control unit 20 is explained with reference to FIG. 30

FIG. 31, is a flow chart that shows the process of loading operation of the functional segment. In the flowchart, SegmentK is a variable that indicates each of the Segments (PCS, WDS, PDS, and 55 ODS) that are read in the video clip playback. An ignore indicator is an indicator to determine if SegmentK is ignored or loaded. The flowchart has a loop structure, in which first the ignore indicator is initialized to zero and then Stages S21-S24 and Stages S27-S31 are repeated for each SegmentK (Step S25 and Step S26).

Stage S21 is to judge whether SegmentK is the PCS, and if SegmentK is the PCS, judgments are made in step S27 and step S28.

Step S22 is to judge whether the ignore indicator is at 0. If the ignore indicator is at 0, the operation moves to step S23, and if the ignore indicator is at 1, the operation moves to Step S24. If the ignore indicator is 0 (If in step S22), Segment K is loaded in the Coded Data Intermediate Memory 13 in Step 5 S23.

If the ignore indicator is 1 (Not in Step S22), Segment K is ignored in Step S24. Therefore, the rest of all functional segments belonging to the DS are ignored because Step S22 is No (Step S24).

As explained above, it is determined by the indicator to ignore whether the SegmentK is ignored or loaded. Stages S27-S31, S34, and S35 are stages for setting the ignore indicator. 10

In Step S27, it is judged whether the segment_type of Segment K is the Acquisition Point. If Segment K is the Acquisition Point the operation moves to step S28, and if Segment K is either the Beginning of Time or the Normal Case, then the operation moves to Step S31.

In Step S28, it is judged whether an earlier DS exists in any of the buffers in the Graphics Decoder 12 (the encoded data buffer 13, the graphics stream processor 14, the object buffer 15, and Composition buffer 16). The trial in Stage S28 is made when the trial in Stage S27 is Yes. A case in which there is no previous DS in the Graphics Decoder 12 indicates the case in which the jump operation is performed. In this case, the representation starts from the DS which is the Acquisition Point, and therefore the operation moves to Step S30 (Not in Step S28). In Step S30, the ignore indicator is set to 0 and the operation moves to Step S22. twenty

A case in which there is a preceding DS in the Graphics Decoder 12 indicates a case in which normal reproduction is performed. In this case, the operation moves to Step S29 (If in Step S28), the ignore indicator is set to 1 and the operation moves to Step S22.

In Step S31, it is judged whether the PCS_composition_state is the Normal Case. If the PCS is the Normal Case, the operation moves to Step S34, and the PCS is the Beginning of Time, then the ignore indicator is set to 25 0 in Step S30.

In Step S34, as in Step S28, it is judged whether there is an earlier DS in any of the buffers in the Graphics Decoder 12. If there is an earlier DS, the ignore indicator is set to 0 (Step S30) . If the previous DS does not exist, it is not possible to obtain enough functional segments to compose an interactive screen and the ignore indicator is set to 1 (Step S35). 30

By setting the ignore indicator as above, the functional segments that constitute the Normal Case are ignored when the previous DS does not exist in the Graphics Decoder 12.

Taking an example of a case in which the DS is multiplexed as shown in FIG. 31, the way in which the reading of the DS is performed is explained. In the example of FIG. 31, three DS are multiplexed with a moving image. The composition_state of a DS1 is the Beginning of Time, the composition_state of a DS10 is the Acquisition Point and the composition_state of a DS20 is the Normal Case.

Since, in the Videoclip in which the three DS and the moving image are multiplexed, a jump operation is performed for pt10 image data as shown by the arrow am1, the DS10 is the closest to the jump target. , and therefore the DS10 is the DS described in the flow chart in FIG. 30. Although it is judged whether the state_composition is the Acquisition Point in Step S27, the ignore indicator is set to 0 because there is no previous 40 DS in the Coded Data Intermediate Memory 13, and the DS10 is loaded to the Intermediate Memory of Encoded Data 13 of the reproduction apparatus as shown by the arrow md1 in FIG. 32. On the contrary, in a case where the jump target is after the DS10 (arrow am2 in FIG. 31), the DS20 will be ignored because the DS20 is the Normal Case Representation Set and DS20 because no there is a previous DS in the Intermediate Memory of Coded Data 13 (arrow md2 in FIG. 32). Four. Five

FIG. 33 illustrates the loading of the DS1, DS10 and DS20 in normal playback. The DS1 whose PCS_composition_state is the Beginning of Time is loaded to the Coded Data Intermediate Memory 13 as it is (Step S23). However, because the ignore indicator of the DS10 whose PCS_composition state is the Acquisition Point is set to 1 (Step S29), the functional segments that constitute the DS10 are ignored and not loaded into the Coded Data Intermediate Memory 13 (arrow rd2 in FIG. 34, and Step S24). In addition, the 50 DS20 is loaded into the Coded Data Intermediate Memory 13, because the PCS_state_ of the DS20 is the Normal Case (arrow rd3 in FIG. 34).

The operations performed by the Graphics controller 17 are explained below. Fig. 35-37 illustrate a flow chart showing the operations performed by the Graphics controller 17.

Stages S41-S44 are stages for a main flow chart routine and expects any of the events prescribed in Steps S41-S44 to occur.

Step S41 is to judge whether the current playback instant is the instant indicated by the DTS in the PCS, and if the judgment is Yes, then the operation is performed in Stages S45-S53.

Step S45 is to judge if the OCS_composition_state is the beginning_time, and if it is judged to be the 5 start_time, the Graphics Plane 8 is completely erased in Step S46. If it is judged to be different from the beginning_time, the window indicated by the window_horizontal_position, the window_vertical_position, the window_width, and the WDS_wheel height is deleted.

Stage S48 is a stage performed after the deletion performed in Stage S46 or Stage S47, and is to judge whether the time indicated by the PTS of any ODSx has elapsed. The decoding of any ODSx could already be completed at the instant the erase ends, because deletion of the entire Graphics Plane 8 takes time. Therefore, in Steps S48, it is judged whether the decoding of any ODSx has already been completed at the time the deletion ends. If the judgment is No, the operation returns to the main routine. If the time indicated by the PTS of any ODSx has already passed, an operation is performed in steps S49-S51. In Step S49, it is judged whether the object_captured_object is at 0, and if the indicator indicates 0, then the Graphics Object is set 15 to "not represent" (Step S50).

If the indicator is different from 0, in Step S49, then the object captured based on the horizontal_object_capture_position, the_object_capture_position_ position, the_capture_width, and the capture_height are written in the Window in the Graphics Plane 8 at the position indicated by the horizontal_capture_capture_position and the position_vertical_capture_object (Step S51). By the above operation, one or more Graphics Objects 20 are represented in the Window.

In Step S52, it is judged whether the moment corresponding to the PTS of another SDG has passed. When the writing of the ODSx for Graphics Plane 8 occurs, if the decoding of the ODSy has already been completed, then the ODSy becomes ODSx (Step S53) and the operation moves to Step S49. Therefore, the operation from Stages S49-S51 is also performed for other SDGs. 25

Next, Step S42 and Stages S54-S59 are explained by reference to FIG. 36.

In Step S42, it is judged whether the current playback point is in the WDS PTS. If the current playback point is judged to be in the WDS PTS, then it is judged whether the Window number is one or different from one in Step S54. If it is judged to be two, the operation returns to the main routine. If it is judged to be one, a processing loop of Steps S55-S59 is performed. In the processing loop, the operations in Steps S55-S59, 30 are performed for each of the two Graphic Objects represented in the Window. In Step S57, it is judged whether the indicator_captured_object indicates 0. If it indicates 0, then the graph is not represented (Step S58).

If it does not indicate 0, then the captured object is written based on the horizontal_object_capture_position, the vertical_capture_position_point, the wide_capture and the_capture height in the Graphics Plane Window 8 at the position indicated by the horizontal_object_capture_position, and the vertical_capture_point. 35 Repeating the above operations, more than one Graphics Object is represented in the Window.

In Step S44, it is judged whether the current reproduction point is in the PTS of the PDS. If the current playback point is judged to be in the PTS of the PDS, then it is judged whether the palette_Update_ indicator is one or different from one in Step S60. If the judgment is one, the PDS indicated by the pallet_id is set to the CLUT unit (Step S61). If the judgment is 0, then Step S61 skips. 40

After this, the CLUT unit performs the color conversion of the Graphics Object on the Graphics Plane 8 to combine with the moving image (Step S62).

Next, referring to FIG. 37, Step S43 and Stages S64-S66 are explained.

In Step S43, it is judged whether the current reproduction point is in the SDG PTS. If the judgment is that the current reproduction point is in the SDG PTS, then it is judged whether the Window number is two, or different from two, in Step S63. If the judgment is one, the operation returns to the main routine, if the judgment is two, the operations are performed in Stages S64-S66. In Step S64, it is judged whether the indicator_captured_object indicates 0. If it indicates 0, then the Graphs are not represented (Step S65).

If it does not indicate 0, then the captured object is written based on the horizontal_object_capture_position, the_object_capture_position, the width_capture and the capture_height in the Window in the Graphics Plane 8 at the 50 position indicated by the horizontal_object_capture_position and the vertical_object_point. Repeating the above operations, the Graphics Object is represented in each of the Windows.

The above explanations are about the DTS and the PTS of the PCS, and the DTS and PTS of the ODS that belong to the DSn. The DTS and PTS of the PDS, and the DTS and PTS of the END are not explained. First, the DTS and the PTS are explained

of the PD that belong to the DSn.

As for the PDS belonging to the DSn, it is sufficient if the PDS that is available in the CLUT 9 unit by the PCS is loaded to Composition Intermediate Memory 16 (DTS (DSn [PCS])) after the starting point of the decoding of the first ODS (DTS (DSn [ODS1])). Therefore, a PTS value of each PDS (PDS1 - PDSlast) is required in the DSn to be set so as to satisfy the following relationships. 5

DTS (DSn [PCS]) ≤ PTS (DSn [PDS1])

PTS (DSn [PDSj]) ≤ PTS (DSn [PDSj + 1]) ≤ PTS (DSn

[PDSlast])

PTS (DSn [PDSlast]) ≤ DTS (DSn [ODS1])

Note that the DTS of the PDS is not mentioned during playback, the DTS of the ODS is set to the same value 10 as the PTS of the PDS to meet MPEG2 regulations.

Following is an explanation about the roles of DTS and PTS in parallel processing in the playback apparatus when the DTS and PDS are set so as to satisfy the above relationships. FIG. 38 illustrates the parallel operation of the reproduction apparatus based on the PDS PTS. FIG. 38 is based on FIG. 26. The first row in FIG. 38 indicates the establishment of the SDG in the CLUT 9 unit. Under the first row 15 are the same as the first to fifth rows in FIG. 26. The establishment of PDS1-last in the CLUT 9 unit is carried out simultaneously with the start of decoding of ODS1 (arrows up2, up3). (The establishment of the PDS1-PDSlast for the CLUT 9 unit is done after the transfer of the PCS and the WDS and before the decoding of the ODS1, and therefore the establishment of the PDS1-PDSlast for the CLUT 9 unit is set before the indicated point by the DTS of ODS1 as shown by arrows up2 and up3). twenty

As described above, the establishment of the PDS is done before decoding the ODS.

An establishment of the PTS of the END of the Representation Set segment in the DSn is explained below. The END belonging to the DSn indicates the end of the DSn, and therefore it is necessary that the PTS of the FIN indicate the moment of completion of the decoding of the ODS2. The decoding completion time is indicated by the PTS (PTS (DSn [ODSlast])) of ODS2 (ODSlast), and therefore the PTS of the END is required to be set to a value that satisfies the following equation

PTS (DSn [END]) = PTS (DSn [ODSlast])

In terms of the relationship between the DSn and the PCS belonging to the DSn + 1, the PCS in the DSn is loaded for Composition Intermediate Memory 16 before the loading time of the first ODS (ODS1), and therefore the PTS of the END should be after the instant of loading of the PCS in the DSn and before the instant of loading of the PCS belonging to the 30 DSn + 1. Therefore, the PTS of the END is required to satisfy the following relationship.

DTS (DSn [PCS]) ≤ PTS (DSn [FIN]) ≤ DTS (DSn + 1 [PCS])

On the contrary, the loading moment of the first ODS (ODS1) is before the loading moment of the last PDS (Last PDS), and therefore the PTS of the END (PTS (DSn [FIN])) should be after the instant of PDS load belonging to the DSn (PTS (DSn [PDSlast])). Therefore, the PTS of the END is required to satisfy the following relationship.

PTS (DSn [PDSlast]) ≤ PTS (DSn [END])

The following is an explanation about the meaning of the PTS of the END in parallel processing of the reproduction apparatus. FIG. 39 is a diagram describing the meaning of the END in the parallel process of the reproduction apparatus. FIG. 39 is based on FIG 28, and each row in FIG. 39 is substantially the same as in FIG. 40. 28 unlike the first row in FIG. 39 indicates the contents of Composition Intermediate 16. In addition, in FIG. 39, two Representation Sets DSn and DSn + 1 are illustrated. The last ODS in the DSn is the last ODS of the A-ODS, and therefore, the point indicated by the PTS of the END is before the DTS of the PCS in the DSn + 1.

By the PTS of the END, it is possible to find when the loading of the ODS in the DSn is completed during playback.

Note that although the DTS of the FIN is not mentioned during playback, the DTS of the FIN is set to the same value as the PTS of the FIN to satisfy MPEG2 regulations.

As described above, a part of the Graphics Plane is specified as the Window to represent the Graphics according to the present embodiment, and therefore the reproduction apparatus does not have to represent the Graphics for the entire Plane. The reproduction apparatus may represent the Graphics for only one

Default Window size, from 25% to 33% of the Graphics Plane, for example. Because the representation of Graphics other than the Graphics in the Window is not necessary, the load for the software on the playback device decreases.

Even in the worst case where the Graphics update is done in ¼ of the Graphics Plane, for example, it is possible to represent the Graphics synchronously with the image by the reproduction apparatus by performing the writing to the Graphics Plane at a predetermined transfer rate such as 256 Mbps, and setting the size of the Window so as to ensure synchronous representation with the image.

In this way it is possible to render high resolution subtitles for various playback devices, because the synchronous representation is easily secured.

(Second Embodiment) 10

 The First Embodiment explained above is for dedicated graphics for subtitle representation. On the contrary, the Second Embodiment is about graphics for interactive representation.

 Among the embodiments of a recording medium according to the present invention, an example of using the recording medium is explained below. As in the First Embodiment, the recording medium of the Second Embodiment can also be manufactured by an improvement in the application layer of the BD-ROM. FIG. 41 15 is a diagram schematically illustrating a video clip structure of the second embodiment.

 The Videoclip (shown in the center) is structured as follows. The video stream composed of a plurality of video frames (image pj1, pj2, and pj3), and the audio stream composed of a plurality of audio frames (upper row of the drawing) respectively become a line of PES packets (second row of the drawing), and then in a line of TS packages (third row of the drawing). The flow of interactive graphics (bottom row of the 20 drawing) becomes a line of PES packages (second row at the bottom of the drawing), and then a line of TS packages (third row at the bottom of the drawing). The three TS packet lines are multiplexed, and thus the Videoclip is constituted.

 Next, the flow of interactive graphics is explained. The interactive graphics stream has an Interactive Composition Segment (ICS) instead of the PCS, and has no WDS. The interactive graphics flow is similar to the 25 presentation graphics flow, in that it has functional segments called Palette Definition Segments (PDS), an Object Definition Segment (ODS), and an END of the Representation Set Segment ( FINISH).

 The layout of the GUI parts on the screen generates an interactive screen that is defined by the functional segments. FIG. 42A is a diagram illustrating such an interactive screen made by the flow of interactive graphics. This interactive screen includes four parts of the GUI called from button A to button D. Interactivity through the flow of interactive graphics means changing the state of these parts of the GUI (i.e., the buttons) according to the operations of Username. The status of the parts of the GUI (buttons) includes a "normal state bt1", a "selected state bt2", and an "active state bt3", which are shown in FIG. 42A The normal state is a state in which a simple representation is provided. In opposition to this, the selected state is a state in which an approach is given according to the user operation, but confirmation has not been received. The active state is a state in which confirmation is received. The status of the button can be changed by a press directed on the keys of the remote controller 400, which is shown in the First Embodiment. FIG. 42B is a diagram illustrating the keys of the remote controller 400, through which the operation of the user directed to the interactive screen is received. As shown in this drawing, remote controller 400 is provided with the Move Up key, the Move Down key, the Move Right key, and the Move Left key. 40

 The Move Up key is for, when a button on the interactive screen is in a selected state, set the button above this selected button, so that it is in the selected state. The Move Down key is to set the button below this selected button to be in the selected state. The Move Right key is to set the button to the right of the selected button to be in the selected state and the Move Left key is to set the button to the left of the selected button to be in the selected state.

 The Activated key is to set the selected button to the active state (ie to activate). The numeric keys "0 to" 9 "are for setting a button that corresponds to the number that is assigned, in a selected state. The" +10 "key is for receiving an operation of adding 10 to the numerical values already entered. you will notice that the "0" key and the "+10" key are both to receive the entry of numerical values not less than 50 10 digits, therefore, any of them is sufficient for remote controller 400.

 Each of the states (ie, normal state, selected state, and active state) are made up of a plurality of graphics in an unzipped state. Each of the decompressed graphics, which is to represent each of the states of the buttons, is called the "Graphics Object." The reason why a state of a button is represented by a plurality of decompressed graphics is to take into account the realization of the animation representation for each state of each of the buttons.

 Next, the improvements directed to the definition segments (ODS, PDS) in the present embodiment are explained. ODS and PDS have the same data structure as those of the First Embodiment. The only difference lies in the "object_ID" concerning the SDG. The ODS in the Second Embodiment constructs the animation using a plurality of Graphic Objects defined by a plurality of ODS. In animation construction, an object_ID is added to a series of ODS, where the object_ID is a serial number. 5

 The ICS is explained below. An Interactive Composition Segment is a functional segment that constitutes an interactive screen. The Interactive Composition Segment has the data structure shown in FIG. 43. As shown in this drawing, the ICS is composed of segment_type; segment_length; composition_number, composition_state; update_command_command, pts__composition_output_time; pts_select_output_time, UO_mask_table; animation_trace_trace_code; 10 default_selected_button_number; default_activated_button_number; and the button information sets (info button (1) (2) (3)…).

 The "composition_number" represents numerical values from 0 to 15, which indicate updating.

 The "composition_state" represents the DS that begins with the current ICS in the Normal Case, the Acquisition Point, or the Beginning of Time. fifteen

 The "update_command_indicator" represents whether the button command within this ICS has changed since the first ICS. For example, if the DS to which a certain ICS belongs is the Acquisition Point, this ICS will have the same content as an ICS that is just before this ICS, in principle. However, if the "update_command_indicator" becomes active, a button command different from the ICS that had just been set as ICS can be set. This indicator is set to be valid when you want to change a command while the Graphics Object is applied.

 The "pts_time_composition_output" describes the final moment of the interactive screen. In the final instant, the representation of the interactive screen is no longer valid, and thus is not performed. It is desirable that the pts_time_composition_output be accurately described in the playing time line for moving image data. 25

 The "pts_select_out_time" describes the final moment of a valid button selection period. During the selection_output_time pts, the button specified by the default_activated_button_number is activated. The period of pts_time_output_selection is equal to or less than the period of pts_time_output_composition. The pts_time_selection_selection is described in the accuracy of the time of the video frame.

 The "UO_mask_table" represents the permission / prohibition of the user operation for the Set of 30 Representation that corresponds to the ICS. If this mask field is set as a prohibition, the operation of use directed to the reproduction apparatus will be invalid.

 The "animation_frame_state_code" describes a frame rate to be applied to the animation_type button. The animation frame rate is obtained by dividing the video frame rate by the value in this field. If the value in this field is "00", only the ODS specified by object_object_id_xxx is represented, and without animation, with ODS 35 being among the ODS that define the Graphics Objects for the buttons.

 The "default_selected_button_number" indicates a button number that should be set to a state selected by default, when an interactive screen representation has begun. If this field is "0", the button that has the button number stored in the record of the playback device will be automatically set to be in the active state. If this field is not "0", it means that this field indicates a valid button value. 40

 The "default_activated_button_number" represents a button to be automatically set in the active state, when the user did not set any button to be in the active state before the instant defined by the selection_out_time_season. If the default_activated_button_number is "FF", the button currently in the selected state will be automatically selected at the instant defined by pts_select_out_time. If the default_activated_button_number is "00", automatic selection will not be made and if it is different from "00" and "FF", this field will be interpreted as indicative of a valid button number.

 The button information (button_ info) defines each of the composite buttons on the interactive screen. The guideline in this drawing focuses on the internal structure of the i button information, which is about the ith button that controls the ICS. The following explains the information elements that constitute the button information i.

 The "button_number" is a value that uniquely identifies the i button in the ICS. fifty

 The "numerically_selectable_indicator" indicates whether to allow the selection of numerical values for the i button.

 The "auto_action_indicator" indicates whether to automatically set the i button. If the auto_action_ indicator is set to active (that is, at bit value 1), button i will be in an active state, rather than in a selected state. For him

Otherwise, if the auto_action_ flag is set to off (that is, at bit value 0), button i will be set to a simply selected state, even if this button has been selected.

 The "object_horizontal_position" and the "object_vertical_position" respectively indicate the horizontal position and the vertical position of the upper left image point of the i button on the interactive screen.

 The "upper_button_number" indicates the number of the button to be set in a selected state instead of the i, 5 button when the Move Up key is pressed at the moment when the i button is in a selected state. If the number corresponding to the i button has been set in this field, the push directed to the Move Up key will be ignored.

 The "lower_button_number", the "left_button_number", and the "right_button_number" indicate the button number that will be in a selected state instead of pressing the i button, when the Move Down key, Move Left key and Move Right key are respectively pressed while that the i button is in a selected state 10. If the number corresponding to the i button has been set in this field, the push directed to these keys will be ignored

 The "normal_object_start" is a field such that, when the i button is represented in a normal state by animation, the first number among the serial numbers that are assigned to the plurality of ODS that constitute the animation is described in this "normal_object_start ". fifteen

 The "normal_object_finality" is a field such that, when the i button is represented in a normal state by animation, the last number among the serial numbers (that is, the id_object) that are assigned to the plurality of ODS that constitute the animation is described in this end_id_object_normal. If the ID indicated in this normal_object_init is the same as the ID indicated in the normal_object_id_start, the still image corresponding to this ID in the Graphics Object will be the image for the i button. twenty

 The "normal_repedition_indicator" indicates whether to repeatedly continue the animation representation of the i button that is in normal state.

 The "selected_object_start" is a field such that, when the i button is represented in a selected state in animation, the first number among the serial numbers that are assigned to the plurality of ODS that constitute the animation is described in this selected_object_id_start. 25

The "selected_ object_id_ end" is a field such that, when the i button is represented in a state selected by animation, the last number among the serial numbers that are assigned to the plurality of ODS constituting the animation is described in this selected_ object_id_id. If the ID indicated in the selected object_id_did is the same as the ID indicated in the selected_id_id_id_start, the still image corresponding to this ID in the Graphics Object will be the image for the i button. 30

The "selected_repedition_indicator" indicates whether the animation representation for button i continues repeatedly in the selected state. If the selected_object_id_start and the selected_object_did have the same value, this field will be set to 00.

The "start_object_id_object" is a field such that, when the i button is represented in the animation-activated state, the first number among the serial numbers that are assigned to the plurality of ODS that constitute the animation is described in this start_object_id_object .

The "end_id_object_activated" is a field such that, when the i button is represented in the animation-activated state, the last number among the serial numbers (that is, the object_id) that are assigned to the plurality of ODS that constitute the animation is described in this end_id_object_ activated.

The button command is explained below. 40

The button command (button_command) is a command to be executed when the button i is put into the active state.

An example of interactive control through the ICS is explained below. This example assumes ODS and ICS as illustrated in FIG. 44. FIG. 44 shows a relationship between the SDG included in the DSn and the ICS. This DSn is assumed to contain SDGs 11-19, 21-29, 31-39, and 41-49. Among these SDGs, SDGs 11-19 illustrate respectively the states of button A; SDG 21-29 illustrate the states of button B; SDG 31-39 the states of button C; and SDG 41-49 states of the D button. (Please refer to parentheses "}"). It is then assumed that the status controls for these buttons A - button D are described in the info_button (1), (2), (3), (4), respectively.

The control execution timing via the ICS coincides with the representation timing of the arbitrary image data pt1 in the moving image of FIG. 45, this means that an interactive screen tm1 composed of button A-button D being composed (gs1) will be represented within this image data pt1 (gs2). As the interactive screen is composed of a plurality of buttons according to the contents of the moving image, it becomes possible to represent very real images with the use of the buttons and through the ICS.

FIG. 46 illustrates an example of ICS description, in a case where the state of button A - button D is changed as shown in FIG. 47. Arrows hh1 and hh2 in FIG. 47 symbolically represent the state change generated by the info_vecino () of the info button (1). The neighbor_info () of the info button (1) has a lower_button_number to which the C button is set. Therefore, if the UO of the MOVE Down key that is being pressed is generated while the A button is in a selected state (FIG 47, up1), button C will be in a selected state 5 (FIG. 47, sj1). Since the right_button_number in the neighbor_ info () of the info button (1) is set as the B button, if the UO of the MOVE key is generated that is being pressed while the A button is in a selected state (FIG. 47, up2), button B will be in a selected state (FIG. 47, sj2).

The hh3 arrow in FIG. 47 shows the control for changing the status of the info button (3) due to the info_vecino (). Since the top_button_number in the neighbor info_ of the info button (3) is set as button A, if the UO of the MOVE key is generated that is being pressed while button C is in a selected state, button A will be again in the selected state.

Next, the images for button A - button D are explained. At this point, the assumption is made that SDGs 11-21, 31 and 41 have images illustrated in FIG. 49, and the like. As in the ICS, the normal_info_state () of the button_information (1) has a normal_object_id_start, a normal_object_ end that indicates the 15 SDG11-13, the normal state for button A is represented as animation of SDGs 11-13. In addition, since the selected_state_information () of the button_information (1) has a selected_object_id_start, an end_selected_object that indicates SDGs 14-16, the selected state of button A is represented as ODS14-16. As a result of setting this button A to be in the state selected by a user, the figure that is the image of button A will change to that of SDG14-16, from that of SDG11-13. At this point, if the provision is made in which the normal_repetition_ indicator, the selected_repetition_ indicator is set to 1, in the_normal_state_info (), and the selected_state_state () respectively, then the animation of the SDGs 11-13 and the animation of the ODS14-16 will be represented repeatedly and continuously, as shown by "→ (A)", "(A) →", "→ (B)" and "(B) →" of the drawing.

If a plurality of ODS that can present animation is assigned, for button A - button D, and the corresponding controls are described in the ICS, the button status control can be performed more subtly and quickly (for example by changing the expression of the character of the image when the user's operation changes).

The order of the SDGs in the Representation Set is explained below. As mentioned above, the SDGs belonging to the Representation Set are indicated by the ICS to represent a state of a button. The order of the SDGs in the Representation Set is determined according to the indication on which state of a button should be represented.

More specifically, the SDGs in the Representation Set are grouped under the state they represent, (1) representing the normal state, (2) representing the selected state, (3) representing the active state, and so on. Each such group that represents a state of a button is called a "button_state group". These groups of button_state are then arranged in the order such as "normal state → selected state → 35 active state". Defining the order of the SDGs will consequently define the order of the SDGs in the Representation set.

FIG. 50 illustrates the order of the SDGs belonging to the Representation Set. In the second row of this diagram, three groups of button_state of the Representation Set are shown. This drawing shows three sets of ODS; a set of ODS representing the normal state (ODS for the Normal state); a set of 40 ODS representing the selected state (ODS for the Selected state); and a set of ODS representing the active state (ODS for the Active state). These button_state groups are arranged in the order "normal state → selected state → active state". The purpose of this order is to read the components that constitute the initial representation of the interactive screen, before reading the other components that constitute the representation of the screen after the update. Four. Five

The first row of FIG. 50 shows the Graphic Objects "An, Bn, Cn, Dn, As, Bs, Cs, Ds, Aa, Ba, Ca, Da". The subscript "n" assigned to An, Bn, Cn, Dn represents the normal state of the corresponding button. Similarly, the subscript "s" of As, Bs, Cs, Ds represents the selected state of the corresponding button, and the subscript "a" represents the active state of the corresponding button. The second row of FIG. 50 shows the button_state groups to which the Graphics Objects of the first row belong. It should be noted in this drawing that each set of ODS1-ODSn is assigned to the same number, such as 1 and n. However, the sets are different from each other, and belong to N-ODS, S-ODS, and A-ODS, respectively. This also applies to each similar drawing later in this document.

FIG. 51 illustrates the state transition of an interactive screen in which the button_state groups of FIG. 50. 55

The interactive screen of this drawing has a plurality of states that are the "initial representation", "update representation according to the user's first action", and "update representation according to the user's second action". The arrows in this drawing represent user actions that trigger the change of

corresponding status According to this drawing, the four buttons A, B, C, and D have a "normal state", "selected state", "active state" respectively. This can be understood, so that to perform the initial representation, the Graphics Object is necessary to represent the three normal states and the Graphics Object to represent a selected state.

Even in a case where the button selected by default is not defined and the button that will be placed in the selected state changes dynamically, the initial representation will be made once the decoding for the Graphic Objects representing the graphic is complete. normal state and the selected state, for each of the buttons. Taking this into consideration, the present embodiment arranges the button_state groups each corresponding to a different state of the states in the order of "normal state - selected state - active state", as shown in the second row of FIG. 50. Such provision makes the initial representation 10 even when the reading and decoding of the SDGs that constitute the active state are incomplete, and helps to shorten the start-up period with the beginning of the Representation Set reading and the end with the termination of the initial representation.

Next, the following explains in what order the SDGs illustrated in FIG. 48 and 49. FIG. 52 illustrates the order of the SDGs in the Representation Set. In this drawing, the SDGs for Normal 15 state consist of SDG 11-13, SDG 21-23, SDG 31-33, and SDG 41-43. The SDGs for the Selected state are constituted by SDG 14-16, SDG 24-26, SDG 34-36, and SDG 44-46, and the SDGs for the Active status are constituted by SDG 17-19, SDG 27-29, SDG 37-39, and SDG 47-49. SDGs 11-13 are to represent the change in the expression of the character shown in FIG. 49. The same applies to SDG 21-23, SDG 31-33, and SDG 41-43. Therefore, by arranging these SDGs in the upper group of the button state, it is possible to arrange the preparation of the initial representation even in the middle of reading the Representation Set. According to this, the interactive screen you take in animation can be done without delay.

Next, the order of ODS that are multiple-referenced by a plurality of buttons is explained. At this point, the multiple-reference means that the object_object of an ODS is indicated by two or more normal_information, selected_state, and activated_information. By adopting such a multiple-reference method, the selected state 25 of a button can be represented using the Graphics Object to represent the normal state of a different button. This makes it possible to share the image of the Graphics Object. Sharing helps reduce the number of SDGs. In this case, a problem concerning the SDGs used in the multiple-reference is to which button-state group this SDG belongs.

More specifically, when the normal state of a button and the selected state of another button are represented by an ODS, it will be considered whether this ODS belongs to the state-button group corresponding to the normal state or to the state-button group corresponding to the selected state.

In this case, the ODS is arranged only once in the status-button group that corresponds to the status that appears sooner.

If a certain ODS is used in the multiple-reference of both the normal state and the selected state, this ODS will be arranged in the state-button group corresponding to the normal state (N-ODS), and not in the corresponding state-button group to the selected state (S-ODS). In addition, if another ODS is used in multiple-reference of both the selected state and the active state, this ODS will be arranged in the button-state group corresponding to the selected state (S-ODS), and not in the button-state group corresponding to the active state (A-ODS). In sum, the SDGs in such a multiple reference method will be available only once within the status group-button corresponding to the status shown above.

The order of the SDGs in the SDGs is explained below. In S-ODS, which ODS comes first depends on whether the button selected by default is determined statically, or is dynamic. The default selected button that is statically determined has a valid value that is set (excluding 00) in the default_selected_button_number in the ICS, and this value specifies the button. When the default_selected_button_number indicates a valid value, and there is no ODS that represents the default selected button in the N-ODS, the ODS representing the default selected button will be arranged first.

If the default_selected_button_number indicates the value 00, the button set in the default selected state will change dynamically according to the status of the side of the playback device.

A case in which the default_selected_button_number should be set to indicate the value 0 is, for example, where the Video clip to which the Representation Set has been multiplexed functions as an articulation point for a plurality of reproduction paths. If, for example, the plurality of previous reproduction paths are respectively the first, second and third chapters, and the Representation Set is the point of articulation for the representation of the buttons corresponding to the first, second and third chapters it is inappropriate to decide for default the button that will be in the state selected in the default_selected_button_number.

In such a case, it is ideal to change the button that will be in the selected state according to which, one of the plurality of previous playback paths is currently being passed, until it reaches this Set of

Representation (for example, the second-chapter button when it is reached from the first chapter, the third chapter button when it is reached from the second chapter, and the fourth-chapter button when it is reached from the third button). In a case where the button that will be in the selected state will change, the default_selected_button_number will be designated as invalid, that is, the value 0 is set for it. As the button that will be in the selected state will change, it is not necessary a layout structure of certain SDGs at the beginning of the button-state group.

FIG. 53 shows the difference in the ODS arrangement in the S-ODS between a case where the default_selected_button_number is "= 0", and the case where it is "= button B", In this drawing, the dashed line ss1 shows the disposition of the ODS in the S-ODS, in a case where the default_selected_button_number indicates the B button, and the dashed line ss2 shows the disposition of the ODS in the S-ODS, in a case where the default_selected_button_number indicates the value 0 As the notation in this drawing shows, when the default_selected_button_number indicates button B, the SDGs B that indicate the selected state of button B are arranged first of the S-SDGs, and the SDGs of the other buttons are arranged behind them. same. On the contrary when the default_selected_button_number indicates the value 0, the SDGs A that indicate the selected state of button A are arranged first. As such, the default_selected_button_number is valid or does not cause the order of the S-ODS to change greatly.

Next, the following explains how the Representation Set that has these ICS and ODS on the playing timeline for the Videoclip is arranged. The DTS and the OTS PTS can be set based on the expressions shown in the first embodiment. On the contrary, the DTS and the PTS of the ICS will be different from those shown in the first embodiment. The following explains the values for the DTS and the PTS of the ICS. twenty

When it is immediately after the beginning of Time, the PTS in the ICS shall be set to be of a value equal to or greater than the value resulting from adding (1) the value of the PTS of the ODS whose decoding time is the last of the SDGs that constitute the initial representation of the DSn, (2) the time required to erase the Graphics Plane and (3) the writing time to write the Graphics Object obtained by decoding the SDGs for the Graphics Plane. On the contrary, when it is at the Acquisition Point, it will be set to be equal to or greater than the value obtained by adding (3) the writing period of the plan to (1) the value of the SDG PTS.

When the default_selected_button_number is indicated in the ICS, the initial representation can be made provided that i) the ODS is decoded for the representation of the normal state of all buttons and ii) the decoding of the ODS for the representation of the selected state of the default button. The ODS for the representation of the selected state of the plurality of buttons in the initial representation are called S-ODS, and the 30 ODS whose decoding time comes first between the ODS (in this case, the ODS for the default button representation ) is called S-ODS first. The PTS value of this S-ODS first is set as the PTS value of the ODS whose decoding time is last, and is used as the PTS reference value in the ICS.

When the default_selected_button_number is not indicated in the ICS, any button can be in the selected state. Therefore the preparation for the initial representation will not be completed until preparation 35 for the representation of the normal state and the selected state for all buttons. Among the S-ODS to represent the selected state of the plurality of buttons in the initial representation, the one whose decoding time comes last is called the S-ODS last. The PTS value for this last S-ODS is set as the PTS value of the ODS whose decoding time comes last, and is used as a PTS reference value in the ICS.

If the completion time for the decoding of the S-ODS first is assumed to be PTS (DSn [S-40 ODS first), PTS (DSn [ICS]) will be the value resulting from adding to the PTS (DSN [S-ODS first]) , (2) the time required to erase the Graphics Plane, and (3) the writing time to write the Graphics Object obtained from the decoding of the ODS for the Graphics Plane.

We assume at this point that, within the Graphics Plane, the width and height of a rectangular area to represent an image are defined respectively as "video_width" and "video_height", and that the writing rate in the Graphics Plane is 45 of 128 Mbps. Then the time required to clear the Graphics Plane is expressed as "8 * video_width * video_height // 128,000,000". When this is expressed in 90 KHz time accuracy, the erase time (2) of the Graphics Plane will be 90,000 * (8 * video_width * video_height // 128,000,000).

In addition, assuming at this point that the total size of the Graphics Objects specified by all the button information included in the ICS is ΣSIZE (DSn [ICS.BUTTON [i]]), and that the write rate in the Plane of 50 Graphics is 128 Mbps, so the time required to write to the Graphics Plane is expressed as ΣSIZE (DSn [ICS.BUTTON [i]]) // 128,000,000. If this is expressed with a time accuracy of 90 KHz, the erase time is 90,000 * (ΣSIZE (DSn [ICS.BUTTON [i]]) // 128,000,000).

At this point ΣSIZE (DSn [ICS.BUTTON [i]]) is the total size of the Graphics Object represented first, among the Graphics Objects representing all buttons. This ΣSIZE (DSn 55 [ICS.BUTTON [i]]) will obtain a different value, in a case where the default selected button is already determined that in a case where the default selected button changes dynamically. When the button selected by default has been statically determined, ΣSIZE (DSn [ICS.BUTTON [i]]) will be the total of 1) the ODS

represented for the first time from the plurality of ODS to represent the selected state of the button selected by default, and 2) ODS represented for the first time from among the plurality of ODS to represent the normal state of the buttons except the button selected by default.

On the contrary, when the button selected by default changes dynamically, the case in which the write time is the longest should be assumed, because it is difficult to know which button will be the button selected by default. 5 In this case, it is considered that the Graphics Object to be represented for the first time is the Graphics Object that has the largest size (Max (ODSn1.ODSs1) among 1) the Graphics Objects that represent the first page in the state normal of an arbitrary button x (ODSn1) and 2) the Graphical Objects that represent the first page in the selected state of the x button (ODSs1).

The result of adding this Max (ODSn1, ODSs1) of the reach button will be ΣSIZE (DSn [ICS.BUTTON [i]]). 10

FIG. 54A, 54B illustrate the values taken by ΣSIZE (DSn [ICS.BUTTON [i]]), in a case where the N-ODS includes a plurality of ODS constituting the AD buttons, and where the S-ODS includes a plurality of ODS constituting the AD buttons. At this point, when the default_selected_button_number indicates a valid value ΣSIZE (DSn [ICS.BUTTON [i]]) will be the total size for the four SDGs shown by the box on the thin line. "As1" is the ODS represented for the first time from among the plurality of ODS representing the state selected from button A. "Bn1", "Cn1", and "Dn1" represent the corresponding ODS represented first from among the plurality of ODS representing the normal states of the B-button D. When these sizes are expressed in size (), Σ SIZE (DSn [ICS.BUTTON [i]]) will be:

size (As1) + size (Bn1) + size (Cn1) + size (Dn1).

On the contrary, when the default_selected_button_number is "= 0", ΣSIZE (DSn [ICS.BUTTON [i]]) 20 will be:

The largest ODS of An1, As1 + The largest ODS of Bn1, Bs1 + The largest ODS of Cn1, Cs1 + The largest ODS of Dn1, Ds1.

Therefore ΣSIZE (DSn [ICS.BUTTON [i]]) is expressed as follows.

Σ SIZE (DSn [ICS.BUTTON [i]]) 25

= max (size (Cn1), size (Cs1)) + max (size (Dn1),

size (Ds1))

 Using the expression set forth above, the PTS (DSn [ICS]) immediately after the beginning of the Epoch of Time is expressed as follows.

  PTS (DSn [ICS]) ≥ PTS (DSn [S - ODS first]) 30

  + 90,000 * (8 * video_width * video_height // 128,000,000)

  + 90,000 * (ΣSIZE (DSn [ICS.BUTTON [i]]) // 128,000,000)

 An exemplary embodiment of the synchronized representation, establishing the PTS and DTS as above, is shown in FIG. 55. This drawing assumes a case in which the button is represented in the timing of representation of any image data p and 1 in the moving image. In this case, the PTS value 35 in the ICS should be set to match the time point of representation of the corresponding image data.

 In addition, the value of PTS in the ODS should be set at the time point (1) of this drawing, because, in the time obtained by subtracting, from the PTS in the ICS, the erase period of the "cd1" screen and the period If the Graphics Object "td1" is transferred, the decoding of the SDGs whose decoding time is the last 40 of the SDGs that constitute the initial representation of the DSn should be completed. In addition, because decoding of the ODS requires the period of dd1, the DTS value of the ODS should be set earlier for this PTS for the period of dd1.

 FIG. 55 has only one ODS to combine with a moving image, which is a simplified example. To perform the initial representation of the interactive screen to be combined with the moving image between the plurality of ODS, the PTS and the DTS in the ICS, and the PTS, DTS in the ODS should be set as shown in FIG. 56. 45

 FIG. 56 shows how the DTS and PTS are set in a case in which the initial representation of the interactive screen is constituted by a plurality of ODS, and where the default selected button is statically determined. If the decoding for the first S-ODS whose decoding is performed last, from among the SDGs to perform the initial representation, will end during the period dd1, of this drawing, the PTS (DSn [S-ODSprimero]) of this S-ODS first should be set to indicate the time of period dd1. fifty

 In addition, before the initial representation, screen wiping and transfer of already Decoded Graphics Objects should be performed. Therefore the PTS (DSn [ICS]) of the ICS should be set to be after the time obtained by adding, to the value of this PTS (DSn [S-ODSfirst]), the period required for screen erase (90,000 * ( 8 * width_video * height_video // 128,000,000)) and the transfer period of the Decoded Graphics Object (90,000 * (ΣSIZE (DSn [ICS.BUTTON [i]]) // 128,000,000)). 5

 FIG. 57 shows how the DTS and PTS are set in a case where the initial representation of the interactive screen is constituted by a plurality of ODS, and where the default selected button is not determined. If the decoding for the last S-ODS whose decoding is performed last, among the SDGs for the initial representation, will end during the dd2 period of this drawing, the PTS (DSn [S-ODSlast]), of this S -OD Last should be set to indicate the time of the dd2 period. 10

In addition, before the initial representation, screen wiping and transfer of already Decoded Graphics Objects should be performed. Therefore the PTS (DSn [ICS]) of the ICS should be set to be after the time obtained by adding, the value of this PTS (DSn [S-ODSlast], the period required for screen deletion (90,000 * (8 * video_width * video_height // 128,000,000)) and the transfer period of the Graphics Object (90,000 * (ΣSIZE (DSn [ICS.BUTTON [i]]) // 128,000,000)).

It should be noted at this point that the synchronization control by means of the PTS in the ICS, established above, includes not only the control to represent the button at a certain timing on the playing timeline, but also includes the control to enable representation of a pop-up menu for a certain period of time on the playback timeline. The Pop-up menu is a menu represented, as a pop-up window, by a press directed to the menu key provided by the remote controller 400. The synchronization control via the PTS in the ICS also includes enabling this representation of the Pop-up window in the timing of representation of certain image data in the Videoclip. The SDGs that make up this pop-up menu are first decoded and then written to the Graphics Plane, just like the SDGs that constitute a button. Unless the writing of the Graphics Plane has been completed, it is impossible to answer the menu call by the user. In view of this, the time in which the representation of the Popup Window is made possible is written to the PTS in the ICS, in the synchronous representation of the Popup Window menu.

Following the explanation about the recording medium of the present invention set forth above, a playback apparatus according to the present invention is explained as follows. The internal structure of the reproduction apparatus according to the second embodiment is substantially the same as that of the first embodiment, except for some improvements for the Object Buffer 15, and for the Graphics controller 17. Therefore the improvements for Object Buffer 15, and Graphics controller 17 are detailed below.

The graphic objects that are obtained by the decoding performed by the processor of the Graphics Flow 14 and which are to constitute an interactive screen are arranged in the Object Buffer 15 according to the second embodiment. FIG. 58 illustrates the content of the Object Intermediate Memory 15 compared to the Graphics Plane 8. The content of the Object Intermediate Memory 15 assumes a case in which the SDGs shown in FIG. 48 and FIG 49 are written in the Object Buffer 15. The examples of FIG. 48 and FIG. 49 perform the animation of the four buttons by 36 SDGs (SDG11-SDG49), where the SDGs representing all the frames of this animation are stored in this Object Buffer 15, and the representation position of each SDG 40 stored in this Object Buffer 15 is defined in the Graphics Plane 8. This representation position is defined by the horizontal_button_button and the vertical_position_Button of the corresponding button information. Animation is done by writing the plurality of ODS stored in Intermediate Memory 15 at the corresponding representation position of Graphics Plane 8, transferring one frame at a time. Four. Five

The graphics controller 17 of the second embodiment interprets the ICS provided in the Composition buffer unit 16, and executes the control based on the ICS. The execution timing of this control is based on the value of the PTS assigned to the ICS. The important task of this Graphics controller 17 is a write operation at the initial instant of representation of the interactive screen, and at the moment of update. The following describes, with reference to FIG. 59, the write operation at the initial display instant of the interactive screen 50 and at the update instant. FIG. 59 illustrates the operation performed by the Graphics controller at the initial moment of representation. As this diagram shows, the graphics controller 17 performs the control so that the ODS belonging to the S-ODS of button A are written in the representation position defined by the horizontal_button_button and the vertical_button_button of the button information on the button TO; and similarly, the ODS belonging to the N-ODS of buttons B, C and D are written in the respective representation positions 55 defined by the corresponding horizontal_button_Button and the_vertical_Button_button of the button information of the B, C buttons and D. Note at this point that the arrows w1, w2, w3, and w4 symbolically show the aforementioned writing. When writing, the initial representation shown in FIG. 51. It should be noted at this point that not all SDGs are necessary for the initial representation of the interactive display, provided that Object Buffer 15 contains the SDGs belonging to the S-SDG 60 of the default button selected and the ODS that belong to the N-ODS of the other buttons, is enough to

complete the initial representation of the interactive screen. Therefore, when the ODS belonging to the S-ODS of the button selected by default and the ODS belonging to the N-ODS of the other buttons have been decoded, it can be said that they are ready for the Graphics controller 17 to start performing the writing for the initial representation of the interactive screen.

FIG. 60 illustrates the operation performed by the Graphics controller 17 when updating the interactive screen according to the first User Action (Move Right). As this drawing shows, the graphics controller 17 performs the control so that the ODS belonging to the S-ODS of the B button is written at the representation position defined by the horizontal_button_button and the vertical_position_button of the button information on the B button ; and similarly, the ODS belonging to the N-ODS of button A are written in the representation position defined by horizontal_button_button and the vertical_position_button of the button information of button 10 A. Note at this point that arrows w5, w6 w7 and w8 show the writing mentioned above symbolically. When writing, the state change shown in FIG. 51. Buttons C and D are in the normal state, just as at the time of initial representation, but the writing in the Graphics Plane 8 is being continuously performed for them, so that the animation continues.

Similar to the previous one, FIG. 61 and 62 illustrate the operations performed by the Graphics controller 15 17, in the interactive screen update when the first User Action is "Move Down" and "On". At the time of updating the interactive screen, the S-ODS and the A-ODS of the buttons are different from those of the button selected by default, and thus it is desirable that all ODS have been stored in the Intermediate Memory of Objects 15.

In the reproduction apparatus, constructed as indicated above, each of the components 20 performs the decoding operations in a parallel processing method, just as in the first embodiment.

FIG. 63 is a timing diagram illustrating a parallel processing performed by the reproduction apparatus. The fourth row shows the BD-ROM Representation Set, and the third row shows the reading periods of ICS, PDS, ODS for the buffer of the Coded Data 13. The second row 25 shows decoding periods of ODS, where Decoding is performed by the Graphics Flow processor 14. The first row shows periods of operation of the Graphics controller 17. The decoding start time for the SDGs is shown by DTS11, DTS12, and DTS13 respectively. The storage for the Buffered Data buffer 13 of the first ODS (N-ODS [ODS1]) among those belonging to the N-ODS will be completed by DTS11. The storage in the buffer of Encoded Data 13, of the last 30 SDGs (N = SDG [SDG]) among those belonging to the NDS, will be completed by DTS12. Thus, each of the SDGs will be read for the encoded Data buffer 13 at the time shown by its own DTS.

On the contrary, the moment of completion of the decoding of each of the SDGs is shown by PTS11, PTS12, and PTS13 of the drawing. The decoding of the N-ODS (ODS1) performed by the Graphics Flow processor 14 will be completed by the PTS11; and the decoding of the N-ODS (ODSn) will be completed by PTS12. As such, in the time shown by the DTS of each of the SDGs, the SDG has been read for the encoded data buffer 13, and each of the SDGs read for the encoded data buffer 13 will be decoded and they will be written in the Object Buffer 15 at the time shown by the PTS shown by the corresponding PTS. The graphics flow processor 14 performs this series of operations, in a parallel processing method. 40

When the button selected by default is determined statically, all the Graphics Objects necessary for the initial representation of the interactive screen will be ready in the Object Buffer 15, when the decoding is complete for 1) the button_state group corresponding to the normal state, and 2) the first ODS of the button_state group corresponding to the selected state. In this drawing, at the instant shown by PTS13, all the Graphics Objects necessary for the initial representation of the interactive screen are ready. Four. Five

In this drawing, the period cd1 in the first row is the period necessary for the deletion of the Graphics Plane 8. In addition, the period td1 is the period necessary to write, to the Graphics Plane 8, the Graphics Objects that constitute the first page of the interactive screen, which are between the Graphics Objects obtained in the Object Intermediate Memory 15. The exact storage location of the Graphics Objects in the Graphics Plane 8 is the place shown by the horizontal_button_button and the vertical_button_position. In other words, cd1 (erase period 50 of the screen) td1 (period of writing of the Graphics Objects that have been decoded) are added to the PTS13 of the ODS, the decompressed graphics constituting the interactive screen that will be obtained on the Plane of Graphs 8 in the period obtained. Next, 1) by having the CULT unit 9 perform a color conversion of the decompressed graphics, and 2) by having the sum unit 10 combine the decompressed image stored in the video plane 6, the composition image will be obtained. 55

In opposition to the case in which the initial representation is made after decoding all the SDGs included in the Representation Set, it is possible, in the case established above, to perform an initial representation regardless of whether the decoding of a status group- button corresponding to the selected state has been completed, or if the decoding of a status group-button corresponding to the state

active is complete. Therefore, the initial representation will be done before in this case for the period h and 1 in the drawing.

It will be seen in this drawing, that each set of ODS1-ODSn has been assigned the same number, such as 1 to n. However, the sets are different from each other, and belong to the N-ODS, the S-ODS, and the A-ODS respectively. This also applies to each similar drawing later in this document. 5

In the graphics decoder 12, even while the Graphics controller 17 continues executing the deletion of the Graphics Plane 8, or writing in the Graphics Plane 8, the processor of the Graphics Flow 14 continues to perform the decoding (the decoding period of the ODSn, the decoding period of ODS1, and the decoding period n of the ODSn, in the second row). Therefore, it becomes possible to finish the decoding of the other SDGs other than those being treated by the Graphics controller 17, rather than conventionally, since the other SDGs will be decoded simultaneously with the decoding of the SDGs that are being dealing with the graphics controller 17. As it becomes possible to have the preparation for the update of the interactive screen before competing the decoding of the other SDGs, the update of the interactive display, which will use the other SDGs, will therefore be terminated before conventionally. The parallel processing mentioned above allows both the initial representation of the interactive screen and its updating to be carried out without delay.

FIG. 63 assumes the case in which the button selected by default has been statically determined. On the contrary, FIG. 64 is a timing diagram illustrating parallel processing by the playback apparatus in a case where the default selected button changes dynamically. When the button selected by default changes dynamically, the Graphics Objects necessary for the initial representation will be ready, when all the ODS belonging to the button-state group have been decoded and the Graphic Objects have been obtained in the Graphics Plane. In opposition to the case in which the initial representation is made after the decoding of all the SDGs included in the button-state group corresponding to the active state, the case established above allows the initial representation to be made regardless of whether the decoding of the corresponding status group-button active status has been completed. Therefore, the initial representation will be made before 25 in this case for the period h and 2 in the drawing.

FIG. 65 is a time diagram that chronologically illustrates the transitions in the occupation of the Graphics Plane 8, the Object Intermediate Memory 15, the Coded Data buffer 13, and the Composition buffer 16. The occupation notations used in this drawing conform to those used in FIG. 30. Like the SDGs that constitute the N-SDGs, the S-SDGs, the A-SDGs are decoded in the second embodiment, the number of simply increasing parts and the simply decreasing parts is greater than in FIG. 30. Except for this difference, FIG. 65 is the same as FIG. 30. Only in the first embodiment, the graphics for example in FIG. 65 are illustrated using: the DTS and the PTS assigned to the ODS; the DTS and PTS assigned to the ICS; the size and transfer rate of each of the buffers illustrated in FIG. 27. In addition to creating such graphics, users can know how the status of each of the buffers changes, in the editing stage. Since the transition of the state of each of the buffers can be adjusted by updating DTS and PTS, it is also possible, in this embodiment, to avoid generating the decoding load that would exceed the decoder specification on the side of the reproduction apparatus, and avoid the overflow incident of the buffer for playback. According to this, the hardware / software implementation will be made easy, in the development phase of the playback devices. 40

Next, the improvement of the software necessary to perform the reproduction apparatus of the second embodiment is explained.

FIG. 66 is a flow chart showing the process of loading operation of a functional segment. This drawing is drawn based on the flowchart of FIG. 31. The difference is that, after Step S29, Stages S36 and S67 are added to FIG. 66. 45

Step S36 is to judge whether the update_command_ flag is at 1. If it is at 1 (Step S36: Yes), only the button command is loaded in the button information for the Coded Data Intermediate Memory 13, and the others are ignored (Stage S37). If it is 0, the control moves to Step S22, thereby ignoring the ICS representing the Acquisition Point (Step S24).

Then, assuming the case in which multiplexing is performed as in FIG. 67, the following 50 explains how the DS is read. The example of FIG. 67 multiplexes three DS with a moving image. Among the three DSs, the first DS1 has a Start_Age as a Composition_state, includes a button command called LinkPL (PLNº5), and whose update_command_ indicator is set to 0.

DS10 is a "Duplicate" of DS1, and has the Acquisition Point as a Composition_state, includes a button command called LinkPL (PLN5) and whose update_command_ indicator is set to 0. 55

The DS20 is "Inheritance" of DS1, and has the Acquisition Point as the Composition_state. The difference with the DS1 is the button command (LinkPL (PLNº10)), and thus to represent this, its update_command_ indicator is set to 1.

We assume at this point that these three DS and the moving image are multiplexed in a Videoclip, and a jump operation is performed to the image data pt10 of ms1. In this case, the DS10 that is closer to the jump target is the objective of FIG. 66. In Step 27, it will be judged whether the composition_state is the Acquisition Point, but there is no preceding DS in the graphics decoder 12. Therefore the ignore indicator is set to 0, and this DS10 is loaded into memory Intermediate Encoded Data 13 of the reproduction apparatus 5 (hs1 of FIG. 68). On the contrary, when the objective of the jump operation falls after the position in which the Representation Set (ms2) exists, the Representation Set 20 (hs2 of FIG. 68) will be read for the Data buffer Coded 13.

FIG. 70 shows the loading of DS1, DS10, and DS20, in normal reproduction as performed in FIG. 69. Among the three DS, DS1 whose ICS Composition_state is the Beginning of Time is loaded into the buffer 10 of Coded Data 13 as it is (Step S23). However, the DS10, whose ICS Composition_state is the Acquisition Point, has the indicator of ignoring 1 (Step S29). Therefore, the functional segments that constitute DS10 will not be loaded into the buffer of the Encoded Data 13, and will instead be ignored (Step S24). In addition, as for DS20, it is true that its ICS Composition_state is the Acquisition Point, but its update_command_ indicator is set to 1. Therefore, Step S36 gets "Yes", and thus only the command of 15 is loaded. button thereof, and only the DS ICS button command over the Coded Data buffer 13 is replaced with the DS20 button command (Step S37). However, the ignore indicator still represents 1, and thus the different commands of this button command will not be loaded, and instead will be ignored.

When the DS20 is reached, the content of the screen remains the same, however the button command has changed from LinkPL (No. 5) to LinkPL (No. 19). Such replacement of the button command enables the control of changing the content of a button command. The following explains the processing performed by the Graphics controller. FIG. 71 is a flowchart that illustrates the main processing routine performed by the graphics controller 17. In this flowchart, the following three operations are executed repeatedly: the time stamp synchronization operation (Step S35), the operation of animation representation (Stage S36), and operation 25 UP (Stage S37).

At this point, the processing performed by the Graphics controller 17 is explained. The processing performed by the Graphics controller 17 changes greatly from what is shown in FIG. 36-38, to what is shown in FIG. 71-78. FIG. 71 is a flow chart illustrating the main processing routine performed by the Graphics controller 17. FIG. 72 is a flow chart illustrating the processing to perform the synchronization control 30 using the time stamp. In this flowchart, a judgment is made as to whether any of the conditions of Steps S41, S43-S47 is maintained. If any of the conditions is maintained, the corresponding operation is performed, and then returns to the main routine again. The established procedure is a subroutine.

Step S41 is to judge whether the current reproduction point is a point in time represented by the PTS of the S-ODS first, and the time represented by the PTS of the S-ODS last. If the current point of reproduction is judged to be one of the established instants, the period α thereof is calculated. The period α is obtained by the sum of (2) the period required to erase the Graphics Plane, and (1) the period required to write the Graphics Object obtained by decoding the SDGs, for the Graphics Plane.

In Step S42, the Graphics controller 17 refers to the Composition_state in the ICS, already) if the composition_state is the Beginning of Time, set α to be the "erase period of the plane (2) + period of writing 40 the plane (3) "; b) if the Compilation_state is the Acquisition Point, set α to be the period of writing of the plan (3). The calculation of the writing period of the plane (3) is carried out as follows: if the default_selected_button_number is a valid value, the calculation method of FIG. 54A; and if the default_selected_button_number is 0, the calculation method of FIG. 54B. When α is calculated, the control will return to the processing loop. Four. Five

Step S43 is to judge whether the current reproduction point is the instant represented by PTS-α in the ICS. If the judgment gives an affirmative result, a write operation is performed on the Graphics Plane 8 (Step S51), and the control returns to the main routine.

Step S45 is to judge whether the current point of reproduction is the PTS in the ICS. If the judgment gives an affirmative result then the extraction of the contents of the Graphics Plane 8 is instructed. The destination of the contents is 50 the CLUT 9 unit. The CLUT 9 unit performs the color conversion for the contents. Then the interactive screen will be combined with the contents of the video plane 9. As a result, the initial representation is performed (Step S52). Next, the variable "animation" (p) (p = 1, 2, 3… n) is set to 0 (Step S53), and the control returns to the main routine. At this point, the animation variable (p) is a global variable that indicates which frame number in the frame sequence is currently represented, used in the execution of the animation representation of button (p) 55 (a global variable is a variable that is valid through a plurality of flowcharts). Therefore in step S53, the button (p) of all the buttons will be set to 0.

Steps S46 and S47 are to judge whether the current playback point has reached the time information described in the ICS.

Step S46 is to judge whether the current playback instant is the instant represented by the PTS_selection_out_time, and if the judgment gives an affirmative result, an operation is performed to activate the button represented by the defective_activated_button_number, and the control returns to the main routine (Stage S54).

Step S47 is to judge if the current playback point is the PTS_select_out_time and if the judgment gives an affirmative result, the screen is cleared, then the control returns to the main routine (Step S55). In the synchronization operation established above, each of the operations in Step S51 and Step S54 is performed as a subroutine. Following this, the subroutine is explained in Step S51 with reference to FIG. 73

FIG. 73 is a flowchart that illustrates the writing operation of the initial menu representation, for the Graphics Plane 8. Step S64 is to judge whether the State_Composition in the ICS is the Beginning of Time, and if the judgment is affirmative, the Graphics Plane is deleted in Step S65, and the operations of Steps 66-73 are performed. 10 The period required to clear the Graphics Plane 8 is the period cd1 in FIG. 56 and FIG. 57. If the judgment of Step S64 is negative, Step S65 is skipped, and the operations of Step S66-S73 are performed.

Steps S66-S73 form a processing loop, which is repeated for each element of the ICS button information (Stages S66, S67). The button information that should go through this processing loop is called button information (p). fifteen

Step S67 is to judge whether the indication by the default_selected_button_number is valid or not. Step S68 is to judge whether the button_ info (p) is the button information corresponding to the default selected button indicated by the default_selected_button_number.

If the judgment in Step S68 is negative, the Graphics Object of the normal_object_id_start, indicated by the normal_ info_state of the button_button (p) is in the Object Intermediate Memory 15, and is identified as 20 the Graphics Object (p) ( Stage S69).

If the judgment in Step S68 is affirmative, the Graphics Object of the selected_object_id_start, indicated by the info_state_selected from the info_button (p) is in the Object Intermediate 15, and is identified as the Graphics Object (p) (Stage) S70), then the button (p) is set as the current button (Step S71). The current button is a button that has been set to be in the state selected in the interactive screen 25 currently displayed. The playback apparatus stores the identifier of this current button as PSR (10).

Once the Graphics Object (p) has been identified as a result of Stage S69 and Stage S70, the Graphics Object (p) is written at the position on the Graphics Plane 8, which is indicated by the horizontal_button_button position and the position_vertical_button of the button_info (p) (Step S72). Repeating the operations described above for each of the elements of the button information, the first Graphics Object, which is between the plurality of graphic objects each showing the status of a corresponding button, will be written in the Graphics Plane 8 The period required to perform the operation, which is addressed to the Graphics Object that is necessary for at least the initial representation of the Object Buffer 15, is shown by the period td1 of FIG. 56 and FIG 57.

When the default_selected_button_number is "= 0", and the default selected button changes dynamically, step S67 will be No, and it is judged whether the button_ info (p) corresponds to the current button. If the trial of Step S67 gives an affirmative result, the control goes to Step S70; and if the judgment gives a negative result, the control moves to Step S69.

Next, the processing of the subroutine is explained in Step S54, with reference to FIG. 74.

FIG. 74 is a flow chart illustrating the automatic activation processing for the button 40 selected by default. First, it is judged whether the default_activated_button_number is 0 or FF (Step S75). If the trial of Step S75 gives a result of "00", no processing is performed and the control returns to the main routine; and if the judgment of Step S75 results in "FF", the current button i is changed to the active state (Step S77), the animation variable (i) is set to 0, and the control returns to the main routine ( Stage S78).

If the judgment in Step S75 results in a value other than "00" and "FF", the button specified as the default_number_button_default is set as the current button (Step S76), the current button is changed to the active state (Step S77), the animation variable (i) corresponding to the current button i is set to 0, and the control returns to the main routine (Step S78).

The processing set forth above allows the button in the selected state to change to the active state after a predetermined time. fifty

The animation is explained below through the menu (Step S36). FIG. 75 is a flowchart showing animation rendering processing.

At this point, the initial representation is made by writing a Graphics Object in the Graphics Plane 8, the Graphics Object having been specified by 1) the normal_object_start of the normal_state_age and 2) the

start_object_selected from the selected_state_info, for each of the button_ info. At this point, the "animation" is a processing to update the Graphics Plane with an arbitrary plot of each of the buttons (ie Graphics Object of the ith plot), each time a cycle of the loop processing of Stage S35-Stage S37. This update is done by returning to the main routine, writing the Graphical Objects indicated by the normal_state_ info and the selected_state_ info from the button_button, one by one for the Plane 5 of Graphs 8. At this point, the variable q is used to identify each of the Graphical Objects indicated by the normal_info_state and the selected_info_state of the button_info, for each of the elements of the button information.

The processing for the realization of this animation representation is detailed with reference to FIG. 75. This flowchart assumes a case where the ICS_Repetition_ Indicator and the ICS_Repetition_Recording Indicator, 10 are set to indicate “necessary repetition”, to simplify the explanation.

Step S80 is to judge whether the initial representation has ended. If the trial of Step S80 gives a negative result, the control returns without performing any processing; If the trial of Stage S80 gives an affirmative result, Stages S81-Stage S93 are performed. Step S81-Step S93 constitutes a loop processing of repeating the operations of the operations of Step S83-Step S93, for each of the info_button in ICS 15 (Step 81, Step S82).

Step S83 is to set the animation variable (p) corresponding to the button_info (p), for the variable q. Performing this stage, the variable q will indicate the current number of frames corresponding to the button_ info (p).

Step S84 is to judge the button_ info (p) corresponds to the button currently in the selected state (hereinafter in this document "current button"). twenty

If the info_button (p) is judged to be different from that of the current button, the judgment of step S86 is performed.

Step S86 is to judge if the current button is in the active state, and if the judgment is affirmative, the identifier resulting from the sum of the variable q at the start_object_id_initial in the info_button (p). Info_state_activated is set to be the ID (q). Next, a button command is executed from among those included in the button_ info (p) (Step S88). 25

If it is judged that the current button is not in the active state, the identifier resulting from adding the variable q to the selected_object_id_start in the button_info (p) .selected_info_state is set to be the ID (q) (Step S89).

Once the ID (q) is determined as a result of the above operations, the Graphics Object (p) that has the ID (q) and that exists in the Object Buffer 15 is written to the position of the Graphics Plane 8 30 indicated by the horizontal_button_button position and the vertical_button_position of the button_button (p) (Step S90).

By the loop processing explained above, from among the plurality of Graphics Objects that constitute the selected state (or active state) of the current button, and the normal state of the other buttons, the Graphics Object corresponding to page q -th is written in the Graphics Plane 8.

Step S91 is to judge if the normal_object_id_start + has reached the normal_object_ end. If judgment 35 of Step S91 gives a negative result, the value resulting from increasing the variable q by 1 is set as the variable "animation (p)" (Step S92). If the judgment of Step S91 gives an affirmative result, the variable "animation (p)" is initialized to have the value 0 (Step S93). The operations established above are repeated for all the info_button in the ICS (Step S81, Step S82). When all the info_buttons have been subject to the previous operations, the control will return to the main routine. 40

During Stage S80-Stage S93 explained above, each time the main routine is performed (Stage S35-Stage S37), the image of each of the buttons on the interactive screen will be updated for a new Graphics Object. This means that, when the main routine mentioned above (Step S35 - Step S37) is performed several times, the so-called animation is performed. In the animation, the Graphics controller 17 adjusts the time so that the representation range for a frame of Graphics Objects will be the value indicated by the animation_frame_source_code.

It should be noted at this point that, in Step S88, the button commands included in the button_ info (p) are executed one by one. However, it is also possible to execute the button commands collectively, after the series of Graphics Objects corresponding to the active state has been represented. The process of the UO operation, which is performed in Step S37 of the main routine with reference to FIG. 76. 50

FIG. 76 is a flow chart showing the process of the UO operation. In this flow chart it is judged whether any of the conditions of Stages S100 - Step S103 is maintained. If any of the conditions is maintained, the corresponding processing is performed, and then returns to the main routine. Step S100 is to judge whether the TableMascUO is set to "1", and if the judgment is affirmative, the control will return to the main routine, without performing any processing. 55

Step S101 is to judge whether the Move Up / Down / Left / Right key has been pressed. If the judgment is affirmative, the current button is changed (Step S104), and then it is judged whether the auto_action_author of the current button is 1 (Step 108). If the judgment of Step S108 is negative, control returns to the main routine. If the judgment of Step 108 is affirmative, the control moves to Step S105.

Step S102 is to judge whether the activated key has been pressed. If the judgment is affirmative, the current button i is changed 5 to an active state (Step S105). Then, the variable "animation (i)" is set to 0 (Step 106).

Step S103 is to judge whether it is a case of numerical value input. If the judgment is affirmative, the corresponding numerical input operation is performed (Step S107), and the control returns to the main routine. Among the processes in FIG. 76, each of Stages 104 and Stage 107 is a subroutine. The processes of these subroutines are shown in FIG. 77 and FIG. 78. The following is an explanation of these flowcharts. 10

FIG. 77 is a flow chart showing the process of the current button change operation. First, from among the upper_button_number, the lower_button_number, the left_button_number, and the right_button_number, it is identified which belongs to the neighbor_ info of the current button, which corresponds to the key pressed (Step S110).

Then the current button is set as "button i", and the button that will be the new current button is set as 15 "button j" (Step S111). Step S112 is to judge whether the j button set in Step S111 corresponds to the i button. If it corresponds to any of the others, the control will return to the main routine without performing any processing. If it does not correspond to any of the others, the j button is set as the current button (Step S113), the "animation (i)" variable and the "animation (j)" variable are set to 0, and the control Go back to the main routine (Step S114).

FIG. 78 is a flow chart showing the process of the numerical value input operation. The trial is performed on whether there is an info_button j that has a button number that matches the numerical value entered (Step 121). Next, the judgment is made on whether the numerically_selectable_number of the button_ info j is 1 (Step S122). If Stage S121 and Stage S122 are "Yes", the current button changes to a normal state, and the j button is set as the current button (Stage S123), and the variable "animation (i)" and the variable " animation (j) "is set to 0 (Step S124). After these operations, the judgment is made as to whether the self-action_ indicator of the button_ info j is 25 1 (Step S125). If the judgment is negative, the control returns to the main routine.

If the judgment is affirmative, the current button is changed to the active state in Step S126, and the control returns to the main routine.

If any one of Steps S121-S122 is No, the control will return to the main routine.

Graphics controller 17 performs the above processes, to perform synchronized representation. At this point, please note that if a representation of the interactive screen activated by a user operation is performed using a pop-up window representation or similar, the Graphics Flow processor 14 and the Graphics controller 17 perform the following operations, which are the same operations performed to perform synchronized representation. Performing the following operations, the Graphics Object is obtained in the Graphics Plane 8. After the Graphics Object is obtained as mentioned above, it is expected until the current reproduction point passes the time indicated by the PTS assigned to the ICS. Then, after the mentioned instant, if the UO controller 18 receives a UO indicating a menu call, it will be taken to the CLUT 9 unit, and the CLUT 9 unit is instructed to perform the Graphics Object stored in the Plane of Graphics 8. If such extraction is performed in synchronization with the OU, a pop-up window representation will be performed according to the pressing of the menu call. 40

The above explanation shows the establishment of the PTS in the ICS; and the DTS in the ODS and the PTS, which belong to the DSn. However, it does not mention DTS in the ICS; DTS and PTS in the PDS; the DTS and the PTS in FIN. In view of this, the following explains the time stamps related to these. Since the WDS does not exist in the second embodiment, the ICS should be loaded to the Composition buffer, before 1) the start time of the decoding of the first PDS (PDS1) of the DSn (ie DTS (DSn [ODS1])) ), and 2) the time at which the first PDS (PDS1) in DSn becomes available (ie PTS (DSn [PDS1])). In other words, the value that satisfies the following expression should be set:

DTS (DSn [ICS]) ≤ DTS (DSn [ODS1])

DTS (DSn [ICS]) ≤ PTS (DSn [PDS1])

Next, the establishment of the DTS and the PTS is explained for each of the PDS belonging to the 50 DSn.

The moment in which each PDS belonging to a DSn becomes valid in the CLUT unit 9, is from 1) the moment in which the ICS is loaded to the Composition buffer 16 to 2) the moment of commencement of the decoding for the first ODS (DTS (DSn [ODS1]). In view of this, the PTS value of each of the PDS belonging to the DSn (ie PDS1 - PDSlast) should be set to the value that satisfies the following relationships : 55

 DTS (DSn [ICS]) ≤ PTS (DSn [PDS1])

PTS (DSn [PDSj]) ≤ PTS (DSn [PSj + 1]) ≤ PTS (DSn [PDSlast])

 PTS (DSn [PDSlast]) ≤ DTS (DSn [ODS1])

Next, the establishment of the PTS of the "END of the Representation Set Segment" belonging to the DSn is explained. The END belonging to the DSn shows the end of the DSn. Therefore it should be the instant of completion of the decoding of the last SDG (last SDG) of the DSn. This decoding end time is indicated by PTS (PTS (DSn [ODSlast])), and thus the End PTS should be set as the value indicated by the following expression:

 PTS (DSn [END]) = PTS (DSn [ODSlast])

In view of the relationship with the ICS belonging to the DSn and the DSn + 1, the ICS in the DSn is loaded into Composition buffer 10 before the instant of loading of the first ODS (ie ODS1). Therefore, the PTS in the END should be after 1) the loading instant of the ICS belonging to the DSn (ie DTS (DSn [ICS])), and before 2) the loading instant of the ICS belonging to the DSn + 1 (ie DTS (DSn + 1 [ICS])). Therefore, the PTS in the END should satisfy the following relationship:

 DTS (DSn [ICS]) ≤ PTS (DSn [FIN]) ≤ DTS (DSn + 1 [ICS]) 15

On the contrary, the moment of loading of the first ODS (that is, ODS1) PTS in FIN (ie PTS (DSn [FIN]) should be after the moment of loading of the PDS belonging to the DSn. Therefore, the PTS In FIN, you should satisfy the following relationship:

 PTS (DSn [PDSlast]) ≤ PTS (DSn [END])

Since the ICS, the PDS and the ODS to which the DTS and the PTS are set, are incorporated in advance in the Video Clip, it is convenient to describe an interactive control to make the reproduction apparatus execute a certain operation in the instant in the that a plot of a certain moving image appears on the screen. In other words, the above arrangement is convenient to describe an interactive control that is strongly synchronized with the contents of the moving image. In addition, the ICS, the PDS, and the ODS, are multiplexed over the Videoclip itself. Therefore in a case where the sections to which a user would like to perform the playback control 25 are numerous, such as a few hundred, it is not necessary to store all the IDS, PDS and ODS, which correspond to all sections. , in memory of. Because the ICS, PDS, and ODS have to be read from a BD-ROM, the following provision is sufficient. That is, ICS, PDS and ODS, which correspond to the section of moving image to be reproduced at the time, remain residents in memory. After the reproduction of this motion picture section is finished, the corresponding ICS, PDS, and ODS are deleted from memory, and instead, the 30 ICS, PDS, ODS corresponding to the subsequent motion picture section They are stored in memory. As ICS, PDS, and ODS are multiplexed in the Videoclip, even if the number of ICS, PDS and ODS are made up of a few hundred, memory occupancy can be restricted to a minimum required level.

As explained above, the present embodiment has 360 pages of ODS in the way the animation is performed. Therefore when the button material is grouped under three states, the SDGs will be grouped into 35 120 pages (that is, in three groups of button states). The button-state groups are arranged so that a group corresponding to the state that appears sooner is placed more at the beginning, compared to a group corresponding to the state that appears later. Because of this, in playback, a status group-button corresponding to the state that appears sooner is loaded to the playback apparatus accordingly sooner, compared to the status group-button corresponding to the state that appears later. Accordingly, 40 even if decoding of all 360 ODS pages has not been completed, at least the initial representation is ready to be performed if only about 1/3 - 2/3 of the total ODS are complete. Since the initial representation operation can be started when about 1/3 - 2/3 of the total SDGs are completed, even if there are numerous SDGs to read and decode, the initial display will not be delayed. Therefore, the interactive screen runs quickly, even if the screen contains animation to entertain users. Four. Five

(Third Embodiment)

 The present embodiment relates to a method of manufacturing a BD-ROM. FIG. 79 illustrates a method of manufacturing the PCS explained in the first embodiment.

 The method of manufacturing a BD-ROM includes: a step of producing material S201 to photograph an image, and record the corresponding audio, for example; an S202 editing stage of generating an application format; 50 and an S203 printing stage to complete the BD-ROM performing printing / lamination.

 Among these stages, the BD-ROM directed editing stage includes the following stages S204-Stage S210.

 In Step S204, control information, window definition information, palette definition information, and graphics are described. In Step S205, the control information, the information of

Window definition, palette definition information, and graphics respectively become a functional segment. In Step S206, the PTS is set in the PCS, according to when the image to be represented in synchronism appears. In Step S207, DTS [ODS] and PTS [ODS] are set according to the value of the PTS [PCS]. In Step S208, DTS [PCS], PTS [PDS], DTS [WDS], and PTS [WDS] are set according to the value of DTS [ODS], and in step S209, the chronological change, in the occupation, of each of the buffers of the blueprint model is expressed as a graph. In Step S210, it is judged whether the chronological change expressed in the graph satisfies the restriction imposed on the player model. If the judgment of step S210 gives an affirmative result, a graphics stream is created in Step S212, and a Videoclip is obtained by multiplexing the graphics stream with a video stream and an audio stream, which have been created separately at Start the flow of graphics. The Videoclip is then made to be in compliance with the BD-ROM format, therefore completing the application format. 10

 The above explanation is for the method of manufacturing a recording medium according to the first embodiment. A method of manufacturing the recording medium according to the second embodiment is shown in FIG. 80. In FIG. 80, Stages S304-Stage S308 replace Stages 204-Stage 208 of FIG. 79.

 Next, Stages S304-Stage S308 are explained. In step S304, the control information, palette definition information and graphics are described. In Step S305, the control information, palette definition information and graphics respectively become a functional segment. In Step S306, the PTS is set in the ICS, according to when the image to be represented in synchronism appears. Next in Step S307, DTS [ODS] and PDS [ODS] are set, according to the value of PTS [ICS]. In Step S308, the DTS [ICS] and the PTS [PDS] are set, according to the value of the DTS [ODS].

(Note) 20

 Needless to say, the above explanation does not show all the embodiments and the manner of use of the present invention. The present invention is also carried out by an embodiment for which any of the following modifications are added (A), (B), (C), (D), ... etc. Please note that the invention in the claims of the present invention are extended or generalized descriptions of any of the previously described embodiments, or modified embodiments based on the following modifications. The extension of the extension or generalization reflects the state of the art at the time of satisfying them.

(A) In all embodiments, the recording medium according to the present invention is assumed to be a BD-ROM. However, the characteristics of the recording medium of the present invention rest on the flow of graphics stored in the recording medium, and this characteristic does not depend on the physical nature of the BD-ROM. In other words, any recording medium that is operable to record a graphics stream can be used in the embodiment of the present invention.

Examples include: an optical disc such as a DVD-ROM, a DVD-RAM, a DVD-RW, a DVD-R, a DVD + RW, a DVD + R, a CD-R, a CD-RW; and an optical magnetic disk such as a PD and MD. Additional examples include a semiconductor memory card such as a compact flash card, a smart medium, a memory card, a multimedia card, and a PCM-CIA card. Even more examples include: a magnetic recording disc such as a floppy disk, a SuperDisco, Clik !; and a removable hard disk device such as ORB, Jaz, SparQ, SyJet, EZFley, and micro controller. Examples also include a hard disk built into a device.

(B) In all embodiments, the playback apparatus decodes the Videoclip stored in the BD-ROM, before taking it to television. However, a structure is also possible in which the playback apparatus is simply a DB-ROM device, and the other components are included in the television. In this case, the reproduction apparatus and the television can be connected to each other through an IEEE1394, to constitute a home network. The reproduction apparatus of the embodiments is for use with the television connected thereto. However, the reproduction apparatus may be integrated with a screen. Furthermore, in the reproduction apparatus of each of the embodiments, only the LSI system (integrated circuit), which is the essence of the processing, can be considered the invention. The reproduction apparatus and the integrated circuit are both the inventions described herein, and thus the act of manufacturing a reproduction apparatus having any of the established forms and modes, based on the internal structure of the reproduction apparatus. of the first embodiment is also an embodiment of the present invention. Any act of transfer whether incurring charges or not (sales if incurring expenses, and gifts if not incurring charges), rent and import constitute an embodiment 50 of the present invention. In addition, any act of carrying out these transfers and rentals, through store display, catalog request, and pamphlet distribution, also constitutes an embodiment of the present invention.

(C) The processing of the information shown in each of the flowcharts is carried out specifically using hardware resources. Therefore any programs whose processes are shown in the flowcharts 55 can respectively constitute an independent invention. All embodiments relating to the programs assume that a program is in the form incorporated in the corresponding playback apparatus. However, the program itself, shown in the first embodiment, may be an independent embodiment of the corresponding reproduction apparatus. The realization of a program properly includes: (1) the act of manufacturing the

Program; (2) the act of transferring the program whether or not you incur charges; (3) the act of renting; (4) the act of importing; (5) the act of providing it to the public through an interactive electronic communications circuit; and (6) offer the transfer to users in general, through store display, catalog request, pamphlet distribution, and so on.

(D) If the concept of time existing in each of the stages, which are executed chronologically in each flowchart 5, is considered an indispensable factor for the specification of the present invention, then each of the processes in the flowchart Flow is interpreted to describe a pattern of use of the reproduction method. If the processes of the flowcharts explained above are executed chronologically, each of the stages in which they are executed is executed, so that it is effective and serves as an instrument for achieving the object of the present invention, it will correspond to the realization of the recording method. of the present invention. 10

(E) When the BD-ROM is recorded, it is desirable that each of the TS packets constituting a Video Clip be assigned an extra control header. The extra control header is called "extra_TP_header", it includes a "Arrived_Time_seal" and a "copy_permission_indicator", and is 4 bytes long. The TS packages assigned to the extra_TP_header "(assigned TS EX package) are divided into groups each of which includes 32 TS packages, and are written in three sectors. The total size of the groups composed of each 32 TS EX- packages allocated is 15 6144 bytes (= 32 * 192), which is equal to the total size of the three sectors (6144 bytes (= 2048 * 3).) The 32 EX-assigned TS packets stored in a sector are referred to as a "Aligned Unit"

When used in a home network connected through IEEE1394, the playback apparatus transmits the Aligned Unit by the following transmission processing. That is, the transmitting device removes the extra_TS_ header of each of the 32 EX-ased TS packets in an Alignment Unit, encodes the 20 main bodies of the TS packets and takes them out. In the extraction of the TS packages, isochronous packages are inserted in many places between the TS packages. The exact places of insertion are based on the time shown by the Seal_Time_Arch of the header_extra_TS_. In response to the removal of the TS packages, the playback apparatus extracts the Descriptor_DTCP. The TCP_Descriptor means setting the permission / prohibition of copying of the extra_TP_header header. Therefore, if the Descriptor_DTCP is described to mean "prohibited copy", the 25 TS packets will not be recorded on another device, at the moment they are used in the home network connected through the IEEE1394.

(F) The digital flow in each of the embodiments is a video clip in a standard BD-ROM. However, it may alternatively be a VOB (Video Object) on the standardized DVD-Video or on the standardized Video Recorder DVD. A VOB is a program flow conforming to ISO_IEC 13818-1, and is obtained by multiplexing a 30 video stream and an audio stream. The video stream in a video clip can alternatively be in the MPEG4 method or in the WMV method. In addition, the audio stream may alternatively be in the Dolby = AC3 method, the MP3 method, the MPEG-AAC method, or the dts method.

(G) The film works in the embodiments can be obtained by encoding the analog image signals, or the flow data composed of the transport streams diffused through the digital broadcast. In addition, content can be obtained by encoding the analog / digital movie signals recorded on a videotape, or it can be a digital work distributed from a distribution server.

(H) The Graphical Objects shown in the first and second embodiments are frame data that have been encoded in a run-length coding method. The reason why the stroke-length coding method is used as a compression / coding method of the Graphic Objects is because the stroke-40 length coding method is the most suitable for compression / decompression of subtitles. Subtitles are characteristic in that the continuous length of an image point value in the horizontal direction is comparatively long. Therefore, if stroke-length coding compression is used, a high compression rate is obtained. In addition, the incident load on decompression is not much, and thus is suitable for creating software for decoding processing. In the present invention, the compression / decompression method used for subtitles is used for the Graphics Objects, so that an apparatus structure for decoding is shared between the subtitles and the Graphics Objects. However, it is not an indispensable feature to adopt the career-length coding method for the Graphics Objects of the present invention, and the Graphics Objects may alternatively be PNG data. In addition, the raster data can be vector data, or transparent images.

(I) PCS rendering effects may be given for the subtitle graphics selected in accordance with the language setting on the side of the device. Therefore, the rendering effect used to be performed by personnel represented by the main body of the moving image on current DVDs can be performed using the subtitle graphics represented in accordance with the language setting on the side of the device. This is very valuable in practice.

(J) The effects of PCS representation can be given for subtitle graphics selected by the side of the apparatus according to the establishment of the representation. Specifically, the graphics for the various modes of representation such as panoramic viewing, adjustment to the screen width (pan scan), and mailbox have been recorded on a BD-ROM, and the device selects one of them according to the setting of the television to which the device is connected, and represents the type of graphics selected. In this case, there will be an effect of

representation for the subtitle graphs represented as above. Therefore, subtitle graphics will look better. Therefore, the representation effect used to perform by the characters represented by the main body of the moving image on the current DVDs can be performed using subtitle graphic representations according to the establishment of representation of the device side. This is very valuable in practice.

(K) In the first embodiment, the write rate Rc for the Graphics Plane is defined so that the size of the window is 25% of the entire size, so that the deletion of the Graphics Plane and the new representation They are possible within a video frame. However, as an alternative, if we assume that the vertical re-plotting time is 25% of 1 / 29.93, then the Rc will be 1Gbps. By setting the Rc as such, the graphic representation will be facilitated. This is very valuable in practice.

 In addition to writing in the vertical re-plotting time, synchronized writing can be performed simultaneously with the write scan. Therefore, even if the write rate is Rc = 256 Mbps, representation will be facilitated.

(L) In each of the embodiments, the reproduction apparatus is equipped with a Graphics Plane. However, instead of this Graphics Plane, a buffer of lines that can store decompressed image points for a line can be mounted on the reproduction apparatus. Since the conversion within the image signal can be performed for each horizontal row (that is, a line), if such a line buffer is provided, the reproduction apparatus can perform the conversion into an image signal.

(M) Previously it has been explained that subtitles are graphics, as well as character sequences to represent the words pronounced in the works of films. However, subtitles may contain a combination of figures, characters and colors that constitute a trademark. In addition, the subtitles may contain all kinds of national brands, official brands adopted by nations for supervision and authorization, brands of international organizations, brands representing places of origin for specific commodities, and the like.

(N) The first embodiment assumes that the subtitles are represented in the upper / lower parts of the screen, and thus the windows are defined in the upper / lower parts of the Graphics Plane, accordingly. However, it is also possible to define the windows in the right / left parts of the Graphics Plane. This is useful in the representation of Japanese subtitles in the longitudinal direction.

(O) The Videoclip in each one of the realizations constitutes a film work. However, the Videoclip can be to perform "karaoke" (accompanied by a prerecorded tape). In this case, in the course of a song, the PCS can perform a rendering effect that changes the color of the subtitles, for example. 30

(P) In a case where a plurality of reproduction paths are joined in another, and the default selected button changes depending on the path on which reproduction is taken, the following arrangement is preferable. That is, the reproduction control in the dynamic scenario is described so that at the moment in which each of the reproduction paths is passed, the auto-value for the reproduction path is set in the register of the reproduction apparatus, and Playback processes are described so that the buttons will be set in a selected state according to the values set in the register. By this arrangement, the button that will be in the selected state can be changed according to the playback path to be passed.

Industrial Applicability

 The recording medium and the reproduction apparatus of the present invention, perform a subtitle representation that has a representation effect and an interactive representation that contains animation, and thus helps to provide the market with high-value film works added, which helps to invigorate the film market, and the consumer goods market. Therefore, the recording medium and the reproduction apparatus of the present invention are very useful in the film industry and in the consumer goods industry.

Claims (4)

1. A reproduction apparatus comprising:  an acquisition unit (2, 3) that operates to acquire, from a recording medium (1), a flow of graphics that includes a data package (WDS, PDS, ODS) and a control package (PCS; ICS) ,  including the data packet (WDS, PDS, ODS) graphic data and a decoding time stamp (DTS) 5 and a first presentation time stamp (PTS), indicating the decoding time stamp (DTS) a time of Beginning of a process for decoding graphic data, indicating the first presentation time stamp (PTS) the end time of said decoding process,  the control package (PCS) including a second presentation time stamp (PTS) indicating the presentation time which is at the time of completion indicated by the first presentation time stamp or later; 10  a processor (14) that operates to  (i) begin said decoding process at the beginning time, and  (ii) finalize said decoding process at said completion time; Y  a controller (17) that operates to write the decoded graphics data in a graphics plane (8) for said presentation time, the graphics plane (8) being the area where the graphic data is represented. fifteen 2. A method of reproduction comprising:  acquire, from a recording medium (1), a flow of graphics that includes a data packet (WDS, PDS, ODS) and a control packet (PCS),  including the data packet (WDS, PDS, ODS) graphic data and a decoding time stamp (DTS) and a presentation time stamp (PTS), indicating the decoding time stamp (DTS) the start time 20 of a process for decoding the graph data, the first presentation time stamp (PTS) indicating the completion time of said decoding process,  the control package (PCS) including a second presentation time stamp (PTS) indicating a presentation time that is the instant of completion indicated by the first presentation time stamp or later; 25  begin said decoding process at said start time;  finalize said decoding process for said completion time; Y  write the decoded graphic data in a graphics plane (8) for said instant of presentation, the graphics plane (8) being an area where the graphic data is represented. 3, A recording medium (1) that has a flow of graphics on it, in which 30  The graphics flow includes a data packet (WDS, PDS, ODS) and a control packet (PCS, ICS) and  The data package (WDS, PDS, ODS) includes graphics data and a decoding time stamp (DTS) and a first presentation time stamp (PTS), and  the decoding time stamp (DTS) indicates the start time of a process for decoding graphics data, and  the first presentation time stamp (PTS) indicates the moment of completion of said decoding process, and  the control package (PCS) includes a second presentation time stamp (PTS), and the second presentation time stamp (PTS) indicates the presentation time which is the end time of said decoding process or later, and 40  the presentation time is an end time of writing the decoded graphics data in a graphics plane (8), the graphics plane (8) being an area where the graphic data is represented. 4. A recording device for recording, on a recording medium (1), a flow of graphics, in which  The graphics flow includes a data packet (WDS, PDS, ODS) and a control packet (PCS, ICS), and  The data package (WDS, PDS, ODS) includes graphics data and a decoding time stamp (DTS) and 45 a first presentation time stamp (PTS), and  the decoding time stamp (DTS) indicates a start time of a process for decoding graphics data, and  the first presentation time stamp (PTS) indicates an end time of said decoding process, and the control package (PCS) includes a second presentation time stamp (PTS), and 5  the second presentation time stamp (PTS) indicates a presentation time that is the end time of said decoding process or later, and  the presentation time is the end time of writing the decoded graphic data in a graphics plane (8), the graphics plane being an area where the graphic data is represented. 5. A recording method comprising: 10  record, on a recording medium (1), a flow of graphics, including the flow of graphics a data packet (WDS, PDS, ODS) and a control packet (PCS, ICS), and  The data package (WDS, PDS, ODS) includes graphics data and a decoding time stamp (DTS) and a first presentation time stamp (PTS), and  the decoding time stamp (DTS) indicates a start stamp of a process for decoding the graph data, and  the first presentation time stamp (PTS) indicates the completion time of said decoding process, and  the control package (PCS) includes a second presentation time stamp (PTS), and  the second presentation time stamp (PTS) indicates the presentation time which is the completion time of said decoding process or later, and  the presentation time is an end time of writing the decoded graphics data in a graphics plane (8), the graphics plane (8) being an area where the graphics data is presented.