JP2013257492A - Control device, display device, control method, illumination control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a novel and improved control device, a novel and improved display device, a novel and improved control method, a novel and improved illumination control method, and a novel and improved program capable of efficiently relieving fatigue on eyes caused due to a luminance difference between a display region in which an image is displayed and a non-display region in which the image is not displayed.SOLUTION: There is provided a control device including an illumination control unit that controls an illumination device illuminating a non-display region of a light-shielding unit that includes a display region in which an image is displayed and the non-display region in which the image is not displayed and is designed to be disposed in a region covering a visual field of a user. The illumination control unit controls the illumination device according to display content of the display region.

Description

  The present disclosure relates to a control device, a display device, a control method, an illumination control method, and a program.

  In recent years, a technique for automatically adjusting the brightness of a display area according to the brightness of the periphery of the display has been proposed in order to reduce eye fatigue caused by viewing the display screen for a long time.

  For example, Patent Document 1 below discloses a technique for detecting the brightness of ambient light and automatically adjusting the brightness of the display area of the display in accordance with the detected brightness of the ambient light.

  Further, for example, Patent Document 2 below relates to a type of HMD (Head Mounted Display) that completely shields an external visual field, and includes a display area where an image is displayed and a non-display area. A technique has been disclosed in which an outer peripheral portion of an image is gradually blurred so that a boundary (image frame) is less likely to be noticed.

JP 2008-76767 A JP-A-5-328258

  However, the technique described in Patent Document 1 is not a technique for automatically adjusting the luminance around the display. For this reason, a luminance difference occurs between the display screen and the periphery of the display, and eye fatigue cannot be effectively improved.

  Further, the technique described in Patent Document 2 is a technique for controlling the luminance of the display area to decrease as it goes toward the outer periphery, and is not a technique for illuminating an area outside the display area. Therefore, it cannot be said that the luminance difference between the display area and the area outside the display area can be sufficiently reduced.

  Therefore, the present technology has been devised in view of the above circumstances, and is effective for eye fatigue caused by a luminance difference between a display area where an image is displayed and a non-display area where an image is not displayed. It is intended to provide a new and improved control device, display device, control method, illumination control method and program that can be improved.

  According to the present disclosure, the non-light-shielding unit having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's visual field. An illumination control unit that controls an illumination device that illuminates the display region is provided, and the illumination control unit is provided with a control device that controls the illumination device according to display contents of the display region.

  In addition, according to the present disclosure, the light-shielding unit has a display area in which an image is displayed and a non-display area in which the image is not displayed, and is designed to be disposed in an area that covers the user's visual field. An image display unit for displaying an image in the display region, an illumination unit that illuminates the non-display region, and an illumination control unit that controls illumination of the non-display region located around the display region. A display device is provided.

  In addition, according to the present disclosure, the light-shielding unit having a display area where an image is displayed and a non-display area where the image is not displayed and which is designed to be arranged in an area that covers the user's visual field, There is provided a control method including a step of controlling an illumination device that illuminates the non-display area according to display contents of the display area.

  In addition, according to the present disclosure, the light-shielding unit having a display area where an image is displayed and a non-display area where the image is not displayed and which is designed to be arranged in an area that covers the user's visual field, A program for causing a computer to realize an illumination control function for controlling an illumination device that illuminates the non-display area, and the illumination control function is provided by a program for controlling the illumination apparatus in accordance with display contents of the display area Is done.

  Further, according to the present disclosure, the light shielding unit has a display area in which an image is displayed and a non-display area in which the image is not displayed, and is designed to be arranged in an area that covers the user's visual field. Then, when displaying an image in the display area and illuminating the non-display area, illumination of the non-display area located around the display area according to information on the image displayed in the display area A lighting control method is provided for controlling the lighting.

  An image is displayed in the display area in a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed. In order to cause a computer to realize an image display function to be displayed and an illumination control function to control illumination to the non-display area located around the display area by controlling an illumination unit that illuminates the non-display area Programs are provided.

  As described above, according to the present disclosure, it is possible to effectively improve eye fatigue caused by a luminance difference between a display area where an image is displayed and an area outside the display area where the image is not displayed. .

It is explanatory drawing for demonstrating the terminology used in this indication. It is an external view which shows the 1st example of the display apparatus which concerns on this embodiment. It is an external view which shows the 2nd example of the display apparatus which concerns on this embodiment. It is a block diagram which shows the function structure of the display apparatus and control apparatus which concern on this embodiment. It is explanatory drawing for demonstrating the illumination control based on the average brightness | luminance of an image. It is explanatory drawing for demonstrating the illumination control based on the one part brightness | luminance of an image. It is explanatory drawing for demonstrating the illumination control based on the brightness | luminance of the edge part of an image. It is a flowchart which shows an example of the flow of the process which the control apparatus which concerns on this embodiment performs. It is a block diagram which shows the function structure of the display apparatus and control apparatus which concern on the modification of this embodiment. It is explanatory drawing for demonstrating the illumination control based on the meta information of an image. It is a block diagram which shows the function structure of the display apparatus and control apparatus which concern on the modification of this embodiment. It is explanatory drawing for demonstrating the image when not performing image control based on illumination control. It is explanatory drawing for demonstrating the image in the case of performing image control based on illumination control. It is explanatory drawing for demonstrating the illumination control according to the rhythm of the music matched with the image.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In addition, in the present disclosure and a part of the drawings, a plurality of constituent elements having substantially the same or related functions are distinguished by attaching different numbers or alphabets after the same reference numerals, or through hyphens or underbars. Different numbers and alphabets may be attached to distinguish them.

  However, in the present disclosure and other parts of the drawings, the same reference numerals may be given when it is not necessary to distinguish between a plurality of components having substantially the same or related functions.

The description will be made in the following order.
1: Introduction (Figure 1)
2: Basic configuration 2-1: Appearance of display device 100 (FIGS. 2 and 3)
2-2: Functional configuration of control device 150 (FIG. 4)
2-2-1: Lighting control based on the average luminance of the image (Fig. 5)
2-2-2: Lighting control based on a partial region of the image (FIG. 6)
2-2-3: Illumination control based on the peripheral area of the image (FIG. 7)
2-3: Flow of processing performed by control device 150 (FIG. 8)
3: Modification 3-1: Lighting control based on external environment (FIG. 9)
3-2: Control Based on Image Meta Information 3-2-1: Control Based on Image Imaging Condition 3-2-2: Control Based on Image Flag (FIG. 10)
3-3: Control of image brightness / color based on brightness / color of illumination unit (FIGS. 11 to 13)
3-4: Lighting Control Based on Rhythm Lighting Control at Predetermined Rhythm 3-5: Example of Combination 3-5-1: Lighting Control Based on Image and External Environment 3-5-2: Lighting Control Based on Image and Rhythm (Fig. 14)
4: Summary

(Overview)
In the basic configuration in the heading, a non-display area (in the present disclosure, an illumination area) of the display apparatus 100 is based on an image (in the present disclosure, simply referred to as an image) displayed in the display area of the display device 100. A configuration for performing illumination control will be described.

  Moreover, in the modification in the said heading, the structure which performs the illumination control of the illumination area of the display apparatus 100 based on the external environment of the display apparatus 100 in addition to an image, the structure which performs the illumination control based on a rhythm, and these and the above-mentioned A combination of the basic configurations will be described.

<1: Introduction (Fig. 1)>
Prior to the description of the display device 100 and the control device 150 according to the present embodiment, the “edge”, which is a term used in the present disclosure, will be described with reference to FIG.

  FIG. 1 is an explanatory diagram for describing terms used in the present disclosure. In the following description, as shown in FIG. 1, attention is focused on a closed region ECR that is defined by an arbitrary boundary 502 and is a closed region, and a region other than the closed region ECR.

  In general, the term “edge” refers to “the region 504 around the boundary 502 among the closed region ECR closed by the predetermined boundary 502” and “the region other than the closed region ECR” shown in FIG. It is a concept including a region 506 around the boundary 502 ”.

  Therefore, in the present disclosure, “the region 504 around the boundary 502 among the closed regions ECR closed by the predetermined boundary 502” and “the region around the boundary 502 among the regions other than the closed region ECR shown in FIG. In order to distinguish from the “region 506”, the “region 504 around the boundary 502 among the closed regions ECR closed by the predetermined boundary 502” is referred to as “the edge of the closed region ECR”. The “region 506 around the boundary 502 among the regions other than the closed region ECR” is referred to as “the edge of the region other than the closed region ECR”.

  For example, when the “closed area ECR” is the “display area”, the “area 504 around the boundary 502 in the display area” is referred to as “the edge of the display area”.

  For example, when the “area other than the closed area ECR” is the “illumination area”, the “area 506 around the boundary 502 among the illumination areas” is referred to as “the edge of the illumination area”. And

The following explanation will be given using the above terms.
<2: Basic configuration>

[2-1: Appearance of Display Device 100 (FIGS. 2 and 3)]
Hereinafter, the display device 100 according to the present embodiment will be described with reference to FIGS. 2 and 3. The display device 100 is controlled by the control device 150. 2 and 3 are external views showing examples of the display device 100. FIG. 2 and 3 are diagrams schematically showing a cross section when the display device 100 is cut in a direction substantially parallel to the user's line of sight.

  Here, the display device shown in FIGS. 2 and 3 is an example of the display device 100, and the position of some components may be changed, or some components may be added, deleted, or changed. Good. In the following description, the display device 100 is described as a non-transmissive HMD that does not transmit light outside the HMD to the inside of the HMD, but the light outside the HMD or part of the light is transmitted inside the HMD. It may be a transmissive HMD or a display other than the head-mounted type.

  Further, the technology according to the present disclosure can be applied even to a device in which the display device 100 and the control device 150 are integrated. The control device 150 may be a server or the like that can be accessed by the display device 100. Further, the control device 150 according to the present embodiment may be integrated with a device associated with the display device 100.

  2 and 3 show a configuration for displaying an image on one side of the user in the display device 100. In an actual HMD, a configuration as shown in FIG. 2 or 3 is provided corresponding to each of the left and right eyes of the user.

  As shown in FIGS. 2 and 3, the display device 100 includes an illumination unit 102, an image display unit 104, and a lens 106. The display device 100 may include a plurality of illumination units 102 as illustrated in FIGS. 2 and 3, or may include one illumination unit 102. The display device 100 also includes a light shielding unit (not shown) that covers the illumination unit 102, the image display unit 104, the lens 106, and the like, and shields light from the external environment by being mounted around the user's eyes. .

  The function as the illumination part 102 is implement | achieved by light emitting elements, such as LED (Light Emitting Diode), for example. The function as the illumination unit 102 can also be realized by a combination of a light emitting element and a light shielding element that shields light from the light emitting element.

  The function as the image display unit 104 is realized by, for example, a liquid crystal display device or an organic EL (Electroluminescence) display device. A part of a liquid crystal display device, an organic EL display, or the like may be used as the illumination unit 102.

  In addition, the lens 106 is appropriately designed in shape and material selected according to the image display unit 104 and the position of the user's eyes. The light from the image display unit 104 may reach the user's eye E through one or more reflections at the boundary surface of the lens 106.

  As shown in FIGS. 2 and 3, the light from the image display unit 104 enters the user's eyes E through the lens 106. The optical path P in FIGS. 2 and 3 shows an example of a path until the light reaches the user's eye E from the image display unit 104.

  Here, the region where the user can clearly recognize the image is a part of the field of view of the user. Therefore, in general, in a display device such as an HMD, the display device 100 is designed so that a virtual image from the image display unit 104 is formed in an area where a user can clearly recognize an image.

  In the present disclosure, a region where a virtual image from the image display unit 104 is formed is referred to as a display region.

  On the other hand, the non-display area generally has a black frame shape because no image is displayed. For this reason, the luminance difference between the display area and the peripheral area of the display area causes fatigue of the eyes of the user.

  Therefore, in the present disclosure, a technique for reducing the luminance difference between the display area and the non-display area by adjusting the luminance of the non-display area with the irradiation light from the illumination unit 102 will be described.

  In the display device 100 according to the present disclosure, the luminance of the irradiation light of the illumination unit 102 is adjusted based on the luminance of the image displayed on the image display unit 104.

  Irradiation light from the illumination unit 102 also enters the user's eyes through the lens 106. However, by increasing the luminance of the non-display area, a portion of the display area that is close to the non-display area may become bright.

  Therefore, it is preferable to design the optical path P from the image display unit 104 and the optical path from the illumination unit 102 to be different.

  For example, like the illumination unit 102-1 in FIG. 2, it is conceivable to arrange the illumination unit 102 on each of the opposing side surfaces of the image display unit 104.

  Also, for example, like the illumination unit 102-2 in FIG. 3, the illumination unit is located on the surface of the lens 106 that faces the user and does not overlap with the display area where the image is displayed when viewed from the user. It is possible to arrange 102.

  With the arrangement of the illumination unit 102 as described above, it is possible to effectively illuminate an area outside the display area while preventing a decrease in image visibility by the user displayed in the display area.

  The configuration of the display device 100 that is controlled by the control device 150 has been described above with reference to FIGS. 2 and 3.

[2-2: Functional configuration of control device 150 (FIG. 4)]
Hereinafter, functional configurations of the display device 100 and the control device 150 will be described with reference to FIG. In FIG. 4, the solid line indicates the flow of the electric signal, and the dotted line indicates the light emission from the image display unit 104. In FIG. 9 and FIG. 11, the line type has the same meaning.

  The display device 100 includes the illumination unit 102, the image display unit 104, and the lens 106 as described above. In addition, the control device 150 includes an illumination control unit 152 and an image control unit 154.

  An image signal is input from the image control unit 154 to the illumination control unit 152 of the control device 150. The image signal includes, for example, a luminance signal of each pixel of the image, a color signal expressed by a set of R signal value, G signal value, and B signal value.

  The illumination control unit 152 of the control device 150 adjusts the luminance and color of the illumination unit 102 of the display device 100 based on the input image information. A more specific control method will be described later. The input image may be a still image or a moving image. The input image may be a two-dimensional image or a stereoscopic image (three-dimensional image).

  The image control unit 154 of the control device 150 controls the image display unit 104 of the display device 100.

  In addition, light from the image display unit 104 of the display device 100 enters the user's eyes E through the lens 106. In addition, as in the example illustrated in FIG. 2, it is also conceivable that light from the illumination unit 102 of the display device 100 enters the user's eyes E through the lens 106.

  The functional configurations of the display device 100 and the control device 150 have been described above with reference to FIG.

  Below, the example of the control method which the illumination control part 152 of the control apparatus 150 performs is demonstrated, referring FIGS. In the following, description will be given mainly focusing on the luminance of the image, but it is possible to control the color based on the same concept.

  Further, the illumination control unit 152 may perform only one or both of luminance control of the illumination region based on the luminance of the display region and color control of the illumination region based on the color of the display region. Good.

(2-2-1: Illumination control based on average luminance of image (FIG. 5))
FIG. 5 is an explanatory diagram for explaining illumination control based on the average luminance of an image. In the display area AR1 of the display device 100, an image with a low average luminance of the entire area such as an image taken outdoors at night or an image of the universe is displayed.

  The non-display area is, for example, an area in contact with the edge of the display area AR1 when viewed from the user. The non-display area is, for example, an area in contact with the left edge of the display area AR1 (AR2 in FIG. 5) or an area in contact with the right edge of the display area AR1 (AR3 in FIG. 5).

  For example, the illumination control unit 152 of the control device 150 adjusts the brightness of the non-display areas (also referred to as illumination areas in this disclosure) AR2 and AR3 based on the average brightness of the image displayed in the display area AR1. To do.

  For example, the illumination control unit 152 performs illumination control so that the luminance of the illumination areas AR2 and AR3 becomes the average luminance of the image displayed in the display area AR1. The illumination controller 152 may illuminate the illumination areas AR2 and AR3 independently of each other.

  As described above, by adjusting the non-display area to the average luminance of the image, it is possible to achieve the effect of reducing eye fatigue while reflecting the impression of the entire image.

  Here, it is known that when the image input to the control device 150 is a stereoscopic image, the boundary between the display area and the non-display area becomes a step like a frame (frame effect). Therefore, as described above, the effect of reducing eye fatigue by reducing the luminance difference between the display area and the non-display area is particularly remarkable when a stereoscopic image is input to the control device 150. .

(2-2-2: Illumination control based on a partial region of the image (FIG. 6))
FIG. 6 is an explanatory diagram for explaining illumination control based on a partial region of an image. The basic idea is the same as the method shown in FIG.

  The illumination control method shown in FIG. 6 is an effective method when the luminance of one area of the image is low and the luminance of another area is high.

  When an image with a large luminance deviation is displayed in the display area, it is first considered to determine the luminance of the illumination area based on the average luminance of the entire display area as in the illumination control method shown in FIG. . In this case, it is conceivable that the luminance difference is small near one boundary among the boundaries between the display area and the illumination area, but the luminance difference is large near another boundary.

  Therefore, when there are a plurality of illumination areas, the illumination control unit 152 may adjust the brightness of the illumination area based on the brightness of the display area adjacent to each illumination area.

  For example, when there are a plurality of illumination areas, the illumination control unit 152 may adjust the brightness of the illumination area based on the average brightness of the pixels constituting the display area adjacent to each illumination area.

  As illustrated in FIG. 6, for example, the luminance of the illumination area AR2 that is a peripheral area of the display area AR1 is the luminance of the area on the side in contact with the illumination area AR2 (area AR1_L in FIG. 6) of the display area AR1. Controlled based on

  Further, the luminance of the illumination area AR3 which is an area around the display area AR1 and is different from the illumination area AR2 described above is an area on the side in contact with the illumination area AR3 in the display area AR1 (see FIG. 6). It is controlled based on the luminance of the area AR1_R).

  As described above, the display area is divided, and the brightness difference between the display area where the image is displayed and other areas is controlled by controlling each illumination unit 102 based on the luminance of each divided area. Can be made smaller.

  In the example shown in FIG. 6, the display area is divided into two and control is performed based on the luminance of each divided area. However, the scope of application of the technique according to the present embodiment is not limited to this, and the display area The same control can be performed when the is divided into three or more.

  As a result, it is possible to further reduce the eyestrain of the user.

(2-2-3: Illumination control based on the peripheral area of the image (FIG. 7))
FIG. 7 is an explanatory diagram for explaining illumination control based on a peripheral region of an image. FIG. 7 shows an example in which the brightness control of the illumination areas AR2 and AR3 is performed based on the brightness of the edge AR11 of the display area AR1.

  As illustrated in FIG. 7, the illumination control unit 152 is configured to display the non-display area based on the luminance of the edge of the display area AR1 (for example, the average luminance of the pixels included in the image displayed on the edge of the display area AR1). It is also conceivable to perform illumination control of the illumination unit 102 so as to adjust the luminance of the illumination unit 102.

  As described above, by adjusting the illumination irradiated to the non-display area based on the brightness of the edge of the display area, it is specialized near the boundary where the brightness difference between the display area and other areas is conspicuous Effective lighting control becomes possible.

  For example, in the example shown in FIG. 7, the average brightness of the entire display area AR1 is higher than the average brightness of the edge of the display area AR1. Therefore, when the illumination control of the illumination areas AR2 and AR3 is performed based on the average brightness of the entire display area AR1, the brightness difference increases near the boundary between the edge of the display area AR1 and the edge of the illumination area AR2, etc. End up.

  On the other hand, by performing illumination control of the illumination areas AR2 and AR3 based on the brightness of the edge of the display area AR1, the brightness difference near the boundary between the edge of the display area AR1 and the edge of the illumination area AR2, etc. is reduced. It becomes possible to do.

  The example of the control method performed by the illumination control unit 152 of the control device 150 has been described above with reference to FIGS.

[2-3: Flow of processing performed by control device 150 (FIG. 8)]
Hereinafter, an outline of a flow of processing performed by the control device 150 will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of the flow of processing performed by the control device 150.

  As illustrated in FIG. 8, first, the illumination control unit 152 acquires the luminance of each pixel included in the entire image or a part of the image from the image control unit 154 (S102). Here, the image is an image displayed in the display area of the display device 100 that is the control target of the control device 150.

  Further, for example, as in the example illustrated in FIG. 7, when the illumination control unit 152 performs the illumination control based only on the luminance of a part of the region such as the edge of the image, Only the luminance may be acquired. As a result, the processing load on the control device 150 can be reduced and processing can be performed at high speed.

  Next, the illumination control unit 152 calculates the luminance of the illumination area illuminated by the illumination unit 102 of the display device 100 based on the acquired luminance (S104). For example, the illumination control unit 152 adjusts the brightness outside the display area according to the average brightness of the display area where the image is displayed.

  Next, the illumination control unit 152 performs illumination control of the illumination unit 102 so that the luminance of the illumination area becomes the calculated luminance (S106).

  The outline of the flow of processing performed by the control device 150 has been described above with reference to FIG. Note that FIG. 8 is an example, and some processing steps may be added or changed.

  The basic configuration of the display device 100 has been described above with reference to FIGS.

<3: Modification>
The basic configuration of the present embodiment has been described above, but the scope of application of the technology according to the present embodiment is not limited to this. For example, modifications that can be conceived in view of common technical knowledge at the time of implementation illustrated below are naturally included in the scope of application of the technology according to the present embodiment.

[3-1: Lighting control based on external environment (FIG. 9)]
Hereinafter, with reference to FIG. 9, a modified example in which the illumination area is controlled based on the external environment in addition to the luminance of the image considered in the above basic configuration will be described.

  FIG. 9 is a block diagram illustrating a functional configuration of the display device 100 according to the present modification. Below, the structure which controls an illumination area | region based on environmental light among external environments is demonstrated.

  For example, as illustrated in FIG. 9, the illumination control unit 152 of the control device 150 according to this modification example is based on the brightness of the ambient light input from the image control unit 154 and the ambient light detection unit 108 of the display device 100. The illumination control of the illumination unit 102 of the display device 100 is performed.

  For example, the environment detection unit 108 of the display device 100 is disposed in a part of the HMD that is in contact with the external environment, or is disposed in a part of a space in which the display device 100 is installed.

  The external environment in the case of the HMD is, for example, an environment outside the light shielding unit. In other words, for example, when a non-transparent HMD is attached, the user cannot visually recognize, but when the non-transparent HMD is removed from the head, the user can visually recognize the environment. It is.

  In the case of a display other than the HMD, for example, in addition to a space in which the display is installed (for example, a room in which the display is installed), the outside of the space (for example, outside the room in which the display is installed) ) Is considered as the external environment, and it is possible to detect the intensity of ambient light.

  By using the ambient light to control the brightness of the illumination area, when the HMD or the like is attached or detached, or when the user exits the room where the display is installed, the brightness of the environment visually recognized by the user is changed. It is possible to reduce the burden on the user's eyes.

  It is also possible to control the luminance of the illumination area in consideration of external environmental factors other than ambient light, such as temperature, humidity, and weather. It is also possible to control the luminance of the illumination area according to the time zone.

  The lighting control in consideration of the external environment has been described above with reference to FIG.

[3-2: Control based on image meta-information]
Hereinafter, a modification example in which the luminance of the illumination area is controlled based on the meta information added to the image will be described with reference to FIG.

(3-2-1: Control based on image capturing conditions)
The illumination control unit 152 can also control the illumination unit 102 based on information about imaging conditions such as the type of digital camera, imaging date and time, and exposure conditions, which are added when an image is captured by the digital camera.

(3-2-2: Control based on image flag (FIG. 10))
The information added to the image is not limited to the information related to the imaging conditions. For example, the illumination control unit 152 may perform illumination control of the illumination unit 102 based on meta information such as a flag added in advance to a predetermined scene as an effect of a moving image such as a movie.

  Even if the flag added to the predetermined scene is not previously given by the video producer or the like, the lighting control unit 152 can analyze the video by analyzing the video such as the presence or absence of the predetermined scene and the time when the predetermined scene is displayed. The illumination control of the illumination unit 102 may be performed based on the information that can be acquired.

  For example, an example as shown in FIG. 10 is conceivable for the control based on an image flag or the like. FIG. 10 is an explanatory diagram for explaining illumination control based on image meta-information.

  As shown in FIG. 10, in the case of a moving image where the scene changes from a normal scene (FIG. 10A) to an explosion scene (FIG. 10B), the brightness of the illumination areas AR2 and AR3 at the start of the explosion scene (FIG. 10B) It can be considered that the display area AR1 is significantly higher than the average luminance and the like to surprise the viewer.

  The illumination control based on the meta information of the image as described above enhances the effect of the image and allows the user to be more immersed in the image.

  The lighting control based on the image meta information has been described above with reference to FIG.

[3-3: Control of Image Brightness / Color Based on Luminance / Color of Illumination Unit (FIGS. 11 to 13)]
In the basic configuration and the modification described above, the illumination control of the illumination unit has been described based on the brightness of the image, the meta information, and the like. However, the scope of application of the technology according to the present embodiment is not limited to this.

  For example, a configuration in which the luminance, color, etc. of the image displayed in the display area is controlled according to the luminance, color, etc. of the illumination unit that illuminates the illumination area is also possible. Below, the modification which performs image control according to illumination control is demonstrated, referring FIGS. 11-13.

  FIG. 11 is a block diagram illustrating functional configurations of the display device 100 and the control device 150 when image control is performed according to illumination control. In the technology according to this modification, as shown in FIG. 11, in addition to the information flow from the image control unit 154 to the illumination control unit 152, the information flow from the illumination control unit 152 to the image control unit 154 also occurs. In other words, the illumination control unit 152 and the image control unit 154 cooperate to perform the following control.

  The image control unit 154 predicts the luminance of the illumination area irradiated by the illumination unit 102 based on the signal from the illumination control unit 152, and adjusts the luminance of the image according to the luminance of the illumination region.

  Here, FIG. 12 is an explanatory diagram for describing an image when image control based on illumination control is not performed. FIG. 13 is an explanatory diagram for explaining an image when image control based on illumination control is performed.

  As shown in FIG. 12, when the image control based on the illumination control is not performed, the luminances of the illumination regions AR2 and AR3 are only controlled according to the luminance of the display region AR1.

  On the other hand, when performing image control based on illumination control, for example, as shown in FIG. 13, luminance continues from the edge of the display area AR1 to the edge of the illumination area AR2 and the edge of the illumination area AR3. It is conceivable to control the image so as to change with time.

  By performing image control so that the luminance continuously changes from the edge of the display area AR1 to the edges of the illumination areas AR2 and AR3, it is possible to further reduce eyestrain of the user.

  By combining the above configuration with the illumination control of the illumination unit 102 performed by the illumination control unit 152, the luminance near the boundary between the display region and the illumination region can be changed more continuously.

  In the above, the modification which performs image control according to illumination control was demonstrated, referring FIGS.

[3-4: Lighting control based on rhythm]
Below, the modification which performs the illumination control based on a rhythm is demonstrated.

  In this modification, the illumination control unit 152 performs illumination control of the illumination unit 102 based on a predetermined rhythm.

  The illumination control unit 152 illuminates the illumination unit 102 so that, for example, when the time change in brightness of the illumination unit 102 is graphed, the illumination control unit 152 has a waveform (for example, a sine wave or a square wave) that changes at a constant cycle. Take control.

  In addition, the illumination control unit 152 may perform illumination control of the illumination unit 102 so as to match the rhythm of various musical pieces, for example.

  In the above, the technique which concerns on the modification of this embodiment was demonstrated.

[3-5: Example of combination]
The basic configuration and the modification example according to the present embodiment have been described above. The technologies related to these basic configurations and the technologies related to the modification examples can be combined. Below, the example of the combination of these techniques is demonstrated.

  However, the combination of the techniques according to the basic configuration and the modified example is not limited to the following example.

(3-5-1: Lighting control based on image and external environment)
For example, the illumination control unit 152 can perform illumination control of the illumination unit 102 based on both the image displayed in the display area and the external environment.

  When lighting control is performed in consideration of two or more elements, it is necessary to consider a ratio that considers each of these elements.

  For example, in the case of considering the two elements of the image and the external environment as in this combination, the user may determine a ratio in which the image and the external environment are considered, and the illumination control unit 152 However, the ratio may be automatically determined according to the content of the image, the situation of the external environment, and the like.

  For example, a case where a user views a moving image using an HMD is considered as an example. For example, the illumination control unit 152 changes the ratio of considering the image and the external environment depending on the position of the reproduction part in the entire moving image.

  The lighting control unit 152 increases the ratio of considering the external environment for the beginning of the moving image, and reduces the luminance difference between the external environment and the HMD internal environment. In addition, the lighting control unit 152 gradually increases the ratio of considering the image from the beginning to the middle of the moving image so that the user can be immersed in the content of the moving image. In addition, the lighting control unit 152 gradually increases the ratio of considering the external environment from the middle part to the end part of the moving image, and reduces the luminance difference when the user removes the HMD.

  It is also conceivable that information regarding a ratio that considers each of the image and the external environment is added to the image input to the control device 150 as meta information.

  The meta information may have different contents depending on the type of image, for example, whether it is a game or a movie.

  For example, in the case of a game, it is conceivable to increase the ratio of considering the external environment in order to prevent the user from being immersed in the game for a long time. On the other hand, in the case of a movie, it may be possible to increase the ratio of considering images so that the user can be more immersed in the story.

(3-5-2: Lighting control based on image and rhythm (FIG. 14))
For example, the illumination control unit 152 can also perform illumination control of the illumination unit 102 based on both the moving image displayed in the display area and the rhythm of the music that is the back music of the moving image.

  For example, even if there is no change or a slight difference in the image displayed in the display area AR1 from FIG. 14A to FIG. 14B, the back music of the image shown in FIG. 14A and the back music of the image shown in FIG. If they are different, the brightness of the illumination areas AR2 and AR3 will change.

  For example, the illumination control unit 152 performs illumination control of the illumination unit 102 based on the average luminance of the moving image when the average luminance of the moving image changes by a predetermined threshold or more in a predetermined time. On the other hand, the lighting control unit 152 performs lighting control so that the luminance of the lighting unit 102 changes at a predetermined rhythm when the average luminance of the moving image does not change by a predetermined threshold or more at a predetermined time.

  As described above, when the time change of the average luminance of the moving image is small, the user can watch the moving image without getting bored by performing the lighting control that changes the luminance of the lighting unit 102 with a predetermined rhythm. It is considered possible.

<3: Summary>
Finally, the technical idea of this embodiment will be briefly summarized. The technical idea described below can be applied to a control device that controls a display device such as a non-transmissive HMD. For example, the control device expressed as the following (1) makes it possible to reduce eye fatigue caused by the luminance difference between the display area and the non-display area of the display device.

(1)
Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view A lighting control unit for controlling the device;
The illumination control unit controls the illumination device according to display contents of the display area.
Control device.
(2)
The illumination control unit controls the illumination in conjunction with information of an image displayed in the display area.
The control device according to (1) above.
(3)
The illumination control unit controls the illumination device based on information of pixels constituting a predetermined area of an image displayed in the display area.
The control device according to (2).
(4)
The illumination control unit controls the illumination based on information of pixels located in the vicinity of the periphery of the display area among pixels constituting an image displayed in the display area.
The control device according to (3).
(5)
The illumination control unit controls the brightness of the illumination in conjunction with the brightness of an image displayed in the display area.
The control device according to any one of (2) to (4).
(6)
The illumination control unit controls the color of the illumination in conjunction with the color of the image displayed in the display area.
The control device according to any one of (2) to (5).
(7)
An image control unit for displaying an image displayed in an area close to the non-display area in the display area so that the image is gradually blurred;
The control device according to any one of (1) to (6).
(8)
The image control unit controls the luminance of an image to be displayed in the display area according to the luminance of the non-display area.
The control device according to (7) above.
(9)
The illumination control unit controls illumination of a part of the non-display area based on information on an image displayed on a part of the display area adjacent to the part of the non-display area to be controlled by illumination. To
The control device according to (2).
(10)
An environmental light detection unit that detects environmental light of an external environment where the surface of the light shielding unit located on the opposite side of the surface including the display region and the non-display region is exposed;
The illumination control unit controls the illumination according to the ambient light.
The control device according to any one of (1) to (9).
(11)
The illumination control unit controls the brightness of the illumination in conjunction with the intensity of the ambient light.
The control device according to (10) above.
(12)
The illumination control unit controls the color of the illumination in conjunction with the color of the ambient light.
The control device according to (10) or (11).
(13)
The illumination control unit changes illumination to the non-display area based on meta information of an image displayed in the display area.
The control device according to (1) above.
(14)
The illumination control unit changes illumination with a predetermined rhythm,
The control device according to (1) above.
(15)
A light-shielding unit that has a display area in which an image is displayed and a non-display area in which the image is not displayed, and is designed to be disposed in an area that covers the user's field of view;
An image display unit for displaying an image in the display area;
An illumination unit that illuminates the non-display area;
An illumination control unit that controls illumination of the non-display area located around the display area;
Comprising
Display device.
(16)
The illumination unit is disposed around the image display unit.
The display device according to (15).
(17)
Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view Controlling the device according to the display content of the display area,
Control method.
(18)
Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view A program for causing a computer to realize a lighting control function for controlling the device,
The illumination control function controls the illumination device according to the display content of the display area.
program.
(19)
An image is displayed in the display area in a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed. An illumination control method for controlling illumination of the non-display area located around the display area in accordance with information on an image displayed in the display area when the non-display area is illuminated.
(20)
An image is displayed in the display area in a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed. An image display function to be displayed,
An illumination control function for controlling an illumination unit that illuminates the non-display area and controlling illumination to the non-display area located around the display area;
A program to make a computer realize.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

DESCRIPTION OF SYMBOLS 100 Display apparatus 102 Illumination part 104 Image display part 106 Lens 108 Ambient light detection part 150 Control apparatus 152 Illumination control part 154 Image control part

Claims (20)

Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view A lighting control unit for controlling the device;
The illumination control unit controls the illumination device according to display contents of the display area.
Control device. The illumination control unit controls the illumination in conjunction with information of an image displayed in the display area.
The control device according to claim 1. The illumination control unit controls the illumination device based on information of pixels constituting a predetermined area of an image displayed in the display area.
The control device according to claim 2. The illumination control unit controls the illumination based on information of pixels located in the vicinity of the periphery of the display area among pixels constituting an image displayed in the display area.
The control device according to claim 3. The illumination control unit controls the brightness of the illumination in conjunction with the brightness of an image displayed in the display area.
The control device according to claim 2. The illumination control unit controls the color of the illumination in conjunction with the color of the image displayed in the display area.
The control device according to claim 2. An image control unit for displaying an image displayed in an area close to the non-display area in the display area so that the image is gradually blurred;
The control device according to claim 1. The image control unit controls the luminance of an image to be displayed in the display area according to the luminance of the non-display area.
The control device according to claim 7. The illumination control unit controls illumination of a part of the non-display area based on information on an image displayed on a part of the display area adjacent to the part of the non-display area to be controlled by illumination. To
The control device according to claim 2. An environmental light detection unit that detects environmental light of an external environment where the surface of the light shielding unit located on the opposite side of the surface including the display region and the non-display region is exposed;
The illumination control unit controls the illumination according to the ambient light.
The control device according to claim 1. The illumination control unit controls the brightness of the illumination in conjunction with the intensity of the ambient light.
The control device according to claim 10. The illumination control unit controls the color of the illumination in conjunction with the color of the ambient light.
The control device according to claim 10. The illumination control unit changes illumination to the non-display area based on meta information of an image displayed in the display area.
The control device according to claim 1. The illumination control unit changes illumination with a predetermined rhythm,
The control device according to claim 1. A light-shielding unit that has a display area in which an image is displayed and a non-display area in which the image is not displayed, and is designed to be disposed in an area that covers the user's field of view;
An image display unit for displaying an image in the display area;
An illumination unit that illuminates the non-display area;
An illumination control unit that controls illumination of the non-display area located around the display area;
Comprising
Display device. The illumination unit is disposed around the image display unit.
The display device according to claim 15. Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view Controlling the device according to the display content of the display area,
Control method. Illumination for illuminating the non-display area of a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed and which is designed to be disposed in an area that covers a user's field of view A program for causing a computer to realize a lighting control function for controlling the device,
The illumination control function controls the illumination device according to the display content of the display area.
program. An image is displayed in the display area in a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed. An illumination control method for controlling illumination of the non-display area located around the display area in accordance with information on an image displayed in the display area when the non-display area is illuminated. An image is displayed in the display area in a light-shielding portion having a display area in which an image is displayed and a non-display area in which the image is not displayed. An image display function to be displayed,
An illumination control function for controlling an illumination unit that illuminates the non-display area and controlling illumination to the non-display area located around the display area;
A program to make a computer realize.