JP5146845B2 - Head mounted display - Google Patents

Abstract

A head-mounted display includes an image display that is mounted on the head of a user and permits the user to visually recognize an image, input detector that is mounted on the body of the user to detect coordinates of input by a user in a detection area, an image generation unit that generates a trajectory image of the input based on the coordinates of input and output this generated trajectory image to the image display, a displacement determination unit that determines a relative displacement of the character written into the detection area from the coordinates of input, and a position correction unit that corrects the displacement of the character based on the displacement.

Description

  The present invention relates to a head mounted display capable of displaying a user's entry operation.

Conventionally, as shown in Patent Document 1, there has been proposed an electronic pen capable of electronically generating and storing a trace of a user's entry operation.
On the other hand, as shown in Patent Document 2, a head mounted display that allows a user to input a virtual image displayed by the head mounted display using a pen has been proposed.

JP 2006-92410 A JP 2005-339267 A

The electronic pen disclosed in Patent Document 1 has a problem that it does not become hands-free and is not excellent in mobility because it fills in a two-dimensional input surface. On the other hand, the head-mounted display disclosed in Patent Document 2 is configured to allow a user to input a virtual image using a pen, and thus becomes hands-free and excellent in mobility. However, there is a problem that it is difficult for the user to input the virtual image because it is difficult for the user to grasp the sense of distance to the virtual image.
As a solution to this problem, it is conceivable that an input surface for detecting a user's entry operation is attached to the body such as the user's waist and the user's entry operation is displayed on a head-mounted display. With such a configuration, even if the user cannot directly see the input surface, the user can check his / her entry operation on the head mounted display, and the mobility of the electronic pen is impaired. There is no.
However, when the user enters characters on the input surface, it is difficult for the user to visually recognize the input surface, and the characters entered by the user are skewed or overlapped, and the characters overlap as desired. This causes a problem that the character trajectory cannot be generated electronically.
The present invention solves the above problems and provides a head mounted display that can electronically generate a trajectory of a character desired by a user.

The invention according to claim 1, which has been made to solve the above problems,
An image generator mounted on the user's head and allowing the user to visually recognize the image;
An entry operation detection means for detecting entry operation coordinates, which are coordinates of the entry operation of the user on a detection area which is two-dimensional and is attached to the user's body;
Based on the entry operation coordinates, entry operation image generation means for generating a locus image of the entry operation and outputting the generated locus image to the image generation unit;
Character input selection means for selecting whether or not the entry operation is a character input by a user input operation;
When a character input is selected by the character input selection means, a character position deviation determining means for determining a position deviation of the character entered on the detection area from the entry operation coordinates with respect to the first direction on the detection area. When,
Character position correction means for correcting the position shift of a character based on the position shift determined by the character position shift determination means;
It is characterized by having.

The invention according to claim 2 is the invention according to claim 1,
The entry operation image generation means outputs a character string image of a character string made up of a plurality of characters whose relative positional deviation has been corrected by the character position correction means to the image generation section.
As a result, the user can confirm the correction state of the character position deviation.

The invention according to claim 3 is the invention according to claim 1 or 2,
The correction direction of the character position deviation corrected by the character position correction means is
A first mode for correcting a shift in the first direction on the detection region, or
The apparatus further includes a correction direction selection unit that selects, by a user input operation, a second correction mode for correcting a shift with respect to a second direction that is a direction orthogonal to the first direction on the detection region.
As a result, it is possible to arbitrarily select a direction for correcting the positional deviation of characters.

The invention according to claim 4 is the invention according to claims 1 to 3,
It further has an inclination detection means for detecting the inclination of the detection area,
The character position correction means corrects the inclination of the character entered in the detection area based on the inclination information of the detection area detected by the inclination detection means.
As a result, even when the detection area is inclined and the character written on the detection area is inclined, the inclination of the character can be corrected.
Note that, when performing automatic character recognition, the inclination of each character is corrected, so that the character recognition accuracy is improved.

The invention according to claim 5 is the invention according to claims 1 to 4,
It further has an acceleration detection means for detecting the acceleration received by the detection region,
The character position correcting means performs correction for moving the character written in the detection area based on the acceleration.
As a result, even when a character position shift occurs on the detection area due to the vibration of the detection area, the position shift can be corrected.

The invention according to claim 6 is the invention according to claims 1 to 5,
The character position correcting means does not correct the character position deviation when the relative position deviation of the character entered on the detection area detected by the character position deviation determining means is equal to or less than a predetermined value. To do.
As a result, even when a character misalignment that cannot be visually recognized by the user occurs, the character misalignment is not corrected unnecessarily.

The invention according to claim 7 is the invention according to claims 1 to 6,
Further comprising character overlap judging means for judging whether or not adjacent characters overlap based on the input operation coordinates,
When the character overlap determining means determines that adjacent characters overlap,
The character position correcting means moves the character to a position where adjacent characters do not overlap based on the entry operation coordinates.
As a result, it is possible to eliminate the superimposed state of characters entered in the detection area.

  According to the present invention, the character position deviation determining means determines the relative position deviation of the characters entered on the detection area, and the character position correcting means is based on the determined position deviation. Since the misalignment is corrected, it is possible to provide a head mounted display that can electronically generate a trajectory of a character desired by a user.

1 is an overall view of a head mounted display showing an embodiment of the present invention. It is explanatory drawing which shows the outline | summary of this invention. It is a block diagram of a head mounted display. It is a flowchart of a main process. It is explanatory drawing of mode selection. It is explanatory drawing at the time of initial position coordinate determination. It is explanatory drawing of an entry start state. It is explanatory drawing of a coordinate transformation process. It is explanatory drawing of the state which the user's entry operation approached outside the detection area. It is explanatory drawing of a warning alerting | reporting state. It is explanatory drawing of the state in which the coordinate transformation process is performed again. It is a flowchart of the correction process of 1st Embodiment. It is explanatory drawing of character overlap correction. It is explanatory drawing of character inclination correction | amendment. It is explanatory drawing of acceleration position shift correction. It is explanatory drawing of the character string inclination correction process of 1st Embodiment. It is a flowchart of the correction process of 2nd Embodiment. It is explanatory drawing of the character string inclination correction process of 2nd Embodiment.

(Overview of head mounted display)
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. As shown in FIG. 1, the head-mounted display 100 includes a head-mounted display unit 50 that is worn on the user's head and a control unit 30 that is worn on the body such as the user's waist. The head mounted display unit 50 includes a head mounting unit 51 and an image generation unit 52. In the embodiment shown in FIG. 1, the head mounting portion 51 is in the shape of a frame of glasses, but may be in the shape of a helmet or the like, and includes anything that is structured to be mounted on the user's head. .

  The image generation unit 52 is attached to the front side of the head mounting unit 51. The image generation unit 52 generates an image and makes the user visually recognize the image. In the present embodiment, the image generation unit 52 is configured using a retinal scanning display that allows a user to visually recognize an image by scanning laser light directly on the user's eyeball. As described above, when the image generation unit 52 is configured using the retinal scanning display, the user can visually recognize the image generated by the image generation unit 52 and can also visually recognize the outside world. The image generation unit 52 may have a configuration using other devices such as a liquid crystal display and an organic EL (Organic Electroluminescence) display.

  The control unit 30 is a device that detects a user's entry operation and generates a trace image of the entry operation displayed by the image generation unit 52. The control unit 30 is connected to the image generation unit 52. The control unit 30 is provided with an operation unit 35 for operating the head mounted display 100. The control unit 30 is provided with an entry operation detection unit 31 as shown in FIG. The entry operation detection unit 31 is a device that detects the coordinates of the entry operation of the user on the two-dimensional detection area 31a. In this embodiment, when the user performs an entry operation on the detection area 31a with the input pen 60, the entry operation detection unit 31 detects the coordinates on the detection area 31a by the entry operation as “entry operation coordinates”. It has become.

  The absolute coordinates (x, y) of the detection area 31a coincide with the absolute coordinates (X, Y) of the display area 90 of the image generation unit 52. When the user performs an entry operation on the detection area 31a with the input pen 60 (shown in FIG. 2B), the entry operation detection unit 31 detects the entry operation with the input pen 60, and FIG. As shown in FIG. 6, the locus of the entry operation by the user is displayed in the display area 90 of the image generation unit 52. When the control unit 30 is worn on the user's waist, as shown in FIG. 2B, the user moves characters from the upper part to the lower part (from the x negative direction to the x positive direction) of the detection area 31a. Fill out. Since the user cannot visually recognize the detection area 31a, as shown in FIG. 2C, the characters entered on the detection area 31a overlap or shift. Further, as shown in FIG. 14, when the control unit 30 is inclined from the horizontal line or the vertical line, characters written on the detection area 31a are inclined. Further, when the user performs an entry operation in the detection area 31a during walking or the like, the control unit 30 is shaken up and down, so that the characters entered in the detection area 31a are shifted as shown in FIG. In the present invention, as described above, as shown in FIG. 2A, by correcting the position of the overlapped character, the shifted character, and the tilted character written in the detection area 31a by the control unit 30. Characters entered on the detection area 31a are arranged and displayed on the image generation unit 52. Hereinafter, the head mounted display 100 that realizes such a function will be described in detail.

(Block diagram of head-mounted display)
A block diagram of the head mounted display 100 will be described with reference to FIG. The control unit 30 includes a control board 20 that performs various controls of the head mounted display 100. The control board 20 includes a CPU 10, a RAM 11, a ROM 12, an auxiliary storage device 13, an image generation controller 16, a VRAM 17, and an interface 19. These components are connected to each other by a bus 9. The image generation controller 16 and the VRAM 17 are connected to each other.

  A CPU (abbreviation of central processing unit) 10 performs various calculations and processes in cooperation with a RAM (abbreviation of random access memory) 11 and a ROM (abbreviation of read only memory) 12.

The RAM 11 temporarily stores programs processed by the CPU 10 and data processed by the CPU 10 in its address space. The RAM 11 includes an entry operation coordinate storage area 11a, an initial position coordinate storage area 11b, a start position coordinate storage area 11c, an entry locus coordinate storage area 11d, a correction mode storage area 11e, an acceleration data storage area 11f, and an inclination angle data storage area 11g. Have.
In the entry operation coordinate storage area 11a, “entry operation coordinates” input to the bus 9 are stored.
In the initial position coordinate storage area 11b, “initial position coordinates” on the display area 90 of the image generation unit 52 determined by an initial position coordinate determination program 12c described later are stored.
The start position coordinate storage area 11 c stores “start position coordinates” that are coordinates of the start position of the entry operation to the detection area 31 a by the user's input pen 60.
In the entry locus coordinate storage area 11d, “entry locus coordinates” generated by the coordinate conversion program 12e are stored.
In the correction mode storage area 11e, a flag indicating that one of the “vertical correction mode” and the “horizontal correction mode” is stored. The “vertical correction mode” is a mode in which the direction for correcting the positional deviation of characters is the vertical direction (first direction). The “horizontal correction mode” is a mode in which the direction for correcting the positional deviation of characters is the horizontal direction (second direction). The first direction and the second direction are orthogonal to each other.
The acceleration data storage area 11f stores “acceleration data” of the control unit 30 (detection area 31a) and “detection time” of the “acceleration data”.
In the inclination angle data storage area 11g, “inclination angle data” of the detection area 31a and “detection time” of this “inclination angle data” are stored.

  The ROM 12 stores various programs and parameters for controlling the head mounted display 100. The various programs are processed by the CPU 10 to realize various functions. The ROM 12 includes a mode selection screen display program 12a, a mode selection program 12b, an initial position coordinate determination program 12c, a start position coordinate detection program 12d, a coordinate conversion program 12e, an entry locus image generation program 12f, an entry operation error detection program 12g, a warning. A notification program 12h, a character entry completion determination program 12i, a character overlap determination program 12j, a character position deviation determination program 12k, and a character position correction program 12m are stored. It should be noted that these programs and data may be stored in the auxiliary storage device 13.

The mode selection screen display program 12a displays an “input mode selection screen” (shown in FIG. 5A) for selecting whether it is “character input mode” or “drawing input mode” or “vertical correction mode”. The “correction mode selection screen” (shown in FIG. 5B) for selecting either “horizontal correction mode” or “no deviation correction” is displayed in the display area of the image generation unit 52. 90 is a program for outputting an instruction to be displayed on the image generation controller 16 to the display.
The mode selection program 12b is a program that determines whether “character input mode” or “drawing input mode” is selected by a user's selection operation. Further, the mode selection program 12b determines whether a mode of “vertical correction mode”, “horizontal correction mode”, or “no deviation correction” is selected by the user's selection operation. It is a program to do.
The initial position coordinate determination program 12c is a program for determining initial position coordinates 99 (shown in FIGS. 7 to 11) on the display area 90 of the image generation unit 52.
The start position coordinate detection program 12d is a program for detecting a start position coordinate 91 (shown in FIGS. 7 to 11) that is a writing start position by the user from the “entry operation coordinates”.
The coordinate conversion program 12e converts the start position coordinates 91 of the entry operation by the user into the initial position coordinates 99 on the display area 90 of the image generation unit 52, and the initial position coordinates 99, the “entry operation coordinates”, and the start position coordinates. This is a program for calculating “entry trajectory coordinates” sequentially using the positional relationship with 91.
The entry trajectory image generation program 12f is a program that generates an “entry trajectory image” to be output to the image generation unit 52 based on the calculated “entry trajectory coordinates”.
The entry operation error detection program 12g is a program for detecting the proximity or separation of the entry operation of the user outside the detection area 31a.
The warning notification program 12h is a program for displaying a warning image on the image generation unit 52 and notifying the user of a warning when the proximity or departure from the detection area 31a of the user's entry operation is detected.
The one-character entry completion determination program 12i is a program for determining whether or not the user has completed the writing operation for the detection area 31a.
The character overlap determination program 12j is a program for detecting the overlap of adjacent characters entered in the detection area 31a.
The character position deviation determination program 12k is a program for determining the relative position deviation of the characters entered on the detection area 31a from the coordinate positions on the detection area 31a of each character.
The character position correction program 12m is a program that corrects the positional deviation of adjacent characters based on the relative positional deviation of the characters.
It should be noted that the mode selection screen display program 12a, the mode selection program 12b, the initial position coordinate determination program 12c, the start position coordinate detection program 12d, the coordinate conversion program 12e, the entry locus image generation program 12f, the entry operation error detection program 12g, and a warning notification program 12h, the character entry completion determination program 12i, the character overlap determination program 12j, the character position deviation determination program 12k, and the character position correction program 12m may be configured as an ASIC (Application Specific Integrated Circuit).

  The auxiliary storage device 13 is, for example, a nonvolatile memory or a hard disk. The auxiliary storage device 13 has an entry trajectory coordinate storage area 13a and an entry operation coordinate storage area 13b. The entry locus coordinate storage area 13 a stores “entry locus coordinates” generated by the entry operation on the detection area 31 a by the user in the “character input mode”. The entry operation coordinate storage area 13b stores “entry operation coordinates” generated by the entry operation on the detection area 31a by the user in the “drawing input mode”.

  The image generation controller 16 has a GPU (Graphics Processing Unit). The image generation controller 16 generates an “entry operation trajectory image” in accordance with a drawing command from the entry trajectory image generation program 12 f and stores it in the VRAM 17. The “entry operation locus image” stored in the VRAM 17 is output to the image generation unit 52 as an “image signal”.

  The interface 19 converts the physical and logical form of the signal. The interface 19 is connected to an entry operation detection unit 31, an acceleration sensor 32, a tilt sensor 33, and an operation unit 35.

  In the present embodiment, the tip of the input pen 60 emits an alternating magnetic field, and the input operation detection unit 31 is provided with detection coils for detecting the alternating magnetic field in a matrix. With this configuration, the entry operation detection unit 31 generates “entry operation coordinates” that are coordinates of the entry operation of the user on the two-dimensional detection region 31a. The “entry operation coordinates” are generated after a predetermined time (several milliseconds). However, when the user moves the input pen 60 away from the detection area 31 a of the entry operation detection unit 31, “entry operation coordinates” are not generated. The generated “entry operation coordinates” are output to the bus 9 via the interface 19. The “entry operation coordinates” input to the bus 9 are stored in the entry operation coordinate storage area 11 a of the RAM 11 together with the “detection time” when the “entry operation coordinates” are generated.

  The acceleration sensor 32 is a device that detects the acceleration received by the detection region 31a. In the present embodiment, the acceleration sensor 32 detects acceleration in the x-axis direction and the y-axis direction of the absolute coordinates of the detection region 31a. The acceleration sensor 32 detects the acceleration received by the detection region 31a after a predetermined time (several milliseconds), and generates “acceleration data”. The generated “acceleration data” is output to the bus 9 via the interface 19, and is stored in the acceleration data storage area 11f of the RAM 11 together with the “detection time” of the “acceleration data”.

  The tilt sensor 33 is a device that detects the tilt of the detection region 31a from the horizontal line or the vertical line. In this specification, a vertical line is a line in a direction in which gravity acts on an object, and a horizontal line is a line in a direction orthogonal to the vertical line. The tilt sensor 33 detects the tilt of the detection region 31a after a predetermined time (several milliseconds), and generates “tilt angle data”. The generated “tilt angle data” is output to the bus 9 via the interface 19 and is stored in the tilt angle data storage area 11 g of the RAM 11 together with the “detection time” of the “tilt angle data”.

  The operation unit 35 includes buttons and a touch panel. The operation unit 35 is used to perform various operations of the head mounted display 100 by turning the head mounted display 100 into an ON state (power-on state) or an OFF state (power-off state) by a user operation. It is.

(Description of main processing)
The main flow will be described with reference to FIG. When the user operates the operation unit 35 to turn on the power of the head mounted display 100, the main process starts and the process proceeds to S8.
In S8 “activation process”, various programs of the head mounted display 100 are activated. When the process of S8 ends, the process proceeds to S9.

  In the process of S9 “display input mode selection screen”, the mode selection screen display program 12a generates an “input mode selection screen” that allows the user to select “character input mode” or “drawing input mode”. A command to be displayed on 52 is output to the image generation controller 16. Then, as illustrated in FIG. 5A, an “input mode selection screen” including buttons of “character input mode” and “drawing input mode” is displayed on the image generation unit 52. Further, the mode selection program 12 b outputs a command for displaying the pointer 97 on the display area 90 of the image generation unit 52 to the image generation controller 16. Then, the pointer 97 is displayed on the display area 90 of the image generation unit 52 as shown in FIG. In addition, in a state where the pointer 97 is displayed on the display area 90 of the image generation unit 52, the user presses the tip of the input pen 80 against the detection area 31a of the entry operation detection unit 31 to a predetermined position. When the “drag operation” is performed, the pointer 97 moves with the “drag operation”. When the process of S9 ends, the process proceeds to the determination process of S10.

In the determination process of S10 “character input mode?”, The mode selection program 12b determines whether “character input mode” is selected by the user's operation of the input pen 80. When the user performs the “selection operation” after moving the pointer 97 over the “character input mode” button by operating the input pen 80, the mode selection program 12b displays the “character input mode”. It is determined that it has been selected (YES in S10), and the process proceeds to S11.
On the other hand, when the user performs the “selection operation” after moving the pointer 97 over the “drawing input mode” button by operating the input pen 80, the mode selection program 12 b reads “drawing input”. It is determined that “mode” has been selected (NO in S10), and the process proceeds to S51.
The “selection operation” includes, for example, a double-click operation in which the user moves the tip of the selection pen 80 away from the detection area 31a and repeats it twice.

  In the process of S11 “correction mode selection screen display”, the mode selection screen display program 12a selects either “vertical correction mode”, “horizontal correction mode”, or “no deviation correction”. A command to display the “correction mode selection screen” on the image generation unit 52 is output to the image generation controller 16. Then, as shown in FIG. 5B, a “correction mode selection screen” including buttons of “vertical correction mode”, “horizontal correction mode”, and “no deviation correction” is displayed on the image generation unit 52. . Further, the mode selection program 12 b outputs a command for displaying the pointer 97 on the display area 90 of the image generation unit 52 to the image generation controller 16. Then, the pointer 97 is displayed on the display area 90 of the image generation unit 52 as shown in FIG. When the process of S11 ends, the process proceeds to the determination process of S12.

In the determination process of S12 “selection complete?”, The mode selection program 12b has selected one of “vertical correction mode”, “horizontal correction mode”, and “no deviation correction” by the user's operation of the input pen 80. Judge whether or not. When the user performs a “selection operation” after moving the pointer 97 over any of the “vertical correction mode”, “horizontal correction mode”, and “no misalignment correction” buttons by operating the input pen 80 The mode selection program 12b stores the selected mode in the correction mode storage area 11e (YES in the determination process in S12), and proceeds to the determination process in S13.
On the other hand, if none of the “vertical correction mode”, “horizontal correction mode”, and “no deviation correction” is selected (NO in S12), the process does not proceed to S13.

In the process of S <b> 13 “sensor activation”, the CPU 10 starts detecting the acceleration of the detection area 31 a by the acceleration sensor 32. The “acceleration data” detected and generated by the acceleration sensor 32 is stored in the acceleration data storage area 11 f of the RAM 11 together with the “detection time”.
Further, the CPU 10 starts detecting the inclination of the detection area 31 a by the inclination sensor 33. The “tilt angle data” detected and generated by the tilt sensor 33 is stored in the tilt angle data storage area 11 g of the RAM 11 together with the “detection time”.
When the process of S13 ends, the process proceeds to the determination process of S14.

  In the determination process of S14 “Is there an initial position input?”, The initial position coordinate determination program 12c determines whether or not there is an initial position input. Specifically, when the user brings the tip of the input pen 80 into contact with the detection area 31a of the entry operation detection unit 31, the initial position coordinate determination program 12c determines that there is an initial position input (the determination process of S14 is performed). YES), the process proceeds to S15. On the other hand, if the initial position coordinate determination program 12c does not determine that there is an initial position input (NO in S14), the process does not proceed to S15.

  In the process of S15 “display initial position mark with absolute coordinates”, the initial position coordinate determination program 12c is displayed on the display area 90 corresponding to the absolute coordinates of the tip of the operation pen 80 on the detection area 31a detected in the process of S14. A drawing command for displaying the initial position mark 98 at the position is output to the image generation controller 16. Then, as shown in FIG. 6, an initial position mark 98 is displayed on the display area 90 of the image generation unit 52. When the process of S15 ends, the process proceeds to S16.

  In the determination process of S16 “Is there an initial position determination input?”, The initial position coordinate determination program 12c determines whether or not there is an initial position determination input. Specifically, when the user operates the operation unit 35 and the initial position coordinate determination program 12c determines that there is an initial position determination input (YES in S16), the initial position coordinate determination program 12c stores the coordinates at which the initial position mark 98 of the display area 90 of the image generation unit 52 is displayed as the “initial position coordinates” in the initial position coordinate storage area 11b of the RAM 11, and proceeds to the determination process of S17. On the other hand, if the initial position coordinate determination program 12c does not determine that there is an initial position determination input (NO in S16), the process does not proceed to S17. Thus, in the present invention, the user can select an arbitrary position on the display area 90 of the image generation unit 52 as the “initial position coordinates”.

  In the determination process of S17 “Is there an entry operation?”, The CPU 10 determines whether or not there is an entry operation by the user. Specifically, when the user performs an input operation on the detection area 31 a of the input operation detection unit 31 with the input pen 80, and the “input operation coordinates” are input to the bus 9 via the interface 19, the CPU 10 If it is determined (YES in S17), the process proceeds to S18. At this time, the start position coordinate detection program 12d stores the oldest “entry operation coordinates” in time series in the start position coordinate storage area 11c of the RAM 11 as “start position coordinates”. On the other hand, when the CPU 10 does not determine that the “entry operation coordinates” has been input to the bus 9 via the interface 19 (NO in S17), the process does not proceed to S18.

  In the process of S18 “start storage of entry operation coordinates”, the CPU 10 starts the process of storing the “entry operation coordinates” input to the bus in the entry operation coordinate storage area 11a of the RAM 11. When the process of S18 is completed, the process proceeds to S19.

In the process of S19 “start entry locus coordinate calculation”, the coordinate conversion program 12e starts to calculate “entry locus coordinates” that are locus coordinates of the user entry operation displayed in the display area 90 of the image generation unit 52. Next, a process in which the coordinate conversion program 12e calculates “entry locus coordinates” will be described.
The coordinate conversion program 12e recognizes “initial position coordinates” and “start position coordinates” by referring to the initial position coordinate storage area 11b and the start position coordinate storage area 11c of the RAM 12. Then, as shown in FIG. 7, the coordinate conversion program 12 e converts the start position coordinates 91 of the entry operation by the user into initial position coordinates 99 on the display area 90 of the image generation unit 52.
Next, the coordinate conversion program 12 e recognizes “entry operation coordinates” by referring to the entry operation coordinate storage area 11 a of the RAM 11. Then, the coordinate conversion program 12e sequentially calculates “entry trajectory coordinates” using the initial position coordinates 99 and the positional relationship between the “entry operation coordinates” and the start position coordinates 91. In the present embodiment, the coordinate conversion program 12e sequentially adds the difference values (X ′ and Y ′ shown in FIG. 8) between the “entry operation coordinates” and the start position coordinates 91 to the initial position coordinates 99. Calculate “entry trajectory coordinates”. The calculated “entry locus coordinates” is stored in the entry locus coordinate storage area 11 d of the RAM 11.
When the process of S19 ends, the process proceeds to S20.

In the process of S20 “Start display on image display unit”, the entry locus image generation program 12f generates a “display area locus image” based on the “entry locus coordinates” stored in the entry locus coordinate storage area 11d. To do. Specifically, the entry trajectory image generation program 12 f outputs a drawing command for generating a line connecting “entry trajectory coordinates” adjacent in time series to the image generation controller 16. However, when the “entry trajectory coordinates” adjacent in time series are separated by a predetermined distance or more, the user has moved the input pen 80 away from the detection area 31a of the entry operation detection unit 31. Adjacent “entry trajectory coordinates” are not connected.
When a drawing command for generating a line connecting adjacent “entry trajectory coordinates” in time series is input to the image generation controller 16, a display area 90 of the image generation unit 52 is displayed as shown in FIG. 8. A “display area trajectory image” that is a character string is displayed. When the process of S20 ends, the process proceeds to the determination process of S21.

  In the determination process of S21 “one character entry complete?”, The one character entry completion determination program 12i determines whether or not the user has written one character. Specifically, the one-character entry completion determination program 12i refers to the entry operation coordinate storage area 11a, so that the “detection time” of the “entry trajectory coordinates” adjacent in time series becomes a predetermined time (for example, several hundreds). It is determined whether or not the “detection time” is longer than a predetermined time, and it is determined that the user has finished writing one character in the detection area 31a. If the one-character entry completion determination program 12i determines that the user has written one character (YES in S21), the process proceeds to S22. On the other hand, if the one-character entry completion determination program 12i determines that the user has not finished writing one character (NO in S21), the process proceeds to S25.

  In S22 “correction processing”, “correction processing” for correcting the positional deviation, inclination, and overlap of the characters entered in the entry area 31a is executed. Details will be described later using the flow shown in FIG. When the process of S22 ends, the process proceeds to the determination process of S25.

In the determination processing of S25 “proximity outside detection area?”, The entry operation error detection program 12g determines whether or not the user's entry operation (tip of the input pen 80) has detected proximity or separation outside the detection area 31a. to decide. As shown in FIG. 9, the entry operation detection unit 31 has a proximity warning area 31b from the outer edge of the detection area 31a to a slightly inner position from the outer edge. When the user's entry operation enters the proximity warning area 31b, the entry operation error detection program 12g determines that the user's entry operation has approached outside the detection area 31a. If the user entry operation is not detected from the detection area 31a after the user entry operation has entered the proximity warning area 31b, the entry operation error detection program 12g causes the user entry operation to be detected in the detection area 31a. Judge that he has left.
If the entry operation error detection program 12g detects approaching or leaving from the detection area 31a of the entry operation of the user (determination process YES in S25), the process proceeds to S31.
On the other hand, if the entry operation error detection program 12g does not detect proximity or separation outside the detection area 31a of the entry operation of the user (determination process of S25), the process proceeds to S41.

In the processing of S31 “notify warning”, the warning notification program 12h outputs a drawing command for displaying a warning in the image generation unit 52 to the image generation controller 16. Then, a warning is displayed on the image generation unit 52 as shown in FIG.
Alternatively, an embodiment in which a speaker is provided in the head mounted display 100 and a warning sound is reproduced by the speaker to notify the user of the warning may be used.
When the process of S31 ends, the process proceeds to the determination process of S32.

  In the determination process of S32 “change in input operation coordinates by more than a predetermined value?”, The input operation error detection program 12g refers to the input operation coordinate storage area 11a of the RAM 11 to determine whether the “input operation coordinates” have changed more than a predetermined value. Determine whether. That is, when the user perceives the warning notified in the process of S31 and moves the input pen 80 to the inside of the detection area 31a, the “entry operation coordinates” change by a predetermined amount or more. If the entry operation error detection program 12g determines that the “entry operation coordinates” have changed by more than a predetermined value (YES in S32), the process proceeds to S33. On the other hand, if the entry operation error detection program 12g does not determine that the “entry operation coordinates” have changed more than a predetermined value (NO in S32), the process does not proceed to S33.

In the process of S33 “Recalculation of entry locus coordinates”, the coordinate conversion program 12e obtains the entry locus at the time when the entry operation error detection program 12g detects the proximity or departure of the entry operation of the user outside the detection area in the determination process of S25. Using the positional relationship between the coordinates 92 (shown in FIGS. 10 and 11) and the start position coordinates 93 and the entry operation coordinates 94 (shown in FIG. 11) after the entry operation detection unit 31 detects again, the entry locus coordinates 95 (shown in FIG. 11) is calculated. In the present embodiment, the coordinate conversion program 12e adds a difference value (X ″, Y ″ shown in FIG. 11) between the entry operation coordinates 94 and the start position coordinates 93 to the entry locus coordinates 92. The entry locus coordinates 95 are calculated. The calculated “entry locus coordinates” is stored in the entry locus coordinate storage area 11 d of the RAM 11. Furthermore, as shown in FIG. 11, a “display area trajectory image” is displayed in the display area 90 of the image generation unit 52 based on the recalculated “entry trajectory coordinates”.
In this way, when the input pen 80 that the user is likely to leave outside the detection area 31a is moved to the inside of the detection area 31a, the “entry trajectory coordinates” are recalculated in the process of S33. Therefore, the “entry trajectory coordinates” are calculated without interruption, and the “display area trajectory image” is displayed in the display area 90 of the image generation unit 52. When the process of S33 ends, the process proceeds to the determination process of S41.

  In the determination process of S41 “character input mode cancel?”, The CPU 10 determines whether or not a signal for canceling the “character input mode” has been input to the bus 9 when the user operates the operation unit 35. If the CPU 10 determines that a signal for canceling the “character input mode” has been input to the bus 9 (YES in S41), the process proceeds to S44. On the other hand, if the CPU 10 determines that the signal for canceling the “character input mode” is not input to the bus 9 (NO in S41), the process proceeds to S42.

  In the determination process of S42 “no entry operation for a predetermined time?”, The CPU 10 determines whether or not the user has performed an entry operation in the detection area 31a of the entry operation detection unit 31 for a predetermined time (for example, several minutes) or longer. Specifically, when the CPU 10 determines that “entry operation coordinates” have not been input to the bus 9 for a predetermined time or longer (YES in S42), the process proceeds to S44. On the other hand, if the CPU 10 determines that “entry operation coordinates” are input to the bus 9 within a predetermined time (NO in S42), the process proceeds to S46.

  In the process of S44 “Save entry locus coordinates”, the CPU 10 saves the “Entry locus coordinates” stored in the entry locus coordinate storage area 11 d of the RAM 11 in the entry locus coordinates storage area 13 a of the auxiliary storage device 13. In this way, by saving the “entry trajectory coordinates” in the entry trajectory coordinate storage area 13a, the contents entered by the user can be used later. When the process of S44 ends, the process returns to S9.

  In the determination process of S46 “End?”, The CPU 10 determines whether or not an “end signal” is input to the bus 9 by the user operating the operation unit 35. If the CPU 10 determines that the “end signal” has been input to the bus 9 (YES in S46), the process proceeds to S47. When the CPU 10 determines that the “end signal” has not been input to the bus 9 (NO in S46), the process returns to S25.

  In the process of S47 “Save entry locus coordinates”, the CPU 10 saves the “Entry locus coordinates” stored in the entry locus coordinates storage area 11 d of the RAM 11 in the entry locus coordinates storage area 13 a of the auxiliary storage device 13. When the process of S47 is completed, the head mounted display 100 is turned off, and the series of flows is completed.

  In the process of S51 “start of entry operation coordinates”, the CPU 10 starts the process of storing the “entry operation coordinates” input to the bus in the entry operation coordinate storage area 11a of the RAM 11. When the process of S51 ends, the process proceeds to S52.

  In the processing of S52 “start display of entry operation locus”, the entry locus image generation program 12f creates a “display area locus image” based on the “entry operation coordinates” stored in the entry operation coordinate storage area 11a of the RAM 11. Generate. Specifically, the entry trajectory image generation program 12 f outputs a drawing command for generating a line connecting “entry operation coordinates” adjacent in time series to the image generation controller 16. However, when the “entry operation coordinates” adjacent in time series are separated by a predetermined distance or more, it is considered that the user has moved the input pen 80 away from the detection area 31a of the entry operation detection unit 31. “Entry operation coordinates” adjacent in series are not connected. When a drawing command for generating a line connecting adjacent “entry operation coordinates” in time series is input to the image generation controller 16, a “display area trajectory image” is displayed on the display area 90 of the image generation unit 52. Is done. That is, when the input mode is the “drawing input mode”, the content entered by the user in the detection area 31 a with the input pen 80 is displayed as it is in the display area 90 of the image generation unit 52. When the process of S52 ends, the process proceeds to the determination process of S53.

  In the determination process of S53 “drawing input mode?”, The CPU 10 determines whether or not a signal for releasing the “drawing input mode” has been input to the bus 9 by the user operating the operation unit 35. When the CPU 10 determines that a signal for canceling the “drawing input mode” has been input to the bus 9 (YES in S53), the process proceeds to S55. On the other hand, when the CPU 10 determines that the signal for canceling the “drawing input mode” is not input to the bus 9 (NO in S53), the process proceeds to S54.

  In the determination process of S54 “no entry operation for a predetermined time?”, The CPU 10 determines whether or not the user has performed an entry operation in the detection area 31a of the entry operation detection unit 31 for a predetermined time (for example, several minutes) or longer. Specifically, if the CPU 10 determines that “entry operation coordinates” have not been input to the bus 9 for a predetermined time or longer (YES in S54), the process proceeds to S55. On the other hand, if the CPU 10 determines that “entry operation coordinates” are input to the bus 9 within a predetermined time (NO in S54), the process proceeds to S56.

  In the process of S55 “Save entry operation coordinates”, the CPU 10 saves “Entry operation coordinates” stored in the entry operation coordinate storage area 11 a of the RAM 11 in the entry operation coordinates storage area 13 b of the auxiliary storage device 13. When the process of S55 ends, the process returns to S9.

  In the determination process of S <b> 56 “end?”, The CPU 10 determines whether the “end signal” is input to the bus 9 by the user operating the operation unit 35. When the CPU 10 determines that the “end signal” is input to the bus 9 (YES in S56), the process proceeds to S47. When the CPU 10 determines that the “end signal” is not input to the bus 9 (NO in S56), the process returns to the determination process in S53.

In the process of S57 “Save entry operation coordinates”, the CPU 10 saves “Entry operation coordinates” stored in the entry operation coordinate storage area 11 a of the RAM 11 in the entry operation coordinates storage area 13 b of the auxiliary storage device 13. When the process of S57 is finished, the head mounted display 100 is turned off, and the series of flows is finished.
In the embodiment described above, in the process of S20, the locus of the entry operation in the middle of the entry in the detection area 31a is displayed on the image generation unit 52. However, the process of S20 is skipped and one character is displayed. There may be an embodiment in which the character that is the locus of the entry operation is displayed on the image generation unit 52 when the entry is completed and the process of S22 is completed.

(Correction process of the first embodiment)
The “correction process” of the first embodiment will be described with reference to FIGS. When the “correction process” starts, the process proceeds to S111.
In the determination process of S111 “characters are overlapped?”, The character overlap determination program 12j, as shown in FIG. 13 (A) and (B), newly entered character 72 and the previously described character It is determined whether or not 71 overlaps. Specifically, the character overlap determination program 12j refers to the entry locus coordinate storage area 11d of the RAM 11, and this time, the line (entry locus) connecting the “entry locus coordinates” of the character 71 entered previously is entered. Whether the newly entered character 72 overlaps the previously described character 71 by determining whether or not the line (entry locus) connecting the “entry locus coordinates” of the entered character 72 overlaps. Judge whether or not. If the character overlap determination program 12j determines that the newly entered character 72 and the previously described character 71 overlap (state (B) of FIG. 13) (YES in S111) The process proceeds to S112. On the other hand, when the character overlap determination program 12j determines that the newly entered character 72 and the previously described character 71 do not overlap (state (A) in FIG. 13) (determination process in S111) Is NO), the process proceeds to S113.

  In the process of S112 “correction at intervals for each character”, the character position correction program 12m recognizes “entry locus coordinates” by referring to the entry locus coordinate storage area 11d. Then, based on the recognized “entry trajectory coordinates”, the character position deviation determination program 12k calculates a position deviation amount that is a position where the adjacent previously written character 71 and the newly entered character 72 do not overlap. The character position correction program 12m causes the newly entered character 72 to move to a position where the adjacent previously written character 71 and the newly entered character 72 do not overlap based on the calculated positional deviation amount. (Shown in FIG. 13C), the “entry trajectory coordinates” are changed and updated and stored in the entered trajectory coordinate storage area 11d. When the process of S112 ends, the process proceeds to the determination process of S113.

  In the determination process of S113 “Is there a correction mode?”, The CPU 10 refers to the correction mode storage area 11e of the RAM 11 to select one of the correction modes “vertical correction mode” or “horizontal correction mode”. Judge whether or not. If the CPU 10 determines that either “vertical correction mode” or “horizontal correction mode” has been selected (YES in S113), the process proceeds to S111. On the other hand, if the CPU 10 determines that the “no deviation correction” mode has been selected (NO in S113), the S22 “correction process” ends, and the process proceeds to S25.

  In the process of S121 “inclination angle data recognition”, the character position deviation determination program 12k recognizes the inclination angle θ of the detection area 31a from the horizontal line or the vertical line by referring to the inclination angle data storage area 11g of the RAM 11. In the embodiment shown in FIG. 14, the character position deviation determination program 12k recognizes the inclination angle θ of the detection area 31a from the vertical line (X ′ axis). When the process of S121 ends, the process proceeds to S122.

  In the process of S122 “character inclination correction”, the character position correction program 12m rotates the reference coordinates of “entry locus coordinates” from the absolute coordinates (x, y) of the detection area 31a by the inclination angle θ from the absolute coordinates. The input coordinates are converted into the relative coordinates (x ′, y ′), the “entry trajectory coordinates” with the relative coordinates as the reference coordinates are generated, and the “entry trajectory coordinates” are updated and stored in the entered coordinate storage area 11d. In this “character inclination correction process”, the inclination of the character written on the absolute coordinates (x, y) of the detection area 31a is corrected. When the process of S122 ends, the process proceeds to S131.

  In the process of S131 “acceleration data recognition”, the character position deviation determination program 12k refers to the acceleration data storage area 11f of the RAM 11 and determines the “acceleration” received by the detection area 31a and the “detection time” of the “acceleration”. recognize. When the process of S131 is completed, the process proceeds to S132.

In the process of S132 “acceleration position deviation correction”, the character position deviation determination program 12k collates the “detection time” of “acceleration” with the “detection time” of “entry trajectory coordinates”, and the both “detection times”. Based on the “acceleration” that “” matches, the positional deviation of the “entry trajectory coordinates” corresponding to the “detection time” is calculated. The positional deviation is calculated according to the magnitude of “acceleration”. The character position correction program 12m moves the “entry operation coordinates” to the opposite side of the “acceleration” direction corresponding to the “entry trajectory coordinates” based on the calculated positional deviation of the “entry trajectory coordinates”. Is generated. The generated “entry locus coordinates” is updated and stored in the entry locus coordinate storage area 11d.
For example, as shown in FIG. 15, when the user uses the head mounted display 100 while walking, the user performs an entry operation on the detection area 31a that moves back and forth and up and down, and the positional deviation of the characters entered on the detection area 31a. Even if this occurs, the “acceleration position deviation correction” corrects the character position deviation.
In the embodiment shown in FIG. 15, the character position correction program 12m corrects only the positional deviation in the y-axis direction of the “entry trajectory coordinate”. Of course, the character position correction program 12m is the “entry trajectory coordinate”. The positional deviation in the x-axis direction is also corrected.
When the process of S132 ends, the process proceeds to S141.

  In the process of S141 “recognize the start point coordinates of the first character”, the character position deviation determination program 12k refers to the entry trajectory coordinate storage area 11d, thereby starting point coordinates 75 of the first character 73 entered in the detection area 31a. Recognize Specifically, the character position deviation determination program 12 k recognizes the “entry trajectory coordinate” having the oldest “detection time” as the start point coordinate 75 of the first character 73 in time series. When the process of S141 ends, the process proceeds to S142.

  In the process of S142 “recognize the end point coordinates of a character that has been written”, the character position deviation determination program 12k refers to the entry trajectory coordinate storage area 11d to thereby complete the written character 74 (currently written in the detection area 31a). The end point coordinates 76 of the described characters) are recognized. Specifically, the character position deviation determination program 12k recognizes the end point coordinate 76 of the character 74 that has finished writing the “entry trajectory coordinate” with the latest “detection time” in time series. When the process of S142 ends, the process proceeds to S143.

  In the process of S143 “calculate the inclination from the start point / end point”, the character position deviation determination program 12k refers to the correction mode storage area 11e and determines whether the correction mode is “vertical correction mode” or “horizontal correction mode”. Check if it is. Then, the character position deviation determination program 12k reads the absolute coordinates (x, x, x) of the straight line 77 connecting the start point coordinates 75 of the first character 73 recognized in the processing of S141 and S142 and the end point coordinates 76 of the written characters 76. The inclination of y) with respect to the reference line is calculated. When the correction mode is the “vertical correction mode”, the absolute coordinate x-axis of the detection region 31a becomes the reference line 79, as shown in FIG. In this case, the character position deviation determination program 12k calculates the inclination angle θ78 of the straight line 77 with respect to the x-axis that is the reference line 79. On the other hand, when the correction mode is the “horizontal correction mode”, the y-axis of the absolute coordinate of the detection area 31a becomes the reference line. In this case, the character position deviation determination program 12k calculates the inclination angle θ of the straight line 77 with respect to the y-axis that is the reference line. When the process of S143 ends, the process proceeds to the determination process of S144.

  In the determination process of S144 “is the inclination greater than or equal to a predetermined value?”, The CPU 10 determines that the inclination (inclination angle θ) with respect to the absolute coordinates (x, y) of the detection area 31a of the straight line 77 calculated in the process of S143 is equal to or greater than the predetermined value. It is determined whether or not. When the CPU 10 determines that the inclination with respect to the reference line is equal to or greater than the predetermined value (YES in S144), the process proceeds to S145. On the other hand, when the CPU 10 determines that the inclination of the straight line 77 with respect to the absolute coordinates (x, y) of the detection area 31a is smaller than the predetermined value (NO in S144), the “correction process” ends. , The process proceeds to S25.

  In the process of S145 “character string inclination correction”, the character position correction program 12m is based on the inclination (inclination angle θ78) with respect to the absolute coordinates (x, y) of the detection area 31a of the straight line 77 calculated in the process of S143. As shown in FIG. 16B, the positional relationship between the first character 73 and the written character 74 is parallel to the reference line 79 (in the embodiment of FIG. 16, the X axis is the reference line). Then, the “entry trajectory coordinates” are corrected. Specifically, a reference line 79 ′ parallel to the reference line 79 is calculated starting from the starting point coordinate 75 of the first character, and a comparison between the reference line 79 ′ and the straight line 77 indicates that each character to be corrected to 77 ′ is 77 ′. The movement distance in the Y-axis direction according to the X coordinate is calculated. Each character is corrected by adding the movement distance in the Y-axis direction. The corrected “entry locus coordinate” is updated and stored in the entry locus coordinate storage area 11d. When the process of S145 ends, the “correction process” ends, and the process proceeds to the determination process of S25.

Since the writing start position and writing end position differ depending on the character, even if the adjacent character is not inclined with respect to the absolute coordinate of the detection region 31a, the straight line 77 is inclined with respect to the reference line of the absolute coordinate of the detection region 31a. There is. In the determination process of S144, when the inclination of the straight line 77 with respect to the reference line is smaller than a predetermined value, S145 “character string inclination correction” is not performed, and thus “entry trajectory coordinates” may be corrected meaninglessly. No.
(Correction process of the second embodiment)
The “correction process” of the second embodiment will be described with reference to FIGS. 17 and 18. Each process of S211, S212, S213, S221, S222, S231, and S232 of the “correction process” of the second embodiment is the same as S111, S112, S113, S121, of the “correction process” of the first embodiment. Since it is the same as each process of S122, S131, and S132, description is abbreviate | omitted.

When the process of S232 ends, the process proceeds to S241.
In the process of S241 “Calculate the centroid coordinates of the first character”, the character position deviation determination program 12k determines the centroid coordinates on the absolute coordinates (x, y) of the detection area 31a of the first character 81 described in the detection area 31a. 84 is calculated. Specifically, the character position deviation determination program 12k calculates the barycentric coordinate 84 by calculating the barycentric coordinate of the quadrangle 83 surrounding the first character 81. When the process of S241 ends, the process proceeds to S242.

  In the process of S242 “Calculate the barycentric coordinates of the written character”, the character position deviation determination program 12k is on the absolute coordinates (x, y) of the detection area 31a of the written character 82 described in the detection area 31a. The barycentric coordinates 86 are calculated. Specifically, the character position deviation determination program 12k calculates the barycentric coordinates 86 by calculating the barycentric coordinates of the quadrangle 85 surrounding the written character 82. When the process of S242 ends, the process proceeds to S243.

  In the process of S243 “calculate the inclination from the center of gravity coordinates”, the character position deviation determination program 12k refers to the correction mode storage area 11e and determines whether the correction mode is “vertical correction mode” or “horizontal correction mode”. Check if it is. Then, the character position deviation determination program 12k reads the absolute coordinates (x, x, x) of the detection area 31a of the straight line 87 connecting the barycentric coordinates 84 of the first character 81 and the barycentric coordinates 86 of the written character 82 recognized in the processes of S241 and S242. The inclination of y) with respect to the reference line is calculated. When the correction mode is the “vertical correction mode”, the absolute coordinate x-axis of the detection region 31a becomes the reference line 89, as shown in FIG. In this case, the character position deviation determination program 12k calculates the inclination angle θ88 of the straight line 87 with respect to the x axis which is 89 as the reference line. On the other hand, when the correction mode is the “horizontal correction mode”, the y-axis of the absolute coordinate of the detection area 31a becomes the reference line. In this case, the character position deviation determination program 12k calculates the inclination angle θ of the straight line 87 with respect to the y axis that is the reference line. When the process of S243 ends, the process proceeds to S244.

  In the process of S244 “character string inclination correction”, the character position correction program 12m is based on the inclination (inclination angle θ78) of the detection area 31a of the straight line 87 with respect to the absolute coordinates (x, y) calculated in the process of S243. As shown in FIG. 18B, the positional relationship between the first character 81 and the written character 82 is parallel to the reference line 89 (in the embodiment of FIG. 18, the X axis is the reference line 89). Thus, the “entry trajectory coordinates” are corrected. Specifically, a reference line 89 ′ parallel to the reference line 89 is calculated starting from the barycentric coordinate 84 of the first character, and a comparison between the reference line 89 ′ and the straight line 87 indicates that each character to be corrected to 87 ′ is 87 ′. A movement distance in the Y-axis direction corresponding to the X coordinate of the center of gravity is calculated. Alternatively, since the center of gravity of each character is calculated, the movement distance in the Y-axis direction may be calculated from the absolute position of the center of gravity of each character. Alternatively, without calculating the center of gravity of each character, by calculating the movement distance in the Y-axis direction according to the X-coordinate of the center of gravity of each character to be corrected to 87 ′ for 87, each character is moved in the Y-axis direction. You can calculate the distance traveled. Each character is corrected by adding the movement distance in the Y-axis direction. The corrected “entry locus coordinate” is updated and stored in the entry locus coordinate storage area 11d. When the process of S244 ends, the “correction process” ends, and the process proceeds to the determination process of S25.

The input pen 80 may be configured to generate infrared rays and ultrasonic waves, the input detection unit 31 may be configured to receive the infrared rays and ultrasonic waves, and the input detection unit 31 may detect a user's entry operation.
Alternatively, the detection area 31a may be imaged to detect a user entry operation.
Further, the input detection unit 31 may be configured with a pressure-sensitive or capacitive touch panel.
In the embodiment described above, the user performs an entry operation in the detection area 31a of the input detection unit 31 using the input pen 80. However, the input detection unit 31 is configured by a touch panel or the input detection unit 31 is used. In this embodiment, the user performs an entry operation on the detection area 31a with a finger, and the input detection unit 31 detects the entry operation.

  In the embodiment described above, in the process of S <b> 11 of “main process” shown in FIG. 4, either “vertical correction mode”, “horizontal correction mode”, or “no shift correction” is set. As shown in FIG. 2, the user can select the operation mode 60 a on the input pen 60, and the user can select various modes by operating the operation button 60 a. Absent. Alternatively, in the processing of S11, there may be an embodiment in which the user selects various modes by operating the operation unit 35.

  Although the present invention has been described above in connection with the most practical and preferred embodiments at the present time, the present invention is not limited to the embodiments disclosed herein. However, the present invention can be appropriately changed without departing from the gist or concept of the invention that can be read from the claims and the entire specification, and a head-mounted display accompanying such a change should also be understood as being included in the technical scope. I must.

9 Bus 10 CPU
11 RAM
11a Entry operation coordinate storage area 11b Initial position coordinate storage area 11c Start position coordinate storage area 11d Entry locus coordinate storage area 11e Correction mode storage area 11f Acceleration data storage area 11g Tilt angle data storage area 12 ROM
12a mode selection screen display program 12b mode selection program 12c initial position coordinate determination program 12d start position coordinate detection program 12e coordinate conversion program 12f entry locus image generation program 12g entry operation error detection program 12h warning notification program 12i 1 character entry completion judgment program 12j Character overlap determination program 12k Character position deviation determination program 12m Character position correction program 13 Auxiliary storage device 13a Entry trajectory coordinate storage area 13b Entry operation coordinate storage area 16 Image generation controller 17 VRAM
DESCRIPTION OF SYMBOLS 19 Interface 30 Control part 31 Entry operation detection part 31a Detection area 31b Proximity warning area 32 Acceleration sensor 33 Inclination sensor 35 Operation part 50 Head mounted display part 51 Head mounting part 52 Image generation part 60 Input pen 60a Operation part 71 It is written last time Characters 72 Newly entered characters 73 First character 74 Finished character 75 First point coordinate of first character 76 End point coordinate of written character 77 Straight line 78 Inclination angle 79 Reference line 81 First character 82 Characters finished writing 83 rectangle 84 centroid coordinates 85 rectangle 86 centroid coordinates 87 straight line 88 tilt angle 89 reference line 90 display area 91 start position coordinates 92 entry locus coordinates 93 entry position coordinates 94 entry operation coordinates 95 entry locus coordinates 96 warning 97 pointer 98 initial position mark 99 Initial position Coordinate 100 head-mounted display

Claims (7)

An image generator mounted on the user's head and allowing the user to visually recognize the image;
An entry operation detection means for detecting entry operation coordinates, which are coordinates of the entry operation of the user on a detection area which is two-dimensional and is attached to the user's body;
Based on the entry operation coordinates, entry operation image generation means for generating a locus image of the entry operation and outputting the generated locus image to the image generation unit;
Character input selection means for selecting whether or not the entry operation is a character input by a user input operation;
When a character input is selected by the character input selection means, a character position deviation determining means for determining a position deviation of the character entered on the detection area from the entry operation coordinates with respect to the first direction on the detection area. When,
Character position correction means for correcting the position shift of a character based on the position shift determined by the character position shift determination means;
A head-mounted display comprising:   The entry operation image generation means outputs a character string image of a character string composed of a plurality of characters whose relative positional deviation has been corrected by the character position correction means to the image generation section. The described head mounted display. The correction direction of the character position deviation corrected by the character position correction means is
A first mode for correcting a shift with respect to the first direction;
The apparatus further comprises a correction direction selection means for selecting by a user input operation whether the second correction mode is to correct a deviation with respect to a second direction which is a direction orthogonal to the first direction on the detection area. The head mounted display of Claim 1 or Claim 2. It further has an inclination detection means for detecting the inclination of the detection area,
4. The character position correcting means corrects the inclination of the character entered in the detection area based on the inclination information of the detection area detected by the inclination detecting means. The described head mounted display. It further has an acceleration detection means for detecting the acceleration received by the detection region,
The head mounted display according to any one of claims 1 to 4, wherein the character position correcting means performs correction for moving the character written in the detection area based on the acceleration.   The character position correcting means does not correct the character position deviation when the relative position deviation of the character entered on the detection area detected by the character position deviation determining means is equal to or less than a predetermined value. The head mounted display according to any one of claims 1 to 5. Further comprising character overlap judging means for judging whether or not adjacent characters overlap based on the input operation coordinates,
When the character overlap determining means determines that adjacent characters overlap,
The head-mounted display according to any one of claims 1 to 6, wherein the character position correcting means moves the character to a position where adjacent characters do not overlap based on the entry operation coordinates.

Images