US11442270B2 - Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge - Google Patents

Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge Download PDF

Info

Publication number
US11442270B2
US11442270B2 US16/511,353 US201916511353A US11442270B2 US 11442270 B2 US11442270 B2 US 11442270B2 US 201916511353 A US201916511353 A US 201916511353A US 11442270 B2 US11442270 B2 US 11442270B2
Authority
US
United States
Prior art keywords
partial
user
camera
front surface
reflection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/511,353
Other versions
US20190339527A1 (en
Inventor
Hong Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Original Assignee
Advanced New Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Advanced New Technologies Co Ltd filed Critical Advanced New Technologies Co Ltd
Assigned to ALIBABA GROUP HOLDING LIMITED reassignment ALIBABA GROUP HOLDING LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ZHANG, HONG
Publication of US20190339527A1 publication Critical patent/US20190339527A1/en
Assigned to ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD. reassignment ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ALIBABA GROUP HOLDING LIMITED
Assigned to Advanced New Technologies Co., Ltd. reassignment Advanced New Technologies Co., Ltd. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Application granted granted Critical
Publication of US11442270B2 publication Critical patent/US11442270B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/09Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
    • G02B27/0938Using specific optical elements
    • G02B27/095Refractive optical elements
    • G02B27/0955Lenses
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/141Beam splitting or combining systems operating by reflection only using dichroic mirrors

Definitions

  • This application relates generally to virtual reality (VR) technology, and more specifically, to a VR head-mounted apparatus.
  • VR virtual reality
  • VR technology uses a computer graphics system and various control interfaces to generate an interactive environment on a computer and thus provides three-dimensional immersive scenes for a user.
  • Existing technologies may create VR experience through a VR head-mounted apparatus, such as VR glasses or a VR helmet.
  • this application provides a VR head-mounted apparatus.
  • the apparatus may provide improved acquisition accuracy for an infrared image of an eye of a user wearing the VR apparatus.
  • a first aspect of this specification provides a VR head-mounted apparatus.
  • the VR head-mounted apparatus disclosed herein may comprise a convex lens, a first camera and a partial-reflection partial-transmission lens for reflecting infrared light.
  • the partial-reflection partial-transmission lens may be located on a side of the convex lens towards a user when the user wears the VR head-mounted apparatus, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely to reflect an infrared image of an eye of the user to the first camera.
  • the partial-reflection partial-transmission lens may have a high transmittance for visible light and a low transmittance for infrared light.
  • the partial-reflection partial-transmission lens may include an infrared dichroic mirror.
  • the infrared dichroic mirror may comprise a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
  • the first camera may be located outside a visible area of the convex lens with respect to the user.
  • the partial-reflection partial-transmission lens may have a plate shape, the lens surface of the partial-reflection partial-transmission lens may be inclined upward, the first camera may be located at a top of the apparatus, and a lens of the first camera may face downward.
  • the lens surface of the partial-reflection partial-transmission lens may be inclined downward, the first camera may be located at a bottom of the apparatus, and a lens of the first camera may face upward.
  • the partial-reflection partial-transmission lens may have a wedge-shaped cross section, a back surface of the partial-reflection partial-transmission may be disposed vertically, the lens surface of the partial-reflection partial-transmission lens is inclined downward, the first camera may be located at a bottom of the apparatus, and a lens of the first camera may face upward.
  • the partial-reflection partial-transmission lens may include an upper lens structure and a lower lens structure disposed obliquely, and a joint of the upper lens structure and the lower lens structure may be located in the middle of the partial-reflection partial-transmission lens.
  • the apparatus may further include a second camera, the first camera may be located at a top of the apparatus with a lens of the first camera facing the upper lens structure, and the second camera may be located at the bottom of the apparatus with a lens of the second camera facing the lower lens structure.
  • the upper lens structure and the lower lens structure may be symmetrical with respect to a horizontal plane going through the middle of the partial-reflection partial-transmission lens.
  • the partial-reflection partial-transmission lens may include an upper lens structure and a lower lens structure disposed obliquely, and a joint of the upper lens structure and the lower lens structure may be located at an upper part of the partial-reflection partial-transmission lens.
  • the apparatus may further comprise a second camera. The first camera may be located at a top of the apparatus and a lens of the first camera may face the upper lens structure, and the second camera may be located at a bottom of the apparatus and a lens of the second camera may face the lower lens structure.
  • the apparatus may further include a protective frame, which may form an accommodating space adapted to the partial-reflection partial-transmission lens and the convex lens, so as to accommodate and fix the partial-reflection partial-transmission lens and the convex lens to the apparatus.
  • a protective frame which may form an accommodating space adapted to the partial-reflection partial-transmission lens and the convex lens, so as to accommodate and fix the partial-reflection partial-transmission lens and the convex lens to the apparatus.
  • the apparatus may further include an adjustment component, configured to perform angle adjustment on the first camera, such that the lens of the first camera may be kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission lens.
  • this specification provides a VR head-mounted apparatus.
  • the VR head-mounted apparatus comprises a convex lens, a camera, and a partial-reflection partial-transmission lens for reflecting infrared light.
  • the partial-reflection partial-transmission lens may be located on a side of the convex lens towards a user when the user wears the VR apparatus, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely to reflect an infrared image of an eye of the user to the camera.
  • the VR head-mounted apparatus may further include a VR playing component on a side of the convex lens away from the user and configured to display VR content.
  • the VR playing component may be a mobile phone or a tablet, and the VR content may be displayed through a screen of the VR playing component.
  • the VR playing component may be a display component connected to an external apparatus, which may generate the VR content for the VR playing component to display.
  • the external apparatus may be a personal computer or a game console.
  • the partial-reflection partial-transmission lens may have a high transmittance for visible light and a low transmittance for infrared light.
  • the partial-reflection partial-transmission lens may include an infrared dichroic mirror.
  • the infrared dichroic mirror may include a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
  • the VR head-mounted apparatus of this application may comprise a partial-reflection partial-transmission lens, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely. Therefore, without interfering with a user's viewing of VR display content, an infrared image of an eye of the user may be reflected to a camera by the partial-reflection partial-transmission lens, and a deviation angle of a camera during the acquisition of the infrared image of the eye may be reduced.
  • the VR head-mounted apparatus may reduce the deformation and distortion, and improves the acquisition accuracy of the infrared image of the eye.
  • FIG. 1 is a side cross-sectional view of a VR helmet in accordance with a first embodiment of this application.
  • FIG. 2 is a side cross-sectional view of a VR helmet in accordance with a second embodiment of this application.
  • FIG. 3 is a side cross-sectional view of a VR helmet in accordance with a third embodiment of this application.
  • FIGS. 4, 5, and 6 are side cross-sectional views of a VR helmet in accordance with a fourth embodiment of this application.
  • FIG. 7 is a schematic view of controlling an angle of a camera in accordance with one embodiment of this application.
  • FIG. 8 is a schematic view of a partial-reflection partial-transmission lens and a convex lens along with a protective frame in accordance with one embodiment of this application.
  • FIG. 1 is a side cross-sectional view of a VR helmet in accordance with one embodiment of this application.
  • the VR helmet 1 may include a convex lens 2 and a VR playing component 5 .
  • the VR helmet 1 may further include a partial-reflection partial-transmission lens 3 for reflecting infrared light.
  • the partial-reflection partial-transmission lens 3 may be located on a side of the convex lens 2 towards a user when the user wears the VR helmet 1 (i.e., the partial-reflection partial-transmission lens 3 may be located between the convex lens 2 and an eye 6 of the user).
  • the partial-reflection partial-transmission lens 3 may have a high transmittance for visible light (relative to infrared light) and a low transmittance for infrared light (relative to visible light).
  • VR display content played by the VR playing component 5 may, in a form of visible light S 1 , go through the partial-reflection partial-transmission lens 3 almost unaffected, and the eye 6 of the user may receive the visible light S 1 to view the VR display content.
  • infrared light S 2 emitted from the eye 6 of the user may be mostly, if not entirely, reflected by the partial-reflection partial-transmission lens 3 .
  • the reflected infrared light S 2 ′ may be acquired by a camera 4 in the VR helmet 1 , and an infrared image of the eye 6 may be formed from the reflected infrared light S 2 ′ for functions such as eye tracking and iris recognition.
  • a lens surface 30 of the partial-reflection partial-transmission lens 3 may be disposed obliquely. Positions of the partial-reflection partial-transmission lens 3 and the camera 4 may correspond to each other, so that the lens surface 30 of the partial-reflection partial-transmission lens 3 can reflect the infrared light S 2 corresponding to the infrared image of the eye 6 towards the camera 4 .
  • the camera 4 may be located at a lower edge of the VR helmet 1 , and located at a side of the convex lens 2 towards the user (i.e., the left side of the convex lens 2 , as shown in FIG. 1 ).
  • a lens of the camera 4 may face inward towards the partial-reflection partial-transmission lens 3 to acquire the foregoing reflected infrared light S 2 ′.
  • an angle ⁇ between the camera 4 and the reflected infrared light S 2 ′ may be smaller than the foregoing angle ⁇ .
  • a visible area formed between the eye 6 and the convex lens 2 may have a trapezoidal shape as shown in FIG. 1 (in 3-D space, the visible area may have a cone shape since the convex lens 2 is round).
  • a top surface and a bottom surface of the VR helmet 1 i.e., illustrated as a top side and a bottom side of the dashed box shown in FIG. 1 ) may both be planar.
  • the camera 4 is located inside the bottom surface of the VR helmet 1 (as shown in FIG.
  • an installation space for the camera 4 may become smaller as the camera moves closer to the convex lens 2 , and become larger as the camera moves closer to the eye 6 .
  • a larger installation space compared to a situation where the installation position of the camera 4 is close to the convex lens 2
  • an installation angle of the camera 4 e.g., to make it more parallel with the reflected infrared light S 2 ′
  • the VR helmet may be an integrated-style VR head-mounted apparatus, that is, the VR helmet may be able to independently play VR content without resorting to an external apparatus.
  • the VR playing component 5 may be built-in in the VR helmet 1 to implement playing functions such as rendering and displaying of VR display content.
  • the VR helmet 1 may be a split-style VR head-mounted apparatus.
  • the VR helmet 1 may be paired with a mobile apparatus such as a mobile phone or a tablet.
  • the VR playing component 5 may include a mobile apparatus installed in the VR helmet 1 , and the mobile apparatus may use a processor or a graphic card chip for rendering VR display content, and use a screen component for content display.
  • the VR helmet may be paired with a PC host, a game console, or another external apparatus.
  • the VR playing component 5 may be a display component built-in in the VR helmet, and the foregoing external apparatus may be used for rendering VR display content.
  • the partial-reflection partial-transmission lens 3 for reflecting infrared light may refer to a lens having a low transmittance for an infrared spectrum and a high transmittance for other spectra such as visible light. Most, if not all, of light in the low-transmittance infrared spectrum may be reflected by the partial-reflection partial-transmission lens 3 (i.e., “partial-reflection”).
  • partial-reflection partial-transmission lens 3 most, if not all, of light in other spectra such as high-transmittance visible light may pass through the partial-reflection partial-transmission lens 3 almost unaffected, so that the partial-reflection partial-transmission lens 3 's impact on light in other spectra, such as visible light, can be minimized (i.e., “partial-transmission”).
  • the foregoing partial-reflection partial-transmission lens 3 for reflecting infrared light may be an infrared dichroic mirror, such that light in a visible spectrum may be mostly, if not completely, transmitted and light in an infrared spectrum may be mostly, if not completely, reflected.
  • an infrared reflective film such as a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film may be coated on a surface of an optical lens that has a high transmittance for visible light to form the infrared dichroic mirror.
  • a lens may be made entirely of materials in the foregoing infrared reflective film or a similar preparation material to form the infrared dichroic mirror.
  • the VR head-mounted apparatus comprises a partial-reflection partial-transmission lens 3 , and a lens surface 30 of the partial-reflection partial-transmission lens 3 may be obliquely disposed.
  • an infrared image of an eye of the user may be reflected to a camera by the partial-reflection partial-transmission lens 3 .
  • a deviation angle of a camera 4 during the acquisition of the infrared image of the eye may be reduced, which reduces the deformation and distortion of the infrared image of the eye, and improves the acquisition accuracy of the infrared image of the eye.
  • the partial-reflection partial-transmission lens 3 in this specification may have a plate shape as shown in FIG. 1 .
  • the partial-reflection partial-transmission lens 3 as a whole may be arranged obliquely, as shown in FIG. 1 .
  • the partial-reflection partial-transmission lens 3 may have other shapes, and may be arranged in other manners.
  • the partial-reflection partial-transmission lens 3 may have a wedge-shaped cross section.
  • a back surface of the partial-reflection partial-transmission lens 3 (a surface of the partial-reflection partial-transmission lens facing the convex lens 2 ) may be disposed vertically, so that the lens surface 30 of the partial-reflection partial-transmission lens may be disposed inclined.
  • the lens surface 30 of the partial-reflection partial-transmission lens 3 may be inclined downward. This arrangement may reduce the installation difficulty of the partial-reflection partial-transmission lens 3 as the installation angle of the partial-reflection partial-transmission lens 3 does not need to be repeatedly adjusted.
  • the lens surface 30 of the partial-reflection partial-transmission lens 3 is inclined downward, the camera 4 is located at the bottom of the VR helmet 1 , and the lens of the camera 4 may face upward. Due to the structural characteristics of a human eye, the infrared image of the eye 6 of the user can be acquired more completely, clearly and accurately under this setting.
  • the lens surface 30 of the partial-reflection partial-transmission lens 3 is inclined upward, the camera 4 is located at the top of the VR helmet 1 , and the lens of the camera 4 may face downward, the infrared image of the eye 6 can also be obtained.
  • FIG. 4 is a side cross-sectional view of a VR helmet in accordance with one embodiment of this application.
  • the partial-reflection partial-transmission lens 3 may have other shapes.
  • the partial-reflection partial-transmission lens 3 in FIG. 4 may include an upper lens structure 3 A and a lower lens structure 3 B each disposed obliquely, and a joint of the upper lens structure 3 A and the lower lens structure 3 B may be located in the middle of the partial-reflection partial-transmission lens (i.e., in the embodiment shown in FIG. 4 , the upper lens structure 3 A may incline rightward, and the lower lens structure 3 B may incline leftwards).
  • the VR helmet 1 may include two cameras, as shown in FIG. 4 . That is, the VR helmet 1 may include a first camera 4 A and a second camera 4 B.
  • the first camera 4 A may be located at a top of the VR helmet 1 with a lens of the first camera 4 A facing the upper lens structure 3 A
  • the second camera 4 B may be located at a bottom of the VR helmet 1 with a lens of the second camera 4 B facing the lower lens structure 3 B.
  • a positional relationship between the eye 6 and the partial-reflection partial-transmission lens 3 may be different for different users wearing a same VR apparatus.
  • the eye 6 may not be exactly located in a middle position of the VR helmet 1 as shown in FIGS. 1-3 , which may result in the camera 4 not being able to completely acquire the infrared image of the eye of the user.
  • the VR head-mounted apparatus presented in FIG. 4 can ensure that infrared images of the eyes of a user can be completely acquired by the first camera 4 A and the second camera 4 B, regardless the positional changes (e.g., an upward shift or a downward shift) that may occur to the eyes of the user.
  • an upper region of the infrared image of the eye 6 may correspond to a first infrared ray S 21
  • a lower region of the infrared image of the eye 6 may correspond to a second infrared ray S 22 .
  • the first infrared ray S 21 may be reflected by an upper lens surface 30 A of the upper lens structure 3 A to form a first reflected infrared ray S 21 ′, which may be acquired by the first camera 4 A.
  • the second infrared ray S 22 may be reflected by a lower lens surface 30 B of the lower lens structure 3 B to form a second reflected infrared ray S 22 ′, which may be acquired by the second camera 4 B. Then, the first reflected infrared ray S 21 ′ and the second reflected infrared ray S 22 ′ may be combined to form the infrared image of the eye 6 .
  • the eye 6 may shift upward, as shown in FIG. 5 .
  • the first infrared ray S 21 and the second infrared ray S 22 may both be emitted towards the upper lens structure 3 A and reflected by the upper lens surface 30 A of the upper lens structure 3 A to form the first reflected infrared ray S 21 ′ and the second reflected infrared ray S 22 ′, respectively.
  • the first camera 4 A may acquire the first reflected infrared ray S 21 ′ and the second reflected infrared ray S 22 ′, and combine them to form the infrared image of the eye 6 .
  • the eye 6 may shift downward, as shown in FIG. 6 .
  • the first infrared ray S 21 and the second infrared ray S 22 may both be emitted towards the lower lens structure 3 B and reflected by the lower lens surface 30 B of the lower lens structure 3 B to form the first reflected infrared ray S 21 ′ and the second reflected infrared ray S 22 ′, respectively.
  • the second camera 4 B may acquire the first reflected infrared ray S 21 ′ and the second reflected infrared ray S 22 ′, and combine them to form the infrared image of the eye 6 .
  • the upper lens structure 3 A and the lower lens structure 3 B of the partial-reflection partial-transmission lens 3 shown in FIGS. 4-6 may be symmetrical with respect to a horizontal plane going through the middle of the partial-reflection partial-transmission lens 3 , such that the upper lens structure 3 A and the lower lens structure 3 B have the same or similar structural strength and stability, and the partial-reflection partial-transmission lens 3 may have better overall stability.
  • the upper lens structure 3 A and the lower lens structure 3 B may have an asymmetric structure.
  • a larger lower lens structure 3 B may be used for the acquisition of an infrared image of an eye in most cases, and a smaller upper lens structure 3 A may be employed to for the acquisition of an infrared image of an eye in rare cases where the eye 6 of the user is shifted upward.
  • a joint of the upper lens structure 3 A and the lower lens structure 3 B may be located at an upper part of the partial-reflection partial-transmission lens 3 .
  • the VR head-mounted apparatus of this application may further include an adjustment component 7 .
  • the adjustment component 7 may be electrically connected to each camera 4 to perform angle adjustment on the camera 4 , so that the lens of the camera 4 is kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission lens 3 , thereby obtaining a complete, clear and accurate infrared image of the eye.
  • the VR head-mounted apparatus of this application may further include a protective frame 8 , as shown in FIG. 8 .
  • the protective frame 8 may form an accommodating space adapted to the partial-reflection partial-transmission lens 3 and the convex lens 2 , so as to accommodate and fix the partial-reflection partial-transmission lens 3 and the convex lens 2 .
  • the protective frame 8 improves the structural integrity and stability of the VR head-mounted apparatus.
  • the terms “include”, “comprise” and any other variants mean to cover the non-exclusive inclusion. Thereby, the process, method, article, or device which include a series of elements not only include those elements, but also include other elements which are not clearly listed, or include the inherent elements of the process, method, article and device. Without further limitation, the element defined by a phrase “include one . . . ” does not exclude other same elements in the process, method, article or device which include the element.
  • first, second, and third may be used herein to describe various information, such information should not be limited to these terms. These terms are merely used for distinguishing information of the same type from each other.
  • first information may also be referred to as second information, and similarly, second information may also be referred to as first information.
  • second information may also be referred to as first information.
  • the term “if” as used herein may be interpreted as “when . . . ” or “upon . . . ” or “in response to determining.”

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Studio Devices (AREA)

Abstract

Methods, systems, and apparatus for a virtual reality (VR) head-mounted apparatus are provided. One of the apparatus includes a convex lens, a camera and a partial-reflection partial-transmission lens. The partial-reflection partial-transmission lens is located on a side of the convex lens towards a user when the user wears the VR head-mounted apparatus, and a lens surface of the partial-reflection partial-transmission lens is disposed obliquely to reflect an infrared image of an eye of the user to the camera. The VR head-mounted apparatus improves the acquisition accuracy for an infrared image of an eye of the user.

Description

CROSS-REFERENCE TO RELATED APPLICATION
This application is a continuation application of International Patent Application No. PCT/CN2018/077285, filed on Feb. 26, 2018, which is based on and claims priority of the Chinese Patent Application No. 201710109486.6, filed on Feb. 27, 2017 and entitled “VIRTUAL REALITY HEAD-MOUNTED APPARATUS.” The above-referenced applications are incorporated herein by reference in their entirety.
TECHNICAL FIELD
This application relates generally to virtual reality (VR) technology, and more specifically, to a VR head-mounted apparatus.
BACKGROUND
VR technology uses a computer graphics system and various control interfaces to generate an interactive environment on a computer and thus provides three-dimensional immersive scenes for a user. Existing technologies may create VR experience through a VR head-mounted apparatus, such as VR glasses or a VR helmet.
However, due to unique characteristics of VR technology, technical solutions that may work on traditional electronic devices, such as mobile phones or PCs, may not work well on a VR apparatus. For example, when acquiring an infrared image of an eye of a user wearing a VR apparatus, image acquisition conditions for conventional methods may be difficult to satisfy due to structural constraints within the VR apparatus, resulting in difficulties to successfully complete tasks such as biometric recognition, eye tracking, etc. Therefore, a VR apparatus that can quickly and accurately acquire an image of an eye of a user is desired.
SUMMARY
In view of the limitations of existing technologies described above, this application provides a VR head-mounted apparatus. The apparatus may provide improved acquisition accuracy for an infrared image of an eye of a user wearing the VR apparatus.
A first aspect of this specification provides a VR head-mounted apparatus. The VR head-mounted apparatus disclosed herein may comprise a convex lens, a first camera and a partial-reflection partial-transmission lens for reflecting infrared light. The partial-reflection partial-transmission lens may be located on a side of the convex lens towards a user when the user wears the VR head-mounted apparatus, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely to reflect an infrared image of an eye of the user to the first camera.
In some embodiments, the partial-reflection partial-transmission lens may have a high transmittance for visible light and a low transmittance for infrared light.
In some embodiments, the partial-reflection partial-transmission lens may include an infrared dichroic mirror.
In some embodiments, the infrared dichroic mirror may comprise a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
In some embodiments, the first camera may be located outside a visible area of the convex lens with respect to the user.
In some embodiments, the partial-reflection partial-transmission lens may have a plate shape, the lens surface of the partial-reflection partial-transmission lens may be inclined upward, the first camera may be located at a top of the apparatus, and a lens of the first camera may face downward. Alternatively, the lens surface of the partial-reflection partial-transmission lens may be inclined downward, the first camera may be located at a bottom of the apparatus, and a lens of the first camera may face upward.
In some embodiments, the partial-reflection partial-transmission lens may have a wedge-shaped cross section, a back surface of the partial-reflection partial-transmission may be disposed vertically, the lens surface of the partial-reflection partial-transmission lens is inclined downward, the first camera may be located at a bottom of the apparatus, and a lens of the first camera may face upward.
In some embodiments, the partial-reflection partial-transmission lens may include an upper lens structure and a lower lens structure disposed obliquely, and a joint of the upper lens structure and the lower lens structure may be located in the middle of the partial-reflection partial-transmission lens. The apparatus may further include a second camera, the first camera may be located at a top of the apparatus with a lens of the first camera facing the upper lens structure, and the second camera may be located at the bottom of the apparatus with a lens of the second camera facing the lower lens structure.
In some embodiments, the upper lens structure and the lower lens structure may be symmetrical with respect to a horizontal plane going through the middle of the partial-reflection partial-transmission lens.
In some embodiments, the partial-reflection partial-transmission lens may include an upper lens structure and a lower lens structure disposed obliquely, and a joint of the upper lens structure and the lower lens structure may be located at an upper part of the partial-reflection partial-transmission lens. The apparatus may further comprise a second camera. The first camera may be located at a top of the apparatus and a lens of the first camera may face the upper lens structure, and the second camera may be located at a bottom of the apparatus and a lens of the second camera may face the lower lens structure.
In some embodiments, the apparatus may further include a protective frame, which may form an accommodating space adapted to the partial-reflection partial-transmission lens and the convex lens, so as to accommodate and fix the partial-reflection partial-transmission lens and the convex lens to the apparatus.
In some embodiments, the apparatus may further include an adjustment component, configured to perform angle adjustment on the first camera, such that the lens of the first camera may be kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission lens.
According to a second aspect, this specification provides a VR head-mounted apparatus. The VR head-mounted apparatus comprises a convex lens, a camera, and a partial-reflection partial-transmission lens for reflecting infrared light. The partial-reflection partial-transmission lens may be located on a side of the convex lens towards a user when the user wears the VR apparatus, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely to reflect an infrared image of an eye of the user to the camera. The VR head-mounted apparatus may further include a VR playing component on a side of the convex lens away from the user and configured to display VR content.
In some embodiments, the VR playing component may be a mobile phone or a tablet, and the VR content may be displayed through a screen of the VR playing component.
In some embodiments, the VR playing component may be a display component connected to an external apparatus, which may generate the VR content for the VR playing component to display.
In some embodiments, the external apparatus may be a personal computer or a game console.
In some embodiments, the partial-reflection partial-transmission lens may have a high transmittance for visible light and a low transmittance for infrared light.
In some embodiments, the partial-reflection partial-transmission lens may include an infrared dichroic mirror.
In some embodiments, the infrared dichroic mirror may include a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
The VR head-mounted apparatus of this application may comprise a partial-reflection partial-transmission lens, and a lens surface of the partial-reflection partial-transmission lens may be disposed obliquely. Therefore, without interfering with a user's viewing of VR display content, an infrared image of an eye of the user may be reflected to a camera by the partial-reflection partial-transmission lens, and a deviation angle of a camera during the acquisition of the infrared image of the eye may be reduced. The VR head-mounted apparatus may reduce the deformation and distortion, and improves the acquisition accuracy of the infrared image of the eye.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a side cross-sectional view of a VR helmet in accordance with a first embodiment of this application.
FIG. 2 is a side cross-sectional view of a VR helmet in accordance with a second embodiment of this application.
FIG. 3 is a side cross-sectional view of a VR helmet in accordance with a third embodiment of this application.
FIGS. 4, 5, and 6 are side cross-sectional views of a VR helmet in accordance with a fourth embodiment of this application.
FIG. 7 is a schematic view of controlling an angle of a camera in accordance with one embodiment of this application.
FIG. 8 is a schematic view of a partial-reflection partial-transmission lens and a convex lens along with a protective frame in accordance with one embodiment of this application.
DETAILED DESCRIPTION OF THE EMBODIMENTS
Specific, non-limiting embodiments of the present invention will be described with reference to the drawings. It should be understood that particular features and aspects of any embodiment disclosed herein may be used and/or combined with particular features and aspects of any other embodiment disclosed herein. It should also be understood that such embodiments are by way of example and are merely illustrative of a small number of embodiments within the scope of the present invention. Various changes and modifications obvious to one skilled in the art to which the present invention pertains are deemed to be within the spirit, scope and contemplation of the present invention as further defined in the appended claims.
Using a VR helmet as an example, detail structures of a VR head-mounted apparatus of this application are described below through several embodiments.
FIG. 1 is a side cross-sectional view of a VR helmet in accordance with one embodiment of this application. As shown in FIG. 1, the VR helmet 1 may include a convex lens 2 and a VR playing component 5. The VR helmet 1 may further include a partial-reflection partial-transmission lens 3 for reflecting infrared light. The partial-reflection partial-transmission lens 3 may be located on a side of the convex lens 2 towards a user when the user wears the VR helmet 1 (i.e., the partial-reflection partial-transmission lens 3 may be located between the convex lens 2 and an eye 6 of the user). The partial-reflection partial-transmission lens 3 may have a high transmittance for visible light (relative to infrared light) and a low transmittance for infrared light (relative to visible light). Thus, VR display content played by the VR playing component 5 may, in a form of visible light S1, go through the partial-reflection partial-transmission lens 3 almost unaffected, and the eye 6 of the user may receive the visible light S1 to view the VR display content. On the other hand, infrared light S2 emitted from the eye 6 of the user may be mostly, if not entirely, reflected by the partial-reflection partial-transmission lens 3. The reflected infrared light S2′ may be acquired by a camera 4 in the VR helmet 1, and an infrared image of the eye 6 may be formed from the reflected infrared light S2′ for functions such as eye tracking and iris recognition.
More specifically, a lens surface 30 of the partial-reflection partial-transmission lens 3 may be disposed obliquely. Positions of the partial-reflection partial-transmission lens 3 and the camera 4 may correspond to each other, so that the lens surface 30 of the partial-reflection partial-transmission lens 3 can reflect the infrared light S2 corresponding to the infrared image of the eye 6 towards the camera 4. For example, in the embodiment shown in FIG. 1, the camera 4 may be located at a lower edge of the VR helmet 1, and located at a side of the convex lens 2 towards the user (i.e., the left side of the convex lens 2, as shown in FIG. 1). A lens of the camera 4 may face inward towards the partial-reflection partial-transmission lens 3 to acquire the foregoing reflected infrared light S2′. Assuming that an angle between the camera 4 and the infrared light S2 is maintained at a, since the lens surface 30 of the partial-reflection partial-transmission lens 3 may be disposed obliquely to reflect the infrared light S2 towards the camera 4 to form the reflected infrared light S2′, an angle β between the camera 4 and the reflected infrared light S2′ may be smaller than the foregoing angle α. Thus possible deformation and distortion of the infrared image of the eye acquired by the camera 4 due to large angle α may be reduced, which helps to improve the acquisition accuracy for the infrared image of the eye 6, and to further improve the accuracy and precision of subsequent processing such as iris recognition and eye tracking.
Moreover, since the size of the eye 6 of the user tends to be smaller than the size of the aperture of the convex lens 2, a visible area formed between the eye 6 and the convex lens 2 may have a trapezoidal shape as shown in FIG. 1 (in 3-D space, the visible area may have a cone shape since the convex lens 2 is round). A top surface and a bottom surface of the VR helmet 1 (i.e., illustrated as a top side and a bottom side of the dashed box shown in FIG. 1) may both be planar. In an example that the camera 4 is located inside the bottom surface of the VR helmet 1 (as shown in FIG. 1), an installation space for the camera 4 may become smaller as the camera moves closer to the convex lens 2, and become larger as the camera moves closer to the eye 6. Thus, when the camera 4 is installed close to the eye 6 (e.g., installed at a position as shown in FIG. 1), a larger installation space (compared to a situation where the installation position of the camera 4 is close to the convex lens 2) can be obtained to adjust an installation angle of the camera 4 (e.g., to make it more parallel with the reflected infrared light S2′) and to reduce the foregoing angle (3, thereby improving the acquisition accuracy of the camera 4 for the infrared image of the eye 6.
The technical solutions of this application may be applied to any type of VR head-mounted apparatus. For example, as shown in FIG. 1, the VR helmet may be an integrated-style VR head-mounted apparatus, that is, the VR helmet may be able to independently play VR content without resorting to an external apparatus. The VR playing component 5 may be built-in in the VR helmet 1 to implement playing functions such as rendering and displaying of VR display content. Alternatively, the VR helmet 1 may be a split-style VR head-mounted apparatus. In one example, the VR helmet 1 may be paired with a mobile apparatus such as a mobile phone or a tablet. The VR playing component 5 may include a mobile apparatus installed in the VR helmet 1, and the mobile apparatus may use a processor or a graphic card chip for rendering VR display content, and use a screen component for content display. In another example, the VR helmet may be paired with a PC host, a game console, or another external apparatus. The VR playing component 5 may be a display component built-in in the VR helmet, and the foregoing external apparatus may be used for rendering VR display content.
In the embodiments of this application, the partial-reflection partial-transmission lens 3 for reflecting infrared light may refer to a lens having a low transmittance for an infrared spectrum and a high transmittance for other spectra such as visible light. Most, if not all, of light in the low-transmittance infrared spectrum may be reflected by the partial-reflection partial-transmission lens 3 (i.e., “partial-reflection”). Meanwhile, most, if not all, of light in other spectra such as high-transmittance visible light may pass through the partial-reflection partial-transmission lens 3 almost unaffected, so that the partial-reflection partial-transmission lens 3's impact on light in other spectra, such as visible light, can be minimized (i.e., “partial-transmission”).
In some embodiments, the foregoing partial-reflection partial-transmission lens 3 for reflecting infrared light may be an infrared dichroic mirror, such that light in a visible spectrum may be mostly, if not completely, transmitted and light in an infrared spectrum may be mostly, if not completely, reflected. More specifically, in one embodiment, an infrared reflective film such as a TiO2-Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film may be coated on a surface of an optical lens that has a high transmittance for visible light to form the infrared dichroic mirror. In another embodiment, a lens may be made entirely of materials in the foregoing infrared reflective film or a similar preparation material to form the infrared dichroic mirror.
In this application, the VR head-mounted apparatus comprises a partial-reflection partial-transmission lens 3, and a lens surface 30 of the partial-reflection partial-transmission lens 3 may be obliquely disposed. Without interfering with a user's viewing of VR display content, an infrared image of an eye of the user may be reflected to a camera by the partial-reflection partial-transmission lens 3. A deviation angle of a camera 4 during the acquisition of the infrared image of the eye may be reduced, which reduces the deformation and distortion of the infrared image of the eye, and improves the acquisition accuracy of the infrared image of the eye.
The partial-reflection partial-transmission lens 3 in this specification may have a plate shape as shown in FIG. 1. In that case, the partial-reflection partial-transmission lens 3 as a whole may be arranged obliquely, as shown in FIG. 1. In some embodiments, the partial-reflection partial-transmission lens 3 may have other shapes, and may be arranged in other manners. For example, as shown in FIG. 2, the partial-reflection partial-transmission lens 3 may have a wedge-shaped cross section. In that case, a back surface of the partial-reflection partial-transmission lens 3 (a surface of the partial-reflection partial-transmission lens facing the convex lens 2) may be disposed vertically, so that the lens surface 30 of the partial-reflection partial-transmission lens may be disposed inclined. For example, as shown in FIG. 2, the lens surface 30 of the partial-reflection partial-transmission lens 3 may be inclined downward. This arrangement may reduce the installation difficulty of the partial-reflection partial-transmission lens 3 as the installation angle of the partial-reflection partial-transmission lens 3 does not need to be repeatedly adjusted.
In the embodiment shown in FIG. 1 or FIG. 2, the lens surface 30 of the partial-reflection partial-transmission lens 3 is inclined downward, the camera 4 is located at the bottom of the VR helmet 1, and the lens of the camera 4 may face upward. Due to the structural characteristics of a human eye, the infrared image of the eye 6 of the user can be acquired more completely, clearly and accurately under this setting. In the embodiment shown in FIG. 3, the lens surface 30 of the partial-reflection partial-transmission lens 3 is inclined upward, the camera 4 is located at the top of the VR helmet 1, and the lens of the camera 4 may face downward, the infrared image of the eye 6 can also be obtained.
FIG. 4 is a side cross-sectional view of a VR helmet in accordance with one embodiment of this application. As shown in FIG. 4, in addition to the foregoing plate shape as shown in FIGS. 1-3, the partial-reflection partial-transmission lens 3 may have other shapes. For example, the partial-reflection partial-transmission lens 3 in FIG. 4 may include an upper lens structure 3A and a lower lens structure 3B each disposed obliquely, and a joint of the upper lens structure 3A and the lower lens structure 3B may be located in the middle of the partial-reflection partial-transmission lens (i.e., in the embodiment shown in FIG. 4, the upper lens structure 3A may incline rightward, and the lower lens structure 3B may incline leftwards).
In some embodiments, the VR helmet 1 may include two cameras, as shown in FIG. 4. That is, the VR helmet 1 may include a first camera 4A and a second camera 4B. The first camera 4A may be located at a top of the VR helmet 1 with a lens of the first camera 4A facing the upper lens structure 3A, and the second camera 4B may be located at a bottom of the VR helmet 1 with a lens of the second camera 4B facing the lower lens structure 3B.
Since users wearing the VR apparatus may have different shapes and sizes on traits such as their heads, faces and eyes, and the VR apparatus may be uniformly manufactured by a manufacturer, a positional relationship between the eye 6 and the partial-reflection partial-transmission lens 3 may be different for different users wearing a same VR apparatus. For example, the eye 6 may not be exactly located in a middle position of the VR helmet 1 as shown in FIGS. 1-3, which may result in the camera 4 not being able to completely acquire the infrared image of the eye of the user.
To address the foregoing deficiency, the VR head-mounted apparatus presented in FIG. 4 can ensure that infrared images of the eyes of a user can be completely acquired by the first camera 4A and the second camera 4B, regardless the positional changes (e.g., an upward shift or a downward shift) that may occur to the eyes of the user.
For example, when the eye 6 is located near the middle position of the VR helmet 1, an upper region of the infrared image of the eye 6 may correspond to a first infrared ray S21, and a lower region of the infrared image of the eye 6 may correspond to a second infrared ray S22. The first infrared ray S21 may be reflected by an upper lens surface 30A of the upper lens structure 3A to form a first reflected infrared ray S21′, which may be acquired by the first camera 4A. The second infrared ray S22 may be reflected by a lower lens surface 30B of the lower lens structure 3B to form a second reflected infrared ray S22′, which may be acquired by the second camera 4B. Then, the first reflected infrared ray S21′ and the second reflected infrared ray S22′ may be combined to form the infrared image of the eye 6.
In some embodiments, the eye 6 may shift upward, as shown in FIG. 5. The first infrared ray S21 and the second infrared ray S22 may both be emitted towards the upper lens structure 3A and reflected by the upper lens surface 30A of the upper lens structure 3A to form the first reflected infrared ray S21′ and the second reflected infrared ray S22′, respectively. The first camera 4A may acquire the first reflected infrared ray S21′ and the second reflected infrared ray S22′, and combine them to form the infrared image of the eye 6.
In some embodiments, the eye 6 may shift downward, as shown in FIG. 6. The first infrared ray S21 and the second infrared ray S22 may both be emitted towards the lower lens structure 3B and reflected by the lower lens surface 30B of the lower lens structure 3B to form the first reflected infrared ray S21′ and the second reflected infrared ray S22′, respectively. The second camera 4B may acquire the first reflected infrared ray S21′ and the second reflected infrared ray S22′, and combine them to form the infrared image of the eye 6.
In one embodiment, the upper lens structure 3A and the lower lens structure 3B of the partial-reflection partial-transmission lens 3 shown in FIGS. 4-6 may be symmetrical with respect to a horizontal plane going through the middle of the partial-reflection partial-transmission lens 3, such that the upper lens structure 3A and the lower lens structure 3B have the same or similar structural strength and stability, and the partial-reflection partial-transmission lens 3 may have better overall stability. In some embodiments, the upper lens structure 3A and the lower lens structure 3B may have an asymmetric structure. For example, a larger lower lens structure 3B may be used for the acquisition of an infrared image of an eye in most cases, and a smaller upper lens structure 3A may be employed to for the acquisition of an infrared image of an eye in rare cases where the eye 6 of the user is shifted upward. In that case, a joint of the upper lens structure 3A and the lower lens structure 3B may be located at an upper part of the partial-reflection partial-transmission lens 3.
In some embodiments, as shown in FIG. 7, the VR head-mounted apparatus of this application may further include an adjustment component 7. The adjustment component 7 may be electrically connected to each camera 4 to perform angle adjustment on the camera 4, so that the lens of the camera 4 is kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission lens 3, thereby obtaining a complete, clear and accurate infrared image of the eye.
Additionally, the VR head-mounted apparatus of this application may further include a protective frame 8, as shown in FIG. 8. The protective frame 8 may form an accommodating space adapted to the partial-reflection partial-transmission lens 3 and the convex lens 2, so as to accommodate and fix the partial-reflection partial-transmission lens 3 and the convex lens 2. The protective frame 8 improves the structural integrity and stability of the VR head-mounted apparatus.
It should also be noted that the terms “include”, “comprise” and any other variants mean to cover the non-exclusive inclusion. Thereby, the process, method, article, or device which include a series of elements not only include those elements, but also include other elements which are not clearly listed, or include the inherent elements of the process, method, article and device. Without further limitation, the element defined by a phrase “include one . . . ” does not exclude other same elements in the process, method, article or device which include the element.
References are made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The above description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise represented. The implementations set forth in the following description of exemplary embodiments do not represent all implementations consistent with this application. Instead, they are merely examples of apparatuses and methods consistent with aspects related to this application as recited in the appended claims.
The terms used in this application are merely for the purpose of describing specific embodiments, and are not intended to limit this application. The terms “a”, “said” and “the” of singular forms used in this application and the appended claims are also intended to include plural forms, unless otherwise specified in the context clearly. It should also be understood that, the term “and/or” used herein indicates and includes any or all possible combinations of one or more associated listed items.
It should be understood that although the terms such as first, second, and third may be used herein to describe various information, such information should not be limited to these terms. These terms are merely used for distinguishing information of the same type from each other. For example, within the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the term “if” as used herein may be interpreted as “when . . . ” or “upon . . . ” or “in response to determining.”
The foregoing descriptions are merely exemplary embodiments of this application, but are not intended to limit this application. Any modification, equivalent replacement, or improvement made without departing from the spirit and principle of this application should fall within the protection scope of this application.

Claims (20)

What is claimed is:
1. A virtual reality (VR) head-mounted apparatus, comprising:
a convex lens;
a first camera located at a top of the VR head-mounted apparatus;
a second camera located at a bottom of the VR head-mounted apparatus; and
a partial-reflection partial-transmission wedge for reflecting infrared light, wherein the partial-reflection partial-transmission wedge is located on a side of the convex lens towards a user when the user wears the VR head-mounted apparatus,
wherein the partial-reflection partial-transmission wedge comprises an upper structure and a lower structure connected at a joint of the upper structure and the lower structure, the upper structure and the lower structure contacting the convex lens,
the upper structure having an upper-front surface facing towards the user and an upper-back surface facing away from the user, the upper-front surface configured to reflect a light from the user towards the first camera, the upper-front surface being a surface of the upper structure closest to the user, the upper-back surface being a surface of the upper structure closest to the convex lens, the upper-front surface substantially parallel with the upper-back surface,
the lower structure having a lower-front surface facing towards the user and a lower-back surface facing away from the user, the lower-front surface configured to reflect the light from the user towards the second camera, the lower-front surface being a surface of the lower structure closest to the user, the lower-back surface being a surface of the lower structure closest to the convex lens, and the lower-front surface substantially parallel with the lower-back surface, wherein the upper-front surface and the lower-front surface are planar surfaces, the upper-front surface and the lower-front surface form a first obtuse angle at the joint of the upper structure and the lower structure,
the upper-back surface of the upper structure and the lower-back surface of the lower structure forming a second obtuse angle at the joint of the upper structure and the lower structure.
2. The apparatus of claim 1, wherein the partial-reflection partial-transmission wedge has a higher transmittance for visible light than for infrared light.
3. The apparatus of claim 1, wherein the partial-reflection partial-transmission wedge comprises an infrared dichroic mirror.
4. The apparatus of claim 3, wherein the infrared dichroic mirror comprises a TiO2—Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
5. The apparatus of claim 1, wherein the first camera is located outside a visible area of the convex lens with respect to the user.
6. The apparatus of claim 1, wherein the joint of the upper structure and the lower structure is located in the middle of the partial-reflection partial-transmission wedge.
7. The apparatus of claim 6, wherein the upper structure and the lower structure are symmetrical with respect to a horizontal plane going through the middle of the partial-reflection partial-transmission wedge.
8. The apparatus of claim 1, wherein the joint of the upper structure and the lower structure is located at an upper part of the partial-reflection partial-transmission wedge.
9. The apparatus of claim 1, further comprising:
a protective frame, which forms an accommodating space adapted to the partial-reflection partial-transmission wedge and the convex lens, so as to accommodate and fix the partial-reflection partial-transmission wedge and the convex lens to the apparatus.
10. The apparatus of claim 1, further comprising:
an adjustment component configured to perform angle adjustment on the first camera, such that a lens of the first camera is kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission wedge.
11. A virtual reality (VR) apparatus, comprising:
a convex lens;
a first camera located at a top of the VR apparatus;
a second camera located at a bottom of the VR apparatus;
a partial-reflection partial-transmission wedge for reflecting infrared light, wherein the partial-reflection partial-transmission wedge is located on a side of the convex lens towards a user when the user wears the VR apparatus,
wherein the partial-reflection partial-transmission wedge comprises an upper structure and a lower structure connected at a joint of the upper structure and the lower structure, the upper structure and the lower structure contacting the convex lens,
the upper structure having an upper-front surface facing towards the user and an upper-back surface facing away from the user, the upper-front surface configured to reflect a light from the user towards the first camera, the upper-front surface being a surface of the upper structure closest to the user, the upper-back surface being a surface of the upper structure closest to the convex lens, the upper-front surface substantially parallel with the upper-back surface,
the lower structure having a lower-front surface facing towards the user and a lower-back surface facing away from the user, the lower-front surface configured to reflect the light from the user towards the second camera, the lower-front surface being a surface of the lower structure closest to the user, the lower-back surface being a surface of the lower structure closest to the convex lens, the lower-front surface substantially parallel with the lower-back surface, wherein the upper-front surface and the lower-front surface are planar surfaces, the upper-front surface and the lower-front surface form a first obtuse angle at the joint of the upper structure and the lower structure,
the upper-back surface of the upper structure and the lower-back surface of the lower structure forming a second obtuse angle at the joint of the upper structure and the lower structure; and
a VR playing component on a side of the convex lens away from the user and configured to display VR content.
12. The apparatus of claim 11, wherein the VR playing component is a mobile phone or a tablet, and the VR content is displayed through a screen of the VR playing component.
13. The apparatus of claim 11, wherein the VR playing component is a display component connected to an external apparatus, which generates the VR content for the VR playing component to display.
14. The apparatus of claim 13, wherein the external apparatus is a personal computer or a game console.
15. The apparatus of claim 11, wherein the partial-reflection partial-transmission wedge has a higher transmittance for visible light than for infrared light.
16. The apparatus of claim 11, the partial-reflection partial-transmission wedge comprises an infrared dichroic mirror.
17. The apparatus of claim 16, wherein the infrared dichroic mirror comprises a TiO2—Ag—TiO2 infrared reflective film or a ZnS—Ag—ZnS infrared reflective film.
18. The apparatus of claim 11, wherein the first camera is located outside a visible area of the convex lens with respect to the user.
19. The apparatus of claim 11, wherein the joint of the upper structure and the lower structure is located in the middle of the partial-reflection partial-transmission wedge.
20. The apparatus of claim 11, further comprising:
an adjustment component configured to perform angle adjustment on the first camera, such that a lens of the first camera is kept towards a virtual infrared image of the eye formed by the partial-reflection partial-transmission wedge.
US16/511,353 2017-02-27 2019-07-15 Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge Active 2038-10-10 US11442270B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201710109486.6 2017-02-27
CN201710109486.6A CN106908951A (en) 2017-02-27 2017-02-27 Virtual reality helmet
PCT/CN2018/077285 WO2018153371A1 (en) 2017-02-27 2018-02-26 Virtual reality head-mounted apparatus

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/077285 Continuation WO2018153371A1 (en) 2017-02-27 2018-02-26 Virtual reality head-mounted apparatus

Publications (2)

Publication Number Publication Date
US20190339527A1 US20190339527A1 (en) 2019-11-07
US11442270B2 true US11442270B2 (en) 2022-09-13

Family

ID=59208362

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/511,353 Active 2038-10-10 US11442270B2 (en) 2017-02-27 2019-07-15 Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge

Country Status (12)

Country Link
US (1) US11442270B2 (en)
EP (1) EP3557308B1 (en)
JP (1) JP6856863B2 (en)
KR (1) KR102284974B1 (en)
CN (1) CN106908951A (en)
ES (1) ES2824820T3 (en)
MY (1) MY193942A (en)
PH (1) PH12019501661B1 (en)
PL (1) PL3557308T3 (en)
SG (1) SG11201906874WA (en)
TW (1) TWI659229B (en)
WO (1) WO2018153371A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106908951A (en) * 2017-02-27 2017-06-30 阿里巴巴集团控股有限公司 Virtual reality helmet
CN110850594B (en) * 2018-08-20 2022-05-17 余姚舜宇智能光学技术有限公司 Head-mounted visual equipment and eyeball tracking system for same
US11442243B2 (en) * 2019-11-07 2022-09-13 Htc Corporation Head mounted display device
US20230316692A1 (en) * 2020-09-14 2023-10-05 Hewlett-Packard Development Company, L.P. Head Mounted Display with Reflective Surface
CN116802632A (en) * 2020-09-25 2023-09-22 苹果公司 System and method for user authentication device
EP4202531A4 (en) 2020-11-24 2024-03-20 Samsung Electronics Co., Ltd. AUGMENTED REALITY PORTABLE ELECTRONIC DEVICE WITH CAMERA
CN117310972A (en) * 2022-06-21 2023-12-29 北京七鑫易维信息技术有限公司 Eyeball tracking optical device, system and virtual reality equipment

Citations (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4227113A (en) * 1978-10-18 1980-10-07 Duro-Test Corporation Incandescent electric lamp with partial light transmitting coating
JPH06121254A (en) 1992-10-06 1994-04-28 Olympus Optical Co Ltd Head mount type display device
US5347400A (en) 1993-05-06 1994-09-13 Ken Hunter Optical system for virtual reality helmet
US5621424A (en) * 1992-08-24 1997-04-15 Olympus Optical Co., Ltd. Head mount display apparatus allowing easy switching operation from electronic image to external field image
US5689619A (en) 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
US5771124A (en) * 1996-07-02 1998-06-23 Siliscape Compact display system with two stage magnification and immersed beam splitter
US5815741A (en) * 1994-12-21 1998-09-29 Canon Kabushiki Kaisha Image observing apparatus and imaging apparatus utilizing the image observing apparatus
JPH11249588A (en) 1998-02-27 1999-09-17 Shimadzu Corp Head-mounted display
US6018630A (en) * 1994-05-17 2000-01-25 Canon Kabushiki Kaisha Camera viewfinder having a viewpoint detecting apparatus
US6043799A (en) 1998-02-20 2000-03-28 University Of Washington Virtual retinal display with scanner array for generating multiple exit pupils
US6191892B1 (en) * 1996-04-02 2001-02-20 Canon Kabushiki Kaisha Image display apparatus
US20010009478A1 (en) * 1994-06-13 2001-07-26 Shoichi Yamazaki Head-up display device with rotationally asymmetric curved surface
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US20070058261A1 (en) 2004-05-17 2007-03-15 Olympus Corporation Head mount type image display system
CN101077232A (en) 2007-06-07 2007-11-28 南京航空航天大学 Human-computer interaction helmet for type computer
CN200994790Y (en) 2006-12-19 2007-12-26 潘晓刚 System for measuring mental state parameter
US20080316606A1 (en) * 2007-06-20 2008-12-25 Canon Kabushiki Kaisha Image observation apparatus and image observation system
US7522344B1 (en) * 2005-12-14 2009-04-21 University Of Central Florida Research Foundation, Inc. Projection-based head-mounted display with eye-tracking capabilities
WO2009150747A1 (en) 2008-06-13 2009-12-17 パイオニア株式会社 Sight line input user interface unit, user interface method, user interface program, and recording medium with user interface program recorded
US20100164990A1 (en) 2005-08-15 2010-07-01 Koninklijke Philips Electronics, N.V. System, apparatus, and method for augmented reality glasses for end-user programming
US20100321409A1 (en) 2009-06-22 2010-12-23 Sony Corporation Head mounted display, and image displaying method in head mounted display
US20110043436A1 (en) 2006-12-28 2011-02-24 Scalar Corporation Head mount display
CN202198569U (en) 2011-08-09 2012-04-25 中国人民解放军空军航空医学研究所 Side reverse type eye movement detector
US20120194418A1 (en) 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with user action control and event input based control of eyepiece application
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
US20130107371A1 (en) 2011-10-26 2013-05-02 Google Inc. Display Device with Image Depth Simulation
US8482859B2 (en) 2010-02-28 2013-07-09 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US20140340286A1 (en) 2012-01-24 2014-11-20 Sony Corporation Display device
US20140361957A1 (en) * 2012-01-24 2014-12-11 The Arizonia Board Of Regents On Behalf Of The University Of Arizonz Compact eye-tracked head-mounted display
US20150009313A1 (en) * 2013-07-05 2015-01-08 Sony Corporation Visual line detection device and visual line detection method
US20150009574A1 (en) * 2013-07-03 2015-01-08 Eads Deutschland Gmbh Hmd apparatus with adjustable eye tracking device
CN104407440A (en) 2014-11-19 2015-03-11 东南大学 Holographic display device with sight tracking function
US20150242680A1 (en) * 2014-02-26 2015-08-27 Vaibhav Thukral Polarized gaze tracking
WO2015157016A1 (en) 2014-04-09 2015-10-15 3M Innovative Properties Company Head mounted display and low conspicuity pupil illuminator
US20150348327A1 (en) 2014-05-30 2015-12-03 Sony Computer Entertainment America Llc Head Mounted Device (HMD) System Having Interface With Mobile Computing Device for Rendering Virtual Reality Content
WO2015198502A1 (en) 2014-06-27 2015-12-30 株式会社Fove Device for detecting line of sight
US20160062121A1 (en) 2014-01-21 2016-03-03 Osterhout Group, Inc. See-through computer display systems
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
CN205103761U (en) 2015-08-03 2016-03-23 众景视界(北京)科技有限公司 Head -wearing type intelligent device
US20160081547A1 (en) * 2013-05-15 2016-03-24 The Johns Hopkins University Eye tracking and gaze fixation detection systems, components and methods using polarized light
US9329689B2 (en) 2010-02-28 2016-05-03 Microsoft Technology Licensing, Llc Method and apparatus for biometric data capture
US20160180591A1 (en) 2014-12-23 2016-06-23 Mediatek Inc. Eye Tracking With Mobile Device In A Head-Mounted Display
DE202016104179U1 (en) 2016-07-29 2016-08-12 Christian Hildebrandt Output device for stereoscopic image reproduction
CN105955491A (en) 2016-06-30 2016-09-21 北京上古视觉科技有限公司 VR (virtual reality) glasses with eye control and iris recognition functions
US20160291326A1 (en) * 2015-04-02 2016-10-06 Avegant Corporation System, apparatus, and method for displaying an image with a wider field of view
CN205721634U (en) 2016-05-16 2016-11-23 上海青研科技有限公司 A kind of wear-type eye control virtual reality device
CN106214118A (en) 2016-01-28 2016-12-14 北京爱生科贸有限公司 A kind of ocular movement based on virtual reality monitoring system
US20160370591A1 (en) * 2014-12-27 2016-12-22 Fove, Inc. Head mounted display
US20160378176A1 (en) 2015-06-24 2016-12-29 Mediatek Inc. Hand And Body Tracking With Mobile Device-Based Virtual Reality Head-Mounted Display
CN205942608U (en) 2016-06-30 2017-02-08 上海青研科技有限公司 A integration mirror cup that is used for eyeball to track and iris discernment
CN106406543A (en) 2016-11-23 2017-02-15 长春中国光学科学技术馆 VR scene conversion device controlled by human eyes
CN106406509A (en) 2016-05-16 2017-02-15 上海青研科技有限公司 Head-mounted eye control virtual reality device
US9625723B2 (en) * 2013-06-25 2017-04-18 Microsoft Technology Licensing, Llc Eye-tracking system using a freeform prism
US20170115689A1 (en) 2015-10-21 2017-04-27 Beijing Pico Technology Co., Ltd. Virtual reality glasses
US20170147859A1 (en) * 2015-11-25 2017-05-25 Google Inc. Prism-based eye tracking
CN106908951A (en) 2017-02-27 2017-06-30 阿里巴巴集团控股有限公司 Virtual reality helmet
US20170205876A1 (en) * 2016-01-20 2017-07-20 Thalmic Labs Inc. Systems, devices, and methods for proximity-based eye tracking
US20170214905A1 (en) 2015-08-03 2017-07-27 Boe Technology Group Co., Ltd. Virtual reality goggles and display method thereof
US20170262703A1 (en) * 2015-04-01 2017-09-14 Fove, Inc. Head mounted display
US20170287446A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Real-time user adaptive foveated rendering
US20170285337A1 (en) * 2015-11-27 2017-10-05 Fove, Inc. Gaze detection system, gaze point detection method, and gaze point detection program
US20170287112A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
US20170285736A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US9788714B2 (en) 2014-07-08 2017-10-17 Iarmourholdings, Inc. Systems and methods using virtual reality or augmented reality environments for the measurement and/or improvement of human vestibulo-ocular performance
CN206584118U (en) 2017-02-27 2017-10-24 阿里巴巴集团控股有限公司 Virtual reality helmet
US20180068449A1 (en) * 2016-09-07 2018-03-08 Valve Corporation Sensor fusion systems and methods for eye-tracking applications
US20180157320A1 (en) * 2016-12-01 2018-06-07 Oculus Vr, Llc Air spaced optical assembly with integrated eye tracking
US20180203505A1 (en) * 2017-01-17 2018-07-19 Oculus Vr, Llc Varifocal head-mounted display including modular air spaced optical assembly
US20180239423A1 (en) * 2015-02-04 2018-08-23 Itu Business Development A/S A gaze tracker and a gaze tracking method
US20180330652A1 (en) * 2017-05-15 2018-11-15 Google Inc. Near-eye display with extended effective eyebox via eye tracking
US20190101757A1 (en) * 2017-10-02 2019-04-04 Google Inc. Eye tracking using light guide with faceted combiner
US20190101767A1 (en) * 2017-10-03 2019-04-04 Facebook Technologies, Llc Fresnel assembly for light redirection in eye tracking systems
US20190113968A1 (en) * 2016-04-06 2019-04-18 Beijing 7Invensun Technology Co., Ltd. Eyeball Tracking Module for Video Glasses
US20190258314A1 (en) * 2018-02-17 2019-08-22 Varjo Technologies Oy Gaze-tracking system and method of tracking user's gaze using reflective element
US10485420B2 (en) * 2017-02-17 2019-11-26 Analog Devices Global Unlimited Company Eye gaze tracking
US20190361523A1 (en) * 2018-05-23 2019-11-28 Facebook Technologies, Llc In-field illumination and imaging for eye tracking

Patent Citations (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4227113A (en) * 1978-10-18 1980-10-07 Duro-Test Corporation Incandescent electric lamp with partial light transmitting coating
US5621424A (en) * 1992-08-24 1997-04-15 Olympus Optical Co., Ltd. Head mount display apparatus allowing easy switching operation from electronic image to external field image
JPH06121254A (en) 1992-10-06 1994-04-28 Olympus Optical Co Ltd Head mount type display device
US5347400A (en) 1993-05-06 1994-09-13 Ken Hunter Optical system for virtual reality helmet
US6018630A (en) * 1994-05-17 2000-01-25 Canon Kabushiki Kaisha Camera viewfinder having a viewpoint detecting apparatus
US20010009478A1 (en) * 1994-06-13 2001-07-26 Shoichi Yamazaki Head-up display device with rotationally asymmetric curved surface
US5815741A (en) * 1994-12-21 1998-09-29 Canon Kabushiki Kaisha Image observing apparatus and imaging apparatus utilizing the image observing apparatus
US6191892B1 (en) * 1996-04-02 2001-02-20 Canon Kabushiki Kaisha Image display apparatus
US5771124A (en) * 1996-07-02 1998-06-23 Siliscape Compact display system with two stage magnification and immersed beam splitter
US5689619A (en) 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
US6043799A (en) 1998-02-20 2000-03-28 University Of Washington Virtual retinal display with scanner array for generating multiple exit pupils
JPH11249588A (en) 1998-02-27 1999-09-17 Shimadzu Corp Head-mounted display
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US20070058261A1 (en) 2004-05-17 2007-03-15 Olympus Corporation Head mount type image display system
US20100164990A1 (en) 2005-08-15 2010-07-01 Koninklijke Philips Electronics, N.V. System, apparatus, and method for augmented reality glasses for end-user programming
US7522344B1 (en) * 2005-12-14 2009-04-21 University Of Central Florida Research Foundation, Inc. Projection-based head-mounted display with eye-tracking capabilities
CN200994790Y (en) 2006-12-19 2007-12-26 潘晓刚 System for measuring mental state parameter
US20110043436A1 (en) 2006-12-28 2011-02-24 Scalar Corporation Head mount display
CN101077232A (en) 2007-06-07 2007-11-28 南京航空航天大学 Human-computer interaction helmet for type computer
US20080316606A1 (en) * 2007-06-20 2008-12-25 Canon Kabushiki Kaisha Image observation apparatus and image observation system
WO2009150747A1 (en) 2008-06-13 2009-12-17 パイオニア株式会社 Sight line input user interface unit, user interface method, user interface program, and recording medium with user interface program recorded
US20110169730A1 (en) 2008-06-13 2011-07-14 Pioneer Corporation Sight line input user interface unit, user interface method, user interface program, and recording medium with user interface program recorded
US20100321409A1 (en) 2009-06-22 2010-12-23 Sony Corporation Head mounted display, and image displaying method in head mounted display
US20120194418A1 (en) 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with user action control and event input based control of eyepiece application
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
US8482859B2 (en) 2010-02-28 2013-07-09 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US9329689B2 (en) 2010-02-28 2016-05-03 Microsoft Technology Licensing, Llc Method and apparatus for biometric data capture
CN202198569U (en) 2011-08-09 2012-04-25 中国人民解放军空军航空医学研究所 Side reverse type eye movement detector
US20130107371A1 (en) 2011-10-26 2013-05-02 Google Inc. Display Device with Image Depth Simulation
US20140340286A1 (en) 2012-01-24 2014-11-20 Sony Corporation Display device
US20140361957A1 (en) * 2012-01-24 2014-12-11 The Arizonia Board Of Regents On Behalf Of The University Of Arizonz Compact eye-tracked head-mounted display
US20160081547A1 (en) * 2013-05-15 2016-03-24 The Johns Hopkins University Eye tracking and gaze fixation detection systems, components and methods using polarized light
US9625723B2 (en) * 2013-06-25 2017-04-18 Microsoft Technology Licensing, Llc Eye-tracking system using a freeform prism
US20150009574A1 (en) * 2013-07-03 2015-01-08 Eads Deutschland Gmbh Hmd apparatus with adjustable eye tracking device
US20150009313A1 (en) * 2013-07-05 2015-01-08 Sony Corporation Visual line detection device and visual line detection method
US20160062121A1 (en) 2014-01-21 2016-03-03 Osterhout Group, Inc. See-through computer display systems
US20150242680A1 (en) * 2014-02-26 2015-08-27 Vaibhav Thukral Polarized gaze tracking
WO2015157016A1 (en) 2014-04-09 2015-10-15 3M Innovative Properties Company Head mounted display and low conspicuity pupil illuminator
US20170176749A1 (en) 2014-04-09 2017-06-22 3M Innovative Properties Company Head mounted display and low conspicuity pupil illuminator
KR20160143749A (en) 2014-04-09 2016-12-14 쓰리엠 이노베이티브 프로퍼티즈 컴파니 Head mounted display and low conspicuity pupil illuminator
TW201608281A (en) 2014-05-30 2016-03-01 新力電腦娛樂美國有限責任公司 Head mounted device (HMD) system having interface with mobile computing device for rendering virtual reality content
US20150348327A1 (en) 2014-05-30 2015-12-03 Sony Computer Entertainment America Llc Head Mounted Device (HMD) System Having Interface With Mobile Computing Device for Rendering Virtual Reality Content
WO2015198502A1 (en) 2014-06-27 2015-12-30 株式会社Fove Device for detecting line of sight
US10445573B2 (en) * 2014-06-27 2019-10-15 Fove, Inc. Gaze detection device
US20170140224A1 (en) * 2014-06-27 2017-05-18 Fove, Inc. Gaze detection device
US9788714B2 (en) 2014-07-08 2017-10-17 Iarmourholdings, Inc. Systems and methods using virtual reality or augmented reality environments for the measurement and/or improvement of human vestibulo-ocular performance
CN104407440A (en) 2014-11-19 2015-03-11 东南大学 Holographic display device with sight tracking function
CN105718046A (en) 2014-12-23 2016-06-29 联发科技股份有限公司 Mobile device based head mounted display for eye tracking
US20160180591A1 (en) 2014-12-23 2016-06-23 Mediatek Inc. Eye Tracking With Mobile Device In A Head-Mounted Display
US20160370591A1 (en) * 2014-12-27 2016-12-22 Fove, Inc. Head mounted display
US20180239423A1 (en) * 2015-02-04 2018-08-23 Itu Business Development A/S A gaze tracker and a gaze tracking method
US20170262703A1 (en) * 2015-04-01 2017-09-14 Fove, Inc. Head mounted display
US20160291326A1 (en) * 2015-04-02 2016-10-06 Avegant Corporation System, apparatus, and method for displaying an image with a wider field of view
US20160378176A1 (en) 2015-06-24 2016-12-29 Mediatek Inc. Hand And Body Tracking With Mobile Device-Based Virtual Reality Head-Mounted Display
US20170214905A1 (en) 2015-08-03 2017-07-27 Boe Technology Group Co., Ltd. Virtual reality goggles and display method thereof
CN205103761U (en) 2015-08-03 2016-03-23 众景视界(北京)科技有限公司 Head -wearing type intelligent device
US20170115689A1 (en) 2015-10-21 2017-04-27 Beijing Pico Technology Co., Ltd. Virtual reality glasses
US20170147859A1 (en) * 2015-11-25 2017-05-25 Google Inc. Prism-based eye tracking
US20170285337A1 (en) * 2015-11-27 2017-10-05 Fove, Inc. Gaze detection system, gaze point detection method, and gaze point detection program
US20170205876A1 (en) * 2016-01-20 2017-07-20 Thalmic Labs Inc. Systems, devices, and methods for proximity-based eye tracking
CN106214118A (en) 2016-01-28 2016-12-14 北京爱生科贸有限公司 A kind of ocular movement based on virtual reality monitoring system
US20170287112A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
US20170287446A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Real-time user adaptive foveated rendering
US20170285736A1 (en) * 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US20190113968A1 (en) * 2016-04-06 2019-04-18 Beijing 7Invensun Technology Co., Ltd. Eyeball Tracking Module for Video Glasses
CN205721634U (en) 2016-05-16 2016-11-23 上海青研科技有限公司 A kind of wear-type eye control virtual reality device
CN106406509A (en) 2016-05-16 2017-02-15 上海青研科技有限公司 Head-mounted eye control virtual reality device
CN205942608U (en) 2016-06-30 2017-02-08 上海青研科技有限公司 A integration mirror cup that is used for eyeball to track and iris discernment
CN105955491A (en) 2016-06-30 2016-09-21 北京上古视觉科技有限公司 VR (virtual reality) glasses with eye control and iris recognition functions
DE202016104179U1 (en) 2016-07-29 2016-08-12 Christian Hildebrandt Output device for stereoscopic image reproduction
US20180068449A1 (en) * 2016-09-07 2018-03-08 Valve Corporation Sensor fusion systems and methods for eye-tracking applications
CN106406543A (en) 2016-11-23 2017-02-15 长春中国光学科学技术馆 VR scene conversion device controlled by human eyes
US20180157320A1 (en) * 2016-12-01 2018-06-07 Oculus Vr, Llc Air spaced optical assembly with integrated eye tracking
US20180203505A1 (en) * 2017-01-17 2018-07-19 Oculus Vr, Llc Varifocal head-mounted display including modular air spaced optical assembly
US10485420B2 (en) * 2017-02-17 2019-11-26 Analog Devices Global Unlimited Company Eye gaze tracking
CN106908951A (en) 2017-02-27 2017-06-30 阿里巴巴集团控股有限公司 Virtual reality helmet
CN206584118U (en) 2017-02-27 2017-10-24 阿里巴巴集团控股有限公司 Virtual reality helmet
US10546518B2 (en) * 2017-05-15 2020-01-28 Google Llc Near-eye display with extended effective eyebox via eye tracking
US20180330652A1 (en) * 2017-05-15 2018-11-15 Google Inc. Near-eye display with extended effective eyebox via eye tracking
US20190101757A1 (en) * 2017-10-02 2019-04-04 Google Inc. Eye tracking using light guide with faceted combiner
US10627627B2 (en) * 2017-10-02 2020-04-21 Google Llc Eye tracking using light guide with faceted combiner
US20190101767A1 (en) * 2017-10-03 2019-04-04 Facebook Technologies, Llc Fresnel assembly for light redirection in eye tracking systems
US10788677B2 (en) * 2017-10-03 2020-09-29 Facebook Technologies, Llc Fresnel assembly for light redirection in eye tracking systems
US10488917B2 (en) * 2018-02-17 2019-11-26 Varjo Technologies Oy Gaze-tracking system and method of tracking user's gaze using reflective element
US20190258314A1 (en) * 2018-02-17 2019-08-22 Varjo Technologies Oy Gaze-tracking system and method of tracking user's gaze using reflective element
US20190361523A1 (en) * 2018-05-23 2019-11-28 Facebook Technologies, Llc In-field illumination and imaging for eye tracking
US10788892B2 (en) * 2018-05-23 2020-09-29 Facebook Technologies, Llc In-field illumination and imaging for eye tracking
US20200379561A1 (en) * 2018-05-23 2020-12-03 Facebook Technologies, Llc In-field illumination and imaging for eye tracking

Non-Patent Citations (11)

* Cited by examiner, † Cited by third party
Title
Examination Report for European Application No. 18758081.6, dated Jan. 20, 2020, 5 pages.
First Office Action and First Search for Chinese Application No. 201710109486.6 dated Oct. 17, 2018 (5 pages).
International Preliminary Report on Patentability Chapter I for PCT Application No. PCT/CN2018/077285 dated Sep. 6, 2019 (11 pages).
Notice of Allowance for Korean Application No. 10-2019-7022644 dated May 9, 2021.
Office Action and Search Report for Taiwanese Application No. 106139871 dated Oct. 22, 2018 (7 pages).
Office Action for Japanese Application No. 2019-546360 dated Oct. 27, 2020.
Office Action for Korean Application No. 10-2019-7022644 dated Nov. 3, 2020.
Search Report for European Application No. 18758081.6, dated Jan. 8, 2020, 4 pages.
Second Office Action for Chinese Application No. 201710109486.6 dated Jun. 28, 2019 with machine English translation (12 pages).
Written Opinion for Singapore Application No. 11201906874W, dated Apr. 7, 2020, 8 pages.
Written Opinion of the International Searching Authority and International Search Report for PCT Application No. PCT/CN2018/077285 dated May 25, 2018 with partial English translation (12 pages).

Also Published As

Publication number Publication date
CN106908951A (en) 2017-06-30
EP3557308B1 (en) 2020-08-26
PH12019501661B1 (en) 2024-04-17
JP6856863B2 (en) 2021-04-14
KR20190101445A (en) 2019-08-30
TW201831949A (en) 2018-09-01
SG11201906874WA (en) 2019-08-27
EP3557308A1 (en) 2019-10-23
MY193942A (en) 2022-11-02
PH12019501661A1 (en) 2020-03-02
PL3557308T3 (en) 2021-01-25
JP2020514887A (en) 2020-05-21
ES2824820T3 (en) 2021-05-13
TWI659229B (en) 2019-05-11
US20190339527A1 (en) 2019-11-07
WO2018153371A1 (en) 2018-08-30
EP3557308A4 (en) 2020-01-29
KR102284974B1 (en) 2021-08-03

Similar Documents

Publication Publication Date Title
US11442270B2 (en) Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge
US10996477B2 (en) Virtual reality head-mounted apparatus
US11523039B2 (en) Virtual reality head-mounted apparatus
US20160199729A1 (en) Systems and methods for displaying an image or video on a retro-reflective screen
TW201502580A (en) Near eye display
US20190349506A1 (en) Virtual reality head-mounted apparatus
CN108398788B (en) Eye tracking device and virtual reality imaging device
US20180267320A1 (en) Head-mounted display apparatus and adjusting method thereof
US20240345420A1 (en) Eyewear waveguide with reflector
US12047551B2 (en) Correction polarization compensation optic for display systems
US20150054928A1 (en) Auto-stereoscopic display apparatus and storage media
US20220350149A1 (en) Waveguide configurations in a head-mounted display (hmd) for improved field of view (fov)
CN206638889U (en) Head mounted display
US12235456B2 (en) Folded optics for a head mounted display
TW201316039A (en) Naked-eye type matrix screen having 3 dimensional (3-D) image projecting capability

Legal Events

Date Code Title Description
AS Assignment

Owner name: ALIBABA GROUP HOLDING LIMITED, CAYMAN ISLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ZHANG, HONG;REEL/FRAME:049753/0553

Effective date: 20190508

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD., CAYMAN ISLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALIBABA GROUP HOLDING LIMITED;REEL/FRAME:053702/0392

Effective date: 20200826

AS Assignment

Owner name: ADVANCED NEW TECHNOLOGIES CO., LTD., CAYMAN ISLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.;REEL/FRAME:053796/0281

Effective date: 20200910

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

OSZAR »