CN108241211A - One kind wears display equipment and image rendering method - Google Patents
One kind wears display equipment and image rendering method Download PDFInfo
- Publication number
- CN108241211A CN108241211A CN201611218181.0A CN201611218181A CN108241211A CN 108241211 A CN108241211 A CN 108241211A CN 201611218181 A CN201611218181 A CN 201611218181A CN 108241211 A CN108241211 A CN 108241211A
- Authority
- CN
- China
- Prior art keywords
- display equipment
- data texturing
- eye data
- frame image
- left eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000009877 rendering Methods 0.000 title claims abstract description 27
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 123
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 123
- 210000003128 head Anatomy 0.000 description 8
- 238000001514 detection method Methods 0.000 description 5
- 230000003190 augmentative effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000012512 characterization method Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000007257 malfunction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses one kind to wear display equipment and image rendering method, including：Graphics processor GPU for carrying out scene drawing to scene to be shown, generates left eye data texturing and right eye data texturing；Hardware synthesis module for carrying out textures synthesis according to the left eye data texturing and the right eye data texturing, generates current frame image.In said program, by the way that scene drawing and textures synthesis distribution are performed in different hardware modules, textures synthesis task is performed by dedicated hardware synthesis module, so as to solve the technical issues of screen being caused to tear not in time due to GPU texture synthesis in the prior art, ensure the real-time of textures synthesis task.
Description
Technical field
Field of display devices is worn the present invention relates to wearable more particularly to one kind wears display equipment and image rendering side
Method.
Background technology
VR(Virtual Reality；Virtual reality) display or AR (Augmented Reality；Augmented reality) it is aobvious
Show and be broadly divided into two steps：The first step is by GPU (Graphics Processing Unit；Graphics processor) carry out from
The scene rendering of line will be needed by GPU on scene drawing to be shown to right and left eyes texture；Second step is by the line after rendering
Reason submits to GPU and carries out online textures synthesis, is carried out at the same time anti-distortion processing and asynchronous time distorts Timewarp, final to close
Into being displayed on the screen.
In general, above-mentioned two step is realized by being multiplexed GPU, since scene drawing belongs to comparatively laborious task,
And textures synthesis belongs to real-time task, therefore, can distinguish the two tasks by setting different priority, to scene
The normal priority of drafting task gives textures synthesis task higher priority, so as to ensure to need left eye data texturing
When being synthesized to screen with right eye data texturing, GPU can be caused to be switched to textures synthesis task from scene drawing task in time,
So as to which left eye data texturing and right eye data texturing to be synthesized in screen cache and show.
However, multiplexing GPU normally results in GPU load too high, under some scenes higher to requirement of real-time, need
It wants GPU and display controller reads while write data in screen cache, if GPU texture synthesis is not in time, it is possible that GPU
The sequential that data and display controller is written from screen cache reading data to screen cache malfunctions, and leads to screen tear (that is, aobvious
Show that two frames or more frame is shown in same picture by device), it is seen then that a kind of new rendering mode is needed in the prior art, to ensure
The real-time of textures synthesis task.
Invention content
The object of the present invention is to provide one kind to wear display equipment and image rendering method, for solving to deposit in the prior art
Due to GPU texture synthesis screen is caused to tear not in time the technical issues of.
In order to achieve the above-mentioned object of the invention, first aspect of the embodiment of the present invention provides one kind and wears display equipment, including：
Graphics processor GPU for carrying out scene drawing to scene to be shown, generates left eye data texturing and right eye texture
Data；
Hardware synthesis module, for carrying out textures synthesis according to the left eye data texturing and the right eye data texturing,
Generate current frame image.
Optionally, the display equipment of wearing further includes display controller；
The display controller is used to generate vertical synchronization VSYNC signals；
The hardware synthesis module carries out texture conjunction for reading the VSYNC signals according to the VSYNC signals
Into.
Optionally, the display equipment of wearing further includes central processor CPU；
The CPU is used to send left eye texture number to the hardware synthesis module and right eye texture is numbered；
The hardware synthesis module is used to be numbered according to left eye texture number and the right eye texture, obtains the left side
The buffer address of eye data texturing and the right eye data texturing, and based on the buffer address, display equipment is worn from described
Texture cache in read the left eye data texturing and the right eye data texturing.
Optionally, the display equipment of wearing further includes sensor；
The sensor is used to, when wearing display equipment described in user's wearing, detect the head rotation for characterizing user
Directional information；
The hardware synthesis module is used for according to the directional information, to the left eye data texturing and the right eye texture
Data carry out correction for direction, and synthesize intermediate frame image according to the left eye data texturing after correction and right eye data texturing.
Optionally, the display equipment of wearing further includes sensor；
The sensor be used to wearing in user described in when wearing display equipment, detect to characterize user in space
The customer position information of position；
The hardware synthesis module is for the figure according to the customer position information and object in the current frame image
Image position information estimates position of the object in next frame image, generates intermediate frame image.
Optionally, the hardware synthesis module is used to determine the moving object in the current frame image and the fortune
Movement locus of the animal body in the adjacent N frames image including the current frame image, and according to the movement locus pair
Position of the moving object in next frame image is estimated, generates intermediate frame image, and N is the positive integer more than or equal to 2.
Optionally, the hardware synthesis module is additionally operable to wear the lens information of display equipment according to the left eye
Data texturing and the right eye data texturing carry out distortion correction, and according to the left eye data texturing and right eye line after distortion correction
Manage current frame image described in Data Synthesis.
Optionally, the hardware synthesis module is on-site programmable gate array FPGA, application-specific integrated circuit ASIC or another
GPU。
Second aspect of the embodiment of the present invention provides a kind of image rendering method, including：
The graphics processor GPU for wearing display equipment carries out scene drawing to scene to be shown, generates left eye data texturing
With right eye data texturing；
The hardware synthesis module for wearing display equipment is according to the left eye data texturing and the right eye data texturing
Textures synthesis is carried out, generates current frame image.
Optionally, the method further includes：
The hardware synthesis module wears the vertical synchronization VSYNC signals for showing equipment, and according to described described in reading
VSYNC signals carry out textures synthesis.
One or more technical solution in the embodiment of the present invention, at least has the following technical effect that or advantage：
In the scheme of the embodiment of the present invention, wear display equipment and include GPU and hardware synthesis module, GPU is aobvious for treating
Show that scene carries out scene drawing, generate left eye data texturing and right eye data texturing, hardware synthesis module is used for left eye texture
Data and right eye data texturing carry out textures synthesis, generate current frame image, by the way that scene drawing and textures synthesis distribution are existed
It is performed in different hardware modules, textures synthesis task is performed by dedicated hardware synthesis module, avoids scene drawing task
GPU is multiplexed with textures synthesis task, reduces the load of GPU, it is in the prior art since GPU texture synthesizes so as to solve
The technical issues of screen being caused to tear not in time, ensures the real-time of textures synthesis task.
Description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also
To obtain other attached drawings according to these attached drawings：
Fig. 1 is the high-level schematic functional block diagram provided in an embodiment of the present invention for wearing display equipment；
Fig. 2 is another high-level schematic functional block diagram provided in an embodiment of the present invention for wearing display equipment；
Fig. 3 is the flow diagram of image rendering method provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts
Embodiment shall fall within the protection scope of the present invention.
In the embodiment of the present invention, display equipment (English full name is worn：Head Mount Display；English abbreviation：HMD)
By sending optical signalling to eyes, VR, AR (Augmented Reality can be realized；Augmented reality), MR (Mix
reality；Mixed reality) etc. different-effects, such as：It can be VR all-in-one machines, penetration HMD etc. to wear display equipment.
It please refers to Fig.1, Fig. 1 is the high-level schematic functional block diagram provided in an embodiment of the present invention for wearing display equipment, this is worn
Display equipment includes：Graphics processor GPU10, for scene to be shown carry out scene drawing, generation left eye data texturing and
Right eye data texturing；Hardware synthesis module 11, for carrying out line according to the left eye data texturing and the right eye data texturing
Reason synthesis, generates current frame image.
Specifically, the newest directional information that GPU10 is detected according to the sensor for wearing display equipment, draws to be shown
Scene, generates left eye data texturing and right eye data texturing, and sensor can be one in gyroscope, accelerometer and magnetometer
Kind is a variety of, wears display equipment and obtains final directional information, direction information by merging the data of three kinds of sensors
For characterizing the rotation of user's head.Then, GPU10 exports drawing result, i.e. left eye data texturing and right eye data texturing
Into the texture cache for wearing display equipment so that hardware synthesis module 11 is when needing to carry out textures synthesis, from texture cache
Middle reading left eye data texturing and right eye are data texturing, carry out textures synthesis, generate current frame image, and by current frame image
Write-in is worn in the frame buffer memory of display equipment, then, wears the display controller of display equipment from frame buffer memory
Middle taking-up data, and be displayed on the screen.
Wherein, hardware synthesis module 11 can be FPGA (Field-Programmable Gate Array；Scene can compile
Journey gate array), ASIC (Application Specific Integrated Circuits；Application-specific integrated circuit) or it is another
GPU.Frame buffer memory, also known as frame buffer (FrameBuffer), video memory or screen cache, it is picture shown by screen
One direct image, each storage unit of frame buffer correspond to a pixel on screen, and entire frame buffer corresponds to a frame image,
Hardware synthesis module 11 just automatically takes out number by the way that data, display controller are ceaselessly written into frame buffer from frame buffer
According to and show on the screen.
In the embodiment of the present invention, GPU10 is used for scene drawing, and hardware synthesis module 11 is used for textures synthesis, by by field
Scape is drawn and textures synthesis distribution performs in different hardware modules, and textures synthesis is performed by dedicated hardware synthesis module 11
Task avoids scene drawing task and textures synthesis task multiplexing GPU10, reduces the load of GPU10, existing so as to solve
The technical issues of screen being caused to tear not in time due to GPU10 textures synthesis present in technology, ensures textures synthesis task
Real-time.
Further, during GPU draws a frame scene in the prior art, since GPU needs to also serve as textures synthesis task,
Due to the priority higher of textures synthesis, the current drafting tasks of GPU can be punctuated, such GPU, which will frequently switch, to be appointed
Business, the caching utilization rate for leading to GPU is very low, reduces the rendering efficiency of GPU, in the embodiment of the present invention, by by scene drawing
It is performed in different hardware modules with textures synthesis distribution, it is possible to reduce the caching expense of GPU10 that task switching is brought carries
The rendering efficiency of high GPU10.
In the embodiment of the present invention, as shown in Fig. 2, wearing display equipment further includes display controller 12, for generating VSYNC
(Vertical Synchronization；Vertical synchronization) signal, after entire screen completes primary refresh, display controller 12
VSYNC signals can be generated, the effect of VSYNC signals is to make the arithmetic speed of GPU10 consistent with screen refresh frequency, steady to export
Fixed image quality.GPU10 needs to carry out VSYNC signal synchronizations when performing textures synthesis task, specifically, believing in VSYNC
Number generate after, CPU control GPU10 carry out next frame image rendering, if the resource of CPU or GPU10 is occupied, it is possible to meeting
There is CPU or GPU10 scheduling not in time so that GPU10 is written data and display controller 12 to frame buffer and is read from frame buffer
The sequential error of data, and then cause display tear problem.
And in the embodiment of the present invention, hardware synthesis module 11 directly reads VSYNC signals, and is carried out according to VSYNC signals
Textures synthesis synchronizes VSYNC signals by hardware synthesis module 11 and carries out textures synthesis, can generate hardware synthesis module 11
The rate of frame is consistent with screen refresh frequency, also, GPU rendering pipelines generally comprise application program processing stage, geometry
Processing stage, the rasterization process stage, and the rendering pipeline of hardware synthesis module 11 includes the processes pixel stage, it is seen then that hardware
Synthesis module 11 uses shorter rendering pipeline, and compared to the time that GPU10 renders a frame image, hardware synthesis module 11 carries out line
The time for managing synthesis is very short, and so as to avoid due to above-mentioned CPU or GPU10 scheduling not in time, caused screen display tear is asked
Topic ensures the real-time of textures synthesis.
In the embodiment of the present invention, wear display equipment and further include central processor CPU 13, CPU13 is carried out in control GPU10
After scene drawing, newest left eye texture number (i.e. texture ID) can be sent to hardware synthesis module 11 and right eye texture is compiled
Number, then hardware synthesis module 11 is numbered according to left eye texture number and right eye texture, is obtained when needing to read data texturing
The buffer address of left eye data texturing and right eye data texturing is obtained, and based on buffer address, from the texture worn in display equipment
The left eye data texturing and right eye data texturing are read in caching, then synthesizes left eye data texturing and right eye data texturing
Current frame image, and be written in frame buffer.After the data texturing for getting next frame image, in the release of hardware synthesis module 11
The data texturing of one frame data, and start new textures synthesis.
In the embodiment of the present invention, hardware synthesis module 11 can also be according to the left eye of previous frame image (i.e. current frame image)
Data texturing and right eye data texturing generate intermediate frame image so that and it wears display equipment and may remain in relatively low frame per second operation,
That is, by being inserted into intermediate frame image, in the situation that the rendering frame per second of GPU10 is relatively low or the frame per second of VR contents is relatively low
Under, wearing the rendering quality of display equipment will not significantly decrease, next, to following several generation intermediate frame images
Mode illustrates, and in specific implementation process, is not limited to following several embodiments.
A kind of possible embodiment is to wear display equipment to further include sensor 14, sensor 14 can be gyroscope,
One or more in accelerometer and magnetometer, sensor 14 is used for when user wears and wears display equipment, and detection is used for
The directional information of the head rotation of user is characterized, then, the hardware synthesis module 11 is used for according to the directional information, to institute
It states left eye data texturing and the right eye data texturing carries out correction for direction, and according to the left eye data texturing and right eye after correction
Data texturing synthesizes intermediate frame image.
Specifically, use wear display equipment when, if user's head rotation it is too fast, and GPU10 render a frame figure
The time of picture is too long, will make the delay of scene rendering, that is to say, that the head of user has had been rotated through, but corresponding figure
What picture was rendered or rendered not yet is the image of previous frame, and picture will generate shake.To solve the above-mentioned problems,
In the embodiment of the present invention, the hardware synthesis module 11 is used for according to the directional information, to previous frame image (i.e. present frame figure
Picture) left eye data texturing and right eye data texturing carry out correction for direction, and according to the left eye data texturing and right eye after correction
Data texturing synthesizes intermediate frame image, then shows intermediate frame image, so as to effectively reduce the shake of display picture.Its
In, directional information of the directional information for the user's head rotation of the detection of sensor 14.
The time of a frame image is rendered due to comparing GPU10, the time that hardware synthesis module 11 generates intermediate frame image is non-
It is often short, and intermediate frame image is generated by hardware synthesis module 11, the resource of GPU10 will not be seized, therefore do not interfere with
The scene drawing task of GPU10, also, since hardware synthesis module 11 can directly read the VSYNC letters of display controller 12
Number, and textures synthesis is carried out according to VSYNC signals, therefore, the rendering frame per second of GPU10 is relatively low or the frame per second of VR contents compared with
In the case of low, hardware synthesis module 11 can synchronize VSYNC signals and carry out textures synthesis so that the frame of hardware synthesis module 11
Rate is consistent with screen refresh frequency, so as to reduce display float.
Alternatively possible embodiment is that sensor 14 is additionally operable to when user wears and wears display equipment, and detection is used
Customer position information in the position of characterization user in space；Then, the hardware synthesis module 11 is used for according to the use
The image location information of family location information and object in the current frame image, to position of the object in next frame image
It puts and is estimated, generate intermediate frame image.
Specifically, user, which wears, wears display equipment when moving in space, and user can be determined by wearing display equipment
Then position in space renders corresponding scene according to the position of user in space.If wear the wash with watercolours of display equipment
Dye speed does not catch up with the movement speed of user, and it is not smooth to may result in display picture.To solve the above-mentioned problems, the present invention is implemented
In example, the hardware synthesis module 11 is used for the customer position information detected according to sensor 14 and object in the present frame
Image location information in image estimates position of the object in next frame image, generates intermediate frame image, so
Intermediate frame image is shown afterwards, so as to promote the fluency of display picture.
The time of a frame image is rendered due to comparing GPU10, the time that hardware synthesis module 11 generates intermediate frame image is non-
It is often short, therefore, the position of next frame objects in images is estimated according to the location information of user by hardware synthesis module 11
Meter generates current frame image, and current frame image is shown, can to wear rendering speed and the user of display equipment
Movement speed matching, so as to promoted display picture fluency.
The third possible embodiment is that, for the object moved in display scene, the hardware synthesis module 11 is also
For determining that moving object and the moving object are in the phase including the current frame image in the current frame image
Movement locus in adjacent N frames image, and according to the movement locus to position of the moving object in next frame image into
Row estimation, generates intermediate frame image, and N is the positive integer more than or equal to 2.
Wherein, the value of N can be configured according to the operand for wearing display equipment, and the value of N is bigger, and operand is got over
Greatly, location estimation is more accurate.For example：The value of N can be 2, it is assumed that the moving object in current frame image is basketball,
In the previous frame image of current frame image and current frame image, the movement locus of basketball is moves from bottom to top, then hardware synthesizes mould
Block 11 can predict position of the basketball in next frame image according to the movement locus, so that it is determined that basketball is in next frame figure
Position as in generates intermediate frame image, and compared to current frame image, the basketball in intermediate frame image moves from bottom to top, then will
Intermediate frame image is shown so that the movement of basketball becomes more smooth in scene.
As it can be seen that in above-mentioned several embodiments, by being inserted into intermediate frame image, the rendering frame per second of GPU10 it is relatively low or
In the case that the frame per second of person's VR contents is relatively low, wearing the rendering quality of display equipment will not significantly decrease so that wear
Display equipment may remain in relatively low frame per second operation.
In the embodiment of the present invention, hardware synthesis module 11 is additionally operable to wear the lens information of display equipment according to institute
State left eye data texturing and the right eye data texturing and carry out distortion correction, and according to the left eye data texturing after distortion correction and
Right eye data texturing synthesizes the current frame image.Wherein, the lens information includes the amplification factor of lens group and distortion is joined
Number etc., hardware synthesis module 11 can be according to amplification factor and distortion parameter etc. to left eye data texturing and right eye data texturing
Distortion correction is carried out, is then synthesized in frame buffer again, to reduce image fault.
In another embodiment, before intermediate frame image is generated, hardware synthesis module 11 can also to data texturing into
Line distortion corrects, and then, intermediate frame image is synthesized according to the volume data texturing after distortion correction, wherein, intermediate frame image can be with
For according to any one of aforementioned three kinds of embodiments embodiment, the image of generation, this is not restricted.
Based on same inventive concept, the embodiment of the present invention also provides a kind of image rendering method, as shown in figure 3, including：
Step 30, the graphics processor GPU for wearing display equipment carries out scene drawing to scene to be shown, generates left eye line
Manage data and right eye data texturing；
Step 31, the hardware synthesis module for wearing display equipment is according to the left eye data texturing and the right eye line
It manages data and carries out textures synthesis, generate current frame image.
Optionally, the method further includes：
The hardware synthesis module wears the vertical synchronization VSYNC signals for showing equipment, and according to described described in reading
VSYNC signals carry out textures synthesis.
Optionally, the method further includes：
The central processor CPU for wearing display equipment sends left eye texture number and the right side to the hardware synthesis module
Eyeprint reason number；
The hardware synthesis module is numbered according to left eye texture number and the right eye texture, obtains the left eye line
The buffer address of data and the right eye data texturing is managed, and based on the buffer address, from the line for wearing display equipment
The left eye data texturing and the right eye data texturing are read in reason caching.
Optionally, the method further includes：
When display equipment is worn described in being worn in user, the head of sensor detection characterization user for wearing display equipment
The directional information of portion's rotation；
The hardware synthesis module is according to the directional information, to the left eye data texturing and the right eye data texturing
Correction for direction is carried out, and intermediate frame image is synthesized according to the left eye data texturing after correction and right eye data texturing.
Optionally, the method further includes：
When display equipment is worn described in being worn in user, the sensor detection characterization user for wearing display equipment is in sky
Between in position customer position information；
Image position of the hardware synthesis module according to the customer position information and object in the current frame image
Confidence ceases, and position of the object in next frame image is estimated, generates intermediate frame image.
Optionally, the method further includes：
The hardware synthesis module determines that moving object and the moving object are including institute in the current frame image
The movement locus in the adjacent N frames image including current frame image is stated, and is existed according to the movement locus to the moving object
Position in next frame image is estimated, generates intermediate frame image, and N is the positive integer more than or equal to 2.
Optionally, the method further includes：
The hardware synthesis module wears the lens information of display equipment to the left eye data texturing and institute according to
It states right eye data texturing and carries out distortion correction, and institute is synthesized according to the left eye data texturing after distortion correction and right eye data texturing
State current frame image.
The various change mode worn in display equipment and specific example in 1 embodiment of earlier figures are equally applicable to this reality
The image rendering method of example is applied, by the aforementioned detailed description to wearing display equipment, those skilled in the art can be clear
Know the implementation of image rendering method in the present embodiment, so in order to illustrate the succinct of book, this will not be detailed here.
Based on same inventive concept, the embodiment of the present invention also provides a kind of split equipment, including host and wears display and sets
Standby, host includes graphics processor GPU, for carrying out scene drawing to scene to be shown, generates left eye data texturing and right eye
Data texturing；It wears display equipment and includes hardware synthesis module, for according to the left eye data texturing and the right eye texture
Data carry out textures synthesis, generate current frame image.Host and wear display equipment can be by HDMI (High
Definition Multimedia Interface；High-definition multimedia interface), MHL (Mobile High-
Definition Link；High-definition audio and video standard interface) or USB3.0 (Universal Serial Bus；General serial is total
Line) wired connection or wireless connection.
One or more technical solution in the embodiment of the present invention, at least has the following technical effect that or advantage：
In the scheme of the embodiment of the present invention, wear display equipment and include GPU and hardware synthesis module, GPU is aobvious for treating
Show that scene carries out scene drawing, generate left eye data texturing and right eye data texturing, hardware synthesis module is used for left eye texture
Data and right eye data texturing carry out textures synthesis, generate current frame image, by the way that scene drawing and textures synthesis distribution are existed
It is performed in different hardware modules, textures synthesis task is performed by dedicated hardware synthesis module, avoids scene drawing task
GPU is multiplexed with textures synthesis task, reduces the load of GPU, it is in the prior art since GPU texture synthesizes so as to solve
The technical issues of screen being caused to tear not in time, ensures the real-time of textures synthesis task.
All features or disclosed all methods disclosed in this specification or in the process the step of, in addition to mutually exclusive
Feature and/or step other than, can combine in any way.
Any feature disclosed in this specification (including any accessory claim, abstract and attached drawing), except non-specifically chatting
It states, can be replaced by other alternative features that are equivalent or have similar purpose.That is, unless specifically stated, each feature is only
It is an example in a series of equivalent or similar characteristics.
The invention is not limited in aforementioned specific embodiments.The present invention, which expands to, any in the present specification to be disclosed
The step of new feature or any new combination and any new method or process disclosed or any new combination.
Claims (10)
1. one kind wears display equipment, which is characterized in that including：
Graphics processor GPU for carrying out scene drawing to scene to be shown, generates left eye data texturing and right eye texture number
According to；
Hardware synthesis module, for carrying out textures synthesis, generation according to the left eye data texturing and the right eye data texturing
Current frame image.
2. wear display equipment as described in claim 1, which is characterized in that the display equipment of wearing further includes display control
Device；
The display controller is used to generate vertical synchronization VSYNC signals；
The hardware synthesis module carries out textures synthesis for reading the VSYNC signals according to the VSYNC signals.
3. wear display equipment as claimed in claim 2, which is characterized in that the display equipment of wearing further includes central processing
Device CPU；
The CPU is used to send left eye texture number to the hardware synthesis module and right eye texture is numbered；
The hardware synthesis module is used to be numbered according to left eye texture number and the right eye texture, obtains the left eye line
The buffer address of data and the right eye data texturing is managed, and based on the buffer address, from the line for wearing display equipment
The left eye data texturing and the right eye data texturing are read in reason caching.
4. wear display equipment as described in any one of claim 1-3, which is characterized in that the display equipment of wearing also is wrapped
Include sensor；
The sensor be used for user wear described in wear display equipment when, detect for characterize user head rotation side
To information；
The hardware synthesis module is used for according to the directional information, to the left eye data texturing and the right eye data texturing
Correction for direction is carried out, and intermediate frame image is synthesized according to the left eye data texturing after correction and right eye data texturing.
5. wear display equipment as described in any one of claim 1-3, which is characterized in that the display equipment of wearing also is wrapped
Include sensor；
The sensor is used to, when wearing display equipment described in user's wearing, detect to characterize the position of user in space
Customer position information；
The hardware synthesis module is for the image position according to the customer position information and object in the current frame image
Confidence ceases, and position of the object in next frame image is estimated, generates intermediate frame image.
6. wear display equipment as described in any one of claim 1-3, which is characterized in that the hardware synthesis module is used for
Determine moving object in the current frame image and the moving object adjacent including the current frame image
Movement locus in N frame images, and position of the moving object in next frame image is carried out according to the movement locus
Estimation, generates intermediate frame image, and N is the positive integer more than or equal to 2.
7. wear display equipment as described in any one of claim 1-3, which is characterized in that the hardware synthesis module is also used
In wearing the lens information of display equipment according to the left eye data texturing and the right eye data texturing into line distortion
Correction, and the current frame image is synthesized according to the left eye data texturing after distortion correction and right eye data texturing.
8. wear display equipment as described in claim 1, which is characterized in that the hardware synthesis module is field programmable gate
Array FPGA, application-specific integrated circuit ASIC or another GPU.
9. a kind of image rendering method, which is characterized in that including：
The graphics processor GPU for wearing display equipment carries out scene drawing to scene to be shown, generates left eye data texturing and the right side
Eye data texturing；
The hardware synthesis module for wearing display equipment is carried out according to the left eye data texturing and the right eye data texturing
Textures synthesis generates current frame image.
10. method as claimed in claim 9, which is characterized in that the method further includes：
The hardware synthesis module wears the vertical synchronization VSYNC signals of display equipment described in reading, and is believed according to the VSYNC
Number carry out textures synthesis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611218181.0A CN108241211B (en) | 2016-12-26 | 2016-12-26 | Head-mounted display device and image rendering method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611218181.0A CN108241211B (en) | 2016-12-26 | 2016-12-26 | Head-mounted display device and image rendering method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108241211A true CN108241211A (en) | 2018-07-03 |
| CN108241211B CN108241211B (en) | 2020-09-15 |
Family
ID=62701378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611218181.0A Active CN108241211B (en) | 2016-12-26 | 2016-12-26 | Head-mounted display device and image rendering method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108241211B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107945138A (en) * | 2017-12-08 | 2018-04-20 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
| CN109754380A (en) * | 2019-01-02 | 2019-05-14 | 京东方科技集团股份有限公司 | A kind of image processing method and image processing apparatus, display device |
| CN111190560A (en) * | 2019-12-24 | 2020-05-22 | 青岛小鸟看看科技有限公司 | Method, device, equipment and storage medium for acquiring hardware vertical synchronization signal |
| CN114095655A (en) * | 2021-11-17 | 2022-02-25 | 海信视像科技股份有限公司 | Method and device for displaying streaming data |
| WO2022170621A1 (en) * | 2021-02-12 | 2022-08-18 | Qualcomm Incorporated | Composition strategy searching based on dynamic priority and runtime statistics |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118368455A (en) * | 2023-01-18 | 2024-07-19 | 宏达国际电子股份有限公司 | Image quality adjustment method and host computer |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049926A (en) * | 2012-12-24 | 2013-04-17 | 广东威创视讯科技股份有限公司 | Distributed three-dimensional rendering system |
| CN103439793A (en) * | 2013-07-18 | 2013-12-11 | 成都理想境界科技有限公司 | Hmd |
| WO2016073557A1 (en) * | 2014-11-04 | 2016-05-12 | The University Of North Carolina At Chapel Hill | Minimal-latency tracking and display for matching real and virtual worlds |
| WO2016118306A1 (en) * | 2015-01-20 | 2016-07-28 | Microsoft Technology Licensing, Llc | Wearable display with bonded graphite heatpipe |
| CN106154553A (en) * | 2016-08-01 | 2016-11-23 | 全球能源互联网研究院 | A kind of electric inspection process intelligent helmet Binocular displays system and its implementation |
-
2016
- 2016-12-26 CN CN201611218181.0A patent/CN108241211B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049926A (en) * | 2012-12-24 | 2013-04-17 | 广东威创视讯科技股份有限公司 | Distributed three-dimensional rendering system |
| CN103439793A (en) * | 2013-07-18 | 2013-12-11 | 成都理想境界科技有限公司 | Hmd |
| WO2016073557A1 (en) * | 2014-11-04 | 2016-05-12 | The University Of North Carolina At Chapel Hill | Minimal-latency tracking and display for matching real and virtual worlds |
| WO2016118306A1 (en) * | 2015-01-20 | 2016-07-28 | Microsoft Technology Licensing, Llc | Wearable display with bonded graphite heatpipe |
| CN106154553A (en) * | 2016-08-01 | 2016-11-23 | 全球能源互联网研究院 | A kind of electric inspection process intelligent helmet Binocular displays system and its implementation |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107945138A (en) * | 2017-12-08 | 2018-04-20 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
| WO2019109699A1 (en) * | 2017-12-08 | 2019-06-13 | 京东方科技集团股份有限公司 | Picture processing method and apparatus |
| CN107945138B (en) * | 2017-12-08 | 2020-04-03 | 京东方科技集团股份有限公司 | Picture processing method and device |
| US11615509B2 (en) | 2017-12-08 | 2023-03-28 | Beijing Boe Optoelectronics Technology Co., Ltd. | Picture processing method and device |
| CN109754380A (en) * | 2019-01-02 | 2019-05-14 | 京东方科技集团股份有限公司 | A kind of image processing method and image processing apparatus, display device |
| CN109754380B (en) * | 2019-01-02 | 2021-02-02 | 京东方科技集团股份有限公司 | Image processing method, image processing device and display device |
| US11463669B2 (en) * | 2019-01-02 | 2022-10-04 | Beijing Boe Optoelectronics Technology Co., Ltd. | Image processing method, image processing apparatus and display apparatus |
| CN111190560A (en) * | 2019-12-24 | 2020-05-22 | 青岛小鸟看看科技有限公司 | Method, device, equipment and storage medium for acquiring hardware vertical synchronization signal |
| WO2021129334A1 (en) * | 2019-12-24 | 2021-07-01 | 青岛小鸟看看科技有限公司 | Method and apparatus for acquiring hardware vertical synchronisation signal, device, and storage medium |
| CN111190560B (en) * | 2019-12-24 | 2022-09-06 | 青岛小鸟看看科技有限公司 | Method, device, equipment and storage medium for acquiring hardware vertical synchronization signal |
| WO2022170621A1 (en) * | 2021-02-12 | 2022-08-18 | Qualcomm Incorporated | Composition strategy searching based on dynamic priority and runtime statistics |
| CN114095655A (en) * | 2021-11-17 | 2022-02-25 | 海信视像科技股份有限公司 | Method and device for displaying streaming data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108241211B (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108241211A (en) | One kind wears display equipment and image rendering method | |
| CN1952979B (en) | Multi-GPU system and method | |
| US11164357B2 (en) | In-flight adaptive foveated rendering | |
| CN110050250B (en) | Display synchronized image warping | |
| US9342857B2 (en) | Techniques for locally modifying draw calls | |
| US6157395A (en) | Synchronization of frame buffer swapping in multi-pipeline computer graphics display systems | |
| JP5492232B2 (en) | Mirror graphic content to an external display | |
| US7889202B2 (en) | Transparent multi-buffering in multi-GPU graphics subsystem | |
| US11049211B2 (en) | Methods and system for asynchronously buffering rendering by a graphics processing unit | |
| US11164496B2 (en) | Interrupt-free multiple buffering methods and systems | |
| KR20130138143A (en) | System and method for display mirroring | |
| US20130128120A1 (en) | Graphics Pipeline Power Consumption Reduction | |
| TWI698834B (en) | Methods and devices for graphics processing | |
| US10186008B2 (en) | Stereoscopic view processing | |
| TWI749756B (en) | Method and apparatus for generating a series of frames with aid of synthesizer | |
| TW201901615A (en) | Method and virtual reality device for improving image quality | |
| CN112399095A (en) | Video processing method, device and system | |
| TWI498849B (en) | Method for graphics driver level decoupled rendering and display | |
| TW200821984A (en) | Work based clock management for display sub-system | |
| CN119563152A (en) | Post-occlusion based rendering for augmented reality (XR) | |
| US20120154411A1 (en) | Multiple display frame rendering method and apparatus | |
| JP2024502273A (en) | Temporal foveal rendering | |
| US9412194B2 (en) | Method for sub-pixel texture mapping and filtering | |
| US8872896B1 (en) | Hardware-based system, method, and computer program product for synchronizing stereo signals | |
| US11978372B1 (en) | Synchronized dual eye variable refresh rate update for VR display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |