US20070085917A1 - Image pickup apparatus for preventing linearity defect - Google Patents
Image pickup apparatus for preventing linearity defect Download PDFInfo
- Publication number
- US20070085917A1 US20070085917A1 US11/545,538 US54553806A US2007085917A1 US 20070085917 A1 US20070085917 A1 US 20070085917A1 US 54553806 A US54553806 A US 54553806A US 2007085917 A1 US2007085917 A1 US 2007085917A1
- Authority
- US
- United States
- Prior art keywords
- image pickup
- pickup apparatus
- black level
- image
- accordance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
- H04N25/69—SSIS comprising testing or correcting structures for circuits other than pixel cells
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/616—Noise processing, e.g. detecting, correcting, reducing or removing noise involving a correlated sampling function, e.g. correlated double sampling [CDS] or triple sampling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/67—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
Definitions
- the present invention relates to an image pickup apparatus, and more particularly to an image pickup apparatus for photographing with, e.g. a higher photo-sensitivity.
- a solid-state image pickup device When photographing at a higher photo-sensitivity level, photographing over a longer exposure time, or photographing at a higher temperature, a solid-state image pickup device may produce from its effective photosensitive area an image signal lowered in level. This level lowering may be prevented by switching digital clamping to clamping with signal processing, as is disclosed for example in Japanese patent laid-open publication No. 2003-319267.
- a real problem in clamping signals having much noise involves the following case:
- a noise quantity to be estimated cannot be disregarded for signals.
- black level correction i.e. offset correction
- noise reduction should not be adequately controlled, then the signals after reduced in noise cause linearity defects, which leads to, for example, a turned hue or distortion in hue.
- the present invention relates to an image pickup apparatus for preventing linearity defect in a noise clipping process for processing an output of an image pickup device at the time of, e.g. high-sensitive photographing.
- An image pickup apparatus for picking up an image of a field to produce an image signal in accordance with the present invention includes an image pickup device for picking up an imaging field to produce an image signal representative of the imaging field, and a signal processor for processing the image signal.
- the signal processor increases a clamp level for clamping the image signal, performs noise reduction for removing noise of random nature from the image signal before correcting the primary black level for the image signal, and then carries out the black level correction.
- an image signal output from an image pickup device is processed with a signal processor even in the case of a high-sensitivity photographing mode, photographing at a high temperature or photographing with a long-time exposure, black level correction is carried out after each of the processing, thereby making it possible to prevent noise clipping in both analogue and digital systems of the apparatus as well as to prevent a linearity defect. Also, even in a case where there are a number of fixed pattern defects, noise clip can be prevented. Further, in the case of obtaining cumulative data, noise clipping in an integrator system can be prevented.
- FIG. 1 is a schematic block diagram showing an embodiment of an image pickup apparatus to which the present invention is applied;
- FIGS. 2 and 3 plot a relation between the quantity of light incident to the solid-state image pickup device of the illustrative embodiment shown in FIG. 1 and the quantity of digital signals when set at its lower and higher ISO sensitivity levels, respectively;
- FIG. 4 is a flowchart useful for understanding the operation of the image pickup apparatus of the illustrative embodiment
- FIG. 5 is a schematic block diagram showing an alternative embodiment of a signal processor
- FIG. 6 is a flow chart useful for understanding the operation of the image pickup apparatus in the alternative embodiment shown in FIG. 5 .
- an illustrative embodiment 1 of an image pickup apparatus in accordance with the present invention includes a solid-state image pickup device 12 adapted for receiving an optical image incident thereto through an imaging lens, not shown, and a mechanical shutter 10 to perform photoelectrical conversion.
- the solid-state image pickup device 12 is a camera image sensor, which is placed on the focal plane of the imaging lens and converts an optical image formed on the focal plane to electric signal charges corresponding thereto.
- the solid-state image pickup device 12 in the embodiment reads out to a vertical transfer path the signal charges generated in a bi-dimensional array of photosensitive cells 100 arranged in the horizontal and vertical scanning directions of the imaging area, and vertically transfers them in response to vertical transfer pulses V 1 -V 4 fed from a vertical driver 110 toward a horizontal transfer path 102 .
- the horizontal transfer path 102 is driven by the horizontal transfer pulses H 1 and H 2 fed from a horizontal driver 112 and horizontally transfers the signal charges from the vertical transfer path toward an output amplifier 106 .
- the output amplifier 106 sequentially detects the signal charges in response to the reset pulses fed from the output amplifier driver 114 and outputs pixel signals corresponding to the detected signal charges to its output 101 , which constitutes an output of the solid-state image pickup device 12 . In this way, pixel signals corresponding to an optical image captured by the solid-state image pickup device 12 are generated.
- the mechanical shutter 10 exposing the solid-state image pickup device 12 with incident light is controlled for its releasing period of time, or exposure time, by a drive signal fed from a shutter driver 120 .
- the vertical driver 110 , horizontal transfer path 102 , output amplifier driver 114 and shutter driver 120 are responsive to respective timing signals fed from a timing generator (TG) 122 to produce drive signals.
- TG timing generator
- the output amplifier 106 has its output 108 connected to an analog gain circuit 130 via a correlated double sampling (CDS) circuit not shown in the figure.
- the analog gain circuit 130 is a variable-gain amplifier for variably amplifying the output of the solid-state image pickup device 12 with its gain variable, and has its input 108 also connected to receive an output of a clamp circuit 132 in a feeding back manner so that a pixel signal clamped at a predetermined level is inputted therein.
- the gain of the analog gain circuit 130 is controlled with a control output of a control circuit 134 , which is implemented by a central processor unit (CPU).
- CPU central processor unit
- the analog gain circuit 130 has its output 131 connected to an analog-to-digital converter (A/D) 136 , which converts the pixel signal to a corresponding digital signal, which will once be stored in an image memory 138 and thereafter fed to a digital signal processor (DSP) 140 . Further, the analog-to-digital converter 136 outputs a feedback signal to the clamp circuit 132 , while the clamp circuit 132 generates a feedback signal according to a value set by a setting register 142 , where a value set according to the ISO (International Organization for Standardization) sensitivity is stored, and delivers it to the input of the analog gain circuit 130 .
- A/D analog-to-digital converter
- DSP digital signal processor
- a value to be set by the setting register 142 is, for example a value 128 in the case of the photo-sensitivity being set to ISO100-ISO800 and a value 256 in the case of the sensitivity being set to ISO1600 in the illustrative embodiment as shown in the figure.
- Gain control in the analog gain circuit 130 is set according to a value stored in another setting register 144 .
- the other setting register 144 in the illustrative embodiment has stored setting information for setting ISO100, ISO200, ISO400, ISO800 and ISO1600, as shown in the figure and set them in the analog gain circuit 130 according to instructions fed from the control circuit 134 .
- the plurality of sensitivity values set are merely illustrative, and an arrangement may be made forsetting other values of sensitivity, such as ISO64, ISO3200, etc.
- the digital signal processor (DSP) 140 connected to the image memory 138 comprises a noise reducer 142 for removing noise from signals, an offset compensator 144 for compensating for an offset of signals, a white balance (WB) adjuster 146 for adjusting white balance, a gamma corrector 148 for performing gamma correction, a synchronizer 150 for performing synchronization on image signals, a contour enhancement part 152 for enhancing a contour or edge, a coloration enhancement part 154 for adjusting saturation of color, and a compressor 156 for compression-coding image data, which are interconnected via a common bus 160 to the control circuit 134 and the image memory 138 . Also, connected to the image memory 138 there is a card interface (I/F) 164 for interfacing a memory card 162 .
- I/F card interface
- the control circuit 134 is adapted for controlling the image pickup apparatus 1 according to operational information inputted into its operational panel, not shown in the figure.
- the control circuit 134 controls, for example, the start-up of the exposure value calculation and the focal adjustment control necessary for photographing, and further defines the starting of a shutter release to the constituent elements, such as the timing generator 122 , to control the period of an exposure time.
- the control circuit 134 has a function to set the ISO sensitivity according to the operational information fed by the operational panel.
- FIG. 2 plots a relation between the quantity of the light incident to the solid-state image pickup device 12 and the quantity of digital signals in the case of being set to a lower ISO sensitivity level.
- the horizontal axis represents the quantities of incident light normalized at respective ISO sensitivity levels
- the vertical axis represents signal levels and noise quantities ( ⁇ ) after corrected in black level and adjusted in white balance without reducing noise.
- FIG. 3 plots a relation between the quantity of light incident to the solid-state image pickup device 12 and the quantity of digital signals in the case of being set to a higher ISO sensitivity level.
- a (G) is larger than a (R) and a (B).
- IR Infrared Ray
- CCD color filter CCD color filter
- photodiodes embedded in the CCD etc.
- a (G) is imparted at a ratio of 1.2* iso
- a (R) is imparted at a ratio of 1.8* iso
- a (B) at a ratio of 2.0* iso
- the above-described negative effect in the second case varies.
- the above-described negative effect in the second case varies in such a way that the black levels in the G and B channels rise higher than that in the R channel in the lower brightness so as to be G, B>R, resulting in change to red (R).
- the negative effect in the second case described above may be generalized in a way that coloration of channels having much noise occurs in the vicinity of the black level and coloration of channels having less noise occurs in the vicinity of the white level.
- FIGS. 2 and 3 show examples calculated by modeling the generation of noise of random nature.
- the noise pixels lower than the mean value are clipped to zero. Consequently, even when noise reduction, such as smoothing, takes place thereafter, it appears that a color signal having much noise stands out. More specifically, characteristic degradation occurs, in which the color turns to a color with gain increased depending upon the white balance position, while the color turns to a color opponent thereto in the case of being clipped to a higher level of brightness.
- photographing is started in response to depressing a shutter release button provided in the operational panel not shown.
- the exposure of an imaging field is started and the mechanical shutter, not shown, is closed after exposure for a predetermined period of time.
- the shift gate not shown is opened to read out or develop signal charges representative of captured images to the vertical transfer path. Over each of the vertical transfer paths, the signal charges for the pixels associated therewith are transferred in four phases, while two-phase transfer takes place over the horizontal transfer path (HCCD).
- HCCD horizontal transfer path
- photographing in the illustrative embodiment includes a case of photographing to obtain, for example, darkest image data, i.e. light-shielded data, which may preferably be processed, for example in signal processing and used in signal processing and the like.
- optical black (OB) clamping takes place for every horizontal scanning line to bring the black level in a given value with an offset (for example, the median value “128” in the 12-bit system, or others).
- an offset for example, the median value “128” in the 12-bit system, or others.
- the gain in accordance with ISO sensitivity setting is adjusted to amplify a signal to then deliver it to the analog-to-digital converter, where analog-to-digital conversion is performed.
- the converted image data are written in the image memory 138 .
- the clamp level is increased from a value, for example, 128 to 256, depending upon the set ISO sensitivity, a higher temperature and an exposure for a longer period of time to thereby prevent ones of the noise pixels of a brightness lower than the mean value from being clipped.
- step 400 shown in FIG. 4 it is determined whether or not the ISO sensitivity is higher than a predetermined value, ISO1600 with the illustrative embodiment, and if the sensitivity has been set to ISO1600 or more, then the procedure proceeds to step 402 , and otherwise to step 404 .
- step 404 it is further determined whether or not the temperature is higher than a predetermined value. If the temperature is higher than the predetermined value, then the procedure proceeds to step 402 , and otherwise to step 406 .
- step 406 it is determined whether or not the shutter speed, i.e. the shutter release period of time of the mechanical shutter is of a long-time exposure, for example, for 30 second or more. When it is 30 second or more, the procedure proceeds to step 402 , and otherwise it proceeds to step 408 .
- step 408 a clamp level in the clamp circuit 132 is set to a value “128”.
- step 402 followed by steps 400 - 406 , an estimation of the noise quantity ( ⁇ ) takes place according to the results of determining conditions in steps 400 - 406 .
- step 410 it is determined whether or not a clamp quantity about three times as much as the noise quantity ( ⁇ ) estimated in step 402 is secured.
- step 412 the clamp level is set to a value “256”. After that, the procedure proceeds to step 414 .
- step 414 noise reduction is executed.
- noise reduction is taken place by the noise reducer 142 while the black level is maintained.
- Noise reduction removes noise of random nature, such as of smoothened, median type and the like. In this process, pixel clipping due to inevitable random noise, such as amplifier noise, optical shot noise, etc., is prevented.
- black level or offset compensation is executed in step 416
- gamma correction is executed in step 418
- synchronization is executed in step 420 . After those processes, white balance adjustment takes place.
- the image data thus processed are compress-coded by the compressor 156 and recorded in, for example, the memory card 162 connected to the card interface 164 .
- the configuration in which a clamp level is controlled to be increased at the time of photographing under a predetermined exposure condition, such as a super high-sensitivity mode, a high temperature, long-time exposure, etc., then noise reduction for removing random noise takes place prior to black level adjustment and thereafter the black level is adjusted. It is therefore possible to prevent noise clipping in the analog and digital systems of the image pickup apparatus. In such a case, even when the clamp level is not increased, an advantageous effect can be obtained in respect of prevention of noise clipping in the digital system.
- the image pickup apparatus in accordance with the alternative embodiment may be the same as the image pickup apparatus 1 shown in FIG. 1 except that the former includes a signal processor for compensating for a defect in an image prior to reducing noise in step 414 , FIG. 4 , while the remaining configuration may be the same as the image pickup apparatus 1 .
- the signal processor 500 in the alternative embodiment is shown in FIG. 5 .
- the signal processor 500 may be identical with the signal processor 140 except that it includes a defect compensator 510 in addition to the configuration of the signal processor 140 in the image pickup apparatus 1 shown in FIG. 1 , while the remaining structure may be similar to that of the signal processor 140 shown in FIG. 1 , description of which will thus not be repeated.
- the defect compensator 510 in the alternative embodiment is adapted to correct image data in terms of removal of high-frequency fixed pattern noise involved in the black level such as compensation of an image defect such as a spot- or scratch-like defect, compensation of a vertical line defect and correction of an inter-field step (a horizontal line defect).
- image data in terms of removal of high-frequency fixed pattern noise involved in the black level such as compensation of an image defect such as a spot- or scratch-like defect, compensation of a vertical line defect and correction of an inter-field step (a horizontal line defect).
- an offset from the primary black level may preferably be corrected.
- FIG. 6 there is shown an operational flow of the image pickup apparatus in the alternative embodiment. What is different from the operation described in FIG. 4 is that noise reduction takes place followed by step 412 and thereafter, black level correction takes place in the following step 414 .
- the processing operations similar to those shown in FIG. 4 are denoted with the same reference numerals, description of which will thus not be repetitive.
- step 600 the digital signal processor 140 first removes frequency noise accompanied with the black level, such as compensation of a defect, compensation of a vertical line defect, correction of an inter-field step (horizontal line defect), etc.
- frequency noise accompanied with the black level
- the black level such as compensation of a defect, compensation of a vertical line defect, correction of an inter-field step (horizontal line defect), etc.
- light-shielded data which are obtained with light shielded, are possibly subtracted, in which case subtraction is executed only for a differential form, i.e. on a difference from the primary or basic black level, for example, with the primary black level (e.g. “128” or “256”) maintained as well.
- noise reduction intended for removal of noise of random nature is executed in a similar manner to that in the illustrative embodiment shown in FIG. 1 , and thereafter, the primary black is corrected.
- Image defects as being generally called as “white defect”, tend to rise in gradation. Therefore, when they are smoothened rather than removed, the black falls to a further extend like in noise clipping.
- AVB automatic white balance adjustment
- AF automatic focusing
- the signal processors 140 and 500 in the image pickup apparatus shown in FIGS. 1 and 5 are provided with a white balance adjustor 146 .
- integration is performed with the black level maintained in a manner described in connection with the above illustrative embodiments, and then the primary black level is subtracted from the image data.
- the white balance corrector 146 For example, on the consumption of 0 ⁇ i and j ⁇ 8, integration with 64-division is performed by the white balance corrector 146 . If integration data with area divided used in automatic white balancing and the like are acquired after the correction of the black level before noise reduction, an optimum white balance coefficient cannot be obtained, since this results in obtaining a white balance coefficient based on the raised black level. On the other hand, to acquire integration data, integration is performed for pixels in the same area color by color. As a result, a noise reduction effect similar to that in the averaging procedure can be obtained. Accordingly, in the instant alternative embodiment, by obtaining integration data while not correcting the black level but by thereafter correcting the black level based on the obtained integration data, it is possible to obtain an optimum white balance coefficient. Also, based on the same principle, integration data during a photometric operation can be obtained, so that a rise in black level can be prevented from occurring, and therefore, exposure control, which would otherwise decrease exposure, is not needed.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
Description
- 1. Field of the Invention
- The present invention relates to an image pickup apparatus, and more particularly to an image pickup apparatus for photographing with, e.g. a higher photo-sensitivity.
- 2. Description of the Background Art
- When photographing at a higher photo-sensitivity level, photographing over a longer exposure time, or photographing at a higher temperature, a solid-state image pickup device may produce from its effective photosensitive area an image signal lowered in level. This level lowering may be prevented by switching digital clamping to clamping with signal processing, as is disclosed for example in Japanese patent laid-open publication No. 2003-319267.
- In recent years, micropixelation of solid-state image pickup devices, such as a CCD (Charge-Coupled Device) image sensor, has reduced the number of generated electric charges to lower a signal level used. Notwithstanding, cameras replete with a high-sensitivity mode capable of photographing wit less camera shake are called for in the market.
- However, in view of achieving a camera replete with a high-sensitivity mode, a significant increase in gain is required in the subsequent stage to the output port of an image pickup device, and thus, a small distortion of the black level causes a visible image to significantly deteriorate, which has been a problem. In the idea disclosed in the above-indicated publication, clamping focuses attention on its noise, but not on noise in the level lowered in the effective area, and it is therefore considered that the advantage is in practice restrictive.
- A real problem in clamping signals having much noise, such as those in a high-sensitivity mode, i.e. high ISO (International Organization for Standardization) mode, involves the following case: In a super high ISO mode, such as ISO3200 or ISO6400, a noise quantity to be estimated cannot be disregarded for signals. In such a case, if the processing sequence of the clamp level process, black level correction, i.e. offset correction, and noise reduction should not be adequately controlled, then the signals after reduced in noise cause linearity defects, which leads to, for example, a turned hue or distortion in hue. The present invention relates to an image pickup apparatus for preventing linearity defect in a noise clipping process for processing an output of an image pickup device at the time of, e.g. high-sensitive photographing.
- It is an object of the present invention to provide an image pickup apparatus for deducing a linearity defect which would be caused by noise clipping notably in a high-sensitivity photographing mode.
- An image pickup apparatus for picking up an image of a field to produce an image signal in accordance with the present invention includes an image pickup device for picking up an imaging field to produce an image signal representative of the imaging field, and a signal processor for processing the image signal. When processing the image signal produced under a predetermined exposure condition, the signal processor increases a clamp level for clamping the image signal, performs noise reduction for removing noise of random nature from the image signal before correcting the primary black level for the image signal, and then carries out the black level correction.
- According to the present invention, when an image signal output from an image pickup device is processed with a signal processor even in the case of a high-sensitivity photographing mode, photographing at a high temperature or photographing with a long-time exposure, black level correction is carried out after each of the processing, thereby making it possible to prevent noise clipping in both analogue and digital systems of the apparatus as well as to prevent a linearity defect. Also, even in a case where there are a number of fixed pattern defects, noise clip can be prevented. Further, in the case of obtaining cumulative data, noise clipping in an integrator system can be prevented.
- The objects and features of the present invention will become more apparent from consideration of the following detailed description taken in conjunction with the accompanying drawings in which:
-
FIG. 1 is a schematic block diagram showing an embodiment of an image pickup apparatus to which the present invention is applied; -
FIGS. 2 and 3 plot a relation between the quantity of light incident to the solid-state image pickup device of the illustrative embodiment shown inFIG. 1 and the quantity of digital signals when set at its lower and higher ISO sensitivity levels, respectively; -
FIG. 4 is a flowchart useful for understanding the operation of the image pickup apparatus of the illustrative embodiment; -
FIG. 5 is a schematic block diagram showing an alternative embodiment of a signal processor; and -
FIG. 6 is a flow chart useful for understanding the operation of the image pickup apparatus in the alternative embodiment shown inFIG. 5 . - In the following, preferred embodiments of an image pickup apparatus in accordance with the present invention will be described in detail with reference to the appended drawings. Referring to
FIG. 1 , anillustrative embodiment 1 of an image pickup apparatus in accordance with the present invention includes a solid-stateimage pickup device 12 adapted for receiving an optical image incident thereto through an imaging lens, not shown, and amechanical shutter 10 to perform photoelectrical conversion. - The solid-state
image pickup device 12 is a camera image sensor, which is placed on the focal plane of the imaging lens and converts an optical image formed on the focal plane to electric signal charges corresponding thereto. The solid-stateimage pickup device 12 in the embodiment reads out to a vertical transfer path the signal charges generated in a bi-dimensional array ofphotosensitive cells 100 arranged in the horizontal and vertical scanning directions of the imaging area, and vertically transfers them in response to vertical transfer pulses V1-V4 fed from avertical driver 110 toward ahorizontal transfer path 102. Thehorizontal transfer path 102 is driven by the horizontal transfer pulses H1 and H2 fed from ahorizontal driver 112 and horizontally transfers the signal charges from the vertical transfer path toward anoutput amplifier 106. - The
output amplifier 106 sequentially detects the signal charges in response to the reset pulses fed from theoutput amplifier driver 114 and outputs pixel signals corresponding to the detected signal charges to its output 101, which constitutes an output of the solid-stateimage pickup device 12. In this way, pixel signals corresponding to an optical image captured by the solid-stateimage pickup device 12 are generated. In addition, themechanical shutter 10 exposing the solid-stateimage pickup device 12 with incident light is controlled for its releasing period of time, or exposure time, by a drive signal fed from ashutter driver 120. - The
vertical driver 110,horizontal transfer path 102,output amplifier driver 114 andshutter driver 120 are responsive to respective timing signals fed from a timing generator (TG) 122 to produce drive signals. - The
output amplifier 106 has itsoutput 108 connected to ananalog gain circuit 130 via a correlated double sampling (CDS) circuit not shown in the figure. Theanalog gain circuit 130 is a variable-gain amplifier for variably amplifying the output of the solid-stateimage pickup device 12 with its gain variable, and has itsinput 108 also connected to receive an output of aclamp circuit 132 in a feeding back manner so that a pixel signal clamped at a predetermined level is inputted therein. The gain of theanalog gain circuit 130 is controlled with a control output of acontrol circuit 134, which is implemented by a central processor unit (CPU). - The
analog gain circuit 130 has itsoutput 131 connected to an analog-to-digital converter (A/D) 136, which converts the pixel signal to a corresponding digital signal, which will once be stored in animage memory 138 and thereafter fed to a digital signal processor (DSP) 140. Further, the analog-to-digital converter 136 outputs a feedback signal to theclamp circuit 132, while theclamp circuit 132 generates a feedback signal according to a value set by asetting register 142, where a value set according to the ISO (International Organization for Standardization) sensitivity is stored, and delivers it to the input of theanalog gain circuit 130. A value to be set by thesetting register 142 is, for example avalue 128 in the case of the photo-sensitivity being set to ISO100-ISO800 and avalue 256 in the case of the sensitivity being set to ISO1600 in the illustrative embodiment as shown in the figure. - Gain control in the
analog gain circuit 130 is set according to a value stored inanother setting register 144. The other setting register 144 in the illustrative embodiment has stored setting information for setting ISO100, ISO200, ISO400, ISO800 and ISO1600, as shown in the figure and set them in theanalog gain circuit 130 according to instructions fed from thecontrol circuit 134. In addition, the plurality of sensitivity values set are merely illustrative, and an arrangement may be made forsetting other values of sensitivity, such as ISO64, ISO3200, etc. - The digital signal processor (DSP) 140 connected to the
image memory 138 comprises anoise reducer 142 for removing noise from signals, anoffset compensator 144 for compensating for an offset of signals, a white balance (WB) adjuster 146 for adjusting white balance, agamma corrector 148 for performing gamma correction, asynchronizer 150 for performing synchronization on image signals, acontour enhancement part 152 for enhancing a contour or edge, acoloration enhancement part 154 for adjusting saturation of color, and acompressor 156 for compression-coding image data, which are interconnected via acommon bus 160 to thecontrol circuit 134 and theimage memory 138. Also, connected to theimage memory 138 there is a card interface (I/F) 164 for interfacing amemory card 162. - The
control circuit 134 is adapted for controlling theimage pickup apparatus 1 according to operational information inputted into its operational panel, not shown in the figure. Thecontrol circuit 134 controls, for example, the start-up of the exposure value calculation and the focal adjustment control necessary for photographing, and further defines the starting of a shutter release to the constituent elements, such as thetiming generator 122, to control the period of an exposure time. Also, thecontrol circuit 134 has a function to set the ISO sensitivity according to the operational information fed by the operational panel. - Now, reference will be made to
FIG. 2 , which plots a relation between the quantity of the light incident to the solid-stateimage pickup device 12 and the quantity of digital signals in the case of being set to a lower ISO sensitivity level. As shown in the figure, the horizontal axis represents the quantities of incident light normalized at respective ISO sensitivity levels, and the vertical axis represents signal levels and noise quantities (σ) after corrected in black level and adjusted in white balance without reducing noise. Also,FIG. 3 plots a relation between the quantity of light incident to the solid-stateimage pickup device 12 and the quantity of digital signals in the case of being set to a higher ISO sensitivity level. - In the following, description will be made on the reason why in
FIG. 3 the lower brightness side tends to be magenta while the higher brightness side tends to be green will be described. - Noise of a solid-state image pickup device can be modeled in general by the following expression (1):
Total_Noise=SQRT(a* Sig+(a* Noise)ˆ2), (1)
where, a represents gain,
a=ISO sensitivity gain * WB gain=iso * wb,
while Sig is a signal level of a digital image (after adjusted in white balance) and the Noise represents dark noise. - As described above, the total noise increases dependently on the signal level Sig and gain a=iso * wb. The graph shown in
FIG. 3 represents a state after adjusted in white balance, and thus, in each plot Sig is not dependent upon color, while A=iso * wb is dependent upon color. For this, in spite that the color channels for each relative exposure plot on the same, the error bars representative of noise at a noise level in question are different in length from color to color. - For example, the total noise in terms of brightness being Sig=1000 will be, on the assumption of Noise=10:
Total_Noise (R)=SQRT(100a(Rˆ2+1000a(R)), (2)
Total_Noise (G)=SQRT(100a(Rˆ2+1000a(G)), (3)
Total_Noise (B)=SQRT(100a(Rˆ2+1000a(B)), (4)
where R, G and B represent red, green and blue, respectively. - When the white balance is adjusted in the sunlight, usually a(G) is larger than a(R) and a(B). To be exact, it varies depending on the spectral properties of the imaging lens, IR (Infrared Ray) cut filter, CCD color filter, photodiodes embedded in the CCD, etc., while for example, a(G) is imparted at a ratio of 1.2* iso, whereas a(R) is imparted at a ratio of 1.8* iso and a(B) at a ratio of 2.0* iso, the following expressions are developed:
Total_Noise (G)<Total_Noise (R), (5)
Total_Noise (G)<Total_Noise (B). (6) - While the ISO gain iso is smaller, noise clipping due to an increase in the total noise and difference in color between the total noises are small enough to be ignorable, which is not problematic, whereas when the ISO gain iso becomes larger, then firstly, clipping takes place to zero by the pixels containing noise generated on the negative side with respect to the real Sig in the lower brightness so as to increase the primary black level, or clipping takes place to 4096 (in the case of a 12-bit system) by the pixels containing noise generated on the positive side with respect to the real Sig in the higher brightness so as to lower the primary white level.
- Secondly, since the above tendencies relatively significantly occurs in R and B channels larger in noise than a G channel, the black levels of the R and B channels rise higher than the G channel in the lower brightness so as to be R, B>G, resulting in change to magenta (Mg), or the white level of the G channel goes lower than those of the G and B channels in the higher brightness so as to be R, B<G, resulting in change to green (G).
- As for the above negative effects, signal difference is suppressed by the gamma characteristic in the vicinity of the white level, while it is enhanced by the gamma characteristic in the vicinity of the black level, and therefore, the latter negative effect is significant in general. Further, when the white balancing position has changed, the above-described negative effect in the second case varies. For example, when a (R) is small and a (G) and a (B) are larger at a lower color temperature, the above-described negative effect in the second case varies in such a way that the black levels in the G and B channels rise higher than that in the R channel in the lower brightness so as to be G, B>R, resulting in change to red (R). In other words, the negative effect in the second case described above may be generalized in a way that coloration of channels having much noise occurs in the vicinity of the black level and coloration of channels having less noise occurs in the vicinity of the white level.
-
FIGS. 2 and 3 show examples calculated by modeling the generation of noise of random nature. As shown inFIG. 3 , in the lower brightness the noise pixels lower than the mean value are clipped to zero. Consequently, even when noise reduction, such as smoothing, takes place thereafter, it appears that a color signal having much noise stands out. More specifically, characteristic degradation occurs, in which the color turns to a color with gain increased depending upon the white balance position, while the color turns to a color opponent thereto in the case of being clipped to a higher level of brightness. - The operation of an
image pickup apparatus 1 causing such a situation will be described with reference toFIG. 4 . To begin with, photographing is started in response to depressing a shutter release button provided in the operational panel not shown. The exposure of an imaging field is started and the mechanical shutter, not shown, is closed after exposure for a predetermined period of time. After sweeping out smears in order to reset the vertical transfer path (VCCD) of the solid-stateimage pickup device 12, the shift gate not shown is opened to read out or develop signal charges representative of captured images to the vertical transfer path. Over each of the vertical transfer paths, the signal charges for the pixels associated therewith are transferred in four phases, while two-phase transfer takes place over the horizontal transfer path (HCCD). Finally, the signal charges are transferred to the floating diffusion amplifier (FDA), not shown, of theoutput amplifier 106. In theoutput amplifier 106, resetting operation takes place for every pixel so as to avoid color mixture with adjacent signals. In addition, photographing in the illustrative embodiment includes a case of photographing to obtain, for example, darkest image data, i.e. light-shielded data, which may preferably be processed, for example in signal processing and used in signal processing and the like. - In the analog-to-
digital converter 136, optical black (OB) clamping takes place for every horizontal scanning line to bring the black level in a given value with an offset (for example, the median value “128” in the 12-bit system, or others). In theanalog gain circuit 130, the gain in accordance with ISO sensitivity setting is adjusted to amplify a signal to then deliver it to the analog-to-digital converter, where analog-to-digital conversion is performed. The converted image data are written in theimage memory 138. - In the illustrative embodiment, the clamp level is increased from a value, for example, 128 to 256, depending upon the set ISO sensitivity, a higher temperature and an exposure for a longer period of time to thereby prevent ones of the noise pixels of a brightness lower than the mean value from being clipped. Specifically, in
step 400 shown inFIG. 4 , it is determined whether or not the ISO sensitivity is higher than a predetermined value, ISO1600 with the illustrative embodiment, and if the sensitivity has been set to ISO1600 or more, then the procedure proceeds to step 402, and otherwise to step 404. - In
step 404, it is further determined whether or not the temperature is higher than a predetermined value. If the temperature is higher than the predetermined value, then the procedure proceeds to step 402, and otherwise to step 406. Instep 406, it is determined whether or not the shutter speed, i.e. the shutter release period of time of the mechanical shutter is of a long-time exposure, for example, for 30 second or more. When it is 30 second or more, the procedure proceeds to step 402, and otherwise it proceeds to step 408. Instep 408, a clamp level in theclamp circuit 132 is set to a value “128”. - On the other hand, in
step 402 followed by steps 400-406, an estimation of the noise quantity (σ) takes place according to the results of determining conditions in steps 400-406. Subsequently, when proceeding to step 410, it is determined whether or not a clamp quantity about three times as much as the noise quantity (σ) estimated instep 402 is secured. When it can be secured, the procedure proceeds to step 412 where the clamp level is set to a value “256”. After that, the procedure proceeds to step 414. In such a case, when noise distribution follows a normal distribution and if the clamp level of about three times as much as the estimated noise quantity is to be secured, a pixel to be clipped is of 0.3/2 percent, from which a favorable effect can be expected in addition to that from noise reduction which will be described later. When the clamp level of about three times as much as the noise quantity (σ) has not been secured instep 410, the procedure proceeds to step 408, where the clamp level is set to the value “128”. Then, the procedure proceeds to step 414. - In
step 414, noise reduction is executed. In such a case, noise reduction is taken place by thenoise reducer 142 while the black level is maintained. Noise reduction removes noise of random nature, such as of smoothened, median type and the like. In this process, pixel clipping due to inevitable random noise, such as amplifier noise, optical shot noise, etc., is prevented. After that, before white balance is adjusted, black level or offset compensation is executed instep 416, gamma correction is executed instep 418, and synchronization is executed instep 420. After those processes, white balance adjustment takes place. - The image data thus processed are compress-coded by the
compressor 156 and recorded in, for example, thememory card 162 connected to thecard interface 164. - As described above, the configuration, in which a clamp level is controlled to be increased at the time of photographing under a predetermined exposure condition, such as a super high-sensitivity mode, a high temperature, long-time exposure, etc., then noise reduction for removing random noise takes place prior to black level adjustment and thereafter the black level is adjusted. It is therefore possible to prevent noise clipping in the analog and digital systems of the image pickup apparatus. In such a case, even when the clamp level is not increased, an advantageous effect can be obtained in respect of prevention of noise clipping in the digital system.
- In the following, an alternative embodiment of the image pickup apparatus will be described with reference to
FIG. 5 . The image pickup apparatus in accordance with the alternative embodiment may be the same as theimage pickup apparatus 1 shown inFIG. 1 except that the former includes a signal processor for compensating for a defect in an image prior to reducing noise instep 414,FIG. 4 , while the remaining configuration may be the same as theimage pickup apparatus 1. Thesignal processor 500 in the alternative embodiment is shown inFIG. 5 . Thesignal processor 500 may be identical with thesignal processor 140 except that it includes adefect compensator 510 in addition to the configuration of thesignal processor 140 in theimage pickup apparatus 1 shown inFIG. 1 , while the remaining structure may be similar to that of thesignal processor 140 shown inFIG. 1 , description of which will thus not be repeated. - The
defect compensator 510 in the alternative embodiment is adapted to correct image data in terms of removal of high-frequency fixed pattern noise involved in the black level such as compensation of an image defect such as a spot- or scratch-like defect, compensation of a vertical line defect and correction of an inter-field step (a horizontal line defect). In the alternative embodiment, for removal of high-frequency fixed pattern noise, only an offset from the primary black level may preferably be corrected. - Subsequently, in
FIG. 6 there is shown an operational flow of the image pickup apparatus in the alternative embodiment. What is different from the operation described inFIG. 4 is that noise reduction takes place followed bystep 412 and thereafter, black level correction takes place in the followingstep 414. The processing operations similar to those shown inFIG. 4 are denoted with the same reference numerals, description of which will thus not be repetitive. - In
step 600, thedigital signal processor 140 first removes frequency noise accompanied with the black level, such as compensation of a defect, compensation of a vertical line defect, correction of an inter-field step (horizontal line defect), etc. As a control often performed with a long-time exposure, light-shielded data, which are obtained with light shielded, are possibly subtracted, in which case subtraction is executed only for a differential form, i.e. on a difference from the primary or basic black level, for example, with the primary black level (e.g. “128” or “256”) maintained as well. - More specifically, assuming that the light-shielded data is represented by Dark (x, y), the primary black level is equal to “128” and the exposure data are represented by Data (x, y), then Data (x, y) after defect compensation is obtained by the following expression (7):
Data (x, y) after defect compensation=Data (x, y)−(Dark (x, y)−128). (7) - After having removed in particular high-frequency noise from the fixed pattern noise encountered in such a dark noise circumstance, noise reduction intended for removal of noise of random nature is executed in a similar manner to that in the illustrative embodiment shown in
FIG. 1 , and thereafter, the primary black is corrected. Image defects, as being generally called as “white defect”, tend to rise in gradation. Therefore, when they are smoothened rather than removed, the black falls to a further extend like in noise clipping. On the other hand, it is not problematic to remove low-frequency noise, such as one in shading in dark, after the primary black level correction. - Well, another alternative embodiment of the image pickup apparatus to which the present invention is applied will be described. Usually, a digital camera is provided with an automatic white balance adjustment (AWB) function as an automatic signal processing system, which acquires divided and cumulative data from a captured image, from which a light source of the image field captured is estimated to find out an optimum white balance gain. Such an automatic signal processing system for obtaining divided and cumulative data is also required, for example, in automatic focusing (AF) adjustment.
- Thus, the
signal processors FIGS. 1 and 5 , respectively, are provided with awhite balance adjustor 146. In the instant alternative embodiment, in order to obtain divided and cumulative data, integration is performed with the black level maintained in a manner described in connection with the above illustrative embodiments, and then the primary black level is subtracted from the image data. - Specifically,
R[i, j]=Σdata— R(x, y)−128, (8)
G[i, j]=Σdata— G(x, y)−128, (9)
B[i, j]=Σdata— B(x, y)−128, (10)
R/G[i, j]=R[i, j]/G[i, j], (11)
B/G[i, j]=B[i, j]/G[i, j]. (12) - For example, on the consumption of 0<i and j<8, integration with 64-division is performed by the
white balance corrector 146. If integration data with area divided used in automatic white balancing and the like are acquired after the correction of the black level before noise reduction, an optimum white balance coefficient cannot be obtained, since this results in obtaining a white balance coefficient based on the raised black level. On the other hand, to acquire integration data, integration is performed for pixels in the same area color by color. As a result, a noise reduction effect similar to that in the averaging procedure can be obtained. Accordingly, in the instant alternative embodiment, by obtaining integration data while not correcting the black level but by thereafter correcting the black level based on the obtained integration data, it is possible to obtain an optimum white balance coefficient. Also, based on the same principle, integration data during a photometric operation can be obtained, so that a rise in black level can be prevented from occurring, and therefore, exposure control, which would otherwise decrease exposure, is not needed. - The entire disclosure of Japanese patent application No. 2005-299892 filed on Oct. 14, 2005, including the specification, claims, accompanying drawings and abstract of the disclosure is incorporated herein by reference in its entirety.
- While the present invention has been described with reference to the particular illustrative embodiments, it is not to be restricted by the embodiments. It is to be appreciated that those skilled in the art can change or modify the embodiments without departing from the scope and spirit of the present invention.
Claims (19)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005299892A JP4773179B2 (en) | 2005-10-14 | 2005-10-14 | Imaging device |
JP2005-299892 | 2005-10-14 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070085917A1 true US20070085917A1 (en) | 2007-04-19 |
US7692699B2 US7692699B2 (en) | 2010-04-06 |
Family
ID=37947792
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/545,538 Active 2028-07-12 US7692699B2 (en) | 2005-10-14 | 2006-10-11 | Image pickup apparatus for preventing linearity defect |
Country Status (2)
Country | Link |
---|---|
US (1) | US7692699B2 (en) |
JP (1) | JP4773179B2 (en) |
Cited By (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100231764A1 (en) * | 2008-09-11 | 2010-09-16 | David Vakrat | Method and apparatus for post noise reduction black level correction |
US20110019035A1 (en) * | 2009-07-21 | 2011-01-27 | Yoshihiro Satodate | Image pick-up apparatus and image processing method |
US20110069189A1 (en) * | 2008-05-20 | 2011-03-24 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US20110080487A1 (en) * | 2008-05-20 | 2011-04-07 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US20130188075A1 (en) * | 2011-07-26 | 2013-07-25 | Kabushiki Kaisha Toshiba | Black level adjustment control device and solid-state imaging device |
WO2014078443A1 (en) * | 2012-11-13 | 2014-05-22 | Pelican Imaging Corporation | Systems and methods for array camera focal plane control |
US8878950B2 (en) | 2010-12-14 | 2014-11-04 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using super-resolution processes |
US8928793B2 (en) | 2010-05-12 | 2015-01-06 | Pelican Imaging Corporation | Imager array interfaces |
US9025895B2 (en) | 2011-09-28 | 2015-05-05 | Pelican Imaging Corporation | Systems and methods for decoding refocusable light field image files |
US9100586B2 (en) | 2013-03-14 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for photometric normalization in array cameras |
US9100635B2 (en) | 2012-06-28 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for detecting defective camera arrays and optic arrays |
US9106784B2 (en) | 2013-03-13 | 2015-08-11 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing |
US9124864B2 (en) | 2013-03-10 | 2015-09-01 | Pelican Imaging Corporation | System and methods for calibration of an array camera |
US9123117B2 (en) | 2012-08-21 | 2015-09-01 | Pelican Imaging Corporation | Systems and methods for generating depth maps and corresponding confidence maps indicating depth estimation reliability |
US9128228B2 (en) | 2011-06-28 | 2015-09-08 | Pelican Imaging Corporation | Optical arrangements for use with an array camera |
US9185276B2 (en) | 2013-11-07 | 2015-11-10 | Pelican Imaging Corporation | Methods of manufacturing array camera modules incorporating independently aligned lens stacks |
US9197821B2 (en) | 2011-05-11 | 2015-11-24 | Pelican Imaging Corporation | Systems and methods for transmitting and receiving array camera image data |
US9210392B2 (en) | 2012-05-01 | 2015-12-08 | Pelican Imaging Coporation | Camera modules patterned with pi filter groups |
US9214013B2 (en) | 2012-09-14 | 2015-12-15 | Pelican Imaging Corporation | Systems and methods for correcting user identified artifacts in light field images |
US9247117B2 (en) | 2014-04-07 | 2016-01-26 | Pelican Imaging Corporation | Systems and methods for correcting for warpage of a sensor array in an array camera module by introducing warpage into a focal plane of a lens stack array |
US9253380B2 (en) | 2013-02-24 | 2016-02-02 | Pelican Imaging Corporation | Thin form factor computational array cameras and modular array cameras |
US9264610B2 (en) | 2009-11-20 | 2016-02-16 | Pelican Imaging Corporation | Capturing and processing of images including occlusions captured by heterogeneous camera arrays |
US9412206B2 (en) | 2012-02-21 | 2016-08-09 | Pelican Imaging Corporation | Systems and methods for the manipulation of captured light field image data |
US9426361B2 (en) | 2013-11-26 | 2016-08-23 | Pelican Imaging Corporation | Array camera configurations incorporating multiple constituent array cameras |
US9438888B2 (en) | 2013-03-15 | 2016-09-06 | Pelican Imaging Corporation | Systems and methods for stereo imaging with camera arrays |
US9445003B1 (en) | 2013-03-15 | 2016-09-13 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US9462164B2 (en) | 2013-02-21 | 2016-10-04 | Pelican Imaging Corporation | Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information |
US9497429B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Extended color processing on pelican array cameras |
US9497370B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Array camera architecture implementing quantum dot color filters |
US9516222B2 (en) | 2011-06-28 | 2016-12-06 | Kip Peli P1 Lp | Array cameras incorporating monolithic array camera modules with high MTF lens stacks for capture of images used in super-resolution processing |
US9521319B2 (en) | 2014-06-18 | 2016-12-13 | Pelican Imaging Corporation | Array cameras and array camera modules including spectral filters disposed outside of a constituent image sensor |
US9521416B1 (en) | 2013-03-11 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for image data compression |
US9519972B2 (en) | 2013-03-13 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
US9578259B2 (en) | 2013-03-14 | 2017-02-21 | Fotonation Cayman Limited | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US9633442B2 (en) | 2013-03-15 | 2017-04-25 | Fotonation Cayman Limited | Array cameras including an array camera module augmented with a separate camera |
US9741118B2 (en) | 2013-03-13 | 2017-08-22 | Fotonation Cayman Limited | System and methods for calibration of an array camera |
US9766380B2 (en) | 2012-06-30 | 2017-09-19 | Fotonation Cayman Limited | Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors |
US9774789B2 (en) | 2013-03-08 | 2017-09-26 | Fotonation Cayman Limited | Systems and methods for high dynamic range imaging using array cameras |
US9794476B2 (en) | 2011-09-19 | 2017-10-17 | Fotonation Cayman Limited | Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures |
US9813616B2 (en) | 2012-08-23 | 2017-11-07 | Fotonation Cayman Limited | Feature based high resolution motion estimation from low resolution images captured using an array source |
US9888194B2 (en) | 2013-03-13 | 2018-02-06 | Fotonation Cayman Limited | Array camera architecture implementing quantum film image sensors |
US9898856B2 (en) | 2013-09-27 | 2018-02-20 | Fotonation Cayman Limited | Systems and methods for depth-assisted perspective distortion correction |
US9942474B2 (en) | 2015-04-17 | 2018-04-10 | Fotonation Cayman Limited | Systems and methods for performing high speed video capture and depth estimation using array cameras |
US10089740B2 (en) | 2014-03-07 | 2018-10-02 | Fotonation Limited | System and methods for depth regularization and semiautomatic interactive matting using RGB-D images |
US10119808B2 (en) | 2013-11-18 | 2018-11-06 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
US10122993B2 (en) | 2013-03-15 | 2018-11-06 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
US10250871B2 (en) | 2014-09-29 | 2019-04-02 | Fotonation Limited | Systems and methods for dynamic calibration of array cameras |
US10390005B2 (en) | 2012-09-28 | 2019-08-20 | Fotonation Limited | Generating images from light fields utilizing virtual viewpoints |
US10482618B2 (en) | 2017-08-21 | 2019-11-19 | Fotonation Limited | Systems and methods for hybrid depth regularization |
US11270110B2 (en) | 2019-09-17 | 2022-03-08 | Boston Polarimetrics, Inc. | Systems and methods for surface modeling using polarization cues |
US11290658B1 (en) | 2021-04-15 | 2022-03-29 | Boston Polarimetrics, Inc. | Systems and methods for camera exposure control |
US11302012B2 (en) | 2019-11-30 | 2022-04-12 | Boston Polarimetrics, Inc. | Systems and methods for transparent object segmentation using polarization cues |
US11525906B2 (en) | 2019-10-07 | 2022-12-13 | Intrinsic Innovation Llc | Systems and methods for augmentation of sensor systems and imaging systems with polarization |
US11580667B2 (en) | 2020-01-29 | 2023-02-14 | Intrinsic Innovation Llc | Systems and methods for characterizing object pose detection and measurement systems |
US11689813B2 (en) | 2021-07-01 | 2023-06-27 | Intrinsic Innovation Llc | Systems and methods for high dynamic range imaging using crossed polarizers |
US11792538B2 (en) | 2008-05-20 | 2023-10-17 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US11797863B2 (en) | 2020-01-30 | 2023-10-24 | Intrinsic Innovation Llc | Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images |
US11953700B2 (en) | 2020-05-27 | 2024-04-09 | Intrinsic Innovation Llc | Multi-aperture polarization optical systems using beam splitters |
US11954886B2 (en) | 2021-04-15 | 2024-04-09 | Intrinsic Innovation Llc | Systems and methods for six-degree of freedom pose estimation of deformable objects |
US12020455B2 (en) | 2021-03-10 | 2024-06-25 | Intrinsic Innovation Llc | Systems and methods for high dynamic range image reconstruction |
US12067746B2 (en) | 2021-05-07 | 2024-08-20 | Intrinsic Innovation Llc | Systems and methods for using computer vision to pick up small objects |
US12069227B2 (en) | 2021-03-10 | 2024-08-20 | Intrinsic Innovation Llc | Multi-modal and multi-spectral stereo camera arrays |
US12172310B2 (en) | 2021-06-29 | 2024-12-24 | Intrinsic Innovation Llc | Systems and methods for picking objects using 3-D geometry and segmentation |
US12175741B2 (en) | 2021-06-22 | 2024-12-24 | Intrinsic Innovation Llc | Systems and methods for a vision guided end effector |
US12293535B2 (en) | 2021-08-03 | 2025-05-06 | Intrinsic Innovation Llc | Systems and methods for training pose estimators in computer vision |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7804532B2 (en) * | 2005-04-27 | 2010-09-28 | Nikon Corporation | Noise reducing device, electronic camera, and image processing program for reducing image noise by using blackout image |
KR101379256B1 (en) * | 2007-07-09 | 2014-04-02 | 삼성전자주식회사 | Method and apparatus for compensating signal distortion by noise |
JP5049922B2 (en) * | 2008-08-26 | 2012-10-17 | キヤノン株式会社 | Image processing apparatus and image processing method |
JP5088408B2 (en) * | 2010-09-22 | 2012-12-05 | 株式会社ニコン | Image processing apparatus, image processing program, and electronic camera |
JP5153846B2 (en) * | 2010-09-28 | 2013-02-27 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, image processing method, and program |
JP5927565B2 (en) * | 2010-10-27 | 2016-06-01 | パナソニックIpマネジメント株式会社 | Imaging device |
BR112013030805A2 (en) | 2011-06-30 | 2016-12-06 | Fujifilm Corp | imaging device, imaging device control method, imaging device control program |
JP7134786B2 (en) * | 2018-08-27 | 2022-09-12 | キヤノン株式会社 | Imaging device and control method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4412246A (en) * | 1981-07-13 | 1983-10-25 | Hamamatsu Systems, Inc. | Method of adjusting a video microscope system incorporating polarization or interference optics for optimum imaging conditions |
US5512947A (en) * | 1993-03-31 | 1996-04-30 | Fuji Photo Film Co., Ltd. | Video camera |
US5841488A (en) * | 1995-12-28 | 1998-11-24 | Thomson Consumer Electronics, Inc. | Multiple video input clamping arrangement |
US6304292B1 (en) * | 1996-01-12 | 2001-10-16 | Sanyo Electric Co., Ltd. | Digital video camera with high-speed mode |
US20040252204A1 (en) * | 2003-01-31 | 2004-12-16 | Haruhisa Kurane | Digital clamping circuit and digital clamping method |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4196581B2 (en) * | 2002-04-19 | 2008-12-17 | 株式会社ニコン | Digital camera |
JP2005101985A (en) * | 2003-09-25 | 2005-04-14 | Sony Corp | Solid-state image pickup device and image input device |
-
2005
- 2005-10-14 JP JP2005299892A patent/JP4773179B2/en not_active Expired - Fee Related
-
2006
- 2006-10-11 US US11/545,538 patent/US7692699B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4412246A (en) * | 1981-07-13 | 1983-10-25 | Hamamatsu Systems, Inc. | Method of adjusting a video microscope system incorporating polarization or interference optics for optimum imaging conditions |
US5512947A (en) * | 1993-03-31 | 1996-04-30 | Fuji Photo Film Co., Ltd. | Video camera |
US5841488A (en) * | 1995-12-28 | 1998-11-24 | Thomson Consumer Electronics, Inc. | Multiple video input clamping arrangement |
US6304292B1 (en) * | 1996-01-12 | 2001-10-16 | Sanyo Electric Co., Ltd. | Digital video camera with high-speed mode |
US20040252204A1 (en) * | 2003-01-31 | 2004-12-16 | Haruhisa Kurane | Digital clamping circuit and digital clamping method |
Cited By (196)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9041829B2 (en) | 2008-05-20 | 2015-05-26 | Pelican Imaging Corporation | Capturing and processing of high dynamic range images using camera arrays |
US9049390B2 (en) | 2008-05-20 | 2015-06-02 | Pelican Imaging Corporation | Capturing and processing of images captured by arrays including polychromatic cameras |
US20110069189A1 (en) * | 2008-05-20 | 2011-03-24 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US20110080487A1 (en) * | 2008-05-20 | 2011-04-07 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US9124815B2 (en) | 2008-05-20 | 2015-09-01 | Pelican Imaging Corporation | Capturing and processing of images including occlusions captured by arrays of luma and chroma cameras |
US10027901B2 (en) | 2008-05-20 | 2018-07-17 | Fotonation Cayman Limited | Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras |
US9712759B2 (en) | 2008-05-20 | 2017-07-18 | Fotonation Cayman Limited | Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras |
US9576369B2 (en) | 2008-05-20 | 2017-02-21 | Fotonation Cayman Limited | Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view |
US8866920B2 (en) | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US10142560B2 (en) | 2008-05-20 | 2018-11-27 | Fotonation Limited | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US9485496B2 (en) | 2008-05-20 | 2016-11-01 | Pelican Imaging Corporation | Systems and methods for measuring depth using images captured by a camera array including cameras surrounding a central camera |
US8885059B1 (en) | 2008-05-20 | 2014-11-11 | Pelican Imaging Corporation | Systems and methods for measuring depth using images captured by camera arrays |
US8896719B1 (en) | 2008-05-20 | 2014-11-25 | Pelican Imaging Corporation | Systems and methods for parallax measurement using camera arrays incorporating 3 x 3 camera configurations |
US8902321B2 (en) | 2008-05-20 | 2014-12-02 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US9094661B2 (en) | 2008-05-20 | 2015-07-28 | Pelican Imaging Corporation | Systems and methods for generating depth maps using a set of images containing a baseline image |
US9749547B2 (en) | 2008-05-20 | 2017-08-29 | Fotonation Cayman Limited | Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view |
US11412158B2 (en) | 2008-05-20 | 2022-08-09 | Fotonation Limited | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US11792538B2 (en) | 2008-05-20 | 2023-10-17 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US9077893B2 (en) | 2008-05-20 | 2015-07-07 | Pelican Imaging Corporation | Capturing and processing of images captured by non-grid camera arrays |
US9060124B2 (en) | 2008-05-20 | 2015-06-16 | Pelican Imaging Corporation | Capturing and processing of images using non-monolithic camera arrays |
US12041360B2 (en) | 2008-05-20 | 2024-07-16 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US9060121B2 (en) | 2008-05-20 | 2015-06-16 | Pelican Imaging Corporation | Capturing and processing of images captured by camera arrays including cameras dedicated to sampling luma and cameras dedicated to sampling chroma |
US9235898B2 (en) | 2008-05-20 | 2016-01-12 | Pelican Imaging Corporation | Systems and methods for generating depth maps using light focused on an image sensor by a lens element array |
US9041823B2 (en) | 2008-05-20 | 2015-05-26 | Pelican Imaging Corporation | Systems and methods for performing post capture refocus using images captured by camera arrays |
US9191580B2 (en) | 2008-05-20 | 2015-11-17 | Pelican Imaging Corporation | Capturing and processing of images including occlusions captured by camera arrays |
US9188765B2 (en) | 2008-05-20 | 2015-11-17 | Pelican Imaging Corporation | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US9049411B2 (en) | 2008-05-20 | 2015-06-02 | Pelican Imaging Corporation | Camera arrays incorporating 3×3 imager configurations |
US9049367B2 (en) | 2008-05-20 | 2015-06-02 | Pelican Imaging Corporation | Systems and methods for synthesizing higher resolution images using images captured by camera arrays |
US9049391B2 (en) | 2008-05-20 | 2015-06-02 | Pelican Imaging Corporation | Capturing and processing of near-IR images including occlusions using camera arrays incorporating near-IR light sources |
US9049381B2 (en) | 2008-05-20 | 2015-06-02 | Pelican Imaging Corporation | Systems and methods for normalizing image data captured by camera arrays |
US12022207B2 (en) | 2008-05-20 | 2024-06-25 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
US9060120B2 (en) | 2008-05-20 | 2015-06-16 | Pelican Imaging Corporation | Systems and methods for generating depth maps using images captured by camera arrays |
US9055213B2 (en) | 2008-05-20 | 2015-06-09 | Pelican Imaging Corporation | Systems and methods for measuring depth using images captured by monolithic camera arrays including at least one bayer camera |
US9055233B2 (en) | 2008-05-20 | 2015-06-09 | Pelican Imaging Corporation | Systems and methods for synthesizing higher resolution images using a set of images containing a baseline image |
US9060142B2 (en) | 2008-05-20 | 2015-06-16 | Pelican Imaging Corporation | Capturing and processing of images captured by camera arrays including heterogeneous optics |
US20100231764A1 (en) * | 2008-09-11 | 2010-09-16 | David Vakrat | Method and apparatus for post noise reduction black level correction |
US8102444B2 (en) * | 2008-09-11 | 2012-01-24 | Zoran Corporation | Method and apparatus for post noise reduction black level correction |
US20110019035A1 (en) * | 2009-07-21 | 2011-01-27 | Yoshihiro Satodate | Image pick-up apparatus and image processing method |
US8379116B2 (en) | 2009-07-21 | 2013-02-19 | Fujifilm Corporation | Image pick-up apparatus and image processing method |
US10306120B2 (en) | 2009-11-20 | 2019-05-28 | Fotonation Limited | Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps |
US9264610B2 (en) | 2009-11-20 | 2016-02-16 | Pelican Imaging Corporation | Capturing and processing of images including occlusions captured by heterogeneous camera arrays |
US8928793B2 (en) | 2010-05-12 | 2015-01-06 | Pelican Imaging Corporation | Imager array interfaces |
US10455168B2 (en) | 2010-05-12 | 2019-10-22 | Fotonation Limited | Imager array interfaces |
US9936148B2 (en) | 2010-05-12 | 2018-04-03 | Fotonation Cayman Limited | Imager array interfaces |
US11875475B2 (en) | 2010-12-14 | 2024-01-16 | Adeia Imaging Llc | Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers |
US9047684B2 (en) | 2010-12-14 | 2015-06-02 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using a set of geometrically registered images |
US10366472B2 (en) | 2010-12-14 | 2019-07-30 | Fotonation Limited | Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers |
US8878950B2 (en) | 2010-12-14 | 2014-11-04 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using super-resolution processes |
US11423513B2 (en) | 2010-12-14 | 2022-08-23 | Fotonation Limited | Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers |
US12243190B2 (en) | 2010-12-14 | 2025-03-04 | Adeia Imaging Llc | Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers |
US9361662B2 (en) | 2010-12-14 | 2016-06-07 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers |
US9041824B2 (en) | 2010-12-14 | 2015-05-26 | Pelican Imaging Corporation | Systems and methods for dynamic refocusing of high resolution images generated using images captured by a plurality of imagers |
US9197821B2 (en) | 2011-05-11 | 2015-11-24 | Pelican Imaging Corporation | Systems and methods for transmitting and receiving array camera image data |
US10218889B2 (en) | 2011-05-11 | 2019-02-26 | Fotonation Limited | Systems and methods for transmitting and receiving array camera image data |
US9866739B2 (en) | 2011-05-11 | 2018-01-09 | Fotonation Cayman Limited | Systems and methods for transmitting and receiving array camera image data |
US10742861B2 (en) | 2011-05-11 | 2020-08-11 | Fotonation Limited | Systems and methods for transmitting and receiving array camera image data |
US9578237B2 (en) | 2011-06-28 | 2017-02-21 | Fotonation Cayman Limited | Array cameras incorporating optics with modulation transfer functions greater than sensor Nyquist frequency for capture of images used in super-resolution processing |
US9516222B2 (en) | 2011-06-28 | 2016-12-06 | Kip Peli P1 Lp | Array cameras incorporating monolithic array camera modules with high MTF lens stacks for capture of images used in super-resolution processing |
US9128228B2 (en) | 2011-06-28 | 2015-09-08 | Pelican Imaging Corporation | Optical arrangements for use with an array camera |
US20130188075A1 (en) * | 2011-07-26 | 2013-07-25 | Kabushiki Kaisha Toshiba | Black level adjustment control device and solid-state imaging device |
US8866939B2 (en) * | 2011-07-26 | 2014-10-21 | Kabushiki Kaisha Toshiba | Black level adjustment control device and solid-state imaging device |
US9794476B2 (en) | 2011-09-19 | 2017-10-17 | Fotonation Cayman Limited | Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures |
US10375302B2 (en) | 2011-09-19 | 2019-08-06 | Fotonation Limited | Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures |
US10019816B2 (en) | 2011-09-28 | 2018-07-10 | Fotonation Cayman Limited | Systems and methods for decoding image files containing depth maps stored as metadata |
US9025895B2 (en) | 2011-09-28 | 2015-05-05 | Pelican Imaging Corporation | Systems and methods for decoding refocusable light field image files |
US9864921B2 (en) | 2011-09-28 | 2018-01-09 | Fotonation Cayman Limited | Systems and methods for encoding image files containing depth maps stored as metadata |
US20180197035A1 (en) | 2011-09-28 | 2018-07-12 | Fotonation Cayman Limited | Systems and Methods for Encoding Image Files Containing Depth Maps Stored as Metadata |
US9042667B2 (en) | 2011-09-28 | 2015-05-26 | Pelican Imaging Corporation | Systems and methods for decoding light field image files using a depth map |
US9031342B2 (en) | 2011-09-28 | 2015-05-12 | Pelican Imaging Corporation | Systems and methods for encoding refocusable light field image files |
US11729365B2 (en) | 2011-09-28 | 2023-08-15 | Adela Imaging LLC | Systems and methods for encoding image files containing depth maps stored as metadata |
US9036931B2 (en) | 2011-09-28 | 2015-05-19 | Pelican Imaging Corporation | Systems and methods for decoding structured light field image files |
US9031335B2 (en) | 2011-09-28 | 2015-05-12 | Pelican Imaging Corporation | Systems and methods for encoding light field image files having depth and confidence maps |
US9025894B2 (en) | 2011-09-28 | 2015-05-05 | Pelican Imaging Corporation | Systems and methods for decoding light field image files having depth and confidence maps |
US9031343B2 (en) | 2011-09-28 | 2015-05-12 | Pelican Imaging Corporation | Systems and methods for encoding light field image files having a depth map |
US9129183B2 (en) | 2011-09-28 | 2015-09-08 | Pelican Imaging Corporation | Systems and methods for encoding light field image files |
US10984276B2 (en) | 2011-09-28 | 2021-04-20 | Fotonation Limited | Systems and methods for encoding image files containing depth maps stored as metadata |
US9036928B2 (en) | 2011-09-28 | 2015-05-19 | Pelican Imaging Corporation | Systems and methods for encoding structured light field image files |
US10275676B2 (en) | 2011-09-28 | 2019-04-30 | Fotonation Limited | Systems and methods for encoding image files containing depth maps stored as metadata |
US12052409B2 (en) | 2011-09-28 | 2024-07-30 | Adela Imaging LLC | Systems and methods for encoding image files containing depth maps stored as metadata |
US9811753B2 (en) | 2011-09-28 | 2017-11-07 | Fotonation Cayman Limited | Systems and methods for encoding light field image files |
US10430682B2 (en) | 2011-09-28 | 2019-10-01 | Fotonation Limited | Systems and methods for decoding image files containing depth maps stored as metadata |
US9536166B2 (en) | 2011-09-28 | 2017-01-03 | Kip Peli P1 Lp | Systems and methods for decoding image files containing depth maps stored as metadata |
US9412206B2 (en) | 2012-02-21 | 2016-08-09 | Pelican Imaging Corporation | Systems and methods for the manipulation of captured light field image data |
US9754422B2 (en) | 2012-02-21 | 2017-09-05 | Fotonation Cayman Limited | Systems and method for performing depth based image editing |
US10311649B2 (en) | 2012-02-21 | 2019-06-04 | Fotonation Limited | Systems and method for performing depth based image editing |
US9210392B2 (en) | 2012-05-01 | 2015-12-08 | Pelican Imaging Coporation | Camera modules patterned with pi filter groups |
US9706132B2 (en) | 2012-05-01 | 2017-07-11 | Fotonation Cayman Limited | Camera modules patterned with pi filter groups |
US9807382B2 (en) | 2012-06-28 | 2017-10-31 | Fotonation Cayman Limited | Systems and methods for detecting defective camera arrays and optic arrays |
US10334241B2 (en) | 2012-06-28 | 2019-06-25 | Fotonation Limited | Systems and methods for detecting defective camera arrays and optic arrays |
US9100635B2 (en) | 2012-06-28 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for detecting defective camera arrays and optic arrays |
US11022725B2 (en) | 2012-06-30 | 2021-06-01 | Fotonation Limited | Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors |
US10261219B2 (en) | 2012-06-30 | 2019-04-16 | Fotonation Limited | Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors |
US9766380B2 (en) | 2012-06-30 | 2017-09-19 | Fotonation Cayman Limited | Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors |
US9123118B2 (en) | 2012-08-21 | 2015-09-01 | Pelican Imaging Corporation | System and methods for measuring depth using an array camera employing a bayer filter |
US10380752B2 (en) | 2012-08-21 | 2019-08-13 | Fotonation Limited | Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints |
US9123117B2 (en) | 2012-08-21 | 2015-09-01 | Pelican Imaging Corporation | Systems and methods for generating depth maps and corresponding confidence maps indicating depth estimation reliability |
US9858673B2 (en) | 2012-08-21 | 2018-01-02 | Fotonation Cayman Limited | Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints |
US9129377B2 (en) | 2012-08-21 | 2015-09-08 | Pelican Imaging Corporation | Systems and methods for measuring depth based upon occlusion patterns in images |
US9147254B2 (en) | 2012-08-21 | 2015-09-29 | Pelican Imaging Corporation | Systems and methods for measuring depth in the presence of occlusions using a subset of images |
US12002233B2 (en) | 2012-08-21 | 2024-06-04 | Adeia Imaging Llc | Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints |
US9240049B2 (en) | 2012-08-21 | 2016-01-19 | Pelican Imaging Corporation | Systems and methods for measuring depth using an array of independently controllable cameras |
US9235900B2 (en) | 2012-08-21 | 2016-01-12 | Pelican Imaging Corporation | Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints |
US10462362B2 (en) | 2012-08-23 | 2019-10-29 | Fotonation Limited | Feature based high resolution motion estimation from low resolution images captured using an array source |
US9813616B2 (en) | 2012-08-23 | 2017-11-07 | Fotonation Cayman Limited | Feature based high resolution motion estimation from low resolution images captured using an array source |
US9214013B2 (en) | 2012-09-14 | 2015-12-15 | Pelican Imaging Corporation | Systems and methods for correcting user identified artifacts in light field images |
US10390005B2 (en) | 2012-09-28 | 2019-08-20 | Fotonation Limited | Generating images from light fields utilizing virtual viewpoints |
US9749568B2 (en) | 2012-11-13 | 2017-08-29 | Fotonation Cayman Limited | Systems and methods for array camera focal plane control |
US9143711B2 (en) | 2012-11-13 | 2015-09-22 | Pelican Imaging Corporation | Systems and methods for array camera focal plane control |
WO2014078443A1 (en) * | 2012-11-13 | 2014-05-22 | Pelican Imaging Corporation | Systems and methods for array camera focal plane control |
US10009538B2 (en) | 2013-02-21 | 2018-06-26 | Fotonation Cayman Limited | Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information |
US9462164B2 (en) | 2013-02-21 | 2016-10-04 | Pelican Imaging Corporation | Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information |
US9253380B2 (en) | 2013-02-24 | 2016-02-02 | Pelican Imaging Corporation | Thin form factor computational array cameras and modular array cameras |
US9374512B2 (en) | 2013-02-24 | 2016-06-21 | Pelican Imaging Corporation | Thin form factor computational array cameras and modular array cameras |
US9774831B2 (en) | 2013-02-24 | 2017-09-26 | Fotonation Cayman Limited | Thin form factor computational array cameras and modular array cameras |
US9743051B2 (en) | 2013-02-24 | 2017-08-22 | Fotonation Cayman Limited | Thin form factor computational array cameras and modular array cameras |
US9774789B2 (en) | 2013-03-08 | 2017-09-26 | Fotonation Cayman Limited | Systems and methods for high dynamic range imaging using array cameras |
US9917998B2 (en) | 2013-03-08 | 2018-03-13 | Fotonation Cayman Limited | Systems and methods for measuring scene information while capturing images using array cameras |
US11272161B2 (en) | 2013-03-10 | 2022-03-08 | Fotonation Limited | System and methods for calibration of an array camera |
US10225543B2 (en) | 2013-03-10 | 2019-03-05 | Fotonation Limited | System and methods for calibration of an array camera |
US10958892B2 (en) | 2013-03-10 | 2021-03-23 | Fotonation Limited | System and methods for calibration of an array camera |
US9124864B2 (en) | 2013-03-10 | 2015-09-01 | Pelican Imaging Corporation | System and methods for calibration of an array camera |
US9986224B2 (en) | 2013-03-10 | 2018-05-29 | Fotonation Cayman Limited | System and methods for calibration of an array camera |
US11985293B2 (en) | 2013-03-10 | 2024-05-14 | Adeia Imaging Llc | System and methods for calibration of an array camera |
US11570423B2 (en) | 2013-03-10 | 2023-01-31 | Adeia Imaging Llc | System and methods for calibration of an array camera |
US9521416B1 (en) | 2013-03-11 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for image data compression |
US9519972B2 (en) | 2013-03-13 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
US9733486B2 (en) | 2013-03-13 | 2017-08-15 | Fotonation Cayman Limited | Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing |
US9106784B2 (en) | 2013-03-13 | 2015-08-11 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing |
US9888194B2 (en) | 2013-03-13 | 2018-02-06 | Fotonation Cayman Limited | Array camera architecture implementing quantum film image sensors |
US9741118B2 (en) | 2013-03-13 | 2017-08-22 | Fotonation Cayman Limited | System and methods for calibration of an array camera |
US9800856B2 (en) | 2013-03-13 | 2017-10-24 | Fotonation Cayman Limited | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
US10127682B2 (en) | 2013-03-13 | 2018-11-13 | Fotonation Limited | System and methods for calibration of an array camera |
US9578259B2 (en) | 2013-03-14 | 2017-02-21 | Fotonation Cayman Limited | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US10547772B2 (en) | 2013-03-14 | 2020-01-28 | Fotonation Limited | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US9787911B2 (en) | 2013-03-14 | 2017-10-10 | Fotonation Cayman Limited | Systems and methods for photometric normalization in array cameras |
US9100586B2 (en) | 2013-03-14 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for photometric normalization in array cameras |
US10091405B2 (en) | 2013-03-14 | 2018-10-02 | Fotonation Cayman Limited | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US10412314B2 (en) | 2013-03-14 | 2019-09-10 | Fotonation Limited | Systems and methods for photometric normalization in array cameras |
US9497429B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Extended color processing on pelican array cameras |
US9445003B1 (en) | 2013-03-15 | 2016-09-13 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US9633442B2 (en) | 2013-03-15 | 2017-04-25 | Fotonation Cayman Limited | Array cameras including an array camera module augmented with a separate camera |
US9800859B2 (en) | 2013-03-15 | 2017-10-24 | Fotonation Cayman Limited | Systems and methods for estimating depth using stereo array cameras |
US10455218B2 (en) | 2013-03-15 | 2019-10-22 | Fotonation Limited | Systems and methods for estimating depth using stereo array cameras |
US9602805B2 (en) | 2013-03-15 | 2017-03-21 | Fotonation Cayman Limited | Systems and methods for estimating depth using ad hoc stereo array cameras |
US9438888B2 (en) | 2013-03-15 | 2016-09-06 | Pelican Imaging Corporation | Systems and methods for stereo imaging with camera arrays |
US9955070B2 (en) | 2013-03-15 | 2018-04-24 | Fotonation Cayman Limited | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US10122993B2 (en) | 2013-03-15 | 2018-11-06 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
US10542208B2 (en) | 2013-03-15 | 2020-01-21 | Fotonation Limited | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US10182216B2 (en) | 2013-03-15 | 2019-01-15 | Fotonation Limited | Extended color processing on pelican array cameras |
US9497370B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Array camera architecture implementing quantum dot color filters |
US10638099B2 (en) | 2013-03-15 | 2020-04-28 | Fotonation Limited | Extended color processing on pelican array cameras |
US10674138B2 (en) | 2013-03-15 | 2020-06-02 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
US9898856B2 (en) | 2013-09-27 | 2018-02-20 | Fotonation Cayman Limited | Systems and methods for depth-assisted perspective distortion correction |
US10540806B2 (en) | 2013-09-27 | 2020-01-21 | Fotonation Limited | Systems and methods for depth-assisted perspective distortion correction |
US9185276B2 (en) | 2013-11-07 | 2015-11-10 | Pelican Imaging Corporation | Methods of manufacturing array camera modules incorporating independently aligned lens stacks |
US9264592B2 (en) | 2013-11-07 | 2016-02-16 | Pelican Imaging Corporation | Array camera modules incorporating independently aligned lens stacks |
US9426343B2 (en) | 2013-11-07 | 2016-08-23 | Pelican Imaging Corporation | Array cameras incorporating independently aligned lens stacks |
US9924092B2 (en) | 2013-11-07 | 2018-03-20 | Fotonation Cayman Limited | Array cameras incorporating independently aligned lens stacks |
US11486698B2 (en) | 2013-11-18 | 2022-11-01 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
US10767981B2 (en) | 2013-11-18 | 2020-09-08 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
US10119808B2 (en) | 2013-11-18 | 2018-11-06 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
US9426361B2 (en) | 2013-11-26 | 2016-08-23 | Pelican Imaging Corporation | Array camera configurations incorporating multiple constituent array cameras |
US10708492B2 (en) | 2013-11-26 | 2020-07-07 | Fotonation Limited | Array camera configurations incorporating constituent array cameras and constituent cameras |
US9456134B2 (en) | 2013-11-26 | 2016-09-27 | Pelican Imaging Corporation | Array camera configurations incorporating constituent array cameras and constituent cameras |
US9813617B2 (en) | 2013-11-26 | 2017-11-07 | Fotonation Cayman Limited | Array camera configurations incorporating constituent array cameras and constituent cameras |
US10574905B2 (en) | 2014-03-07 | 2020-02-25 | Fotonation Limited | System and methods for depth regularization and semiautomatic interactive matting using RGB-D images |
US10089740B2 (en) | 2014-03-07 | 2018-10-02 | Fotonation Limited | System and methods for depth regularization and semiautomatic interactive matting using RGB-D images |
US9247117B2 (en) | 2014-04-07 | 2016-01-26 | Pelican Imaging Corporation | Systems and methods for correcting for warpage of a sensor array in an array camera module by introducing warpage into a focal plane of a lens stack array |
US9521319B2 (en) | 2014-06-18 | 2016-12-13 | Pelican Imaging Corporation | Array cameras and array camera modules including spectral filters disposed outside of a constituent image sensor |
US11546576B2 (en) | 2014-09-29 | 2023-01-03 | Adeia Imaging Llc | Systems and methods for dynamic calibration of array cameras |
US10250871B2 (en) | 2014-09-29 | 2019-04-02 | Fotonation Limited | Systems and methods for dynamic calibration of array cameras |
US9942474B2 (en) | 2015-04-17 | 2018-04-10 | Fotonation Cayman Limited | Systems and methods for performing high speed video capture and depth estimation using array cameras |
US11562498B2 (en) | 2017-08-21 | 2023-01-24 | Adela Imaging LLC | Systems and methods for hybrid depth regularization |
US10818026B2 (en) | 2017-08-21 | 2020-10-27 | Fotonation Limited | Systems and methods for hybrid depth regularization |
US10482618B2 (en) | 2017-08-21 | 2019-11-19 | Fotonation Limited | Systems and methods for hybrid depth regularization |
US11983893B2 (en) | 2017-08-21 | 2024-05-14 | Adeia Imaging Llc | Systems and methods for hybrid depth regularization |
US11270110B2 (en) | 2019-09-17 | 2022-03-08 | Boston Polarimetrics, Inc. | Systems and methods for surface modeling using polarization cues |
US11699273B2 (en) | 2019-09-17 | 2023-07-11 | Intrinsic Innovation Llc | Systems and methods for surface modeling using polarization cues |
US12099148B2 (en) | 2019-10-07 | 2024-09-24 | Intrinsic Innovation Llc | Systems and methods for surface normals sensing with polarization |
US11982775B2 (en) | 2019-10-07 | 2024-05-14 | Intrinsic Innovation Llc | Systems and methods for augmentation of sensor systems and imaging systems with polarization |
US11525906B2 (en) | 2019-10-07 | 2022-12-13 | Intrinsic Innovation Llc | Systems and methods for augmentation of sensor systems and imaging systems with polarization |
US11302012B2 (en) | 2019-11-30 | 2022-04-12 | Boston Polarimetrics, Inc. | Systems and methods for transparent object segmentation using polarization cues |
US11842495B2 (en) | 2019-11-30 | 2023-12-12 | Intrinsic Innovation Llc | Systems and methods for transparent object segmentation using polarization cues |
US11580667B2 (en) | 2020-01-29 | 2023-02-14 | Intrinsic Innovation Llc | Systems and methods for characterizing object pose detection and measurement systems |
US11797863B2 (en) | 2020-01-30 | 2023-10-24 | Intrinsic Innovation Llc | Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images |
US11953700B2 (en) | 2020-05-27 | 2024-04-09 | Intrinsic Innovation Llc | Multi-aperture polarization optical systems using beam splitters |
US12020455B2 (en) | 2021-03-10 | 2024-06-25 | Intrinsic Innovation Llc | Systems and methods for high dynamic range image reconstruction |
US12069227B2 (en) | 2021-03-10 | 2024-08-20 | Intrinsic Innovation Llc | Multi-modal and multi-spectral stereo camera arrays |
US11290658B1 (en) | 2021-04-15 | 2022-03-29 | Boston Polarimetrics, Inc. | Systems and methods for camera exposure control |
US11683594B2 (en) | 2021-04-15 | 2023-06-20 | Intrinsic Innovation Llc | Systems and methods for camera exposure control |
US11954886B2 (en) | 2021-04-15 | 2024-04-09 | Intrinsic Innovation Llc | Systems and methods for six-degree of freedom pose estimation of deformable objects |
US12067746B2 (en) | 2021-05-07 | 2024-08-20 | Intrinsic Innovation Llc | Systems and methods for using computer vision to pick up small objects |
US12175741B2 (en) | 2021-06-22 | 2024-12-24 | Intrinsic Innovation Llc | Systems and methods for a vision guided end effector |
US12172310B2 (en) | 2021-06-29 | 2024-12-24 | Intrinsic Innovation Llc | Systems and methods for picking objects using 3-D geometry and segmentation |
US11689813B2 (en) | 2021-07-01 | 2023-06-27 | Intrinsic Innovation Llc | Systems and methods for high dynamic range imaging using crossed polarizers |
US12293535B2 (en) | 2021-08-03 | 2025-05-06 | Intrinsic Innovation Llc | Systems and methods for training pose estimators in computer vision |
Also Published As
Publication number | Publication date |
---|---|
JP4773179B2 (en) | 2011-09-14 |
JP2007110486A (en) | 2007-04-26 |
US7692699B2 (en) | 2010-04-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7692699B2 (en) | Image pickup apparatus for preventing linearity defect | |
US7508975B2 (en) | Image sensor | |
KR100617781B1 (en) | Device and method for improving image quality of image sensor | |
US7545420B2 (en) | Image sensing apparatus, image sensing method, and program | |
KR100880085B1 (en) | Imager and noise reduction method | |
CN102572273B (en) | Camera head | |
US20120162467A1 (en) | Image capture device | |
CN102883108B (en) | Picture pick-up device and control method, image processing equipment and method | |
US20040262492A1 (en) | Solid-state image sensing apparatus | |
US20040239790A1 (en) | Image capturing apparatus | |
JP2008042298A (en) | Solid-state image pickup device | |
US8379116B2 (en) | Image pick-up apparatus and image processing method | |
JP4719442B2 (en) | Image signal processing circuit, camera, and image signal processing method | |
US8144210B2 (en) | White balance adjustment device and white balance adjustment method | |
JP2010200109A (en) | Imaging device, control method, and program | |
US8564694B2 (en) | Image pickup device and noise reduction method thereof | |
JP2011009834A (en) | Imager and imaging method | |
JP4872502B2 (en) | Imaging apparatus and clamping method thereof | |
JP4732795B2 (en) | Solid-state imaging device and image correction method | |
JP2010178384A (en) | Image signal processing circuit, camera and image signal processing method | |
JP2011049737A (en) | Imaging apparatus and exposure control method thereof | |
JP2006157341A (en) | Smear correcting method and signal processor for solid-state imaging device, and imaging apparatus | |
JP4415753B2 (en) | Imaging apparatus and imaging method | |
JP5637326B2 (en) | Imaging device | |
JP2011055336A (en) | Imaging apparatus and signal processing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FUJIFILM CORPORATION,JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOBAYASHI, HIROKAZU;REEL/FRAME:018401/0576 Effective date: 20061002 Owner name: FUJIFILM CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOBAYASHI, HIROKAZU;REEL/FRAME:018401/0576 Effective date: 20061002 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552) Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |