US5157499A - High-speed video camera using solid-state image sensor - Google Patents

High-speed video camera using solid-state image sensor Download PDF

Info

Publication number
US5157499A
US5157499A US07/716,630 US71663091A US5157499A US 5157499 A US5157499 A US 5157499A US 71663091 A US71663091 A US 71663091A US 5157499 A US5157499 A US 5157499A
Authority
US
United States
Prior art keywords
image pickup
solid
scanning
pickup elements
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US07/716,630
Inventor
Kazuhiko Oguma
Yutaka Saito
Hiroshi Suzuki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
N A C KK
Original Assignee
N A C KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2172077A external-priority patent/JPH088667B2/en
Priority claimed from JP3048706A external-priority patent/JP2563000B2/en
Application filed by N A C KK filed Critical N A C KK
Assigned to KABUSHIKI KAISHA N A C reassignment KABUSHIKI KAISHA N A C ASSIGNMENT OF ASSIGNORS INTEREST. Assignors: OGUMA, KAZUHIKO, SAITO, YUTAKA, SUZUKI, HIROSHI
Application granted granted Critical
Publication of US5157499A publication Critical patent/US5157499A/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/10—Integrated devices
    • H10F39/12—Image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/745—Circuitry for generating timing or clock signals

Definitions

  • the present invention relates to a high-speed video camera using a solid-state image pickup element.
  • the former system is similar to a standard television system, wherein reading is conducted by driving the solid-state image pickup elements at a high speed.
  • the number of stages of MOS shift registers constituting the scanning circuit becomes large and a clock frequency increases in proportion to the speed of scanning.
  • increases in the wiring capacitance of the clock circuit and the rise time of the clock pulse itself produce adverse effects and consequently, the shift registers are unable to follow the scanning.
  • MOS-type elements are problematic due to the capacitances of horizontal and vertical signal lines, while the CCD-type ones have limitations with respect to high-speed scanning caused by the impairment of transfer efficiency.
  • the above-mentioned latter system is one wherein an image is divided into a plurality of areas or blocks, all the photoelectric conversion element rows in one block are read in parallel and simultaneously, and then the blocks are read sequentially, as disclosed in the National Publication of Translated Version No. 501704/1981.
  • this system necessitates a specific solid-state image pickup element which scans all of the photoelectric conversion element rows in one block in parallel and simultaneously, and includes a number of mechanisms for taking out all signals produced by scanning in parallel and simultaneously, and circuits for amplification and processing thereof.
  • an electronic means for recording the signals after reading them out is complicated and accompanied by difficulties in manufacture.
  • the scanning speed obtained by the above-mentioned former system of the prior art described above is at best two to three times higher than that of standard television (the scanning speed of standard television is 50 to 60 fields per second), and it is impossible to realize scanning at a higher speed than the above using the solid-state image pickup element employed in standard television.
  • the above-mentioned latter system has a shortcoming in that it necessitates that the specific solid-state image pickup element has mechanisms for delivering a plurality of pixel selecting pulses simultaneously from the same vertical shift register and for processing the obtained outputs simultaneously.
  • the present invention furnishes a high-speed video camera of a low cost which realizes high-speed scanning three times or more faster in speed than standard television and solves the above-stated shortcomings by using a solid-state image pickup element employed in standard television.
  • a high-speed video camera of the present invention comprising first and second solid-state image pickup elements each having a predetermined number of photoelectric conversion element rows, a mechanism for projecting a scene equally onto said first and second solid-state image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first solid-state image pickup element, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state image pickup elements being different from the above-mentioned rows in the first solid-state image pickup element scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, and a mechanism for synthesizing signals obtained from said first and second scanning mechanisms in an image.
  • a scene is projected equally onto the discrete solid-state image pickup elements, the photoelectric conversion element rows of these solid-state image pickup elements are scanned simultaneously by the scanning mechanisms corresponding to them, respectively, these scanned photoelectric conversion element rows of the discrete solid-state image pickup elements are set to be arbitrary numbers not corresponding to each other, and one picture is formed by synthesizing the signals thus obtained.
  • a high-speed color video camera of the present invention comprising at least first and second solid-state black-and-white image pickup elements each having a plurality of photoelectric conversion element rows, at least first and second solid-state color image pickup elements each having a plurality of photoelectric conversion element rows, a mechanism for projecting a scene equally onto said first and second solid-state black-and-white image pickup elements and first and second solid-state color image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first black-and-white and solid-state color image pickup elements, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state black-and-white and color image pickup elements being different from the above-mentioned rows in the first black-and-white and color solid-state image pickup elements scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, a mechanism for synthesizing signals obtained from said first and second scanning mechanisms for said first and second
  • a scene is projected equally onto the discrete solid-state image pickup elements, the photoelectric conversion element rows of these solid-state image pickup elements are scanned simultaneously by the scanning mechanisms corresponding to them, respectively, these scanned photoelectric conversion element rows of the discrete solid-state image pickup elements are set to be arbitrary numbers not corresponding to each other, and one color picture is formed by synthesizing the signals thus obtained.
  • FIG. 1 is a fundamental block diagram of a high-speed image pickup camera of the present invention
  • FIGS. 2 and 3 are views for illustrating a scanning method of solid-state image pickup elements in one embodiment of the present invention
  • FIGS. 4 and 5 are views for illustrating a scanning method of solid-state image pickup elements in another embodiment of the present invention.
  • FIGS. 6, 7 and 8 are views for illustrating a scanning method of solid-state image pickup elements in a further embodiment of the present invention.
  • FIG. 9 is a fundamental block diagram of a high-speed color image pickup camera of the present invention.
  • FIG. 1 is a fundamental block diagram of a high-speed image pickup camera of the present invention using two solid-state image pickup elements.
  • numeral 1 denotes a scene
  • 2a an optical device, e.g. a half-mirror, for separating incident light for two solid-state image pickup elements 3a and 3b, 2b a total reflection mirror, 4a and 4b circuits for reading out signals from the solid-state image pickup elements 3a and 3b, and amplifying and processing them, respectively, and 5 a synthesizing circuit for synthesizing signals from said circuits 4a and 4b so as to form a frame.
  • an optical device e.g. a half-mirror
  • 4a and 4b circuits for reading out signals from the solid-state image pickup elements 3a and 3b, and amplifying and processing them, respectively
  • 5 a synthesizing circuit for synthesizing signals from said circuits 4a and 4b so as to form a frame.
  • FIGS. 2 and 3 illustrate states of the solid-state black-and-white image pickup elements 3a and 3b in FIG. 1 being subjected to divided or partial scanning, respectively.
  • a TSL (Transversal Signal Line) MOS-type image pickup element can be employed, for instance.
  • TSL Image Pickup Element with Variable Electronic Shutter the Report on Techniques of the Television Society, ED87-11, issued in 1987.
  • a high frequency clock signal is supplied to a vertical shift register in order to read out signals from photoelectric conversion elements disposed in the shape of a matrix. The time for scanning the lines not required to be read out can be made substantially zero.
  • an upper area of an image pickup surface of the solid-state image pickup element 3a i.e. the area defined by scanning lines 1 to 120, is scanned at a speed equivalent to a field scanning time in the ordinary NTSC system, for instance, by inputting vertical clock pulses to the vertical shift register.
  • said shift register is cleared and scanning is returned forcedly and momentarily to line 1 by inputting a reset pulse to the vertical shift register.
  • a lower area of the image pickup surface i.e.
  • the area defined by scanning lines 121 to 240 (the hatched part), is not scanned, and the scanning time for the solid-state image pickup element 3a is reduced naturally to 1/2 of that required in the case where the whole image pickup surface is scanned at scanning speed of the standard television.
  • the hatched part of the solid-state image pickup element 3b i.e. the area defined by scanning lines 1 to 120, is scanned at high speed until the time corresponding to line 120, by inputting a horizontal clock pulse to the vertical shift register at the time corresponding to line 1.
  • the frequency of the vertical clock pulses is 15.75 KHz ordinarily, the frequency of the horizontal clock pulses is several MHz. Accordingly, the time required for high-speed scanning by the horizontal clock pulses is short and can be substantially neglected.
  • a vertical clock pulse is inputted to the vertical shift register so as to scan the lower area of the image pickup surface, i.e. the area of scanning lines 121 to 240, at the scanning speed of standard television.
  • the scanning time of the solid-state image pickup element 3b is reduced to 1/2 of that required in the case where the whole image pickup surface is scanned at the scanning speed of standard television, in the same way as in the case of the solid-state image pickup element 3a.
  • Signals obtained by these two processes are processed to have proper signal levels by the amplifying-and-processing circuits 4a and 4b and synthesized in the synthesizing circuit 5 having a recording function for forming one frame.
  • the solid-state image pickup elements 3a and 3b are divided in two areas, the upper and lower areas, respectively, and the respective scanning areas thereof are scanned so that they do not overlap each other. It is also possible, in this regard, to provide alternately a plurality of scanning areas and areas not requiring scanning (hatched parts) and to scan separately the corresponding areas of the solid-state image pickup elements 3a and 3b so that they do not overlap each other, as shown in FIGS. 4 and 5.
  • the scanning time for reading the areas not requiring scanning is made substantially zero by supplying the horizontal clock pulse to the vertical shift register as stated above and scanning the scanning areas at the scanning speed of standard television. Thereby the whole image pickup surface can be read in e.g. 1/120 seconds, that is, at a speed which is double that of standard television.
  • FIGS. 6 to 8 illustrate another embodiment using three solid-state image pickup elements, respectively.
  • each solid-state image pickup element is divided into three areas or blocks, i.e., scanning lines 1 to 80, 81 to 160 and 161 to 240, and is scanned. It is understood with ease that speeds three times as high as the scanning speed of standard television can be obtained after synthesis when each area is scanned at this scanning speed, and that a speed six times as high as the scanning speed can be obtained after synthesis when each area is scanned at a scanning speed two times higher than that of standard television.
  • the present invention can be also applied to the case where four or more solid-state image pickup elements are employed and the photoelectric conversion element rows thereof are divided into four or more areas or blocks.
  • the number of elements is increased too much, however, the cost thereof rises and, in addition, hardware therefor becomes complicated.
  • elements for standard television can be used as solid-state image pickup elements and a high-speed video camera can be obtained without using any specific solid-state image pickup element as used in the prior-art apparatus.
  • FIG. 9 shows a fundamental block diagram of a high-speed color image pickup camera of the present invention using two solid-state black-and-white image pickup elements and two solid-state color image pickup elements.
  • incident light from a scene 1 is applied to two optical paths for black-and-white and color through optical devices, e.g. a half-mirror 1a and a total reflection mirror 1b, respectively, and then applied to two solid-state black-and-white image pickup elements 3a and 3b, and two solid-state color image pickup elements 3c and 3d through optical devices, e.g. half-mirrors 2a and 2c, and total reflection mirrors 3b and 3d, respectively.
  • optical devices e.g. a half-mirror 1a and a total reflection mirror 1b
  • Signals from the solid state image pickup elements 3a, 3b, 3c and 3d are read out through amplifying-and-processing circuits 4a, 4b, 4c and 4d, respectively, and synthesized by synthesizing circuits 5 to form a black-and-white frame and a color frame, respectively.
  • a luminance signal component obtained from said black-and-white frame and a color signal component obtained from said color frame are synthesized by a synthesizing circuit 6 to form a color image.
  • three or more solid-state black-and-white and color image pickup elements may be used.
  • this embodiment of the present invention produces such advantages that a sufficiently large luminance signal component of a color video signal can be obtained because the luminance signal component is obtained from the solid-state black-and-white image pickup elements 3a and 3b. In this way, the color signal component can be increased by reducing the bandwidth of the color signal to e.g. 1/10 of that in conventional cases, since it is unnecessary to obtain the luminance signal component from solid-state color image pickup elements 3c and 3d.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

A high-speed video camera having a plurality of solid-state black-and-white image pickup elements to which same scene is projected, respectively, each of said image pickup elements consisting of a plurality of photoelectric conversion element rows, some of which are scanned at the same time. A high-speed color video camera having a plurality of solid-state black-and-white image pickup elements and a plurality of solid-state color image pickup elements to which same scene is projected, respectively, each of image pickup elements consisting of a plurality of photoelectric conversion element rows, some of which in the solid-state black-and-white image pickup elements are scanned at the same time so that a luminance signal component is obtained therefrom, and some of which in the solid-state color image pickup elements are scanned at the same time so that a color signal component is obtained therefrom. The luminance signal component and the color signal component are synthesized to form a color image.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a high-speed video camera using a solid-state image pickup element.
2. Description of the Prior Art
In regard to means of high-speed image pickup for home video recorders and color video cameras employed widely for industrial purposes and using MOS-type or CCD-type solid-state image pickup elements, there is a system wherein high-speed scanning and sequential reading are conducted with increased horizontal and vertical drive frequencies. There is also another system, in this regard, wherein an image is divided into a plurality of areas or blocks, and parallel and simultaneous scanning of photoelectric conversion element rows in each block is conducted sequentially for each block, so as to attain a high speed reading.
In the known reading systems described above, the former system is similar to a standard television system, wherein reading is conducted by driving the solid-state image pickup elements at a high speed. Given that a practical number of pixels is supposed to be two hundred fifty thousand or above, the number of stages of MOS shift registers constituting the scanning circuit becomes large and a clock frequency increases in proportion to the speed of scanning. As a result, increases in the wiring capacitance of the clock circuit and the rise time of the clock pulse itself produce adverse effects and consequently, the shift registers are unable to follow the scanning. Moreover, MOS-type elements are problematic due to the capacitances of horizontal and vertical signal lines, while the CCD-type ones have limitations with respect to high-speed scanning caused by the impairment of transfer efficiency.
The above-mentioned latter system is one wherein an image is divided into a plurality of areas or blocks, all the photoelectric conversion element rows in one block are read in parallel and simultaneously, and then the blocks are read sequentially, as disclosed in the National Publication of Translated Version No. 501704/1981. However, this system necessitates a specific solid-state image pickup element which scans all of the photoelectric conversion element rows in one block in parallel and simultaneously, and includes a number of mechanisms for taking out all signals produced by scanning in parallel and simultaneously, and circuits for amplification and processing thereof. Furthermore, an electronic means for recording the signals after reading them out is complicated and accompanied by difficulties in manufacture.
Accordingly, the scanning speed obtained by the above-mentioned former system of the prior art described above is at best two to three times higher than that of standard television (the scanning speed of standard television is 50 to 60 fields per second), and it is impossible to realize scanning at a higher speed than the above using the solid-state image pickup element employed in standard television. On the other hand, the above-mentioned latter system has a shortcoming in that it necessitates that the specific solid-state image pickup element has mechanisms for delivering a plurality of pixel selecting pulses simultaneously from the same vertical shift register and for processing the obtained outputs simultaneously.
SUMMARY OF THE INVENTION
The present invention furnishes a high-speed video camera of a low cost which realizes high-speed scanning three times or more faster in speed than standard television and solves the above-stated shortcomings by using a solid-state image pickup element employed in standard television.
The above object can be attained by a high-speed video camera of the present invention comprising first and second solid-state image pickup elements each having a predetermined number of photoelectric conversion element rows, a mechanism for projecting a scene equally onto said first and second solid-state image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first solid-state image pickup element, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state image pickup elements being different from the above-mentioned rows in the first solid-state image pickup element scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, and a mechanism for synthesizing signals obtained from said first and second scanning mechanisms in an image.
In the high-speed video camera of the present invention, a scene is projected equally onto the discrete solid-state image pickup elements, the photoelectric conversion element rows of these solid-state image pickup elements are scanned simultaneously by the scanning mechanisms corresponding to them, respectively, these scanned photoelectric conversion element rows of the discrete solid-state image pickup elements are set to be arbitrary numbers not corresponding to each other, and one picture is formed by synthesizing the signals thus obtained.
The above object can also be attained by a high-speed color video camera of the present invention comprising at least first and second solid-state black-and-white image pickup elements each having a plurality of photoelectric conversion element rows, at least first and second solid-state color image pickup elements each having a plurality of photoelectric conversion element rows, a mechanism for projecting a scene equally onto said first and second solid-state black-and-white image pickup elements and first and second solid-state color image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first black-and-white and solid-state color image pickup elements, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state black-and-white and color image pickup elements being different from the above-mentioned rows in the first black-and-white and color solid-state image pickup elements scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, a mechanism for synthesizing signals obtained from said first and second scanning mechanisms for said first and second solid-state black-and-white image pickup elements in one frame to form a luminance signal component, a mechanism for synthesizing signals obtained from said first and second solid-state color image pickup elements in one frame to form a color signal component, and a mechanism for synthesizing the luminance signal component and the color signal component in a color image.
In the high-speed color video camera of the present invention, a scene is projected equally onto the discrete solid-state image pickup elements, the photoelectric conversion element rows of these solid-state image pickup elements are scanned simultaneously by the scanning mechanisms corresponding to them, respectively, these scanned photoelectric conversion element rows of the discrete solid-state image pickup elements are set to be arbitrary numbers not corresponding to each other, and one color picture is formed by synthesizing the signals thus obtained.
Other objects and features of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a fundamental block diagram of a high-speed image pickup camera of the present invention;
FIGS. 2 and 3 are views for illustrating a scanning method of solid-state image pickup elements in one embodiment of the present invention;
FIGS. 4 and 5 are views for illustrating a scanning method of solid-state image pickup elements in another embodiment of the present invention;
FIGS. 6, 7 and 8 are views for illustrating a scanning method of solid-state image pickup elements in a further embodiment of the present invention; and
FIG. 9 is a fundamental block diagram of a high-speed color image pickup camera of the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
FIG. 1 is a fundamental block diagram of a high-speed image pickup camera of the present invention using two solid-state image pickup elements.
In FIG. 1, numeral 1 denotes a scene, 2a an optical device, e.g. a half-mirror, for separating incident light for two solid-state image pickup elements 3a and 3b, 2b a total reflection mirror, 4a and 4b circuits for reading out signals from the solid-state image pickup elements 3a and 3b, and amplifying and processing them, respectively, and 5 a synthesizing circuit for synthesizing signals from said circuits 4a and 4b so as to form a frame.
FIGS. 2 and 3 illustrate states of the solid-state black-and-white image pickup elements 3a and 3b in FIG. 1 being subjected to divided or partial scanning, respectively. As for an average solid-state image pickup element enabling execution of divided or partial scanning, a TSL (Transversal Signal Line) MOS-type image pickup element can be employed, for instance. A detailed description of this solid-state image pickup element is made, for instance, in the article "TSL Image Pickup Element with Variable Electronic Shutter", the Report on Techniques of the Television Society, ED87-11, issued in 1987. In this image pickup element, a high frequency clock signal is supplied to a vertical shift register in order to read out signals from photoelectric conversion elements disposed in the shape of a matrix. The time for scanning the lines not required to be read out can be made substantially zero.
The divided or partial scanning method will now be explained.
In FIG. 2, an upper area of an image pickup surface of the solid-state image pickup element 3a, i.e. the area defined by scanning lines 1 to 120, is scanned at a speed equivalent to a field scanning time in the ordinary NTSC system, for instance, by inputting vertical clock pulses to the vertical shift register. At the time corresponding to scanning line 121, said shift register is cleared and scanning is returned forcedly and momentarily to line 1 by inputting a reset pulse to the vertical shift register. As a result, a lower area of the image pickup surface, i.e. the area defined by scanning lines 121 to 240 (the hatched part), is not scanned, and the scanning time for the solid-state image pickup element 3a is reduced naturally to 1/2 of that required in the case where the whole image pickup surface is scanned at scanning speed of the standard television.
In FIG. 3, in contrast, the hatched part of the solid-state image pickup element 3b, i.e. the area defined by scanning lines 1 to 120, is scanned at high speed until the time corresponding to line 120, by inputting a horizontal clock pulse to the vertical shift register at the time corresponding to line 1. While the frequency of the vertical clock pulses is 15.75 KHz ordinarily, the frequency of the horizontal clock pulses is several MHz. Accordingly, the time required for high-speed scanning by the horizontal clock pulses is short and can be substantially neglected. After the time corresponding to scanning line 121, a vertical clock pulse is inputted to the vertical shift register so as to scan the lower area of the image pickup surface, i.e. the area of scanning lines 121 to 240, at the scanning speed of standard television. As a result, the scanning time of the solid-state image pickup element 3b is reduced to 1/2 of that required in the case where the whole image pickup surface is scanned at the scanning speed of standard television, in the same way as in the case of the solid-state image pickup element 3a. Signals obtained by these two processes are processed to have proper signal levels by the amplifying-and- processing circuits 4a and 4b and synthesized in the synthesizing circuit 5 having a recording function for forming one frame.
The above is a detailed description of an embodiment wherein the solid-state image pickup elements 3a and 3b are divided in two areas, the upper and lower areas, respectively, and the respective scanning areas thereof are scanned so that they do not overlap each other. It is also possible, in this regard, to provide alternately a plurality of scanning areas and areas not requiring scanning (hatched parts) and to scan separately the corresponding areas of the solid-state image pickup elements 3a and 3b so that they do not overlap each other, as shown in FIGS. 4 and 5. In this example, the scanning time for reading the areas not requiring scanning is made substantially zero by supplying the horizontal clock pulse to the vertical shift register as stated above and scanning the scanning areas at the scanning speed of standard television. Thereby the whole image pickup surface can be read in e.g. 1/120 seconds, that is, at a speed which is double that of standard television.
FIGS. 6 to 8 illustrate another embodiment using three solid-state image pickup elements, respectively. In this embodiment, each solid-state image pickup element is divided into three areas or blocks, i.e., scanning lines 1 to 80, 81 to 160 and 161 to 240, and is scanned. It is understood with ease that speeds three times as high as the scanning speed of standard television can be obtained after synthesis when each area is scanned at this scanning speed, and that a speed six times as high as the scanning speed can be obtained after synthesis when each area is scanned at a scanning speed two times higher than that of standard television.
The present invention can be also applied to the case where four or more solid-state image pickup elements are employed and the photoelectric conversion element rows thereof are divided into four or more areas or blocks. When the number of elements is increased too much, however, the cost thereof rises and, in addition, hardware therefor becomes complicated.
According to these embodiments of the present invention, elements for standard television can be used as solid-state image pickup elements and a high-speed video camera can be obtained without using any specific solid-state image pickup element as used in the prior-art apparatus.
FIG. 9 shows a fundamental block diagram of a high-speed color image pickup camera of the present invention using two solid-state black-and-white image pickup elements and two solid-state color image pickup elements.
In this embodiment, incident light from a scene 1 is applied to two optical paths for black-and-white and color through optical devices, e.g. a half-mirror 1a and a total reflection mirror 1b, respectively, and then applied to two solid-state black-and-white image pickup elements 3a and 3b, and two solid-state color image pickup elements 3c and 3d through optical devices, e.g. half- mirrors 2a and 2c, and total reflection mirrors 3b and 3d, respectively.
Signals from the solid state image pickup elements 3a, 3b, 3c and 3d are read out through amplifying-and- processing circuits 4a, 4b, 4c and 4d, respectively, and synthesized by synthesizing circuits 5 to form a black-and-white frame and a color frame, respectively.
A luminance signal component obtained from said black-and-white frame and a color signal component obtained from said color frame are synthesized by a synthesizing circuit 6 to form a color image.
In another embodiment of the present invention, three or more solid-state black-and-white and color image pickup elements may be used.
While elements for standard television can be used as solid-state image pickup elements in the embodiments of the present invention and a high-speed color video camera can be obtained without using any specific solid-state image pickup element as used in the prior-art apparatus, this embodiment of the present invention produces such advantages that a sufficiently large luminance signal component of a color video signal can be obtained because the luminance signal component is obtained from the solid-state black-and-white image pickup elements 3a and 3b. In this way, the color signal component can be increased by reducing the bandwidth of the color signal to e.g. 1/10 of that in conventional cases, since it is unnecessary to obtain the luminance signal component from solid-state color image pickup elements 3c and 3d.

Claims (3)

What is claimed is:
1. A high-speed video camera comprising first and second solid-state image pickup elements each having a predetermined number of photoelectric conversion element rows, a mechanism for projecting an entire scene equally onto said first and second solid-state image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first solid-state image pickup element, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state image pickup elements being different from the above-mentioned rows in the first solid-state image pickup element scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, and a mechanism for synthesizing signals obtained from said first and second scanning mechanisms in an image.
2. A high-speed video camera comprising first, second and third solid-state image pickup elements each having a predetermined number of photoelectric conversion element rows, a mechanism for projecting an entire scene equally onto said first, second and third solid-state image pickup elements, a first scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said first solid-state image pickup element, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state image pickup elements being different from the above-mentioned rows in the first solid-state image pickup element scanned by said first scanning mechanism, a third scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said third solid-state image pickup elements being different from the above-mentioned rows in the first and second solid-state image pickup elements scanned by said first and second scanning mechanisms, respectively, said first, second and third scanning mechanism being synchronized in operation with one another, and a mechanism for synthesizing signals obtained from said first, second and third scanning mechanisms in an image.
3. A high-speed video camera comprising at least first and second solid-state black-and-white image pickup elements each having a plurality of photoelectric conversion element rows, at least first and second solid-state color image pickup elements each having a plurality of photoelectric conversion element rows, a mechanism for projecting an entire scene equally onto said first and second solid-state black-and-white image pickup elements and first and second solid-state color image pickup elements, a first scanning mechanism for scanning photo-electric conversion element rows of an arbitrary number in said first black-and-white and solid-state color image pickup elements, a second scanning mechanism for scanning photoelectric conversion element rows of an arbitrary number in said second solid-state black-and-white and color image pickup elements being different from the above-mentioned rows in the first black-and-white and color solid-state image pickup elements scanned by said first scanning mechanism, said second scanning mechanism being synchronized in operation with said first scanning mechanism, a mechanism for synthesizing signals obtained from said first and second scanning mechanisms for said first and second solid-state black-and-white image pickup elements in one frame to form a luminance signal component, a mechanism for synthesizing signals obtained from said first and second solid-state color image pickup elements in one frame to form a color signal component, and a mechanism for synthesizing the luminance signal component and the color signal component in a color image.
US07/716,630 1990-06-29 1991-06-17 High-speed video camera using solid-state image sensor Expired - Lifetime US5157499A (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2-172077 1990-06-29
JP2172077A JPH088667B2 (en) 1990-06-29 1990-06-29 High speed imaging camera
JP3-48706 1991-02-22
JP3048706A JP2563000B2 (en) 1991-02-22 1991-02-22 High speed color video camera

Publications (1)

Publication Number Publication Date
US5157499A true US5157499A (en) 1992-10-20

Family

ID=26389008

Family Applications (1)

Application Number Title Priority Date Filing Date
US07/716,630 Expired - Lifetime US5157499A (en) 1990-06-29 1991-06-17 High-speed video camera using solid-state image sensor

Country Status (4)

Country Link
US (1) US5157499A (en)
EP (1) EP0473259B1 (en)
KR (1) KR970011536B1 (en)
DE (1) DE69113375T2 (en)

Cited By (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5267025A (en) * 1991-09-19 1993-11-30 Sharp Kabushiki Kaisha Image sensing apparatus having two image sensing portions and one signal processing portion and allowing improved white balance control
US5521640A (en) * 1994-10-31 1996-05-28 At&T Global Information Solutions Company Color image array scanner with high resolution monochrome mode
US5534924A (en) * 1991-03-05 1996-07-09 Thomson Broadcast Method and device to obtain an element of information on depth in the field seen by picture-shooting device
US5638119A (en) * 1990-02-16 1997-06-10 Scanera S.C. Device for increasing the dynamic range of a camera
US5745171A (en) * 1994-04-14 1998-04-28 Asahi Kogaku Kogyo Kabushiki Kaisha Device for generating a luminance signal from a single field
US6288742B1 (en) 1995-09-21 2001-09-11 Lucent Technologies Inc. Video camera including multiple image sensors
US20030117501A1 (en) * 2001-12-21 2003-06-26 Nec Corporation Camera device for portable equipment
US20030184673A1 (en) * 2002-04-02 2003-10-02 Michael Skow Automatic exposure control for digital imaging
US20070030342A1 (en) * 2004-07-21 2007-02-08 Bennett Wilburn Apparatus and method for capturing a scene using staggered triggering of dense camera arrays
US20090278965A1 (en) * 2008-05-07 2009-11-12 Ko Kuk-Won High-speed photographing apparatus using plural cameras
US9576369B2 (en) 2008-05-20 2017-02-21 Fotonation Cayman Limited Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US9800859B2 (en) 2013-03-15 2017-10-24 Fotonation Cayman Limited Systems and methods for estimating depth using stereo array cameras
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US10182216B2 (en) 2013-03-15 2019-01-15 Fotonation Limited Extended color processing on pelican array cameras
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
CN110012215A (en) * 2017-12-08 2019-07-12 索尼半导体解决方案公司 Image processing apparatus and image processing method
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10390005B2 (en) 2012-09-28 2019-08-20 Fotonation Limited Generating images from light fields utilizing virtual viewpoints
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US10708492B2 (en) 2013-11-26 2020-07-07 Fotonation Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11356604B2 (en) * 2020-02-14 2022-06-07 Pixelworks, Inc. Methods and systems for image processing with multiple image sources
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects
US12172310B2 (en) 2021-06-29 2024-12-24 Intrinsic Innovation Llc Systems and methods for picking objects using 3-D geometry and segmentation
US12175741B2 (en) 2021-06-22 2024-12-24 Intrinsic Innovation Llc Systems and methods for a vision guided end effector
US12293535B2 (en) 2021-08-03 2025-05-06 Intrinsic Innovation Llc Systems and methods for training pose estimators in computer vision

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT1271647B (en) * 1994-05-06 1997-06-04 Bts Srl HIGH-FREQUENCY CAMERA OF PHOTOGRAM AND RELATED METHOD OF MANUFACTURE
DE102004011147B3 (en) * 2004-03-08 2005-11-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Image pickup device with multiple image capture modes
KR102074946B1 (en) 2013-10-30 2020-02-07 삼성전자 주식회사 Low-Current Ring Oscillator having Temperature Compensation Scheme, and Device including the same
EP3955560A1 (en) * 2020-08-13 2022-02-16 Koninklijke Philips N.V. An image sensing system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4359757A (en) * 1979-11-29 1982-11-16 Gx-Holding Ag. Method for the opto-electronic transmission of an image original
US4378571A (en) * 1981-07-06 1983-03-29 Xerox Corporation Serial analog video processor for charge coupled device imagers
US4652909A (en) * 1982-09-14 1987-03-24 New York Institute Of Technology Television camera and recording system for high definition television having imagers of different frame rate
US4825301A (en) * 1987-07-16 1989-04-25 Polaroid Corporation Apparatus for encoding and decoding high resolution still images and video images for recording on a standard storage media
US5016109A (en) * 1990-07-02 1991-05-14 Bell South Corporation Apparatus and method for segmenting a field of view into contiguous, non-overlapping, vertical and horizontal sub-fields

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5919472A (en) * 1982-07-22 1984-01-31 Yoshiharu Morimoto High speed camera using solid-state image pickup element
DE3616400A1 (en) * 1985-05-23 1986-11-27 Steinheil-Lear Siegler AG, 8045 Ismaning Optoelectronic image converter
EP0251790A3 (en) * 1986-07-04 1989-11-23 Hitachi, Ltd. A solid state imaging device
JPH01305781A (en) * 1988-06-03 1989-12-11 Mitsubishi Electric Corp Solid-state image pickup device
JPH0236689A (en) * 1988-07-27 1990-02-06 Konica Corp High resolution adaptor for still video camera

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4359757A (en) * 1979-11-29 1982-11-16 Gx-Holding Ag. Method for the opto-electronic transmission of an image original
US4378571A (en) * 1981-07-06 1983-03-29 Xerox Corporation Serial analog video processor for charge coupled device imagers
US4652909A (en) * 1982-09-14 1987-03-24 New York Institute Of Technology Television camera and recording system for high definition television having imagers of different frame rate
US4825301A (en) * 1987-07-16 1989-04-25 Polaroid Corporation Apparatus for encoding and decoding high resolution still images and video images for recording on a standard storage media
US5016109A (en) * 1990-07-02 1991-05-14 Bell South Corporation Apparatus and method for segmenting a field of view into contiguous, non-overlapping, vertical and horizontal sub-fields

Cited By (118)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5638119A (en) * 1990-02-16 1997-06-10 Scanera S.C. Device for increasing the dynamic range of a camera
US5534924A (en) * 1991-03-05 1996-07-09 Thomson Broadcast Method and device to obtain an element of information on depth in the field seen by picture-shooting device
US5267025A (en) * 1991-09-19 1993-11-30 Sharp Kabushiki Kaisha Image sensing apparatus having two image sensing portions and one signal processing portion and allowing improved white balance control
US5745171A (en) * 1994-04-14 1998-04-28 Asahi Kogaku Kogyo Kabushiki Kaisha Device for generating a luminance signal from a single field
US5521640A (en) * 1994-10-31 1996-05-28 At&T Global Information Solutions Company Color image array scanner with high resolution monochrome mode
US6288742B1 (en) 1995-09-21 2001-09-11 Lucent Technologies Inc. Video camera including multiple image sensors
US20030117501A1 (en) * 2001-12-21 2003-06-26 Nec Corporation Camera device for portable equipment
US7443447B2 (en) * 2001-12-21 2008-10-28 Nec Corporation Camera device for portable equipment
US20030184673A1 (en) * 2002-04-02 2003-10-02 Michael Skow Automatic exposure control for digital imaging
US20070030342A1 (en) * 2004-07-21 2007-02-08 Bennett Wilburn Apparatus and method for capturing a scene using staggered triggering of dense camera arrays
US8027531B2 (en) 2004-07-21 2011-09-27 The Board Of Trustees Of The Leland Stanford Junior University Apparatus and method for capturing a scene using staggered triggering of dense camera arrays
US20090278965A1 (en) * 2008-05-07 2009-11-12 Ko Kuk-Won High-speed photographing apparatus using plural cameras
US9576369B2 (en) 2008-05-20 2017-02-21 Fotonation Cayman Limited Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US9712759B2 (en) * 2008-05-20 2017-07-18 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US11412158B2 (en) 2008-05-20 2022-08-09 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US10142560B2 (en) 2008-05-20 2018-11-27 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US12041360B2 (en) 2008-05-20 2024-07-16 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US10027901B2 (en) 2008-05-20 2018-07-17 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US12022207B2 (en) 2008-05-20 2024-06-25 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US11875475B2 (en) 2010-12-14 2024-01-16 Adeia Imaging Llc Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US12243190B2 (en) 2010-12-14 2025-03-04 Adeia Imaging Llc Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US11423513B2 (en) 2010-12-14 2022-08-23 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10742861B2 (en) 2011-05-11 2020-08-11 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US10375302B2 (en) 2011-09-19 2019-08-06 Fotonation Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US10984276B2 (en) 2011-09-28 2021-04-20 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US10019816B2 (en) 2011-09-28 2018-07-10 Fotonation Cayman Limited Systems and methods for decoding image files containing depth maps stored as metadata
US10275676B2 (en) 2011-09-28 2019-04-30 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US11729365B2 (en) 2011-09-28 2023-08-15 Adela Imaging LLC Systems and methods for encoding image files containing depth maps stored as metadata
US10430682B2 (en) 2011-09-28 2019-10-01 Fotonation Limited Systems and methods for decoding image files containing depth maps stored as metadata
US12052409B2 (en) 2011-09-28 2024-07-30 Adela Imaging LLC Systems and methods for encoding image files containing depth maps stored as metadata
US9864921B2 (en) 2011-09-28 2018-01-09 Fotonation Cayman Limited Systems and methods for encoding image files containing depth maps stored as metadata
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US20180197035A1 (en) 2011-09-28 2018-07-12 Fotonation Cayman Limited Systems and Methods for Encoding Image Files Containing Depth Maps Stored as Metadata
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US10311649B2 (en) 2012-02-21 2019-06-04 Fotonation Limited Systems and method for performing depth based image editing
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US10334241B2 (en) 2012-06-28 2019-06-25 Fotonation Limited Systems and methods for detecting defective camera arrays and optic arrays
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US11022725B2 (en) 2012-06-30 2021-06-01 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US12002233B2 (en) 2012-08-21 2024-06-04 Adeia Imaging Llc Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US10380752B2 (en) 2012-08-21 2019-08-13 Fotonation Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US10462362B2 (en) 2012-08-23 2019-10-29 Fotonation Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US10390005B2 (en) 2012-09-28 2019-08-20 Fotonation Limited Generating images from light fields utilizing virtual viewpoints
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US9774831B2 (en) 2013-02-24 2017-09-26 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9917998B2 (en) 2013-03-08 2018-03-13 Fotonation Cayman Limited Systems and methods for measuring scene information while capturing images using array cameras
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
US11570423B2 (en) 2013-03-10 2023-01-31 Adeia Imaging Llc System and methods for calibration of an array camera
US10225543B2 (en) 2013-03-10 2019-03-05 Fotonation Limited System and methods for calibration of an array camera
US11985293B2 (en) 2013-03-10 2024-05-14 Adeia Imaging Llc System and methods for calibration of an array camera
US11272161B2 (en) 2013-03-10 2022-03-08 Fotonation Limited System and methods for calibration of an array camera
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US10958892B2 (en) 2013-03-10 2021-03-23 Fotonation Limited System and methods for calibration of an array camera
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10547772B2 (en) 2013-03-14 2020-01-28 Fotonation Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10455218B2 (en) 2013-03-15 2019-10-22 Fotonation Limited Systems and methods for estimating depth using stereo array cameras
US10674138B2 (en) 2013-03-15 2020-06-02 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10638099B2 (en) 2013-03-15 2020-04-28 Fotonation Limited Extended color processing on pelican array cameras
US10542208B2 (en) 2013-03-15 2020-01-21 Fotonation Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10182216B2 (en) 2013-03-15 2019-01-15 Fotonation Limited Extended color processing on pelican array cameras
US9800859B2 (en) 2013-03-15 2017-10-24 Fotonation Cayman Limited Systems and methods for estimating depth using stereo array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10540806B2 (en) 2013-09-27 2020-01-21 Fotonation Limited Systems and methods for depth-assisted perspective distortion correction
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US10767981B2 (en) 2013-11-18 2020-09-08 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US11486698B2 (en) 2013-11-18 2022-11-01 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10708492B2 (en) 2013-11-26 2020-07-07 Fotonation Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10574905B2 (en) 2014-03-07 2020-02-25 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US11546576B2 (en) 2014-09-29 2023-01-03 Adeia Imaging Llc Systems and methods for dynamic calibration of array cameras
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US11983893B2 (en) 2017-08-21 2024-05-14 Adeia Imaging Llc Systems and methods for hybrid depth regularization
US11562498B2 (en) 2017-08-21 2023-01-24 Adela Imaging LLC Systems and methods for hybrid depth regularization
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US10818026B2 (en) 2017-08-21 2020-10-27 Fotonation Limited Systems and methods for hybrid depth regularization
CN110012215A (en) * 2017-12-08 2019-07-12 索尼半导体解决方案公司 Image processing apparatus and image processing method
US11699273B2 (en) 2019-09-17 2023-07-11 Intrinsic Innovation Llc Systems and methods for surface modeling using polarization cues
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US12099148B2 (en) 2019-10-07 2024-09-24 Intrinsic Innovation Llc Systems and methods for surface normals sensing with polarization
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11982775B2 (en) 2019-10-07 2024-05-14 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11842495B2 (en) 2019-11-30 2023-12-12 Intrinsic Innovation Llc Systems and methods for transparent object segmentation using polarization cues
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11356604B2 (en) * 2020-02-14 2022-06-07 Pixelworks, Inc. Methods and systems for image processing with multiple image sources
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US11683594B2 (en) 2021-04-15 2023-06-20 Intrinsic Innovation Llc Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects
US12175741B2 (en) 2021-06-22 2024-12-24 Intrinsic Innovation Llc Systems and methods for a vision guided end effector
US12172310B2 (en) 2021-06-29 2024-12-24 Intrinsic Innovation Llc Systems and methods for picking objects using 3-D geometry and segmentation
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US12293535B2 (en) 2021-08-03 2025-05-06 Intrinsic Innovation Llc Systems and methods for training pose estimators in computer vision

Also Published As

Publication number Publication date
DE69113375T2 (en) 1996-02-29
EP0473259A2 (en) 1992-03-04
EP0473259A3 (en) 1992-05-27
EP0473259B1 (en) 1995-09-27
KR970011536B1 (en) 1997-07-11
DE69113375D1 (en) 1995-11-02
KR920001920A (en) 1992-01-30

Similar Documents

Publication Publication Date Title
US5157499A (en) High-speed video camera using solid-state image sensor
EP1148712B1 (en) Solid-state image pickup apparatus
US5045932A (en) Method and apparatus for generating a high definition electronic signal from a line scan of a color original
JP2753541B2 (en) Still image pickup device
US5280358A (en) Photoelectric converting apparatus having an analog memory
WO1997017811A1 (en) Method and device for picking up color still image
NL8201745A (en) IMAGE RECORDING DEVICE OF THE "SOLID STATE" TYPE.
US5764289A (en) Solid-state image pick-up apparatus
US4278995A (en) Color line sensor for use in film scanning apparatus
US5764285A (en) Imaging apparatus having area sensor and line sensor
US7619195B2 (en) Imaging device driver, imaging device driving method, and image signal processor
CA1215169A (en) Color television camera with two or more solid-state imaging devices arranged in phase difference fashion
US4746972A (en) Imaging apparatus with bidirectionally transferrable identical charge transfer devices for converting mirror images
US6118481A (en) Solid state image pick-up device and image pick-up apparatus
US6803947B1 (en) Video camera using mixed-line-pair readout, taking still pictures with full vertical resolution
US6809770B1 (en) Imaging device and a digital camera having same
JP2563000B2 (en) High speed color video camera
JPH06189187A (en) Image pickup device, photometric method therefor, focus control method therefor and image pickup method
JP2713295B2 (en) Driving method of solid-state imaging device and imaging device
JPH0460539A (en) High-speed image pickup camera
JPS6198073A (en) Imaging device
KR100270951B1 (en) High density image pick-up apparatus and signal processing thereof
JPS5814789B2 (en) Color Kotai Satsuzou Sochi
JPS6262689A (en) solid-state image sensor
JPH06284327A (en) Driving method for solid-state image pickup element

Legal Events

Date Code Title Description
AS Assignment

Owner name: KABUSHIKI KAISHA N A C

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:OGUMA, KAZUHIKO;SAITO, YUTAKA;SUZUKI, HIROSHI;REEL/FRAME:005746/0609

Effective date: 19910606

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12

OSZAR »