US8355117B2 - Method and arrangement for measuring the distance to an object - Google Patents
Method and arrangement for measuring the distance to an object Download PDFInfo
- Publication number
- US8355117B2 US8355117B2 US11/641,965 US64196506A US8355117B2 US 8355117 B2 US8355117 B2 US 8355117B2 US 64196506 A US64196506 A US 64196506A US 8355117 B2 US8355117 B2 US 8355117B2
- Authority
- US
- United States
- Prior art keywords
- circuit
- distance
- multiplexer
- avalanche
- photodiodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 238000000034 method Methods 0.000 title claims description 53
- 238000003860 storage Methods 0.000 claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000010354 integration Effects 0.000 claims description 47
- 230000002441 reversible effect Effects 0.000 claims description 10
- 230000000694 effects Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 7
- 230000015556 catabolic process Effects 0.000 claims description 4
- 230000035945 sensitivity Effects 0.000 claims description 4
- 230000000737 periodic effect Effects 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 2
- 239000003086 colorant Substances 0.000 claims 1
- 238000005286 illumination Methods 0.000 description 19
- 238000005259 measurement Methods 0.000 description 18
- 230000003287 optical effect Effects 0.000 description 18
- 238000003384 imaging method Methods 0.000 description 9
- 238000000098 azimuthal photoelectron diffraction Methods 0.000 description 8
- 238000010791 quenching Methods 0.000 description 8
- 239000004065 semiconductor Substances 0.000 description 8
- 230000000171 quenching effect Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000003708 edge detection Methods 0.000 description 5
- 238000002474 experimental method Methods 0.000 description 4
- 238000003491 array Methods 0.000 description 3
- 239000002800 charge carrier Substances 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000005693 optoelectronics Effects 0.000 description 3
- 230000003071 parasitic effect Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000630 rising effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 101710129448 Glucose-6-phosphate isomerase 2 Proteins 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000001444 catalytic combustion detection Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000002292 fluorescence lifetime imaging microscopy Methods 0.000 description 1
- 238000005305 interferometry Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 238000009738 saturating Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000003530 single readout Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000009966 trimming Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
- G01C3/08—Use of electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/32—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
- G01S17/36—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated with phase comparison between the received signal and the contemporaneously transmitted signal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
- G01S7/493—Extracting wanted echo signals
Definitions
- the present invention concerns the field of integrated circuits.
- it concerns a new technique for a solid-state image sensor based on avalanche photodiodes that measures the distance of objects in addition to their intensity image.
- Continuous modulation based TOF rangefinders measure the phase difference between a modulated light source and the wave reflected by an object. The distance between the image sensor and the object is directly proportional to measured phase difference.
- megahertz modulation frequencies in conjunction with homodyne phase discrimination and averaging at the pixel level, have been successfully used to relax circuit specifications.
- CCD gates of all pixels have to be clocked at a frequency of at least two times higher than the demodulation frequency. Since CCD gates are essentially metal-oxide-semiconductor (MOS) or semiconductor-oxide-semiconductor (SOS) capacitors, this type of image sensor dissipates a large amount of power, thus preventing them to be used in battery-powered systems. The requirement of an external companion chip is an additional drawback in standard CCD fabrication technology.
- MOS metal-oxide-semiconductor
- SOS semiconductor-oxide-semiconductor
- Utility patent U.S. Pat. No. 6,515,740 (C. Bamji and E. Charbon, “Methods for CMOS-Compatible Three-Dimensional Image Sensing Using Quantum Efficiency Modulation”, proposes a technique of homodyne phase discrimination based on a periodical modulation of the quantum efficiency of two or more photodiodes.
- the advantage of this technique is the use of standard complementary metal oxide semiconductor (CMOS) technology, which allows a system-on-a-chip integration, thus reducing fabrication costs.
- CMOS complementary metal oxide semiconductor
- Time-of-flight (TOF) pulsed based systems for measuring the distance from a circuit to an object use a measure the round-trip time of a single burst of light.
- TOF Time-of-flight
- the main advantage of these methods over modulated type TOF is that a range of operation of a few meters to several kilometers can be achieved.
- pulsed type TOF rangefinders In order to achieve millimeter accuracies, pulsed type TOF rangefinders must have picosecond time discrimination capability. For example, R. Jeremias, W. Brockherde, C. Doemens, B. Hosticka, L. Listl, P. Mengel, “A CMOS Photosensor Array for 3D Imaging Using Pulsed LASER”, Proc. IEEE ISSCC, pp.
- CMOS image sensor 252-253, February 2001, describes a technique based on a pulsed illumination with a standard CMOS image sensor.
- the method consists of sending a relatively long pulse (tens of nanoseconds) and synchronously integrating the signal reflected by objects. Since the integration phase starts at the moment the light pulse is sent, the amount of light integrated for a single pulse depends on the object distance.
- a very powerful laser source which amounts to several of tens of watts, is required for the illumination. This illumination power prevents the use of such rangefinder when user's eye safety operation is strictly compulsory. In addition, the generation of such high power and precise light pulse could potentially increase the overall cost of such system.
- the method consists of illuminating the scene with very short pulses (few hundreds of picosecond), then measuring the direct time-of-flight of each pulse with a time-to-digital converter.
- the first reference (B. F. Aull et al.) requires a custom fabrication process and a special packaging with a companion chip for integrating the accurate time discriminators on chip.
- the second reference (C. Niclass et al.) describes an array of single photon avalanche diodes (SPAD) operating in Geiger mode and integrated in a CMOS technology, thus allowing the integration of time-to-digital converters on a single chip.
- This solid-state sensor presents millimeter resolution over a distance of few meters using a very low power illumination source.
- both techniques require very fast laser diodes (DL) to generate pulses with sub-nanosecond duration.
- DL laser diodes
- a very narrow optical band-pass filter ought to be used.
- One of the aims of the present invention is also to propose pixel circuits and a sensor architecture used to precisely demodulate the incoming signal arriving on an image sensor chip.
- the invention consists in the use of avalanche photodiodes and demodulation circuits, preferably at pixel level, that enable the fabrication of high performance scannerless and solid-state rangefinders using a periodically modulated illumination without the need of any time-to-digital or time-to-amplitude converter.
- continuous modulated generally refers to any signal whose value is varying and continuously defined during the considered time interval, i.e. signals which are neither constant nor comprising Dirac pulses.
- continuous modulated signals include sinusoidal waves, square waves etc.
- photonic wave and the term “light” generally refer to any electromagnetic wave in the visible light, infrared and/or ultra-violet range.
- multiplexer refers to an electrical or opto-electronic switch with selection inputs controllable by either electrical or photonic signals.
- array designates any arrangement of elements in H rows and W columns, with H and W being integers greater or equal than 1.
- a single element for instance a single LED or a single photodiode, is considered as an array with 1 ⁇ 1 element.
- the length of the different rows/columns and the distance between the rows/columns may be uneven.
- Continuous modulation offers the advantage of using off-the-shelf and therefore low-cost components in the illumination sub-system. Compared to pulsed methods, a larger variety of light sources is available for this mode of operation as extremely fast rise and fall times are not required.
- An example of low-cost optical sources that can be used in the continuous modulation method is an array of light emitting diodes (LEDs).
- the phase difference between sent and reflected optical beam is measured, rather than directly measuring the round-trip time of a light beam pulse.
- the modulation frequency is known
- the phase measurement directly corresponds to the time of flight, the quantity of interest for range imaging.
- the use of a single modulation frequency is known as homodyne modulation/demodulation technique.
- the light reflected by an object in the scene is modulated in intensity and phase, where the phase modulation is caused by the object three-dimensional (3D) information.
- Demodulation of a reflected signal can be performed by synchronously sampling the signal at many different points within the modulated signal period. Since a perfect sampling method requires an infinite bandwidth, a practical method consists of (a) dividing the period of the modulated signal in several fractions and (b) accumulating the photocharges during each fraction independently over a very large number of modulation period cycles. The number of fractions (ND) within the modulation signal period should be carefully chosen since each fraction requires an independent storage device. For a practical implementation, an interesting ND is 4.
- the demodulated phase PHI, the amplitude A and the offset B can be found respectively by
- Equation ⁇ ⁇ 4 ⁇ ⁇ TD ⁇ F . Equation ⁇ ⁇ 5
- TD is the duration of the fraction of the period, and the factor ⁇ /[TD ⁇ Sin( ⁇ )] can be understood as amplitude measurement efficiency, practically below 1 due to the limited bandwidth used in the measurement of each value Ci.
- PHI gives a direct measurement of the object distance Z by
- the quantities A and B can also be very useful.
- the amplitude A holds the information regarding the level of accuracy for a given measurement of Z. For instance, if the storage devices used to hold the values ⁇ Ci ⁇ start saturating, A is decreased for that particular measurement. This information can be used in the system level to decide whether it can rely on that particular measurement or, otherwise, discard it, or whether a particular avalanche photodiode should be deactivated.
- the signal offset B can be used as an intensity measurement for each point of the object in addition to the distance measurement, thus enabling the generation of an intensity image of the object based on the same measurement data.
- Equations 1, 3, and 6 remain unchanged and TD should be replaced by TD′ in equations 2 and 5.
- FIG. 1 illustrates a rangefinder system
- FIG. 2 illustrates pixel building blocks
- FIG. 3 illustrates a multiplexer principle
- FIG. 4 illustrates a multiplexer waveform
- FIG. 5 illustrates an APD circuit operating in Geiger mode variant A
- FIG. 6 illustrates an APD circuit operating in Geiger mode variant B
- FIG. 7 illustrates an APD circuit operating in Geiger mode variant A with edge detection circuit
- FIG. 8 illustrates an APD circuit operating in Geiger mode variant B with edge detection circuit
- FIG. 9 illustrates a rising edge detection circuit
- FIG. 10 illustrates a falling edge detection circuit
- FIG. 11 illustrates a pixel circuitry according to the present invention
- FIG. 12 illustrates a waveform for the S signal within the pixel circuitry with respect to the illumination modulation
- FIG. 13 illustrates a variant of APD circuit comprising multiple avalanche photodiodes operating in Geiger mode
- FIG. 14 illustrates a waveform of multiplexer signals for the half integration time during which S is active.
- the present invention proposes a realization method of a solid-state rangefinder imager sensor comprising avalanche photodiodes (APD), and a continuous-modulated illumination scheme.
- APD avalanche photodiodes
- FIG. 1 illustrates an example of realization of an arrangement according to the present invention.
- the arrangement 10 includes a light source 20 , light source optics 30 used to create a cone of light 30 . 1 , a light source driver 40 , a controller 50 , a solid-state image sensor 60 comprising an array of pixels 70 based on avalanche photodiodes and an imaging lens 80 .
- the light source 20 based for example on an array of LEDs or DLs, emits a periodic continuous modulated optical signal with frequency F and duty cycle close to 50%.
- the light source optics usually an optical diffuser and/or a lens, creates a cone of light 30 . 1 that illuminates an object 90 in the scene. Different points of the object, such as 90 . 1 and 90 .
- the avalanche photodiodes in the sensor are preferably fabricated using at least two semiconductor p-n junctions.
- the active p-n junction for instance the one closest to the illuminated semiconductor surface, is reverse biased to forms the avalanche multiplication region.
- a collecting p-n junction for instance one of the remaining p-n junctions, collects all the charge carriers generated by the absorption of the reflected photonic wave in the semiconductor bulk, beyond the collecting p-n junction, so that the timing precision of the signal of the avalanche photodiode is not deteriorated by the diffusion time of the charge carriers generated beyond the collecting junction.
- the avalanche photodiode may coexist with low voltage transistors on a same integrated circuit.
- the collecting p-n junction allows the isolation of the avalanche photodiode so that one of its nodes can be biased to a relatively high voltage keeping the other node of the avalanche photodiode within a voltage level compatible with the low voltage transistors.
- the avalanche photodiodes thus preferably operate in so-called Geiger mode, although a functioning in linear mode is not excluded.
- the pixel circuit preferably comprises at least a quenching circuit used to lower the reverse bias voltage to quench the avalanche current, and preferably at least a recharge circuit that is used to increase the reverse bias voltage above the photodiode breakdown voltage such that it recovers its detection ability after a quenching phase, in an embodiment, the quenching circuit operates passively by means of a resistive electrical path consisting of at least one resistor and/or at least one transistor. Alternatively, the quenching circuit could operate in active quenching by dynamically lowering the reverse bias voltage of the avalanche photodiode by means of active devices such as metal-oxide-semiconductor (MOS) transistors.
- MOS metal-oxide-semiconductor
- the recharge circuit operates in passive recharge by increasing the reverse bias by means of resistive electrical path consisting of at least one resistor and/or at least one transistor.
- the recharge circuit could operate in active recharge by dynamically increasing the reverse bias voltage by means of active devices such as metal-oxide-semiconductor transistors.
- the demodulation principle is processed in the pixel level by (a) dividing the period of the modulated signal in ND fractions of period and (b) counting independently the number of photons falling on an APD during each fraction of period over a very large number of modulation period cycles.
- FIG. 2 presents a schematic diagram of the general pixel circuitry.
- the pixel consists of four building blocks: an APD circuit 110 , a multiplexer 150 , an optional storage device 170 and a readout circuit 190 .
- the APD circuit outputs a signal 140 that is connected to the common input of the multiplexer.
- the signal 140 can be either digital when the APD operates in Geiger mode or analogue when it operates in linear mode. In a preferred embodiment, the APD operates in Geiger mode enabling single photon detection and high time discrimination capability.
- the APD circuit 110 can be held in an inactive mode either by the storage device via 131 when its capacity is reached or by a global line 120 driven by the image sensor controller 50 .
- the multiplexer circuit 150 is used to demodulate the optical reflected signal.
- the multiplexer could possibly be implemented by means of any kind of analogue or digital switches and/or logic gates based either on n-channel MOS, on p-channel MOS, on both n-channel MOS and p-channel MOS transistors, on NPN bipolar transistors, on PNP bipolar transistors, or more generally, on any kind of electrical or opto-electronic device.
- FIG. 3 depicts the multiplexer principle wherein the number of period fractions N is 4.
- the input of the multiplexer 140 is exclusively connected to each output 160 depending on the value of its selection signals 210 .
- the remaining output connections remain in an inactive state when they are not selected by 210 .
- this inactive state can be a logic zero, a logic one, a low voltage level, a high voltage level or a zero current state.
- FIG. 4 shows an example of the waveforms of the selection signals S 1 , S 0 210 and output signals Q 0 , Q 1 , Q 2 , Q 3 160 of FIG. 3 as a function of the time t.
- an output address When an output address is selected by 210 , it reproduces the input value 140 of the multiplexer.
- the demodulation principle is achieved by dividing the light source modulation period in N fractions of period, and synchronously driving the selection signal of the multiplexer 210 such that each multiplexer output is connected to the input during at least one fraction of period per modulation cycle.
- the storage device 170 of FIG. 2 possesses N storage devices and N input signals 160 .
- An additional output signal 130 can be optionally used as a feedback signal to indicate that the maximum storage capacity has been reached.
- This feedback signal can be used either by the APD circuit 110 via 131 and/or by the multiplexer circuit 150 via 132 so that all the input signals 160 of the storage device remain inactive when at least one of the storage devices has reached its maximum storage capacity.
- the same feedback signal can be optionally transmitted to the pixel readout circuit 190 via an interface 180 so that it requests, in turn, an asynchronous or synchronous readout operation to the system controller 50 .
- the pixel readout circuit 190 of FIG. 2 is connected to the storage device 170 via a digital or analogue interface 180 and it is used to transmit the data or signal stored in the storage device to the system controller 50 via an output bus 200 .
- the readout operation can be performed serially and/or in parallel depending on the implementation. It can in addition be performed asynchronously or synchronously.
- the readout operation for a given pixel can be performed one or more times within a single integration time. In a preferred embodiment, the same pixel is read out many times within a single integration time so that the requirement on the storage device capacity can be eased, thus reducing the storage device size.
- FIG. 5 shows a configuration for the APD circuit whereby the APD signal stays compatible with the low voltage CMOS electronics.
- a quenching and recharge circuit 230 is required.
- the circuit 230 can optionally have an input 220 driven by 131 and/or 120 to stop the APD activity.
- the input 220 can be used, for instance, when the storage device 170 is full or the system is busy.
- the avalanche photodiode 240 operates in linear mode, the circuit 230 becomes a reset circuit. In this configuration, the cathode of the avalanche photodiode 240 stays always below the circuit power supply voltage V DD 260 .
- the element 270 represents the first electronic stage within the APD circuit. It is used to convert the APD signal to a voltage pulse or to a current pulse. Its output 280 represents the output 140 of 110 .
- FIG. 6 shows a second configuration for the APD circuit.
- the position of the avalanche photodiode 240 and of the reference 230 are exchanged.
- the advantage of this configuration is that no negative voltage is required and the APD signal can still be maintained below the voltage of the power supply.
- this configuration can help to decrease the APD parasitic capacitance when it is based on shallow p-type anode within an n-type well cathode.
- FIG. 7 and FIG. 8 depict respectively other embodiments of the circuits of FIG. 5 and FIG. 6 in which an additional element 290 (edge detection circuit) is added to reduce the voltage or current pulse duration.
- an additional element 290 edge detection circuit
- the function of the element 290 is to shorten the duration of the signal pulse so that it becomes very short as compared to TD, thus minimizing errors.
- FIG. 9 and FIG. 10 show two different implementations for the element 290 when the APD circuit signal is a digital voltage pulse. If the leading edge of the signal pulse is a rising edge, the circuit of FIG. 9 is used.
- This circuit consists of an input node 300 , an inverter gate 310 , a delay cell 320 , a AND gate 330 , and the APD circuit output signal 280 .
- An example of waveform for the input node 300 and for the output signal 280 is shown in FIG. 9 . If the leading edge of the signal pulse is a falling edge, the circuit of FIG. 10 can be used instead. In this circuit, the AND gate 330 is replaced by a NOR gate 340 . An example of waveform for the signals 300 and 280 is also shown in FIG. 10 .
- a comparator in order to detect the leading edge of a digital voltage pulse at the output of the avalanche photodiode, one connects one node of the avalanche photodiode to a comparator.
- comparator being for example an analogue comparator or a logic gate such as a digital inverter
- FIG. 11 shows a complete pixel circuit according to the present invention wherein reference 110 is for instance the circuit of FIG. 6 operating in Geiger mode.
- the multiplexer 150 has two channels.
- the multiplexer is designed in such way to hold its selection signal when the signal in 140 is active. This mechanism prevents the signal, a digital pulse in this particular case, from appearing on both outputs of the multiplexer (Q 0 and Q 1 ) if the selection signal 210 changes during the digital pulse duration.
- FIG. 14 shows an example of waveform of the signals of a multiplexer implementing such mechanism. As can be seen, at the moment of photon detection, depending on the state of the selection signal 210 , either Q 0 or Q 1 reproduces the digital pulse triggered by the photon.
- the storage device 170 consists in this example of two digital counters 400 and 410 .
- the counters are only sensitive to the leading edge of the digital pulse appearing on their input. In this configuration, only two different fractions of period ⁇ Ci ⁇ are sampled and stored simultaneously. In order to compute all four ⁇ Ci ⁇ where i can be 0, 1, 2 and 3, corresponding to each fraction of a period modulation cycle, the full integration time is divided in two halves, corresponding to two fractions of the integration time.
- the period P of the optical wave has a duration of less than a few microseconds, preferably a duration of a few nanoseconds, for example 50 ns.
- the integration time has preferably a duration of at least a few microseconds, preferably at least a few milliseconds, possibly 33 ms.
- FIG. 12 presents an example of waveform for optical power of the modulated illumination system and the waveform of the corresponding selection signal 210 of the multiplexer.
- the selection signal is S and it operates at the illumination modulation frequency F.
- the fractions of period C 0 and C 2 corresponding to the phases ⁇ 0 and ⁇ 180 are stored.
- the select signal 210 becomes S′ and it has a phase shift of 90 degrees with respect to S of the previous HIT.
- the remaining fractions of period C 1 and C 3 corresponding to the phases ⁇ 90 and ⁇ 270 are stored.
- the pixel readout circuit 190 When the total capacity of one of the counters is reached, its overflow signal 130 is used through a logic gate 420 to stop the APD circuit or deactivate the multiplexer outputs until the end of the next readout phase. After the readout phase, the pixel readout circuit 190 resets both counters and the APD circuit starts operating normally.
- the integration time can be further divided into an even number of interlaced intervals larger than two. The method consists then in using all the odd intervals of the integration time to form the first fraction of integration time, i.e. the first HIT and all the even intervals to form the second fraction of integration time (second HIT). The total duration of all intervals is the integration time.
- a total integration time of lets assume, 33 ms, is divided into 10 intervals of 3.3 ms each.
- the output of the multiplexer 150 is added into the counters c 0 /c 2 depending on the fraction of the period.
- the output of the multiplexer 150 is added into the counters c 1 /c 3 depending on the fraction of the period.
- FIG. 13 depicts an APD circuit in which two APDs are used.
- Each APD 240 is connected to its own biasing circuit, in this example a quenching/recharge circuit 230 , and its own first electronics stage 270 .
- the output of their first stage electronics are combined together via a logic circuit 500 when the APDs are operating in Geiger mode, in this example an OR gate, or via an analogue current adder stage, e.g. a simple node, when they are operating in linear mode.
- the number of APDs combined within a single pixel can be increased to more than two and that the logic circuit 500 can be any logic gate or any combination of them.
- An interesting aspect of this method is the fact that one or more combined APDs can be temporarily deactivated via their bias circuit 220 depending on the amount of signal the rangefinder receives.
- their photodetectors tend to saturate due to large amount of light reflected, thus limiting the measurement accuracy.
- One trivial solution to this problem is to lower the sensitivity of the pixel's photodetector by changing its operating condition, e.g. its bias voltage, or reducing the time during which the pixel's photodetector is sensitive to light.
- one or more APDs can be completely turned off within an individual pixel, within a set of pixels or within all pixels, thus increasing the dynamic range in the high end.
- the same principle can be additionally used to reduce the effects of pixels that have higher noise and/or present defects. For instance, when a particular pixel composed of two APDs and one APD suffers too much from dark current in linear mode or dark counts in Geiger mode, or from high noise, or from any other defects, it can be switched off and the signal of the remaining APD(s) within the pixel could be adapted in the system level to compensate for the APD that is not operating properly.
- This method is especially interesting to increase the fabrication yield, by increasing the number of acceptable integrated circuits, when a standard and large scale IC fabrication process that is not optimized for image sensor is used.
- Parts or the totality of the avalanche photodiodes can be switched off permanently, for example by programming some elements of the corresponding circuit or via laser trimming for instance.
- parts or the totality of the avalanche photodiodes can be switched off permanently or temporarily, for example with a single command, and/or by writing a value in a memory element such as, but to restricted to, a digital latch or a digital flip-flop associated with one or several pixels.
- the photonic wave of interest can be additionally focused into the light sensitive area of the pixels, that is to say, into the centre of the avalanche photodiodes, by means of integrated optics such as microlenses.
- This technique known in the art for conventional image sensors, is particularly advantageous so as to improve photon collection preventing said photonic wave to fall on the light insensitive area of the pixel and possibly to disturb components on those areas.
- the proposed arrangement enables the detection, simultaneously or separately, of the intensity of the photonic wave.
- Said light intensity provides greyscale image of the target photonic wave.
- usual colour filters such as, but not restricted to, Red, Green and Blue, or infrared filters, can be used to generate, simultaneously or separately, colour intensity images and/or distance map images.
- a small portion of the illumination power 30 . 1 is collected by means of an optic component and is used as a reference signal to modulate the input 210 of multiplexer 150 .
- the collection of a portion of the illumination power can be done, but not restricted to, by means of a lens, an optical coupler, optic fibre or any combination of them.
- the use of such reference signal coming from the illumination power may be used for generating a compensation signal and for cancelling the effects of timing and/or amplitude shifts or timing jitter at the light source 20 due to external parameters such as temperature or any other environment factor.
- Said reference signal can be used in the form of photonic wave when multiplexer 150 is at least partially made of opto-electronic components such as, but not restricted to, phototransistors.
- Said reference signal can be alternatively converted to an electrical signal and used to modulate the input 150 of said multiplexer 150 . This conversion can be achieved by means of any kind of photodetectors including avalanche photodiodes.
- the pixel is exposed to the received photonic wave via an imaging lens, and the APDs within a pixel are arranged such that their distance is smaller than half of the spatial resolution of the imaging lens.
- the senor is thus composed of an array of pixels, and each pixel is composed of at least one avalanche photodiode and one circuit for processing signals output by the avalanche photodiode.
- the avalanche photodiodes and the corresponding circuit are both arranged in matrix form on a monolithic substrate, preferably on a single CMOS sensor.
- avalanche photodiodes may however be possible to share one circuit, or some elements of the circuit, by several avalanche photodiodes.
- a single multiplexer a single set of storage devices and/or a single read-out circuit for several avalanche photodiodes in a sub-array, or for all avalanche photodiodes in a row and/or in a column.
- the invention relates to solid-state sensors comprising zero, one or two dimensional array of avalanche photodiodes, i.e. also to arrays comprising a single row of pixel, single column, single pixel, up to arrays with hundreds or even thousands of rows and columns of pixels.
- the frequency used for the modulation of the photonic source may be constant or predefined, or changed at any time. It may be possible for example to select a higher frequency when a high resolution is required, and a lower frequency when a lower resolution is sufficient, or when it is possible to perform a better interpolation within a period of the signal.
- the frequency is changed or swept between several measures of a single scene. In this case, the high frequency may be used in order to benefit from the highest possible resolution, whereas a lower frequency will be used for phase unwrapping and to prevent the 2 ⁇ -phase ambiguity.
- each apparatus is located in such way their photonic signals do not interact with each other, thereby preventing any interference effect. Even thought this technique is simple and effective, in some applications, especially when at least one of the proposed arrangements is moving, such spatial separation cannot be guaranteed. In such cases, more sophisticated techniques such as TDMA, WDMA, FDMA, or CDMA ought to be used.
- TDMA is performed by assigning a timeslot for each arrangement of the system during which only one arrangement actively generates its photonic illumination, the remaining arrangements in the multi-camera environment being in inactive state or performing tasks with non-use of photonic illumination.
- TDMA requires that all the apparatuses in the environment work synchronously and possibly having a master arrangement that controls the timeslots and synchronization.
- TDMA restricts the amount of effective time an arrangement operates; it reduces the measurement rate and/or reduces the performance of each apparatus.
- each arrangement in the environment emits photonic waves with a unique wavelength.
- such wavelength is sufficiently spaced in the electromagnetic spectrum from any wavelength assigned to any other apparatus in the environment.
- optical filters chosen accordingly to assigned wavelengths, one can prevent the photonic wave of a given arrangement to reach the photosensitive area of a neighbour arrangement, thus preventing interference.
- an arrangement namely A700, could be equipped with a light source emitting at 700 nm and all the remaining arrangements could be equipped with light sources emitting at wavelengths below 675 nm or above 725 nm.
- an optical band-pass filter such as interference optical filters, centred at 700 nm and with a bandwidth smaller than 50 nm could be used with arrangement A700 preventing the photonic waves of the remaining arrangements to reach its photosensitive area.
- the total range of photonic modulation bandwidth is divided into a number of discrete frequencies.
- Each frequency is assigned to each individual arrangement in the multi-camera context and it is used to modulate said selection input 210 of multiplexer 150 as well as light source 20 .
- the external photonic wave corresponding to a different frequency is averaged and contributes uniformly into all the accumulated values ⁇ Ci ⁇ . Consequently, the external photonic waves corresponding to different frequencies do not contribute to the phase measurement at the assigned frequency.
- This averaging effect is particular effective when the number of modulation periods, and consequently the integration time, is increased.
- the assignment of discrete frequencies to each arrangement may be achieved by many different means.
- each arrangement could have a permanent and unique frequency or a temporary frequency assigned in real time depending on the availability of non-used frequencies at a given multiple-camera context.
- the assignment and modification of frequencies can be achieved extremely fast, especially when proposed arrangement is mounted on a moving vehicle and can randomly interact to a number of different similar arrangements or different sources of modulated photonic waves.
- real time measurement of the phase PHI, amplitude A, and/or the offset B may be used to evaluate frequency slots availability by, for example, deterministically or randomly scanning a number of possible frequencies.
- Other communication means available between different arrangements such as, but not restricted to, wired electrical signal, infrared and/or radio-frequency can also be used in the process of frequency selection and distribution.
- FDMA frequency sweep
- each arrangement can use a different frequency during sub-intervals of the total integration time.
- the use of a pseudo-random sequence of frequencies by each arrangement would for example restrain other arrangements to operate at the same frequency over an extend amount of time.
- Continuous frequency sweeping modulation is also known in the art as chirp modulation.
- the actual implementation of FDMA can require frequency synthesizer circuits that can be monolithically implemented on the same integrated circuit as the proposed arrangement. Examples of frequency synthesizer known in the art are phase locked loops and delay locked loops.
- CDMA implies the use of modulation waveforms that are orthogonal with respect to the demodulation process.
- Each arrangement operating in the multiple-camera context uses an individual waveform, or simply a code, in such way that, during the process of demodulation, parasitic photonic signals emitted from other arrangements do not interfere with the phase measurement. This characteristic is obtained by the orthogonality property of selected waveforms.
- These waveforms can be used in the proposed arrangement to modulate said selection input 210 of multiplexer 150 as well as light source 20 .
- An example of modulation waveform based on CDMA that is applicable to the present invention is pseudo noise optical modulation.
- Pseudo random sequences can be effectively generated by a number of analogue or digital circuits know in the art, suitable to be monolithically integrated with the proposed arrangement.
- An example of such circuits is the linear feedback shift register circuit.
- Another advantageous property of proposed invention is the possible use of digital waveforms, or codes, to modulate said selection input 210 of multiplexer 150 as well as light source 20 .
- Other analogue or digital modulations schemes based on orthogonal waveforms and/or on modifications of the modulation frequency may be used.
- the described arrangement can also be used within the frame of the invention for other purposes than measuring the distance of an object, for example for measuring its speed or acceleration, or also for determining the lifespan of a fluorophore attached to a given molecule under investigation by means of the phase of a photonic wave received by the avalanche photodiode.
- the lifespan can be recorded independently and in parallel for all pixels in a lifetime imaging experiment.
- the fluorophore and/or surrounding molecules can be identified and/or analyzed on filterless experiments such as a lab-on-chip or on microscopy based experiments such as FLIM.
- the described arrangement can be used in any application or experiment involving the measurement of the phase and/or amplitude of a photonic wave. Examples of such applications can be found in the art and, in particular, in utility patent U.S. Pat. No. 6,825,455.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
-
- a photonic source for illuminating said object using a continuous modulated photonic wave,
- a solid-state image sensor, comprising an array of avalanche photodiodes and a plurality of circuits for processing signals output by said avalanche photodiodes to yield data depending on the photonic wave reflected by said object onto said photodiodes.
Description
-
- a photonic source for illuminating said object using a modulated photonic wave,
- a solid-state image sensor, comprising a zero, one or two dimensional array of avalanche photodiodes and a plurality of circuits for processing signals output by said avalanche photodiodes to yield data depending on the photonic wave reflected by said object onto said photodiodes.
where F is the modulation frequency,
Claims (35)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/641,965 US8355117B2 (en) | 2005-12-21 | 2006-12-20 | Method and arrangement for measuring the distance to an object |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US75202705P | 2005-12-21 | 2005-12-21 | |
US11/641,965 US8355117B2 (en) | 2005-12-21 | 2006-12-20 | Method and arrangement for measuring the distance to an object |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070182949A1 US20070182949A1 (en) | 2007-08-09 |
US8355117B2 true US8355117B2 (en) | 2013-01-15 |
Family
ID=38333724
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/641,965 Expired - Fee Related US8355117B2 (en) | 2005-12-21 | 2006-12-20 | Method and arrangement for measuring the distance to an object |
Country Status (1)
Country | Link |
---|---|
US (1) | US8355117B2 (en) |
Cited By (77)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120133921A1 (en) * | 2010-11-30 | 2012-05-31 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (spad) |
US20130300838A1 (en) * | 2010-12-23 | 2013-11-14 | Fastree3D S.A. | Methods and devices for generating a representation of a 3d scene at very high speed |
US9058081B2 (en) | 2010-11-30 | 2015-06-16 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (SPAD) |
US20160014393A1 (en) * | 2014-07-09 | 2016-01-14 | Massachusetts Institute Of Technology | Methods and Apparatus for Virtual Sensor Array |
US9238393B2 (en) | 2011-09-14 | 2016-01-19 | Stmicroelectronics (Research & Development) Limited | System and method for monitoring vibration isolators |
US9537956B1 (en) * | 2015-12-11 | 2017-01-03 | Uber Technologies, Inc. | System for acquiring time-synchronized sensor data |
US9568620B2 (en) | 2014-09-22 | 2017-02-14 | General Electric Company | Solid state photomultiplier |
US9596666B1 (en) | 2015-12-11 | 2017-03-14 | Uber Technologies, Inc. | System for processing asynchronous sensor data |
US20170199272A1 (en) * | 2014-07-03 | 2017-07-13 | Sharp Kabushiki Kaisha | Optical reflection sensor and electronic device |
US9735539B2 (en) | 2015-07-20 | 2017-08-15 | Apple Inc. | VCSEL structure with embedded heat sink |
US9785150B2 (en) | 2015-12-11 | 2017-10-10 | Uber Technologies, Inc. | Formatting sensor data for use in autonomous vehicle communications platform |
US9819144B2 (en) | 2015-05-14 | 2017-11-14 | Apple Inc. | High-efficiency vertical emitters with improved heat sinking |
US9866816B2 (en) | 2016-03-03 | 2018-01-09 | 4D Intellectual Properties, Llc | Methods and apparatus for an active pulsed 4D camera for image acquisition and analysis |
US9874693B2 (en) | 2015-06-10 | 2018-01-23 | The Research Foundation For The State University Of New York | Method and structure for integrating photonics with CMOs |
US9997551B2 (en) | 2015-12-20 | 2018-06-12 | Apple Inc. | Spad array with pixel-level bias control |
US20180180473A1 (en) * | 2016-12-22 | 2018-06-28 | Sick Ag | Light Receiver Having a Plurality of Avalanche Photodiode Elements and Method for Supplying a Bias Voltage |
US10034375B2 (en) | 2015-05-21 | 2018-07-24 | Apple Inc. | Circuit substrate with embedded heat sink |
US10036801B2 (en) | 2015-03-05 | 2018-07-31 | Big Sky Financial Corporation | Methods and apparatus for increased precision and improved range in a multiple detector LiDAR array |
CN108445502A (en) * | 2018-02-11 | 2018-08-24 | 余晓智 | A kind of TOF modules and its implementation based on ARM and LINUX |
US10073177B2 (en) * | 2014-11-14 | 2018-09-11 | Massachusetts Institute Of Technology | Methods and apparatus for phased array imaging |
US10085310B2 (en) | 2010-11-30 | 2018-09-25 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (SPAD) |
US10101747B2 (en) | 2015-12-11 | 2018-10-16 | Uber Technologies, Inc. | Formatting sensor data for use in autonomous vehicle communications platform |
US10114103B2 (en) | 2016-03-31 | 2018-10-30 | Uber Technologies, Inc. | System and method for sensor triggering for synchronized operation |
US20180364355A1 (en) * | 2016-10-31 | 2018-12-20 | Gerard Dirk Smits | Fast scanning lidar with dynamic voxel probing |
US10190983B2 (en) | 2016-04-15 | 2019-01-29 | Massachusetts Institute Of Technology | Methods and apparatus for fluorescence lifetime imaging with pulsed light |
US10203399B2 (en) | 2013-11-12 | 2019-02-12 | Big Sky Financial Corporation | Methods and apparatus for array based LiDAR systems with reduced interference |
US10263032B2 (en) | 2013-03-04 | 2019-04-16 | Apple, Inc. | Photodiode with different electric potential regions for image sensors |
US10285626B1 (en) | 2014-02-14 | 2019-05-14 | Apple Inc. | Activity identification using an optical heart rate monitor |
US10324171B2 (en) | 2015-12-20 | 2019-06-18 | Apple Inc. | Light detection and ranging sensor |
US10397546B2 (en) | 2015-09-30 | 2019-08-27 | Microsoft Technology Licensing, Llc | Range imaging |
US10440301B2 (en) | 2017-09-08 | 2019-10-08 | Apple Inc. | Image capture device, pixel, and method providing improved phase detection auto-focus performance |
US10438987B2 (en) | 2016-09-23 | 2019-10-08 | Apple Inc. | Stacked backside illuminated SPAD array |
US10462452B2 (en) | 2016-03-16 | 2019-10-29 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
US10477149B2 (en) | 2016-01-20 | 2019-11-12 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US10473921B2 (en) | 2017-05-10 | 2019-11-12 | Gerard Dirk Smits | Scan mirror systems and methods |
US10482559B2 (en) | 2016-11-11 | 2019-11-19 | Uatc, Llc | Personalizing ride experience based on contextual ride usage data |
US10502815B2 (en) | 2015-12-18 | 2019-12-10 | Gerard Dirk Smits | Real time position sensing of objects |
US10523923B2 (en) | 2015-12-28 | 2019-12-31 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
US10527728B2 (en) * | 2017-01-27 | 2020-01-07 | Samsung Electronics Co., Ltd | Apparatus and method for range measurement |
US10564284B2 (en) | 2016-12-27 | 2020-02-18 | Gerard Dirk Smits | Systems and methods for machine perception |
US10585175B2 (en) | 2014-04-11 | 2020-03-10 | Big Sky Financial Corporation | Methods and apparatus for object detection and identification in a multiple detector lidar array |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10609348B2 (en) | 2014-05-30 | 2020-03-31 | Apple Inc. | Pixel binning in an image sensor |
US10622538B2 (en) | 2017-07-18 | 2020-04-14 | Apple Inc. | Techniques for providing a haptic output and sensing a haptic input using a piezoelectric body |
US10620300B2 (en) | 2015-08-20 | 2020-04-14 | Apple Inc. | SPAD array with gated histogram construction |
US10656251B1 (en) | 2017-01-25 | 2020-05-19 | Apple Inc. | Signal acquisition in a SPAD detector |
US10725177B2 (en) | 2018-01-29 | 2020-07-28 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US10801886B2 (en) | 2017-01-25 | 2020-10-13 | Apple Inc. | SPAD detector having modulated sensitivity |
US10830879B2 (en) | 2017-06-29 | 2020-11-10 | Apple Inc. | Time-of-flight depth mapping with parallax compensation |
US10848693B2 (en) | 2018-07-18 | 2020-11-24 | Apple Inc. | Image flare detection using asymmetric pixels |
US10881028B1 (en) | 2019-07-03 | 2020-12-29 | Apple Inc. | Efficient heat removal from electronic modules |
US10943935B2 (en) | 2013-03-06 | 2021-03-09 | Apple Inc. | Methods for transferring charge in an image sensor |
US10955552B2 (en) | 2017-09-27 | 2021-03-23 | Apple Inc. | Waveform design for a LiDAR system with closely-spaced pulses |
US10955234B2 (en) | 2019-02-11 | 2021-03-23 | Apple Inc. | Calibration of depth sensing using a sparse array of pulsed beams |
US10962867B2 (en) | 2007-10-10 | 2021-03-30 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US10962628B1 (en) | 2017-01-26 | 2021-03-30 | Apple Inc. | Spatial temporal weighting in a SPAD detector |
US20210133992A1 (en) * | 2019-10-31 | 2021-05-06 | Stmicroelectronics (Research & Development) Limited | Depth map sensor with bin rotation |
US11019294B2 (en) | 2018-07-18 | 2021-05-25 | Apple Inc. | Seamless readout mode transitions in image sensors |
US20210302552A1 (en) * | 2017-09-29 | 2021-09-30 | Sony Semiconductor Solutions Corporation | Time measurement device and time measurement unit |
US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US11233966B1 (en) | 2018-11-29 | 2022-01-25 | Apple Inc. | Breakdown voltage monitoring for avalanche diodes |
RU212795U1 (en) * | 2021-03-29 | 2022-08-09 | Открытое Акционерное Общество "Пеленг" | LASER RANGEFINDER |
US11476372B1 (en) | 2020-05-13 | 2022-10-18 | Apple Inc. | SPAD-based photon detectors with multi-phase sampling TDCs |
US11500094B2 (en) | 2019-06-10 | 2022-11-15 | Apple Inc. | Selection of pulse repetition intervals for sensing time of flight |
US11555900B1 (en) | 2019-07-17 | 2023-01-17 | Apple Inc. | LiDAR system with enhanced area coverage |
WO2023038417A1 (en) * | 2021-09-08 | 2023-03-16 | 주식회사 솔리드뷰 | Flash lidar sensor using zoom histogramming tdc |
US11681028B2 (en) | 2021-07-18 | 2023-06-20 | Apple Inc. | Close-range measurement of time of flight using parallax shift |
US11699715B1 (en) | 2020-09-06 | 2023-07-11 | Apple Inc. | Flip-chip mounting of optoelectronic chips |
US11710945B2 (en) | 2020-05-25 | 2023-07-25 | Apple Inc. | Projection of patterned and flood illumination |
US11725935B2 (en) * | 2017-07-31 | 2023-08-15 | Hexagon Technology Center Gmbh | Distance meter comprising SPAD arrangement for consideration of multiple targets |
US11733359B2 (en) | 2019-12-03 | 2023-08-22 | Apple Inc. | Configurable array of single-photon detectors |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
US11852727B2 (en) | 2017-12-18 | 2023-12-26 | Apple Inc. | Time-of-flight sensing using an addressable array of emitters |
US11982566B2 (en) | 2019-03-29 | 2024-05-14 | Ecole Polytechnique Federale De Lausanne (Epfl) | System, device, and method for quantum correlation measurement with single photon avalanche diode arrays |
US12025807B2 (en) | 2010-10-04 | 2024-07-02 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
US12123589B1 (en) | 2023-05-22 | 2024-10-22 | Apple Inc. | Flood projector with microlens array |
US12196860B2 (en) | 2021-03-02 | 2025-01-14 | Apple Inc. | Depth sensor calibration using internal reflections |
Families Citing this family (111)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008011617A2 (en) * | 2006-07-21 | 2008-01-24 | The Regents Of The University Of California | Shallow-trench-isolation (sti)-bounded single-photon avalanche photodetectors |
DE202007018027U1 (en) * | 2007-01-31 | 2008-04-17 | Richard Wolf Gmbh | endoscope system |
US7675610B2 (en) * | 2007-04-05 | 2010-03-09 | The United States Of America As Represented By The Secretary Of The Army | Photon counting, chirped AM LADAR system and related methods |
JP5019117B2 (en) * | 2007-11-14 | 2012-09-05 | スタンレー電気株式会社 | Distance image generator |
CN102027388B (en) * | 2008-04-11 | 2013-08-28 | 瑞士联邦理工大学,洛桑(Epfl) | Time-of-flight based imaging system using a display as illumination source |
EP2359593B1 (en) * | 2008-11-25 | 2018-06-06 | Tetravue, Inc. | Systems and methods of high resolution three-dimensional imaging |
US8519340B2 (en) | 2008-12-22 | 2013-08-27 | Koninklijke Philips N.V. | High dynamic range light sensor |
DE102009029364A1 (en) * | 2009-09-11 | 2011-03-24 | Robert Bosch Gmbh | Measuring device for measuring a distance between the measuring device and a target object by means of optical measuring radiation |
DE102009029372A1 (en) * | 2009-09-11 | 2011-03-24 | Robert Bosch Gmbh | Measuring device for measuring a distance between the measuring device and a target object by means of optical measuring radiation |
DE102009029376A1 (en) * | 2009-09-11 | 2011-05-12 | Robert Bosch Gmbh | Photon detector with paralyzable photon-sensitive element, in particular SPAD, as well as distance measuring device with such a photon detector |
DE102009045323A1 (en) * | 2009-10-05 | 2011-04-07 | Robert Bosch Gmbh | Optical distance measuring device with calibration device |
EP2536335A1 (en) * | 2010-02-19 | 2012-12-26 | Glysure Ltd | Intravascular glucose sensor |
US8426797B2 (en) * | 2010-03-23 | 2013-04-23 | Massachusetts Institute Of Technology | CMOS readout architecture and method for photon-counting arrays |
JP2011199798A (en) * | 2010-03-24 | 2011-10-06 | Sony Corp | Physical information obtaining apparatus, solid-state imaging apparatus, and physical information obtaining method |
DE102010003409B4 (en) * | 2010-03-29 | 2022-06-09 | pmdtechnologies ag | Time of flight camera |
DE102010003843A1 (en) | 2010-04-12 | 2011-10-13 | Robert Bosch Gmbh | Distance measuring device with homogenizing measurement evaluation |
DE102010039295A1 (en) | 2010-08-13 | 2012-02-16 | Robert Bosch Gmbh | Equipment for optically measuring distance of target object, has evaluation device that separately evaluates even and odd harmonics of detection signal of receiving unit over total measuring time |
CN102375973B (en) * | 2010-08-24 | 2013-04-03 | 汉王科技股份有限公司 | Face recognition method and system, and infrared back light compensation method and system |
JP5644294B2 (en) * | 2010-09-10 | 2014-12-24 | 株式会社豊田中央研究所 | Photodetector |
WO2012054231A2 (en) | 2010-10-04 | 2012-04-26 | Gerard Dirk Smits | System and method for 3-d projection and enhancements for interactivity |
US9857469B2 (en) | 2010-10-22 | 2018-01-02 | Heptagon Micro Optics Pte. Ltd. | System and method for multi TOF camera operation using phase hopping |
US9066087B2 (en) * | 2010-11-19 | 2015-06-23 | Apple Inc. | Depth mapping using time-coded illumination |
GB2485991A (en) * | 2010-11-30 | 2012-06-06 | St Microelectronics Res & Dev | Camera using a Single Photon Avalanche Diode (SPAD) array |
GB2485990A (en) * | 2010-11-30 | 2012-06-06 | St Microelectronics Res & Dev | An optical user-input device using SPADs |
GB201020282D0 (en) * | 2010-11-30 | 2011-01-12 | Dev Ltd | An improved input device and associated method |
GB2485995B (en) | 2010-11-30 | 2014-01-01 | St Microelectronics Res & Dev | Improved proximity sensor and associated method, computer readable medium and firmware |
EP2469294A1 (en) * | 2010-12-23 | 2012-06-27 | André Borowski | 2D/3D real-time imager and corresponding imaging methods |
EP2469295A1 (en) * | 2010-12-23 | 2012-06-27 | André Borowski | 3D landscape real-time imager and corresponding imaging methods |
US8599363B2 (en) | 2011-04-06 | 2013-12-03 | GM Global Technology Operations LLC | Method and apparatus for an object detection system using two modulated light sources |
US8976340B2 (en) * | 2011-04-15 | 2015-03-10 | Advanced Scientific Concepts, Inc. | Ladar sensor for landing, docking and approach |
DE102011107645A1 (en) | 2011-07-12 | 2013-01-17 | Leica Microsystems Cms Gmbh | Apparatus and method for detecting light |
DE102011081567B4 (en) | 2011-08-25 | 2023-08-31 | pmdtechnologies ag | Receiver for an optical range finder |
KR101797014B1 (en) | 2011-09-14 | 2017-11-14 | 삼성전자주식회사 | Unit pixel of a three-dimensional image sensor |
EP2594959B1 (en) * | 2011-11-17 | 2017-01-04 | Heptagon Micro Optics Pte. Ltd. | System and method for multi TOF camera operation using phase hopping |
CN102636259B (en) * | 2012-04-25 | 2014-11-26 | 清华大学 | Multi-aperture optical signal detection system and method |
WO2014025428A2 (en) * | 2012-05-12 | 2014-02-13 | Van Cruyningen Izak Jan | Light ranging with moving sensor array |
JP6225411B2 (en) * | 2012-10-16 | 2017-11-08 | 株式会社豊田中央研究所 | Optical distance measuring device |
DE102012223689B3 (en) * | 2012-12-19 | 2014-01-02 | Robert Bosch Gmbh | Measuring device for use in laser rangefinder for determining distance to target object, has receiving devices including detector units and time measuring units, which are selectively connected with detector units |
US9300458B2 (en) * | 2013-02-05 | 2016-03-29 | Cable Television Laboratories, Inc. | Transmission opportunity scheduling |
GB2510891A (en) * | 2013-02-18 | 2014-08-20 | St Microelectronics Res & Dev | Apparatus |
FR3002329A1 (en) | 2013-02-20 | 2014-08-22 | St Microelectronics Grenoble 2 | PROXIMITY SENSOR |
CN103424748B (en) * | 2013-08-31 | 2015-02-11 | 王敏 | Photosensitive constant-current capacitance integration area array distance sensor |
RU2539773C1 (en) * | 2013-09-11 | 2015-01-27 | Открытое акционерное общество "Научно-исследовательский институт "Полюс" им. М.Ф. Стельмаха" (ОАО "НИИ "Полюс" им. М.Ф. Стельмаха") | Laser target-range finder |
US10132626B2 (en) * | 2013-09-18 | 2018-11-20 | Infineon Technologies Ag | Adaptive distance estimation |
JP6285168B2 (en) * | 2013-12-17 | 2018-02-28 | 株式会社デンソー | Radar equipment |
JP6312420B2 (en) * | 2013-12-20 | 2018-04-18 | スタンレー電気株式会社 | Distance image generator |
IL230517A0 (en) * | 2014-01-19 | 2014-04-30 | Mantisvision Ltd | Synchronizing 3d imaging devices |
WO2015149027A1 (en) | 2014-03-28 | 2015-10-01 | Gerard Dirk Smits | Smart head-mounted projection system |
KR102409952B1 (en) * | 2014-04-07 | 2022-06-17 | 삼성전자주식회사 | High resolution, high frame rate, low power image sensor |
US9785824B2 (en) * | 2014-04-15 | 2017-10-10 | Infineon Technologies Ag | Apparatus and a method for detecting a motion of an object in a target space |
DE102014209375A1 (en) | 2014-05-16 | 2015-11-19 | Robert Bosch Gmbh | Multi-target laser rangefinder |
JP6465382B2 (en) * | 2014-10-02 | 2019-02-06 | 株式会社リコー | Object detection device and sensing device |
EP3029494A1 (en) * | 2014-12-02 | 2016-06-08 | Sick Ag | Optoelectronic sensor |
WO2016168378A1 (en) | 2015-04-13 | 2016-10-20 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
US9450007B1 (en) | 2015-05-28 | 2016-09-20 | Stmicroelectronics S.R.L. | Integrated circuit with reflective material in trenches and related methods |
US10591592B2 (en) | 2015-06-15 | 2020-03-17 | Humatics Corporation | High-precision time of flight measurement systems |
US10422870B2 (en) | 2015-06-15 | 2019-09-24 | Humatics Corporation | High precision time of flight measurement system for industrial automation |
CN107949766A (en) * | 2015-06-15 | 2018-04-20 | 修麦提克斯公司 | High-precision time-of-flight measurement system |
GB201511551D0 (en) | 2015-07-01 | 2015-08-12 | St Microelectronics Res & Dev | Photonics device |
WO2017004663A1 (en) | 2015-07-08 | 2017-01-12 | The Commonwealth Of Australia | Spad array structures and methods of operation |
US10557939B2 (en) | 2015-10-19 | 2020-02-11 | Luminar Technologies, Inc. | Lidar system with improved signal-to-noise ratio in the presence of solar background noise |
US10942261B2 (en) | 2015-10-21 | 2021-03-09 | Samsung Electronics Co., Ltd | Apparatus for and method of range sensor based on direct time-of-flight and triangulation |
US10488496B2 (en) | 2015-11-05 | 2019-11-26 | Luminar Technologies, Inc. | Lidar system with improved scanning speed for high-resolution depth mapping |
WO2017095817A1 (en) | 2015-11-30 | 2017-06-08 | Luminar Technologies, Inc. | Lidar system with distributed laser and multiple sensor heads and pulsed laser for lidar system |
US10708577B2 (en) * | 2015-12-16 | 2020-07-07 | Facebook Technologies, Llc | Range-gated depth camera assembly |
CA3008650A1 (en) | 2015-12-17 | 2017-06-22 | Humatics Corporation | Radio-frequency localization techniques and associated systems, devices, and methods |
US10191154B2 (en) | 2016-02-11 | 2019-01-29 | Massachusetts Institute Of Technology | Methods and apparatus for time-of-flight imaging |
US20170351336A1 (en) * | 2016-06-07 | 2017-12-07 | Stmicroelectronics, Inc. | Time of flight based gesture control devices, systems and methods |
DE102016111225A1 (en) * | 2016-06-20 | 2017-12-21 | Sick Ag | Distance measuring optoelectronic sensor and method for detecting and determining the distance of an object |
US10598783B2 (en) | 2016-07-07 | 2020-03-24 | Microsoft Technology Licensing, Llc | Multi-frequency unwrapping |
US10495736B2 (en) | 2016-08-04 | 2019-12-03 | Stmicroelectronics (Research & Development) Limited | Single SPAD array ranging system |
JP6730150B2 (en) | 2016-09-16 | 2020-07-29 | 株式会社東芝 | Photodetector and distance measuring device |
US10436910B2 (en) * | 2016-09-20 | 2019-10-08 | Apple Inc. | Line scan depth sensor comparing a time dependent waveform of the signals to an expected waveform |
EP3316497B1 (en) * | 2016-10-26 | 2019-10-16 | STMicroelectronics (Research & Development) Limited | A single photon avalanche diode module for communications |
US10557965B2 (en) * | 2016-12-02 | 2020-02-11 | Stmicroelectronics (Grenoble 2) Sas | Device, system, and method for detecting human presence |
EP3339887B1 (en) * | 2016-12-22 | 2019-04-03 | Sick AG | Light receiving device with a plurality of avalanche photodiodes and method for light detection |
EP3339820B1 (en) * | 2016-12-22 | 2018-12-12 | Sick AG | Light receiver and a method for reading out avalanche photodiodes |
EP3367131A1 (en) * | 2017-02-27 | 2018-08-29 | STMicroelectronics (Research & Development) Limited | A higher pixel density histogram time of flight sensor |
US9905992B1 (en) | 2017-03-16 | 2018-02-27 | Luminar Technologies, Inc. | Self-Raman laser for lidar system |
US9810786B1 (en) | 2017-03-16 | 2017-11-07 | Luminar Technologies, Inc. | Optical parametric oscillator for lidar system |
US9810775B1 (en) | 2017-03-16 | 2017-11-07 | Luminar Technologies, Inc. | Q-switched laser for LIDAR system |
US9869754B1 (en) | 2017-03-22 | 2018-01-16 | Luminar Technologies, Inc. | Scan patterns for lidar systems |
JP6730217B2 (en) * | 2017-03-27 | 2020-07-29 | 株式会社デンソー | Photo detector |
US10545240B2 (en) | 2017-03-28 | 2020-01-28 | Luminar Technologies, Inc. | LIDAR transmitter and detector system using pulse encoding to reduce range ambiguity |
US10007001B1 (en) | 2017-03-28 | 2018-06-26 | Luminar Technologies, Inc. | Active short-wave infrared four-dimensional camera |
WO2018198729A1 (en) * | 2017-04-28 | 2018-11-01 | シャープ株式会社 | Three-dimensional image element and optical radar device |
US10397554B2 (en) * | 2017-05-16 | 2019-08-27 | Samsung Electronics Co., Ltd. | Time-resolving sensor using shared PPD+SPAD pixel and spatial-temporal correlation for range measurement |
US10116925B1 (en) * | 2017-05-16 | 2018-10-30 | Samsung Electronics Co., Ltd. | Time-resolving sensor using shared PPD + SPAD pixel and spatial-temporal correlation for range measurement |
JP7092319B2 (en) * | 2017-08-31 | 2022-06-28 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッド | A system for detecting and measuring objects |
JP7019894B2 (en) | 2017-08-31 | 2022-02-16 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッド | How to detect objects and sensor systems |
DE102017120953A1 (en) | 2017-09-11 | 2019-03-14 | Sick Ag | Optoelectronic sensor and method for detecting the position of an object |
US10594965B2 (en) * | 2017-09-13 | 2020-03-17 | Semiconductor Components Industries, Llc | Avalanche photodiode image sensors |
US10785400B2 (en) | 2017-10-09 | 2020-09-22 | Stmicroelectronics (Research & Development) Limited | Multiple fields of view time of flight sensor |
US11675048B2 (en) * | 2017-11-30 | 2023-06-13 | Sony Semiconductor Solutions Corporation | Time-of-flight acquisition method and time-of-flight camera |
US10545224B2 (en) | 2017-12-06 | 2020-01-28 | Samsung Electronics Co., Ltd. | Time-resolving sensor using SPAD + PPD or capacitors in pixel for range measurement |
DE102017222972A1 (en) * | 2017-12-15 | 2019-07-04 | Ibeo Automotive Systems GmbH | Receiving arrangement for receiving light signals |
DE102017222974A1 (en) | 2017-12-15 | 2019-06-19 | Ibeo Automotive Systems GmbH | Arrangement and method for determining a distance of at least one object with light signals |
FR3078851B1 (en) * | 2018-03-07 | 2020-02-14 | Teledyne E2V Semiconductors Sas | VISION CAMERA WITH OPTIMIZED FLIGHT-TIME MEASUREMENT FOR A MULTI-CAMERA ENVIRONMENT |
DE102018205378A1 (en) | 2018-04-10 | 2019-10-10 | Ibeo Automotive Systems GmbH | Method for controlling sensor elements of a LIDAR measuring system |
JP2020024138A (en) * | 2018-08-07 | 2020-02-13 | ソニーセミコンダクタソリューションズ株式会社 | Time measurement device and time measurement apparatus |
US10608589B2 (en) * | 2018-08-23 | 2020-03-31 | Semtech Corporation | Multiplexed integrating amplifier for loss of signal detection |
EP3848726B1 (en) * | 2018-09-07 | 2023-08-30 | SZ DJI Technology Co., Ltd. | Laser distance measurement module, apparatus, and method, and mobile platform |
US11579263B2 (en) * | 2018-11-29 | 2023-02-14 | Taiwan Semiconductor Manufacturing Co., Ltd. | Method and apparatus for a hybrid time-of-flight sensor with high dynamic range |
US11863876B2 (en) * | 2019-02-04 | 2024-01-02 | Anduril Industries Inc. | Event-based computational pixel imagers |
US11644547B2 (en) * | 2019-06-27 | 2023-05-09 | Taiwan Semiconductor Manufacturing Company, Ltd. | Time-of-light sensing device and method thereof |
US11443447B2 (en) | 2020-04-17 | 2022-09-13 | Samsung Electronics Co., Ltd. | Three-dimensional camera system |
US11536812B2 (en) * | 2020-06-23 | 2022-12-27 | Aptiv Technologies Limited | Increased dynamic range for time-of-flight (ToF) lidar systems |
US12080415B2 (en) | 2020-10-09 | 2024-09-03 | Humatics Corporation | Radio-frequency systems and methods for co-localization of medical devices and patients |
CN112596068B (en) * | 2020-10-28 | 2025-01-28 | 深圳奥锐达科技有限公司 | Collector, distance measurement system and electronic equipment |
US11726187B2 (en) * | 2020-10-30 | 2023-08-15 | Taiwan Semiconductor Manufacturing Co., Ltd. | High resolution low power inter-correlation SPAD assisted time-of-flight sensor |
WO2022091624A1 (en) * | 2020-11-02 | 2022-05-05 | ソニーセミコンダクタソリューションズ株式会社 | Photodetector and optical detection system |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5202742A (en) * | 1990-10-03 | 1993-04-13 | Aisin Seiki Kabushiki Kaisha | Laser radar for a vehicle lateral guidance system |
US5212386A (en) * | 1991-12-13 | 1993-05-18 | I.S.S. (U.S.A.) Inc. | High speed cross-correlation frequency domain fluorometry-phosphorimetry |
US5892575A (en) * | 1996-05-10 | 1999-04-06 | Massachusetts Institute Of Technology | Method and apparatus for imaging a scene using a light detector operating in non-linear geiger-mode |
US20020036765A1 (en) * | 2000-08-09 | 2002-03-28 | Mccaffrey Nathaniel Joseph | High resolution 3-D imaging range finder |
US20020048012A1 (en) * | 2000-09-05 | 2002-04-25 | Stann Barry L. | Code-multiplexed read-out for ladar systems |
US6414746B1 (en) * | 1999-11-24 | 2002-07-02 | Advanced Scientific Concepts, Inc. | 3-D imaging multiple target laser radar |
US20020084430A1 (en) | 2000-11-09 | 2002-07-04 | Canesta, Inc. | Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation |
US20040008394A1 (en) | 2000-04-28 | 2004-01-15 | Robert Lange | Device and method for spatially resolved photodetection and demodulation of modulated electromagnetic waves |
US20040135992A1 (en) * | 2002-11-26 | 2004-07-15 | Munro James F. | Apparatus for high accuracy distance and velocity measurement and methods thereof |
US6825455B1 (en) | 1996-09-05 | 2004-11-30 | Rudolf Schwarte | Method and apparatus for photomixing |
US20060109450A1 (en) * | 2004-11-19 | 2006-05-25 | Yi Liu | Laser distance measuring device |
US20060192086A1 (en) * | 2005-02-14 | 2006-08-31 | Ecole Polytechnique Federale De Lausanne Epfl | Integrated imager circuit comprising a monolithic array of single photon avalanche diodes |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1293659C (en) * | 2002-07-12 | 2007-01-03 | 日立万胜株式会社 | Alkali battery and manufacture thereof |
-
2006
- 2006-12-20 US US11/641,965 patent/US8355117B2/en not_active Expired - Fee Related
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5202742A (en) * | 1990-10-03 | 1993-04-13 | Aisin Seiki Kabushiki Kaisha | Laser radar for a vehicle lateral guidance system |
US5212386A (en) * | 1991-12-13 | 1993-05-18 | I.S.S. (U.S.A.) Inc. | High speed cross-correlation frequency domain fluorometry-phosphorimetry |
US5892575A (en) * | 1996-05-10 | 1999-04-06 | Massachusetts Institute Of Technology | Method and apparatus for imaging a scene using a light detector operating in non-linear geiger-mode |
US6825455B1 (en) | 1996-09-05 | 2004-11-30 | Rudolf Schwarte | Method and apparatus for photomixing |
US6414746B1 (en) * | 1999-11-24 | 2002-07-02 | Advanced Scientific Concepts, Inc. | 3-D imaging multiple target laser radar |
US20040008394A1 (en) | 2000-04-28 | 2004-01-15 | Robert Lange | Device and method for spatially resolved photodetection and demodulation of modulated electromagnetic waves |
US20020036765A1 (en) * | 2000-08-09 | 2002-03-28 | Mccaffrey Nathaniel Joseph | High resolution 3-D imaging range finder |
US20020048012A1 (en) * | 2000-09-05 | 2002-04-25 | Stann Barry L. | Code-multiplexed read-out for ladar systems |
US20020084430A1 (en) | 2000-11-09 | 2002-07-04 | Canesta, Inc. | Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation |
US6515740B2 (en) | 2000-11-09 | 2003-02-04 | Canesta, Inc. | Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation |
US20040135992A1 (en) * | 2002-11-26 | 2004-07-15 | Munro James F. | Apparatus for high accuracy distance and velocity measurement and methods thereof |
US20060109450A1 (en) * | 2004-11-19 | 2006-05-25 | Yi Liu | Laser distance measuring device |
US20060192086A1 (en) * | 2005-02-14 | 2006-08-31 | Ecole Polytechnique Federale De Lausanne Epfl | Integrated imager circuit comprising a monolithic array of single photon avalanche diodes |
Non-Patent Citations (6)
Title |
---|
Brian F. Aull et al., "Geiger-Mode Avalanche Photodiodes for Three-Dimensional Imaging", Lincoln Laboratory Journal, vol. 13, No. 2, 2002, pp. 335-350. |
Cristiano Niclass et al., "A CMOS 3D Camera with Millimetric Depth Resolution", Swiss Federal Institute of Technology, IEEE Custom Integrated Circuits Conference. pp. 705-708, Oct. 2004. |
Ralf Jeremias et al., International Solid State Circuits Conference, article, "Integrated Mems and Display Drivers", Session 16, Section 16.5 A CMOS Photosensor Array of 3D Imaging Using Pulsed Laser, © 2001, pp. 252-253, 452-453. |
Robert Lange et al., "Time-of-flight Range Imaging With a Custom Solid-state Image Sensor". Laser Metrology and Inspection, vol. 3823, 1999, 12 pages. |
Robert Lange, "3D Time-of-flight Distance Measurement with custom solid-state image sensors in CMOS/CCD-Technology", Department of Electrical Engineering, University of Siegen, 2000, 206 pages. |
Shinichi Yoshimura et al., International Solid State Circuits Conference, article, "CMOS Image Sensors with Embedded Processors", Session 6, Section 6.4 A 48k frame/s CMOS Image Sensor for Real-time 3-D Sensing and Motion Detection, © 2001, 3 pages. |
Cited By (113)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10962867B2 (en) | 2007-10-10 | 2021-03-30 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US11531257B2 (en) | 2007-10-10 | 2022-12-20 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US12025807B2 (en) | 2010-10-04 | 2024-07-02 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
US9058081B2 (en) | 2010-11-30 | 2015-06-16 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (SPAD) |
US20120133921A1 (en) * | 2010-11-30 | 2012-05-31 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (spad) |
US8749765B2 (en) * | 2010-11-30 | 2014-06-10 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (SPAD) |
US10085310B2 (en) | 2010-11-30 | 2018-09-25 | Stmicroelectronics (Research & Development) Limited | Application using a single photon avalanche diode (SPAD) |
US9516244B2 (en) * | 2010-12-23 | 2016-12-06 | Fastree3D S.A. | Methods and devices for generating a representation of a 3D scene at very high speed |
US20130300838A1 (en) * | 2010-12-23 | 2013-11-14 | Fastree3D S.A. | Methods and devices for generating a representation of a 3d scene at very high speed |
US9238393B2 (en) | 2011-09-14 | 2016-01-19 | Stmicroelectronics (Research & Development) Limited | System and method for monitoring vibration isolators |
US9562807B2 (en) | 2011-09-14 | 2017-02-07 | Stmicroelectronics (Research & Development) Limited | System and method for monitoring vibration isolators |
US10263032B2 (en) | 2013-03-04 | 2019-04-16 | Apple, Inc. | Photodiode with different electric potential regions for image sensors |
US10943935B2 (en) | 2013-03-06 | 2021-03-09 | Apple Inc. | Methods for transferring charge in an image sensor |
US12078756B2 (en) | 2013-11-12 | 2024-09-03 | Sos Lab Co., Ltd. | Methods and apparatus for array based lidar systems with reduced interference |
US10203399B2 (en) | 2013-11-12 | 2019-02-12 | Big Sky Financial Corporation | Methods and apparatus for array based LiDAR systems with reduced interference |
US11131755B2 (en) | 2013-11-12 | 2021-09-28 | Big Sky Financial Corporation | Methods and apparatus for array based LiDAR systems with reduced interference |
US12298438B2 (en) | 2013-11-12 | 2025-05-13 | Sos Lab Co., Ltd. | Methods and apparatus for array based LiDAR systems with reduced interference |
US10285626B1 (en) | 2014-02-14 | 2019-05-14 | Apple Inc. | Activity identification using an optical heart rate monitor |
US11860314B2 (en) | 2014-04-11 | 2024-01-02 | Big Sky Financial Corporation | Methods and apparatus for object detection and identification in a multiple detector lidar array |
US10585175B2 (en) | 2014-04-11 | 2020-03-10 | Big Sky Financial Corporation | Methods and apparatus for object detection and identification in a multiple detector lidar array |
US10609348B2 (en) | 2014-05-30 | 2020-03-31 | Apple Inc. | Pixel binning in an image sensor |
US20170199272A1 (en) * | 2014-07-03 | 2017-07-13 | Sharp Kabushiki Kaisha | Optical reflection sensor and electronic device |
US20160014393A1 (en) * | 2014-07-09 | 2016-01-14 | Massachusetts Institute Of Technology | Methods and Apparatus for Virtual Sensor Array |
US9897699B2 (en) * | 2014-07-09 | 2018-02-20 | Massachusetts Institute Of Technology | Methods and apparatus for virtual sensor array |
US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US9568620B2 (en) | 2014-09-22 | 2017-02-14 | General Electric Company | Solid state photomultiplier |
US10073177B2 (en) * | 2014-11-14 | 2018-09-11 | Massachusetts Institute Of Technology | Methods and apparatus for phased array imaging |
US10571569B2 (en) | 2014-11-14 | 2020-02-25 | Massachusetts Institute Of Technology | Methods and apparatus for phased array imaging |
US10036801B2 (en) | 2015-03-05 | 2018-07-31 | Big Sky Financial Corporation | Methods and apparatus for increased precision and improved range in a multiple detector LiDAR array |
US11226398B2 (en) | 2015-03-05 | 2022-01-18 | Big Sky Financial Corporation | Methods and apparatus for increased precision and improved range in a multiple detector LiDAR array |
US9819144B2 (en) | 2015-05-14 | 2017-11-14 | Apple Inc. | High-efficiency vertical emitters with improved heat sinking |
US10034375B2 (en) | 2015-05-21 | 2018-07-24 | Apple Inc. | Circuit substrate with embedded heat sink |
US9874693B2 (en) | 2015-06-10 | 2018-01-23 | The Research Foundation For The State University Of New York | Method and structure for integrating photonics with CMOs |
US9735539B2 (en) | 2015-07-20 | 2017-08-15 | Apple Inc. | VCSEL structure with embedded heat sink |
US10620300B2 (en) | 2015-08-20 | 2020-04-14 | Apple Inc. | SPAD array with gated histogram construction |
US10397546B2 (en) | 2015-09-30 | 2019-08-27 | Microsoft Technology Licensing, Llc | Range imaging |
US9785150B2 (en) | 2015-12-11 | 2017-10-10 | Uber Technologies, Inc. | Formatting sensor data for use in autonomous vehicle communications platform |
US10101747B2 (en) | 2015-12-11 | 2018-10-16 | Uber Technologies, Inc. | Formatting sensor data for use in autonomous vehicle communications platform |
US10877483B2 (en) | 2015-12-11 | 2020-12-29 | Uatc, Llc | Formatting sensor data for use in autonomous vehicle communications platform |
US9537956B1 (en) * | 2015-12-11 | 2017-01-03 | Uber Technologies, Inc. | System for acquiring time-synchronized sensor data |
US9596666B1 (en) | 2015-12-11 | 2017-03-14 | Uber Technologies, Inc. | System for processing asynchronous sensor data |
US10502815B2 (en) | 2015-12-18 | 2019-12-10 | Gerard Dirk Smits | Real time position sensing of objects |
US10324171B2 (en) | 2015-12-20 | 2019-06-18 | Apple Inc. | Light detection and ranging sensor |
US9997551B2 (en) | 2015-12-20 | 2018-06-12 | Apple Inc. | Spad array with pixel-level bias control |
US10523923B2 (en) | 2015-12-28 | 2019-12-31 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
US10477149B2 (en) | 2016-01-20 | 2019-11-12 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US9866816B2 (en) | 2016-03-03 | 2018-01-09 | 4D Intellectual Properties, Llc | Methods and apparatus for an active pulsed 4D camera for image acquisition and analysis |
US10298908B2 (en) | 2016-03-03 | 2019-05-21 | 4D Intellectual Properties, Llc | Vehicle display system for low visibility objects and adverse environmental conditions |
US12096121B2 (en) | 2016-03-03 | 2024-09-17 | 4D Intellectual Properties, Llc | Precision reflectivity and ambient light removal for a geiger mode/single photon active sensor system |
US11477363B2 (en) | 2016-03-03 | 2022-10-18 | 4D Intellectual Properties, Llc | Intelligent control module for utilizing exterior lighting in an active imaging system |
US10382742B2 (en) | 2016-03-03 | 2019-08-13 | 4D Intellectual Properties, Llc | Methods and apparatus for a lighting-invariant image sensor for automated object detection and vision systems |
US10623716B2 (en) | 2016-03-03 | 2020-04-14 | 4D Intellectual Properties, Llc | Object identification and material assessment using optical profiles |
US11838626B2 (en) | 2016-03-03 | 2023-12-05 | 4D Intellectual Properties, Llc | Methods and apparatus for an active pulsed 4D camera for image acquisition and analysis |
US10873738B2 (en) | 2016-03-03 | 2020-12-22 | 4D Intellectual Properties, Llc | Multi-frame range gating for lighting-invariant depth maps for in-motion applications and attenuating environments |
US10462452B2 (en) | 2016-03-16 | 2019-10-29 | Microsoft Technology Licensing, Llc | Synchronizing active illumination cameras |
US10114103B2 (en) | 2016-03-31 | 2018-10-30 | Uber Technologies, Inc. | System and method for sensor triggering for synchronized operation |
US10746841B2 (en) | 2016-03-31 | 2020-08-18 | Uatc, Llc | System and method of sensor triggering for synchronized operation |
US10190983B2 (en) | 2016-04-15 | 2019-01-29 | Massachusetts Institute Of Technology | Methods and apparatus for fluorescence lifetime imaging with pulsed light |
US10337993B2 (en) | 2016-04-15 | 2019-07-02 | Massachusetts Institute Of Technology | Methods and apparatus for fluorescence lifetime imaging with periodically modulated light |
US10658419B2 (en) | 2016-09-23 | 2020-05-19 | Apple Inc. | Stacked backside illuminated SPAD array |
US10438987B2 (en) | 2016-09-23 | 2019-10-08 | Apple Inc. | Stacked backside illuminated SPAD array |
US11271031B2 (en) | 2016-09-23 | 2022-03-08 | Apple Inc. | Back-illuminated single-photon avalanche diode |
US20180364355A1 (en) * | 2016-10-31 | 2018-12-20 | Gerard Dirk Smits | Fast scanning lidar with dynamic voxel probing |
US10451737B2 (en) * | 2016-10-31 | 2019-10-22 | Gerard Dirk Smits | Fast scanning with dynamic voxel probing |
US10482559B2 (en) | 2016-11-11 | 2019-11-19 | Uatc, Llc | Personalizing ride experience based on contextual ride usage data |
US11488277B2 (en) | 2016-11-11 | 2022-11-01 | Uber Technologies, Inc. | Personalizing ride experience based on contextual ride usage data |
US20180180473A1 (en) * | 2016-12-22 | 2018-06-28 | Sick Ag | Light Receiver Having a Plurality of Avalanche Photodiode Elements and Method for Supplying a Bias Voltage |
US10584998B2 (en) * | 2016-12-22 | 2020-03-10 | Sick Ag | Light receiver having a plurality of avalanche photodiode elements and method for supplying a bias voltage |
US11709236B2 (en) | 2016-12-27 | 2023-07-25 | Samsung Semiconductor, Inc. | Systems and methods for machine perception |
US10564284B2 (en) | 2016-12-27 | 2020-02-18 | Gerard Dirk Smits | Systems and methods for machine perception |
US10928492B2 (en) | 2017-01-25 | 2021-02-23 | Apple Inc. | Management of histogram memory for a single-photon avalanche diode detector |
US10656251B1 (en) | 2017-01-25 | 2020-05-19 | Apple Inc. | Signal acquisition in a SPAD detector |
US10801886B2 (en) | 2017-01-25 | 2020-10-13 | Apple Inc. | SPAD detector having modulated sensitivity |
US10962628B1 (en) | 2017-01-26 | 2021-03-30 | Apple Inc. | Spatial temporal weighting in a SPAD detector |
US10527728B2 (en) * | 2017-01-27 | 2020-01-07 | Samsung Electronics Co., Ltd | Apparatus and method for range measurement |
US11067794B2 (en) | 2017-05-10 | 2021-07-20 | Gerard Dirk Smits | Scan mirror systems and methods |
US10473921B2 (en) | 2017-05-10 | 2019-11-12 | Gerard Dirk Smits | Scan mirror systems and methods |
US10830879B2 (en) | 2017-06-29 | 2020-11-10 | Apple Inc. | Time-of-flight depth mapping with parallax compensation |
US10622538B2 (en) | 2017-07-18 | 2020-04-14 | Apple Inc. | Techniques for providing a haptic output and sensing a haptic input using a piezoelectric body |
US11725935B2 (en) * | 2017-07-31 | 2023-08-15 | Hexagon Technology Center Gmbh | Distance meter comprising SPAD arrangement for consideration of multiple targets |
US10440301B2 (en) | 2017-09-08 | 2019-10-08 | Apple Inc. | Image capture device, pixel, and method providing improved phase detection auto-focus performance |
US10955552B2 (en) | 2017-09-27 | 2021-03-23 | Apple Inc. | Waveform design for a LiDAR system with closely-spaced pulses |
US20210302552A1 (en) * | 2017-09-29 | 2021-09-30 | Sony Semiconductor Solutions Corporation | Time measurement device and time measurement unit |
US10935989B2 (en) | 2017-10-19 | 2021-03-02 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US11852727B2 (en) | 2017-12-18 | 2023-12-26 | Apple Inc. | Time-of-flight sensing using an addressable array of emitters |
US10725177B2 (en) | 2018-01-29 | 2020-07-28 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
CN108445502A (en) * | 2018-02-11 | 2018-08-24 | 余晓智 | A kind of TOF modules and its implementation based on ARM and LINUX |
US11019294B2 (en) | 2018-07-18 | 2021-05-25 | Apple Inc. | Seamless readout mode transitions in image sensors |
US10848693B2 (en) | 2018-07-18 | 2020-11-24 | Apple Inc. | Image flare detection using asymmetric pixels |
US11233966B1 (en) | 2018-11-29 | 2022-01-25 | Apple Inc. | Breakdown voltage monitoring for avalanche diodes |
US12117286B2 (en) | 2019-02-11 | 2024-10-15 | Apple Inc. | Depth sensing using a sparse array of pulsed beams |
US10955234B2 (en) | 2019-02-11 | 2021-03-23 | Apple Inc. | Calibration of depth sensing using a sparse array of pulsed beams |
US11982566B2 (en) | 2019-03-29 | 2024-05-14 | Ecole Polytechnique Federale De Lausanne (Epfl) | System, device, and method for quantum correlation measurement with single photon avalanche diode arrays |
US11500094B2 (en) | 2019-06-10 | 2022-11-15 | Apple Inc. | Selection of pulse repetition intervals for sensing time of flight |
US10881028B1 (en) | 2019-07-03 | 2020-12-29 | Apple Inc. | Efficient heat removal from electronic modules |
US11555900B1 (en) | 2019-07-17 | 2023-01-17 | Apple Inc. | LiDAR system with enhanced area coverage |
US20210133992A1 (en) * | 2019-10-31 | 2021-05-06 | Stmicroelectronics (Research & Development) Limited | Depth map sensor with bin rotation |
US11892568B2 (en) * | 2019-10-31 | 2024-02-06 | Stmicroelectronics (Grenoble 2) Sas | Depth map sensor with bin rotation |
US12140708B2 (en) * | 2019-12-03 | 2024-11-12 | Apple Inc. | Configurable array of single-photon detectors |
US11733359B2 (en) | 2019-12-03 | 2023-08-22 | Apple Inc. | Configurable array of single-photon detectors |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
US11476372B1 (en) | 2020-05-13 | 2022-10-18 | Apple Inc. | SPAD-based photon detectors with multi-phase sampling TDCs |
US12199197B2 (en) | 2020-05-13 | 2025-01-14 | Apple Inc. | SPAD-based photon detectors with multi-phase sampling TDCs |
US11710945B2 (en) | 2020-05-25 | 2023-07-25 | Apple Inc. | Projection of patterned and flood illumination |
US11699715B1 (en) | 2020-09-06 | 2023-07-11 | Apple Inc. | Flip-chip mounting of optoelectronic chips |
US12196860B2 (en) | 2021-03-02 | 2025-01-14 | Apple Inc. | Depth sensor calibration using internal reflections |
RU212795U1 (en) * | 2021-03-29 | 2022-08-09 | Открытое Акционерное Общество "Пеленг" | LASER RANGEFINDER |
US11681028B2 (en) | 2021-07-18 | 2023-06-20 | Apple Inc. | Close-range measurement of time of flight using parallax shift |
WO2023038417A1 (en) * | 2021-09-08 | 2023-03-16 | 주식회사 솔리드뷰 | Flash lidar sensor using zoom histogramming tdc |
US12313812B2 (en) | 2023-04-27 | 2025-05-27 | Apple Inc. | MOE-based illumination projector |
US12123589B1 (en) | 2023-05-22 | 2024-10-22 | Apple Inc. | Flood projector with microlens array |
US12313782B2 (en) | 2024-09-13 | 2025-05-27 | Sos Lab Co., Ltd. | Methods and apparatus for array based LiDAR systems with reduced interference |
Also Published As
Publication number | Publication date |
---|---|
US20070182949A1 (en) | 2007-08-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8355117B2 (en) | Method and arrangement for measuring the distance to an object | |
KR102734518B1 (en) | Methods and systems for high-resolution, long-range flash LIDAR | |
Bronzi et al. | 100 000 frames/s 64× 32 single-photon detector array for 2-D imaging and 3-D ranging | |
US11726185B2 (en) | Image sensor for determining a three-dimensional image and method for determining a three-dimensional image | |
US7586077B2 (en) | Reference pixel array with varying sensitivities for time of flight (TOF) sensor | |
US6580496B2 (en) | Systems for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation | |
US6515740B2 (en) | Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation | |
US7060957B2 (en) | Device and method for spatially resolved photodetection and demodulation of modulated electromagnetic waves | |
US8760549B2 (en) | Demodulation pixel with daisy chain charge storage sites and method of operation therefor | |
Niclass et al. | A single photon avalanche diode array fabricated in 0.35-µm CMOS and based on an event-driven readout for TCSPC experiments | |
Charbon et al. | SPAD-based sensors | |
US8829408B2 (en) | Sensor pixel array and separated array of storage and accumulation with parallel acquisition and readout wherein each pixel includes storage sites and readout nodes | |
Elkhalili et al. | A 4/spl times/64 pixel CMOS image sensor for 3-D measurement applications | |
WO2013104718A2 (en) | Color and non-visible light e.g. ir sensor, namely a multispectral sensor | |
KR20040094848A (en) | Three dimensional image sensing device using intensity modulated light | |
Aull et al. | Three-dimensional imaging with arrays of Geiger-mode avalanche photodiodes | |
US11531094B2 (en) | Method and system to determine distance using time of flight measurement comprising a control circuitry identifying which row of photosensitive image region has the captured image illumination stripe | |
EP1356664A2 (en) | Cmos-compatible three-dimensional image sensing using quantum efficiency modulation | |
Incoronato et al. | Single-shot pulsed-lidar spad sensor with on-chip peak detection for background rejection | |
Niclass et al. | Arrays of single photon avalanche diodes in CMOS technology: picosecond timing resolution for range imaging | |
Stoppa et al. | Scannerless 3D imaging sensors | |
US20250028051A1 (en) | Time-of-flight sensor and electronic device | |
Stoppa et al. | Single-photon detectors for time-of-flight range imaging | |
Kawahito | Time-of-Flight Techniques | |
Hossain | Design and Characterization of a Current Assisted Photo Mixing Demodulator for Tof Based 3d Cmos Image Sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE, SWITZERL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NICLASS, CRISTIANO;REEL/FRAME:019130/0047 Effective date: 20070131 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20250115 |