WO2020214793A1 - Systems and methods for rating vegetation health and biomass from remotely sensed morphological and radiometric data - Google Patents
Systems and methods for rating vegetation health and biomass from remotely sensed morphological and radiometric data Download PDFInfo
- Publication number
- WO2020214793A1 WO2020214793A1 PCT/US2020/028481 US2020028481W WO2020214793A1 WO 2020214793 A1 WO2020214793 A1 WO 2020214793A1 US 2020028481 W US2020028481 W US 2020028481W WO 2020214793 A1 WO2020214793 A1 WO 2020214793A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vroi
- biomass
- maps
- generating
- vegetation
- Prior art date
Links
- 239000002028 Biomass Substances 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000036541 health Effects 0.000 title claims abstract description 31
- 230000000877 morphologic effect Effects 0.000 title claims abstract description 22
- 230000003595 spectral effect Effects 0.000 claims abstract description 22
- 230000011218 segmentation Effects 0.000 claims description 25
- 238000004422 calculation algorithm Methods 0.000 claims description 10
- 239000003550 marker Substances 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 4
- 102100040428 Chitobiosyldiphosphodolichol beta-mannosyltransferase Human genes 0.000 claims description 2
- 101000891557 Homo sapiens Chitobiosyldiphosphodolichol beta-mannosyltransferase Proteins 0.000 claims description 2
- 230000002093 peripheral effect Effects 0.000 claims description 2
- 238000011160 research Methods 0.000 abstract description 5
- 238000000701 chemical imaging Methods 0.000 abstract description 4
- 238000004519 manufacturing process Methods 0.000 abstract description 4
- 230000000052 comparative effect Effects 0.000 abstract description 2
- 238000005259 measurement Methods 0.000 description 9
- 238000013459 approach Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003333 near-infrared imaging Methods 0.000 description 1
- 230000000243 photosynthetic effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000009367 silviculture Methods 0.000 description 1
- 239000002689 soil Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/155—Segmentation; Edge detection involving morphological operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/174—Segmentation; Edge detection involving the use of two or more images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/17—Terrestrial scenes taken from planes or by drones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/188—Vegetation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10036—Multispectral image; Hyperspectral image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30181—Earth observation
- G06T2207/30188—Vegetation; Agriculture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/194—Terrestrial scenes using hyperspectral data, i.e. more or other wavelengths than RGB
Definitions
- the present invention related to image and light detection and ranging (LiDAR) data processing and, in particular, image and LiDAR data processing for rating and assessing vegetation health and biomass of a vegetative region of interest (VROI).
- LiDAR image and light detection and ranging
- Measurement of health and biomass is useful in vegetation related research and development as well as commercial plant (agri-/horti-/silvi- culture, etc) production.
- agriculture input producers may conduct research to measure the effectiveness of a new compound by measuring its effects on plant biomass and health between treated and untreated samples.
- typical methods are complex and do not provide mosaic images to allow for review of objective data related to a VROI.
- the present invention combines and integrates information from both types of sources to provide a more effective single rating of vegetation health and biomass.
- the present invention provides for an objective biomass rating which produces a single numerical measure of vegetation biomass and health that can be used for quantitative comparative assessment of vegetation in research trials and in plant production.
- One aspect of the present invention is that a biomass index is created for objective comparison to one or more vegetative regions of interest (VROI).
- VROI vegetative regions of interest
- the morphological and radiometric input data sources are co-registered, identifying vegetation regions in the input data via a segmentation process, computing a morphological measure such as the height above ground of each identified vegetation pixel, computing a radiometric measure such as the Normalized Difference Vegetation Index (NDVI) at each identified vegetation pixel, combining and integrating the morphological and radiometric measures at each pixel, optionally weighting the result by global appearance factors such as vegetative fill fraction, and then optionally normalizing the combined measurement by a normalizing factor such as assessment area to promote comparison across differing assessment sizes.
- NDVI Normalized Difference Vegetation Index
- FIG. 1 provides a flow chart illustrating at least one embodiment of the present invention.
- FIG. 2 provides examples of visible light imagery of two sample VROIs labeled
- VROI A produces a Biomass Index rating of 3.79 whereas VROI B produces a Biomass Index rating of 4.34.
- FIG. 3 provides examples of segmentation maps for two VROIs labeled A and B.
- the segmentation maps are produced from the visible light imagery shown in FIG. 2.
- FIG. 4 provides examples of height maps for two VROIs labeled A and B. Color bars beneath each image show a conversion of pixel shade to height values measured in centimeters. VROI A has a total volume under canopy in the measured regions of 0.53 cubic- meters, while VROI B has a total volume under canopy in the measured regions of 0.62 cubic- meters.
- FIG. 5 provides examples of NDVI vegetation index maps for two VROIs labeled
- VROI A has an average vegetation index value in the vegetation pixels of 0.59 while VROI B has an average vegetation index value in the vegetation pixels of 0.61.
- FIG. 6 provides at least one embodiment of the 200 inventive system which includes 210 one or more spectral calibration markers placed within a 300 VROI, 220 one or more photographic image capturing platforms for capturing image data of a 300 VROI and 230 one or more computing devices which implements one or more methods for rating vegetation health and biomass if the vegetation in the 300 VROI. Also illustrated is 400 one or more ground control markers which may be used in certain embodiments.
- the present invention provides for systems and methods for rating vegetation health and biomass.
- Systems and methods use one or more platforms for acquiring image data. Further included are one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI) along with the use of one or more ground control markers placed in or near said VROI.
- VROI vegetative regions of interest
- the use of the calibration markers and ground control markers provide for reference data for orienting pixel data to the VROI while providing calibration data for providing reference data for comparison in the generation of objective biomass indexes.
- inventive systems and methods further include the use of one more computing devices.
- Inclusive of such computing devices is at least one processor that is configured to execute a sequence of programmed instructions that cause the processor to implement the one or methods disclosed herein.
- the inventive systems and methods further include the use of one or more data collection systems.
- Data may be collected from sensors mounted to an aerial vehicle, unmanned aerial vehicle, ground vehicle, person, etc.
- Embodiments of the inventions may further use sensors.
- morphological data may originate from sensors such as Light Detection and Ranging (LiDAR) or photogrammetric processing of images
- radiometric data may originate from sources such as imaging sensors (like multi spectral cameras, hyperspectral cameras, digital cameras) or point sensors (like point spectrometers or photosensors)
- One or more embodiments of the invention further include the use of image mosaicking software and photogrammetric software.
- image mosaicking software may be used to process multiple images from an input sensor to produce radiometric map data and/or point-cloud/elevation map data.
- Methods of the present invention allow for the creation of an objective index for the evaluation of a VROI to determine vegetation health and biomass.
- Method include the calculation of at least one or more maps including, generating one or more mosaic maps of a VROI, generating one or more segmentation maps of a VROI, generating one or more height maps of a VROI, or generating one or more Normalized Difference Vegetation Index (NDVI) maps of said VROI
- the present invention further provides for the use of one or more algorithms to be used to arrange and calculate the data obtained from the images, calibration markers, and photographic data.
- one or more algorithms to be used to arrange and calculate the data obtained from the images, calibration markers, and photographic data.
- NDVI Normalized Difference Vegetation Index
- VROI vegetative regions of interest
- photogrammetry shall mean making measurements from photographs which includes position measurements, height measurements, spectral measurement, or combinations thereof.
- photographic images shall mean any images resulting from any imaging technique known in the art, including, without limit, photographs, radio wave, radar data LiDAR, infrared imaging, near infrared imaging, or combinations thereof.
- morphological information shall mean any source of data about the physical form of the vegetation, including, for example, the absolute height of a pixel location, or a digital elevation map (DEM), from a Point-cloud, Rasterized Elevation Map Image, or similar.
- DEM digital elevation map
- Radiometric data shall mean data which may be obtained from one or more Multispectral Reflectance Map Image, Vegetation Index Map Image, or similar.
- aspects of the invention include a method for rating vegetation health and biomass through the use of one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI), which includes generating one or more mosaic maps of a VROI; generating one or more segmentation maps of the VROI, generating one or more height maps of the VROI, generating one or more Vegetation Index (VI) maps of the VROI, and generating the Biomass Index to provide a rating of the vegetation health and biomass in a VROI.
- VROI vegetative regions of interest
- generating one or more mosaic maps includes the steps of obtaining one or more photographic images of a VROI, the one or more photographic images containing RGB data and multi-spectral data, performing photogrammetry of the RGB data from the one or more photographic images of a VROI to obtain morphological information related to the VROI on each image, and arranging together the individual photographic images respective to physical location within a VROI and orienting to the ground control markers to create a mosaic image of the VROI using the one or more photographic images of a VROI.
- the photographic images are obtained using a visible- light digital camera (RGB camera) and a multispectral camera of said VROI.
- RGB camera visible- light digital camera
- VROI multispectral camera
- the multi-spectral photos include photographs of light at additional wavelength regions.
- morphological information includes the absolute height of a pixel location, or a digital elevation map (DEM).
- DEM digital elevation map
- generating one or more segmentation maps of said VROI includes the steps of classifying each pixel location of the mosaic map based on the visible pattern of each pixel location, and producing a pixel map having binary value pixels representative of the presence or absence of a visible pattern.
- the visible pattern is classified by the color, texture, edge, or combinations thereof.
- generating one or more height maps of the VROI includes the steps of processing the morphological information to generate a value representing a height above ground map at each pixel location.
- generating one or more VI maps of the VROI includes the steps of performing photogrammetry of said multi-spectral data and calibrating, using the marker data, to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for normalizing the difference between near infrared and red spectral bands.
- generating one or more VI maps of the VROI includes the steps of performing photogrammetry of the multi-spectral data and calibrating the multi- spectral data, using the marker data, to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for making a combination of the multi- spectral band values to produce a single vegetation index value at each pixel location.
- one or more databases are used for retaining and organizing information for each pixel related to the data used for the mosaic map, segmentation map, height maps, or NDVI maps, wherein each of the data elements for each pixel location may be accessed by one or more users.
- generating the Biomass Index is accomplished using the equation defined in ALG1.
- the method further includes the use of one or more ground control markers placed in or near the VROI.
- the database further comprises the Biomass Index for a
- the Biomass Index for a particular VROI is compared to the Biomass Index for a different VROI, wherein the higher computed Biomass Index is indicative of healthier vegetation than the lower computed Biomass Index.
- the method further includes displaying a mosaic map of one or more captured or generated images wherein upon selection of a VROI using one or more peripherals of a computing device, one or more information stored for that VROI in said database is displayed adjacent to, or overlaid upon, the mosaic map.
- inventive methods may include any combination, or all, of the described features, embodiments, or aspects of the invention as described herein, or otherwise known in the art.
- VROI vegetative regions of interest
- the system further includes one or more ground control markers.
- the one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera is attached to an aerial vehicle.
- the system further includes one or more means for communicating the information capture by said one or more photographic image capturing platforms to one or more computing devices.
- inventive system may include any combination, or all, of the described features, embodiments, or aspects of the invention as described herein, or otherwise known in the art.
- the present invention provides for a system for rating vegetation health and biomass which includes one or more spectral calibration markers, one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera and one or more computing devices for implementing one or more inventive methods as described further herein.
- the inventive system is utilized by placing one or more or the spectral calibration markers in a VROI to allow for a calibration measurement of the VROI for the purpose of capturing and calibrating multi-spectral photos taken of a VROI.
- the one or more photographic image capturing platforms of the system then captures images, and the images are processed using the one or more computing devices which implements one or more inventive methods for evaluating vegetative health and biomass, as further described herein.
- the inventive system further comprises one or more ground control markers.
- the use of the calibration markers and ground control markers provide for reference data for orienting pixel data to the VROI while providing calibration data for providing reference data for comparison in the generation of objective biomass indexes.
- the photographic image capturing platforms includes one or more of a visible-light digital camera or one or more multispectral camera. In at least one embodiment, the photographic image capturing platforms is an aerial vehicle.
- one or more mosaic maps are created which are created by obtaining one or more photographic images of a VROI which includes standard visible-wavelength red, green, and blue (RGB) data and multi-spectral data. Photogrammetry is performed using the RGB data from said one or more photographic images of a VROI to obtain morphological information related to the VROI on each image. Upon obtaining morphological information, the photographic images are arranged together respective to physical location within a VROI and oriented to the ground control markers to create a mosaic image of the VROI.
- RGB red, green, and blue
- multi-spectral photos are images of light at selected wavelength regions, and may include visible and non-visible wavelengths.
- the multi-spectral data is calibrated against one or more spectral calibration markers placed in or near the one or more VROI’s.
- one or more segmentation maps of said VROI are generated by classifying each pixel location said mosaic map based on the visible pattern of each pixel location and producing a pixel map having binary value pixels representative of the presence or absence of a visible pattern. It is appreciated that many measures could be used to interpret the visible pattern, and nothing herein is intended to limit the features used to identify the visible pattern. Examples include using the pixel color, pixel-region texture, pixel-region edges, or combinations thereof. Height Maps
- one or more height maps of the invention are arranged in at least one embodiment of the invention.
- VROI is generated by processing the morphological information to generate a value representing a height above ground map at each pixel location.
- one or more NDVI maps of the invention are provided.
- VROI is generated by performing photogrammetry of the multi-spectral data and calibrating, using the marker data to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for normalizing the difference between near infrared and red spectral bands.
- ALG. 1 Given Morphological input data (M), Radiometric input data (R), Segmentation map (S), and Assessed area (A), each pixel-wise rating factor is computed using ALG. 1.1.
- ALG. 1.1 compute Pi, Vi e 1 ... N
- Hi ⁇ - get segmentation active pixels of rating Hi(M)[S];
- ALG. 1.2 compute F t Vi e 0 ... M
- each area-wide appearance factor may have a distinct computation method designed to best suit the specific implementation of the system.
- F 0 Area(S)/FilledArea(S), where Area(S) is the count of the number of active pixels in the segmentation map S, and FilledArea(S) is the count of the number of active pixels after filling holes in the connected components of the segmentation map S.
- a system for rating vegetation health and biomass is used for the evaluation of vegetation health biomass of a particular vegetative region of interest (VROI).
- the system includes a plurality of spectral calibration markers pre-staged about the VROI, a plurality of ground control markers pre-staged about the VROI and an aerial vehicle system operating as a photographic image capturing platforms which includes a visible-light digital camera (RGB camera) and a multispectral camera for image collection of the VROI.
- RGB camera visible-light digital camera
- the photographic image capturing platform is an aerial vehicle.
- the aerial vehicle is an unmanned remote controlled aerial vehicle or aerial drone.
- the Segmentation map computed from high-resolution visible imagery is computed from the radiometric data source
- the height map is computed from photogrammetric processing of high resolution visible imagery as the morphological data source. All input data are co-registered and gridded to same per-pixel resolution. The computed data is then used to calculate the biomass index.
- the segmentation map is applied to the NDVI map to calculate NDVI pixel values in order to restrict response within measured region to only vegetation pixels so that non vegetation areas (soil, shadows) do not skew the ratings effectiveness.
- the segmentation map is further applied against the height map in order to calculate the height pixel values. This allows for the restriction of the height/volume measurements to desired vegetation canopy
- the height value at that location is multiplied by the NDVI value at that location to get Vi-weighted height values to fuse two sources of information about vegetation health and biomass.
- Height (after division by pixel area) gives a vegetation volume, while NDVI gives both vegetation health indication and indication of biomass-levels due to canopy understory absorption.
- Vi-weighted heights are multiplied by pixel area to get Vl-weighted- volume pixels. This is used to scale the fused rating by its area of assessment to make the rating more physically meaningful and more comparable across differing imaging resolutions. All VI- weighted-volume values are summed to get total-VI-weighted-volume, thus integrating all of the VI-weighted-volume information over the region of interest such as a research plot into a single rating.
- Morphological-closing of segmentation map is then computed to get a filled- segmentation-map, then divided by the number of segmentation map active pixels by the number of filled-segmentation-map active pixels to get the filled-area-ratio to provide an additional source of compiled information about health and biomass as, when compared to other plots in a research trial, a fuller canopy with fewer shadows could indicate more photosynthetic effectiveness and vegetation biomass.
- the total-VI-weighted-volume is multiplied by the filled-area-ratio to get an un normalized biomass index to fuse the pixel-wise and area-wide biomass information.
- the unnormalized biomass index is divided by the assessed area to get final biomass index thus providing a metric comparable across differing plot sizes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Remote Sensing (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Quality & Reliability (AREA)
- Image Processing (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Aviation & Aerospace Engineering (AREA)
Abstract
The inventive system and method presented herein combines and integrates information to provide a more effective single rating of vegetation health and biomass. As a result the present invention provides for an objective biomass rating which produces a single numerical measure of vegetation biomass and health that can be used for quantitative comparative assessment of vegetation in research trials and in plant production. The inventive system and method further provides for remote-sensing of vegetation health and biomass based on combined assessments of morphological data (extracted from sources such as high-resolution elevation raster-maps or point-clouds produced by photogrammetric or LiDAR sensors) and radiometric data (such as spectral reflectance maps generated from multi- or hyper-spectral imaging systems).
Description
SYSTEMS AND METHODS FOR RATING VEGETATION HEALTH AND BIOMASS
FROM REMOTELY SENSED MORPHOLOGICAL AND RADIOMETRIC DATA
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of US Provisional Application No. 62/834,532, having a filing date of April 16, 2019, the disclosure of which is hereby incorporated by reference in its entirety and all commonly owned.
FIELD OF INVENTION
[0002] The present invention related to image and light detection and ranging (LiDAR) data processing and, in particular, image and LiDAR data processing for rating and assessing vegetation health and biomass of a vegetative region of interest (VROI).
BACKGROUND
[0003] Measurement of health and biomass is useful in vegetation related research and development as well as commercial plant (agri-/horti-/silvi- culture, etc) production. For example, agriculture input producers may conduct research to measure the effectiveness of a new compound by measuring its effects on plant biomass and health between treated and untreated samples. However typical methods are complex and do not provide mosaic images to allow for review of objective data related to a VROI.
[0004] It should be appreciated that growers may like to identify areas with potentially reduced yield as candidates for interventions. Typically, remote sensing approaches to assessing the amount and health of vegetation use either a morphological approach of measuring the size
and shape of the vegetation, or a radiometric approach that assesses the biophysical properties of the vegetation by measuring the absorbed/emitted/reflected electromagnetic radiation (light). Both approaches have drawbacks, such as limited assessment of canopy understory and lack of account for vegetation quality in morphological measurements, and disregard of vegetation volume in radiometric approaches.
[0005] Thus there remains an unmet need for remote-sensing based on combined assessments of morphological data (extracted from sources such as high-resolution elevation raster-maps or point-clouds produced by photogrammetric or LiDAR sensors) and radiometric data (such as spectral reflectance maps generated from multi- or hyper-spectral imaging systems).
SUMMARY OF INVENTION
[0006] The present invention combines and integrates information from both types of sources to provide a more effective single rating of vegetation health and biomass. As a result the present invention provides for an objective biomass rating which produces a single numerical measure of vegetation biomass and health that can be used for quantitative comparative assessment of vegetation in research trials and in plant production.
[0007] One aspect of the present invention is that a biomass index is created for objective comparison to one or more vegetative regions of interest (VROI). To create the biomass index, the morphological and radiometric input data sources are co-registered, identifying vegetation regions in the input data via a segmentation process, computing a morphological measure such as the height above ground of each identified vegetation pixel, computing a radiometric measure such as the Normalized Difference Vegetation Index (NDVI) at each identified vegetation pixel,
combining and integrating the morphological and radiometric measures at each pixel, optionally weighting the result by global appearance factors such as vegetative fill fraction, and then optionally normalizing the combined measurement by a normalizing factor such as assessment area to promote comparison across differing assessment sizes.
[0008] This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. The foregoing has outlined some of the pertinent objects of the invention. These objects should be construed to be merely illustrative of some of the more prominent features and applications of the intended invention. Many other beneficial results can be attained by applying the disclosed invention in a different manner or modifying the invention within the scope of the disclosure. Accordingly, other objects and a fuller understanding of the invention may be had by referring to the summary of the invention and the detailed description of the preferred embodiment in addition to the scope of the invention defined by the claims taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF DRAWINGS
[0009] Examples illustrative of embodiments of the disclosure are described below with reference to figures attached hereto. In the figures, identical structures, elements or parts that appear in more than one figure are generally labeled with the same numeral in all the figures in which they appear. Dimensions of components and features shown in the figures are generally chosen for convenience and clarity of presentation and are not necessarily shown to scale. Many of the figures presented are in the form of schematic illustrations and, as such, certain elements may be drawn greatly simplified or not-to-scale, for illustrative clarity. The figures are not intended to be production drawings. The figures (Figs.) are listed below
[0010] FIG. 1 provides a flow chart illustrating at least one embodiment of the present invention.
[0011] FIG. 2 provides examples of visible light imagery of two sample VROIs labeled
A and B. Dotted lines indicate the two center measured rows of vegetation, while the outer two rows of vegetation in each plot are not measured and are not used for comparison. VROI A produces a Biomass Index rating of 3.79 whereas VROI B produces a Biomass Index rating of 4.34.
[0012] FIG. 3 provides examples of segmentation maps for two VROIs labeled A and B.
The segmentation maps are produced from the visible light imagery shown in FIG. 2.
[0013] FIG. 4 provides examples of height maps for two VROIs labeled A and B. Color bars beneath each image show a conversion of pixel shade to height values measured in centimeters. VROI A has a total volume under canopy in the measured regions of 0.53 cubic- meters, while VROI B has a total volume under canopy in the measured regions of 0.62 cubic- meters.
[0014] FIG. 5 provides examples of NDVI vegetation index maps for two VROIs labeled
A and B. Color bars beneath each image show a conversion of pixel shade to vegetation index values. VROI A has an average vegetation index value in the vegetation pixels of 0.59 while VROI B has an average vegetation index value in the vegetation pixels of 0.61.
[0015] FIG. 6 provides at least one embodiment of the 200 inventive system which includes 210 one or more spectral calibration markers placed within a 300 VROI, 220 one or more photographic image capturing platforms for capturing image data of a 300 VROI and 230 one or more computing devices which implements one or more methods for rating vegetation health and biomass if the vegetation in the 300 VROI. Also illustrated is 400 one or more ground
control markers which may be used in certain embodiments.
[0016] It should be clear that the description of the embodiments and attached Figures set forth in this specification serves only for a better understanding of the invention, without limiting its scope. It should also be clear that a person skilled in the art, after reading the present specification could make adjustments or amendments to the attached Figures and above described embodiments that would still be covered by the present invention
DETAILED DESCRIPTION
[0017] The following detailed description is merely exemplary in nature and is in no way intended to limit the scope of the invention, its application, or uses, which may vary. The invention is described with relation to the non-limiting definitions and terminology included herein. These definitions and terminology are not designed to function as a limitation on the scope or practice of the invention, but are presented for illustrative and descriptive purposes only.
[0018] The present invention provides for systems and methods for rating vegetation health and biomass. Systems and methods use one or more platforms for acquiring image data. Further included are one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI) along with the use of one or more ground control markers placed in or near said VROI. The use of the calibration markers and ground control markers provide for reference data for orienting pixel data to the VROI while providing calibration data for providing reference data for comparison in the generation of objective biomass indexes.
[0019] The inventive systems and methods further include the use of one more computing devices. Inclusive of such computing devices is at least one processor that is
configured to execute a sequence of programmed instructions that cause the processor to implement the one or methods disclosed herein.
[0020] The inventive systems and methods further include the use of one or more data collection systems. Various systems are known in the art. Data may be collected from sensors mounted to an aerial vehicle, unmanned aerial vehicle, ground vehicle, person, etc. Embodiments of the inventions may further use sensors. For example, morphological data may originate from sensors such as Light Detection and Ranging (LiDAR) or photogrammetric processing of images, radiometric data may originate from sources such as imaging sensors (like multi spectral cameras, hyperspectral cameras, digital cameras) or point sensors (like point spectrometers or photosensors)
[0021] One or more embodiments of the invention further include the use of image mosaicking software and photogrammetric software. In such embodiments, such software may be used to process multiple images from an input sensor to produce radiometric map data and/or point-cloud/elevation map data.
[0022] Methods of the present invention allow for the creation of an objective index for the evaluation of a VROI to determine vegetation health and biomass. Method include the calculation of at least one or more maps including, generating one or more mosaic maps of a VROI, generating one or more segmentation maps of a VROI, generating one or more height maps of a VROI, or generating one or more Normalized Difference Vegetation Index (NDVI) maps of said VROI
[0023] The present invention further provides for the use of one or more algorithms to be used to arrange and calculate the data obtained from the images, calibration markers, and photographic data.
[0024] Various terms used throughout the specification and claims are defined as set forth below as it may be helpful to an understanding of the invention.
[0025] As used herein, Normalized Difference Vegetation Index (NDVI) shall mean the calculated index using one or more algorithms resulting from the application of one or more systems or methods of the present invention.
[0026] As used herein, vegetative regions of interest (VROI) shall mean one or more regions of interest of a vegetative area desired to be measured.
[0027] As used herein, photogrammetry shall mean making measurements from photographs which includes position measurements, height measurements, spectral measurement, or combinations thereof.
[0028] As used herein, photographic images shall mean any images resulting from any imaging technique known in the art, including, without limit, photographs, radio wave, radar data LiDAR, infrared imaging, near infrared imaging, or combinations thereof.
[0029] As used herein, morphological information shall mean any source of data about the physical form of the vegetation, including, for example, the absolute height of a pixel location, or a digital elevation map (DEM), from a Point-cloud, Rasterized Elevation Map Image, or similar.
[0030] As used herein, Radiometric data shall mean data which may be obtained from one or more Multispectral Reflectance Map Image, Vegetation Index Map Image, or similar. General
[0031] Aspects of the invention include a method for rating vegetation health and biomass through the use of one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI), which includes generating one or more mosaic maps of a
VROI; generating one or more segmentation maps of the VROI, generating one or more height maps of the VROI, generating one or more Vegetation Index (VI) maps of the VROI, and generating the Biomass Index to provide a rating of the vegetation health and biomass in a VROI.
[0032] In certain embodiments, generating one or more mosaic maps includes the steps of obtaining one or more photographic images of a VROI, the one or more photographic images containing RGB data and multi-spectral data, performing photogrammetry of the RGB data from the one or more photographic images of a VROI to obtain morphological information related to the VROI on each image, and arranging together the individual photographic images respective to physical location within a VROI and orienting to the ground control markers to create a mosaic image of the VROI using the one or more photographic images of a VROI.
[0033] In certain embodiments, the photographic images are obtained using a visible- light digital camera (RGB camera) and a multispectral camera of said VROI.
[0034] In certain embodiments, the multi-spectral photos include photographs of light at additional wavelength regions.
[0035] In certain embodiments, morphological information includes the absolute height of a pixel location, or a digital elevation map (DEM).
[0036] In certain embodiments, generating one or more segmentation maps of said VROI includes the steps of classifying each pixel location of the mosaic map based on the visible pattern of each pixel location, and producing a pixel map having binary value pixels representative of the presence or absence of a visible pattern.
[0037] In certain embodiments, the visible pattern is classified by the color, texture, edge, or combinations thereof.
[0038] In certain embodiments, generating one or more height maps of the VROI includes the steps of processing the morphological information to generate a value representing a height above ground map at each pixel location.
[0039] In certain embodiments generating one or more VI maps of the VROI includes the steps of performing photogrammetry of said multi-spectral data and calibrating, using the marker data, to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for normalizing the difference between near infrared and red spectral bands.
[0040] In certain embodiments, generating one or more VI maps of the VROI includes the steps of performing photogrammetry of the multi-spectral data and calibrating the multi- spectral data, using the marker data, to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for making a combination of the multi- spectral band values to produce a single vegetation index value at each pixel location.
[0041] In certain embodiments, one or more databases are used for retaining and organizing information for each pixel related to the data used for the mosaic map, segmentation map, height maps, or NDVI maps, wherein each of the data elements for each pixel location may be accessed by one or more users.
[0042] In certain embodiments, generating the Biomass Index is accomplished using the equation defined in ALG1.
[0043] In certain embodiments, the method further includes the use of one or more ground control markers placed in or near the VROI.
[0044] In certain embodiments, the database further comprises the Biomass Index for a
VROI.
[0045] In certain embodiments, the Biomass Index for a particular VROI is compared to the Biomass Index for a different VROI, wherein the higher computed Biomass Index is indicative of healthier vegetation than the lower computed Biomass Index.
[0046] In certain embodiments, the method further includes displaying a mosaic map of one or more captured or generated images wherein upon selection of a VROI using one or more peripherals of a computing device, one or more information stored for that VROI in said database is displayed adjacent to, or overlaid upon, the mosaic map.
[0047] It should be appreciated that the inventive methods may include any combination, or all, of the described features, embodiments, or aspects of the invention as described herein, or otherwise known in the art.
[0048] Other aspects of the present invention include a system for rating vegetation health and biomass, which includes one or more spectral calibration markers, one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera, and one or more computing devices implementing a computer-usable medium having a sequence of instructions which, when executed by a processor of the computing device, causes the processor to execute a process one or more methods for rating vegetation health and biomass through the use of said one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI), as disclosed herein.
[0049] In certain embodiments, the system further includes one or more ground control markers.
[0050] In certain embodiments, the one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera is attached to an aerial vehicle.
[0051] In certain embodiments, the system further includes one or more means for communicating the information capture by said one or more photographic image capturing platforms to one or more computing devices.
[0052] It should be appreciated that the inventive system may include any combination, or all, of the described features, embodiments, or aspects of the invention as described herein, or otherwise known in the art.
System
[0053] The present invention provides for a system for rating vegetation health and biomass which includes one or more spectral calibration markers, one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera and one or more computing devices for implementing one or more inventive methods as described further herein.
[0054] The inventive system is utilized by placing one or more or the spectral calibration markers in a VROI to allow for a calibration measurement of the VROI for the purpose of capturing and calibrating multi-spectral photos taken of a VROI. The one or more photographic image capturing platforms of the system then captures images, and the images are processed using the one or more computing devices which implements one or more inventive methods for evaluating vegetative health and biomass, as further described herein.
[0055] In at least one embodiment, the inventive system further comprises one or more ground control markers. The use of the calibration markers and ground control markers provide for reference data for orienting pixel data to the VROI while providing calibration data for providing reference data for comparison in the generation of objective biomass indexes.
[0056] In at least one embodiment, the photographic image capturing platforms includes
one or more of a visible-light digital camera or one or more multispectral camera. In at least one embodiment, the photographic image capturing platforms is an aerial vehicle.
Mosaic Maps
[0057] In at least one embodiment of the invention, one or more mosaic maps are created which are created by obtaining one or more photographic images of a VROI which includes standard visible-wavelength red, green, and blue (RGB) data and multi-spectral data. Photogrammetry is performed using the RGB data from said one or more photographic images of a VROI to obtain morphological information related to the VROI on each image. Upon obtaining morphological information, the photographic images are arranged together respective to physical location within a VROI and oriented to the ground control markers to create a mosaic image of the VROI.
[0058] It is appreciated that multi-spectral photos are images of light at selected wavelength regions, and may include visible and non-visible wavelengths. The multi-spectral data is calibrated against one or more spectral calibration markers placed in or near the one or more VROI’s.
Segmentation Maps
[0059] In at least one embodiment of the invention, one or more segmentation maps of said VROI are generated by classifying each pixel location said mosaic map based on the visible pattern of each pixel location and producing a pixel map having binary value pixels representative of the presence or absence of a visible pattern. It is appreciated that many measures could be used to interpret the visible pattern, and nothing herein is intended to limit the features used to identify the visible pattern. Examples include using the pixel color, pixel-region texture, pixel-region edges, or combinations thereof.
Height Maps
[0060] In at least one embodiment of the invention, one or more height maps of the
VROI is generated by processing the morphological information to generate a value representing a height above ground map at each pixel location.
Normalized Difference Vegetation Index (NDVI) Maps
[0061] In at least one embodiment of the invention, one or more NDVI maps of the
VROI is generated by performing photogrammetry of the multi-spectral data and calibrating, using the marker data to provide a reflectance map for each multi-spectral band of light measured, and applying one or more algorithms for normalizing the difference between near infrared and red spectral bands.
Computational Algorithms
[0062] It is appreciated that in order to provide an objective measure of vegetative health and biomass index, one or more algorithms are applied in order to calculate a biomass index, which provides a metric comparable across differing plot sizes. In at least one embodiment, the algorithm, ALG. 1, is as follows: Given Morphological input data (M), Radiometric input data (R), Segmentation map (S), and Assessed area (A), each pixel-wise rating factor is computed using ALG. 1.1.
[0063] ALG. 1.1: compute Pi, Vi e 1 ... N
[0064] Hi <- get segmentation active pixels of rating Hi(M)[S];
[0065] Vi <- get segmentation active pixels of rating Vi(R)[S];
[0066] Pi <- integrate pixel values using ¾(¾, )
[0067] In at least one non-limiting example, the following calculation occurs IfHt, ) =
[0068] Compute each area-wide appearance factor using ALG. 1.2
[0069] ALG. 1.2: compute Ft Vi e 0 ... M
[0070] Where each area-wide appearance factor may have a distinct computation method designed to best suit the specific implementation of the system. In at least one non-limiting example, F0 = Area(S)/FilledArea(S), where Area(S) is the count of the number of active pixels in the segmentation map S, and FilledArea(S) is the count of the number of active pixels after filling holes in the connected components of the segmentation map S.
[0071] Then finally compute the biomass index (B) is using ALG 1.3 :
EXAMPLES
[0073] It is to be understood that while the invention has been described in conjunction with the detailed description thereof, the foregoing description is intended to illustrate and not limit the scope of the invention, which is defined by the scope of the appended claims. Other aspects, advantages, and modifications are within the scope of the following claims.
EXAMPLE 1
[0074] A system for rating vegetation health and biomass is used for the evaluation of vegetation health biomass of a particular vegetative region of interest (VROI). The system includes a plurality of spectral calibration markers pre-staged about the VROI, a plurality of ground control markers pre-staged about the VROI and an aerial vehicle system operating as a photographic image capturing platforms which includes a visible-light digital camera (RGB camera) and a multispectral camera for image collection of the VROI.
[0075] It is appreciated that there are several photographic image capturing platforms
known in the art which are incorporated as vehicles, whether land or aerial vehicles. In at least one embodiment, the photographic image capturing platform is an aerial vehicle. In at least one embodiment, the aerial vehicle is an unmanned remote controlled aerial vehicle or aerial drone.
[0076] First the segmentation map, height map, and NDVI maps are generated as taught herein. The Segmentation map computed from high-resolution visible imagery, the Normalized Difference Vegetation Index (NDVI) map is computed from the radiometric data source, and the height map is computed from photogrammetric processing of high resolution visible imagery as the morphological data source. All input data are co-registered and gridded to same per-pixel resolution. The computed data is then used to calculate the biomass index.
[0077] The segmentation map is applied to the NDVI map to calculate NDVI pixel values in order to restrict response within measured region to only vegetation pixels so that non vegetation areas (soil, shadows) do not skew the ratings effectiveness. The segmentation map is further applied against the height map in order to calculate the height pixel values. This allows for the restriction of the height/volume measurements to desired vegetation canopy
[0078] For each pixel location in the segmentation map, the height value at that location is multiplied by the NDVI value at that location to get Vi-weighted height values to fuse two sources of information about vegetation health and biomass. Height (after division by pixel area) gives a vegetation volume, while NDVI gives both vegetation health indication and indication of biomass-levels due to canopy understory absorption.
[0079] Next the Vi-weighted heights are multiplied by pixel area to get Vl-weighted- volume pixels. This is used to scale the fused rating by its area of assessment to make the rating more physically meaningful and more comparable across differing imaging resolutions. All VI- weighted-volume values are summed to get total-VI-weighted-volume, thus integrating all of the
VI-weighted-volume information over the region of interest such as a research plot into a single rating.
[0080] Morphological-closing of segmentation map is then computed to get a filled- segmentation-map, then divided by the number of segmentation map active pixels by the number of filled-segmentation-map active pixels to get the filled-area-ratio to provide an additional source of compiled information about health and biomass as, when compared to other plots in a research trial, a fuller canopy with fewer shadows could indicate more photosynthetic effectiveness and vegetation biomass.
[0081] The total-VI-weighted-volume is multiplied by the filled-area-ratio to get an un normalized biomass index to fuse the pixel-wise and area-wide biomass information.
[0082] The unnormalized biomass index is divided by the assessed area to get final biomass index thus providing a metric comparable across differing plot sizes
Other Embodiments
[0001] While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the described embodiments in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope as set forth in the appended claims and the legal equivalents thereof.
Claims
1. A method for rating vegetation health and biomass through the use of one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI), the method comprising:
generating one or more mosaic maps of a VROI;
generating one or more segmentation maps of said VROI;
generating one or more height maps of said VROI;
generating one or more Vegetation Index (VI) maps of said VROI; and
generating the Biomass Index to provide a rating of the vegetation health and biomass in a VROI.
2. The method of claim 1 wherein generating one or more mosaic maps comprises the steps of:
obtaining one or more photographic images of a VROI, said one or more photographic images containing RGB data and multi-spectral data;
performing photogrammetry of said RGB data from said one or more photographic images of a VROI to obtain morphological information related to the VROI on each image; and arranging together said individual photographic images respective to physical location within a VROI and orienting to said ground control markers to create a mosaic image of the VROI using the one or more photographic images of a VROI.
3. The method of claim 2 wherein said photographic images are obtained using a visible- light digital camera (RGB camera) and a multispectral camera of said VROI.
4. The method of claim 2 wherein said multi-spectral photos include photographs of light at additional wavelength regions.
5. The method of claim 2 wherein said morphological information is the absolute height of a pixel location, or a digital elevation map (DEM).
6. The method of claim 1 wherein said generating one or more segmentation maps of said VROI comprises the steps of:
classifying each pixel location said mosaic map based on the visible pattern of each pixel location; and
producing a pixel map having binary value pixels representative of the presence or absence of a visible pattern.
7. The method of claim 6 wherein said visible pattern is classified by the color, texture, edge, or combinations thereof.
8. The method of claim 1 wherein said generating one or more height maps of said VROI comprises the steps of processing the morphological information to generate a value representing a height above ground map at each pixel location.
9. The method of claim 1 wherein said generating one or more VI maps of said VROI comprises the steps of:
performing photogrammetry of said multi-spectral data and calibrating, using said marker data, to provide a reflectance map for each multi-spectral band of light measured; and
applying one or more algorithms for normalizing the difference between near infrared and red spectral bands.
10. The method of claim 1 wherein said generating one or more VI maps of said VROI comprises the steps of:
performing photogrammetry of said multi-spectral data and calibrating the multi-spectral data, using said marker data, to provide a reflectance map for each multi-spectral band of light measured; and
applying one or more algorithms for making a combination of the multi -spectral band values to produce a single vegetation index value at each pixel location.
11. The method of claim 1 further comprising one or more databases for retaining and organizing information for each pixel related to the data used for said mosaic map, segmentation map, height maps, or NDVI maps, wherein each of the data elements for each pixel location may be accessed by one or more users.
12. The method of claim 1 wherein generating the Biomass Index is accomplished using the equation defined in ALG1.
13. The method of claim 1 further comprising the use of one or more ground control markers placed in or near said VROI.
14. The method of claim 11 wherein the database further comprises the Biomass Index for a VROI.
15. The method of claim 11 wherein the Biomass Index for a particular VROI is compared to the Biomass Index for a different VROI, wherein the higher computed Biomass Index is indicative of healthier vegetation than the lower computed Biomass Index.
16. The method of claim 11 further comprising displaying a mosaic map of images wherein upon selection of a VROI using one or more peripherals of a computing device, one or more information stored for that VROI in said database is displayed adjacent to, or overlaid upon, the mosaic map.
17. A system for rating vegetation health and biomass, the system comprising:
one or more spectral calibration markers;
one or more photographic image capturing platforms having one or more of a visible- light digital camera or a multi spectral camera;
one or more computing devices implementing a computer-usable medium having a sequence of instructions which, when executed by a processor of the computing device, causes the processor to execute a process for rating vegetation health and biomass through the use of said one or more spectral calibration marker placed in or near one or more vegetative regions of interest (VROI), the method comprising:
generating one or more mosaic maps of a VROI;
generating one or more segmentation maps of said VROI;
generating one or more height maps of said VROI;
generating one or more Vegetation Index (VI) maps of said VROI; and
generating the Biomass Index to provide a rating of the vegetation health and biomass in a VROI.
18. The system of claim 17 further comprising one or more ground control markers.
19. The system of claim 17 wherein said one or more photographic image capturing platforms having one or more of a visible-light digital camera or a multispectral camera is attached to an aerial vehicle.
20. The system of claim 17 further comprising one or more means for communicating the information capture by said one or more photographic image capturing platforms to one or more computing devices.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962834532P | 2019-04-16 | 2019-04-16 | |
US62/834,532 | 2019-04-16 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2020214793A1 true WO2020214793A1 (en) | 2020-10-22 |
WO2020214793A8 WO2020214793A8 (en) | 2021-05-14 |
Family
ID=72832540
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2020/028481 WO2020214793A1 (en) | 2019-04-16 | 2020-04-16 | Systems and methods for rating vegetation health and biomass from remotely sensed morphological and radiometric data |
Country Status (2)
Country | Link |
---|---|
US (1) | US11270112B2 (en) |
WO (1) | WO2020214793A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112380984B (en) * | 2020-11-13 | 2024-04-30 | 华东师范大学 | Remote sensing-based salt-biogas vegetation slow-flow capacity space evaluation method |
CN112396615A (en) * | 2020-11-27 | 2021-02-23 | 广东电网有限责任公司肇庆供电局 | Individual stumpage segmentation method and device based on adjustable hemispherical canopy camera |
CN113063742A (en) * | 2021-03-24 | 2021-07-02 | 和数科技(浙江)有限公司 | Method and system for measuring vegetation biomass, storage medium and terminal |
CN114384534A (en) * | 2021-05-25 | 2022-04-22 | 国网福建省电力有限公司三明供电公司 | Tree barrier growth prediction analysis method for unmanned aerial vehicle line patrol |
CN115346120B (en) * | 2022-08-16 | 2023-06-20 | 中国科学院空天信息创新研究院 | Grassland biomass and carbon fixation remote sensing estimation method thereof |
CN115993336B (en) * | 2023-03-23 | 2023-06-16 | 山东省水利科学研究院 | A monitoring method and early warning method for vegetation damage on both sides of an aqueduct |
CN116308866B (en) * | 2023-05-23 | 2023-07-28 | 武汉大学 | Rice ear biomass estimation method and system based on canopy reflection spectrum |
CN117292267B (en) * | 2023-11-27 | 2024-02-02 | 武汉大学 | A segmented estimation method and system for rice aboveground biomass based on phenological information |
CN117934749B (en) * | 2024-03-25 | 2024-05-24 | 成都陆拓信息技术有限公司 | Three-dimensional visualization method for vegetation carbon fixation value |
CN118762293B (en) * | 2024-09-04 | 2024-11-26 | 西南林业大学 | Rubber forest information identification method based on multi-source remote sensing data |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300375A1 (en) * | 2013-12-04 | 2016-10-13 | Urthecast Corp. | Systems and methods for processing and distributing earth observation images |
US20170250751A1 (en) * | 2016-02-29 | 2017-08-31 | Satellogic Overseas, Inc. (Bvi) | System for planetary-scale analytics |
US20180218214A1 (en) * | 2015-08-06 | 2018-08-02 | Accenture Global Services Limited | Condition detection using image processing |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8411905B2 (en) * | 2008-06-06 | 2013-04-02 | Monsanto Technology Llc | Generating agricultural information products using remote sensing |
TW201022708A (en) * | 2008-12-11 | 2010-06-16 | Univ Nat Central | Method of change detection for building models |
US8862630B2 (en) * | 2009-06-03 | 2014-10-14 | Pioneer Hi-Bred International Inc | Method and system for the use of geospatial data in the development, production, and sale of agricultural seed |
US8335374B2 (en) * | 2009-08-12 | 2012-12-18 | Genetix Corporation | Image segmentation |
US8503761B2 (en) * | 2009-11-12 | 2013-08-06 | Harris Corporation | Geospatial modeling system for classifying building and vegetation in a DSM and related methods |
BR112014009255A8 (en) * | 2011-10-20 | 2017-06-20 | Monsanto Technology Llc | plant counter |
US9798928B2 (en) * | 2013-07-17 | 2017-10-24 | James L Carr | System for collecting and processing aerial imagery with enhanced 3D and NIR imaging capability |
US20160048925A1 (en) * | 2014-01-03 | 2016-02-18 | Buildfax, Inc. | Method of determining structural damage using positive and negative tree proximity factors |
CN106231890A (en) * | 2014-04-14 | 2016-12-14 | 精密种植有限责任公司 | Crop group of hill optimizes system, method and apparatus |
US10568316B2 (en) * | 2014-08-15 | 2020-02-25 | Monsanto Technology Llc | Apparatus and methods for in-field data collection and sampling |
US9916505B2 (en) * | 2014-09-22 | 2018-03-13 | Deere & Company | Method and system for collecting image data |
JP6526474B2 (en) * | 2015-04-30 | 2019-06-05 | 株式会社トプコン | Plant sensor device |
US10008035B1 (en) * | 2015-05-18 | 2018-06-26 | Blue River Technology Inc. | System and method of virtual plant field modelling |
US9745060B2 (en) * | 2015-07-17 | 2017-08-29 | Topcon Positioning Systems, Inc. | Agricultural crop analysis drone |
US10028435B2 (en) * | 2016-03-04 | 2018-07-24 | Deere & Company | Sensor calibration using field information |
US9592912B1 (en) * | 2016-03-08 | 2017-03-14 | Unmanned Innovation, Inc. | Ground control point assignment and determination system |
US20190271550A1 (en) * | 2016-07-21 | 2019-09-05 | Intelligent Technologies International, Inc. | System and Method for Creating, Updating, and Using Maps Generated by Probe Vehicles |
WO2018028191A1 (en) * | 2016-08-10 | 2018-02-15 | 福州大学 | Tavi calculation method based on waveband ration model and solar elevation angle |
US10163194B2 (en) * | 2016-09-23 | 2018-12-25 | Purdue Research Foundation | Method of processing an image |
US10685228B2 (en) * | 2017-01-12 | 2020-06-16 | Sentera, Inc. | Multiple day mapping index aggregation and comparison |
JP6729791B2 (en) * | 2017-03-23 | 2020-07-22 | 日本電気株式会社 | Vegetation index calculation device, vegetation index calculation method, and program |
US9756324B1 (en) * | 2017-04-10 | 2017-09-05 | GELT Inc. | System and method for color calibrating an image |
US10813295B2 (en) * | 2017-04-17 | 2020-10-27 | Iron Ox, Inc. | Method for monitoring growth of plants and generating a plant grow schedule |
US20200182697A1 (en) * | 2017-07-20 | 2020-06-11 | Groview Pty Ltd | Active illumination 2d and/or 3d imaging device for agriculture |
WO2019084324A1 (en) * | 2017-10-25 | 2019-05-02 | Advanced Biological Marketing, Inc. | Endophytic microbial seed treatment formulations and methods related thereto for improved plant performance |
US10705204B2 (en) * | 2017-12-08 | 2020-07-07 | International Business Machines Corporation | Crop classification and growth tracking with synthetic aperture radar |
US11140813B1 (en) * | 2018-01-24 | 2021-10-12 | Scythe Robotics, Inc. | Moisture and vegetative health mapping |
DE102019201988A1 (en) * | 2018-02-20 | 2019-08-22 | Osram Gmbh | FARMED AGRICULTURAL SYSTEM, AGRICULTURAL LIGHT FOR USE IN A TAXED AGRICULTURAL SYSTEM AND AGRICULTURAL MANAGEMENT PROCEDURE |
WO2019173606A1 (en) * | 2018-03-07 | 2019-09-12 | Emerald Metrics | Methods, systems, and components thereof relating to using multi-spectral imaging for improved cultivation of cannabis and other crops |
US11188752B2 (en) * | 2018-03-08 | 2021-11-30 | Regents Of The University Of Minnesota | Crop biometrics detection |
US10891482B2 (en) * | 2018-07-10 | 2021-01-12 | Adroit Robotics | Systems, devices, and methods for in-field diagnosis of growth stage and crop yield estimation in a plant area |
US10769813B2 (en) * | 2018-08-28 | 2020-09-08 | Bendix Commercial Vehicle Systems, Llc | Apparatus and method for calibrating surround-view camera systems |
CN109459392B (en) * | 2018-11-06 | 2019-06-14 | 南京农业大学 | A method for estimating aboveground biomass of rice based on UAV multispectral imagery |
US11270111B2 (en) * | 2019-02-04 | 2022-03-08 | International Business Machines Corporation | Automated management of potentially hazardous objects near power lines |
-
2020
- 2020-04-16 WO PCT/US2020/028481 patent/WO2020214793A1/en active Application Filing
- 2020-04-16 US US16/850,707 patent/US11270112B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300375A1 (en) * | 2013-12-04 | 2016-10-13 | Urthecast Corp. | Systems and methods for processing and distributing earth observation images |
US20180218214A1 (en) * | 2015-08-06 | 2018-08-02 | Accenture Global Services Limited | Condition detection using image processing |
US20170250751A1 (en) * | 2016-02-29 | 2017-08-31 | Satellogic Overseas, Inc. (Bvi) | System for planetary-scale analytics |
Non-Patent Citations (2)
Title |
---|
GALIDAKI ET AL.: "Vegetation biomass estimation with remote sensing: focus on forest and other wooded land over the Mediterranean ecosystem", INTERNATIONAL JOURNAL OF REMOTE SENSING, vol. 38, no. 7, 11 December 2016 (2016-12-11), pages 1940 - 1966, XP055750219, DOI: 10.1080/01431161.2016.1266113 * |
SA ET AL.: "WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming", REMOTE SENSING, vol. 10, no. 9, 6 September 2018 (2018-09-06), pages 1423, XP055750216 * |
Also Published As
Publication number | Publication date |
---|---|
US20200334458A1 (en) | 2020-10-22 |
WO2020214793A8 (en) | 2021-05-14 |
US11270112B2 (en) | 2022-03-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11270112B2 (en) | Systems and methods for rating vegetation health and biomass from remotely sensed morphological and radiometric data | |
Näsi et al. | Remote sensing of bark beetle damage in urban forests at individual tree level using a novel hyperspectral camera from UAV and aircraft | |
Honkavaara et al. | Remote sensing of 3-D geometry and surface moisture of a peat production area using hyperspectral frame cameras in visible to short-wave infrared spectral ranges onboard a small unmanned airborne vehicle (UAV) | |
Doneus et al. | New ways to extract archaeological information from hyperspectral pixels | |
Stanton et al. | Unmanned aircraft system-derived crop height and normalized difference vegetation index metrics for sorghum yield and aphid stress assessment | |
Samiappan et al. | Using unmanned aerial vehicles for high-resolution remote sensing to map invasive Phragmites australis in coastal wetlands | |
Greaves et al. | High-resolution mapping of aboveground shrub biomass in Arctic tundra using airborne lidar and imagery | |
Gini et al. | Aerial images from an UAV system: 3D modeling and tree species classification in a park area | |
Lu et al. | A comparison of multisensor integration methods for land cover classification in the Brazilian Amazon | |
US8810658B2 (en) | Estimating a visible vector representation for pixels in an infrared image | |
US20100208981A1 (en) | Method for visualization of point cloud data based on scene content | |
JP2012196167A (en) | Plant species identification method | |
CN113033279A (en) | Crop fine classification method and system based on multi-source remote sensing image | |
Kong et al. | Super resolution of historic Landsat imagery using a dual generative adversarial network (GAN) model with CubeSat constellation imagery for spatially enhanced long-term vegetation monitoring | |
CN111413279A (en) | Video processing method and device for multispectral detection and multispectral detection terminal | |
Demir | Using UAVs for detection of trees from digital surface models | |
Stroppiana et al. | Estimating crop density from multi-spectral uav imagery in maize crop | |
Neale | Classification and mapping of riparian systems using airborne multispectral videography | |
Mancini et al. | A multi/hyper-spectral imaging system for land use/land cover using unmanned aerial systems | |
Liu et al. | Semi-automatic extraction and mapping of farmlands based on high-resolution remote sensing images | |
Chen et al. | Change of spatial information under rescaling: A case study using multi-resolution image series | |
Imai et al. | Shadow detection in hyperspectral images acquired by UAV | |
JP6200821B2 (en) | Forest phase analysis apparatus, forest phase analysis method and program | |
Jin | ENVI automated image registration solutions | |
Karakizi et al. | Detecting and classifying vine varieties from very high resolution multispectral data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20790866 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20790866 Country of ref document: EP Kind code of ref document: A1 |