Update of the Three Dimensional Version of RHSeg and HSeg
information technology and software
Update of the Three Dimensional Version of RHSeg and HSeg (GSC-TOPS-244)
An improved RHSeg and HSeg algorithm that blends smaller subsections together such that the processing window artifacts are eliminated.
Overview
Image segmentation is the partitioning of an image into related sections or regions. For remotely sensed images of the Earth, an example is a map that divides the image into areas labeled by distinct Earth surface covers such as water, snow, and types of natural vegetation. A key problem encountered with RHSeg is that the image segmentation results often exhibit artifacts caused by the recursive subdivision of the image.
The Technology
Image data is subdivided into overlapping sections. Each image subsection has an extra pixels forming an overlapping seam in the x, y, and z axes. The region labeling these overlapping seams are examined and a histogram is created of the correspondence between region labels across image subsections. A region from one subsection is then merged together with a region from another subsection when specific criterion is met.
This innovations use of slightly overlapping processing windows eliminates processing window artifacts. This innovative approach can be used by any image segmentation or clustering approach that first operates on subsections of data and later combines the results from the subsections together to produce a result for the combined image.
Benefits
- Can subdivide 3-D image data into segments
- Reduces computational requirements
Applications
- Remote imaging
- Medical imaging
Technology Details
information technology and software
GSC-TOPS-244
GSC-17995-1
Similar Results
Hierarchical Image Segmentation (HSEG)
Currently, HSEG software is being used by Bartron Medical Imaging as a diagnostic tool to enhance medical imagery. Bartron Medical Imaging licensed the HSEG Technology from NASA Goddard adding color enhancement and developing MED-SEG, an FDA approved tool to help specialists interpret medical images.
HSEG is available for licensing outside of the medical field (specifically for soft-tissue analysis).
Automatic Extraction of Planetary Image Features and Multi-Sensor Image Registration
NASAs Goddard Space Flight Centers method for the extraction of Lunar data and/or planetary features is a method developed to extract Lunar features based on the combination of several image processing techniques. The technology was developed to register images from multiple sensors and extract features from images in low-contrast and uneven illumination conditions. The image processing and registration techniques can include, but is not limited to, a watershed segmentation, marked point processes, graph cut algorithms, wavelet transforms, multiple birth and death algorithms and/or the generalized Hough Transform.
Super Resolution 3D Flash LIDAR
This suite of technologies includes a method, algorithms, and computer processing techniques to provide for image photometric correction and resolution enhancement at video rates (30 frames per second). This 3D (2D spatial and range) resolution enhancement uses the spatial and range information contained in each image frame, in conjunction with a sequence of overlapping or persistent images, to simultaneously enhance the spatial resolution and range and photometric accuracies. In other words, the technologies allows for generating an elevation (3D) map of a targeted area (e.g., terrain) with much enhanced resolution by blending consecutive camera image frames. The degree of image resolution enhancement increases with the number of acquired frames.
Computational Visual Servo
The innovation improves upon the performance of passive automatic enhancement of digital images. Specifically, the image enhancement process is improved in terms of resulting contrast, lightness, and sharpness over the prior art of automatic processing methods. The innovation brings the technique of active measurement and control to bear upon the basic problem of enhancing the digital image by defining absolute measures of visual contrast, lightness, and sharpness. This is accomplished by automatically applying the type and degree of enhancement needed based on automated image analysis.
The foundation of the processing scheme is the flow of digital images through a feedback loop whose stages include visual measurement computation and servo-controlled enhancement effect. The cycle is repeated until the servo achieves acceptable scores for the visual measures or reaches a decision that it has enhanced as much as is possible or advantageous. The servo-control will bypass images that it determines need no enhancement.
The system determines experimentally how much absolute degrees of sharpening can be applied before encountering detrimental sharpening artifacts. The latter decisions are stop decisions that are controlled by further contrast or light enhancement, producing unacceptable levels of saturation, signal clipping, and sharpness.
The invention was developed to provide completely new capabilities for exceeding pilot visual performance by clarifying turbid, low-light level, and extremely hazy images automatically for pilot view on heads-up or heads-down display during critical flight maneuvers.
ShuttleSCAN 3-D
How It Works
The scanners operation is based on the principle of Laser Triagulation. The ShuttleSCAN contains an imaging sensor; two lasers mounted on opposite sides of the imaging sensor; and a customized, on-board processor for processing the data from the imaging sensor. The lasers are oriented at a given angle and surface height based on the size of objects being examined. For inspecting small details, such as defects in space shuttle tiles, a scanner is positioned close to the surface. This creates a small field of view but with very high resolution. For scanning larger objects, such as use in a robotic vision application, a scanner can be positioned several feet above the surface. This increases the field of view but results in slightly lower resolution. The laser projects a line on the surface, directly below the imaging sensor. For a perfectly flat surface, this projected line will be straight. As the ShuttleSCAN head moves over the surface, defects or irregularities above and below the surface will cause the line to deviate from perfectly straight. The SPACE processors proprietary algorithms interpret these deviations in real time and build a representation of the defect that is then transmitted to an attached PC for triangulation and 3-D display or printing. Real-time volume calculation of the defect is a capability unique to the ShuttleSCAN system.
Why It Is Better
The benefits of the ShuttleSCAN 3-D system are very unique in the industry. No other 3-D scanner can offer the combination of speed, resolution, size, power efficiency, and versatility. In addition, ShuttleSCAN can be used as a wireless instrument, unencumbered by cables. Traditional scanning systems make a tradeoff between resolution and speed. ShuttleSCANs onboard SPACE processor eliminates this tradeoff. The system scans at speeds greater than 600,000 points per second, with a resolution smaller than .001". Results of the scan are available in real time, whereas conventional systems scan over the surface, analyze the scanned data, and display the results long after the scan is complete.