Reflection-Reducing Imaging System for Machine Vision Applications

The Projected BOS imaging system developed at the NASA Langley Research Center provides a significant advancement over other BOS flow visualization techniques. Specifically, the present BOS imaging method removes the need for a physically patterned retroreflective background within the flow of interest and is therefore insensitive to the changing conditions due to the flow. For example, in a wind tunnel used for aerodynamics testing, there are vibrations and temperature changes that can affect the entire tunnel and anything inside it. Any patterned background within the wind tunnel will be subject to these changing conditions and those effects must be accounted for in the post-processing of the BOS image. This post-processing is not necessary in the Projected BOS process here. In the Projected BOS system, a pattern is projected onto a retroreflective background across the flow of interest (Figure 1). The imaged pattern in this configuration can be made physically (a pattern on a transparent slide) or can be digitally produced on an LCD screen. In this projection scheme, a reference image can be taken at the same time as the signal image, facilitating real-time BOS imaging and the pattern to be changed or optimized during the measurements. Thus far, the Projected BOS imaging technology has been proven to work by visualizing the air flow out of a compressed air canister taken with this new system (Figure 2).

NASAs single grid, self-aligned focusing schlieren optical assembly is attached to a commercial-off-the-shelf camera. It directs light from the light source through a condenser lens and linear polarizer towards a polarizing beam-splitter where the linear, vertically-polarized component of light is reflected onto the optical axis of the instrument. The light passes through a Ronchi ruling grid, a polarizing prism, and a quarter-wave plate prior to projection from the assembly as right-circularly polarized light. The grid-patterned light (having passed through the Ronchi grid) is directed past the density object onto a retroreflective background that serves as the source grid. Upon reflection off the retroreflective background, the polarization state of light is mirrored. It passes the density object a second time and is then reimaged by the system. Upon encountering the polarizing prism the second time, the light is refracted resulting in a slight offset. This refracted light passes through the Ronchi ruling grid, now serving as the cutoff grid, for a second time before being imaged by the camera. Both small- and large-scale experimental set ups have been evaluated and shown to be capable of fields-of-view of 10 and 300 millimeters respectively. Observed depths of field were found to be comparable to existing systems. Light sources, polarizing prisms, retroreflective materials and lenses can be customized to suit a particular experiment. For example, with a high speed camera and laser light source, the system has collected flow images at a rate of 1MHz.

The innovation improves upon the performance of passive automatic enhancement of digital images. Specifically, the image enhancement process is improved in terms of resulting contrast, lightness, and sharpness over the prior art of automatic processing methods. The innovation brings the technique of active measurement and control to bear upon the basic problem of enhancing the digital image by defining absolute measures of visual contrast, lightness, and sharpness. This is accomplished by automatically applying the type and degree of enhancement needed based on automated image analysis. The foundation of the processing scheme is the flow of digital images through a feedback loop whose stages include visual measurement computation and servo-controlled enhancement effect. The cycle is repeated until the servo achieves acceptable scores for the visual measures or reaches a decision that it has enhanced as much as is possible or advantageous. The servo-control will bypass images that it determines need no enhancement. The system determines experimentally how much absolute degrees of sharpening can be applied before encountering detrimental sharpening artifacts. The latter decisions are stop decisions that are controlled by further contrast or light enhancement, producing unacceptable levels of saturation, signal clipping, and sharpness. The invention was developed to provide completely new capabilities for exceeding pilot visual performance by clarifying turbid, low-light level, and extremely hazy images automatically for pilot view on heads-up or heads-down display during critical flight maneuvers.

NASAs digital projection focusing schlieren system is attached to a commercial-off-the-shelf camera. For focusing schlieren measurements, it directs light from the light source through a condenser lens and linear polarizer towards a beam-splitter where linear, vertically-polarized component of light is reflected onto the optical axis of the instrument. The light passes through the patterned LCD element, a polarizing prism, and a quarter-wave plate prior to projection from the assembly as left- or right-circularly polarized light. The grid-patterned light (having passed through the LCD element) is directed past the density object onto a retroreflective background (RBG) that serves as the source grid. Upon reflection off the RBG, the polarization state of light is mirrored. It passes the density object a second time and is then reimaged by the system. Upon encountering the polarizing prism the second time, the light is slightly offset. This refracted light passes through the LCD element, now serving as the cutoff grid, for a second time before being imaged by the camera. The LCD element can be programmed to display a variety of grid patterns to enable sensitivity to different density gradients. the color properties of the LCD can be leveraged in combination with multiple colored light sources to enable simultaneous multi-color, multi-technique data collection.

The SQRLi system is made up of three major components including the laser assembly, the mirror assembly, and the electronics and data processing equipment (electronics assembly) as shown in the figure below. The three main systems work together to send and receive the lidar signal then translate it into a 3D image for navigation and imaging purposes. The rover sensing instrument makes use of a unique fiber optic laser assembly with high, adjustable output that increases the dynamic range (i.e., contrast) of the lidar system. The commercially available mirror setup used in the SQRLi is small, reliable, and has a wide aperture that improves the field-of-view of the lidar while maintaining a small instrument footprint. Lastly, the data processing is done by an in-house designed processor capable of translating the light signal into a high-resolution (sub-millimeter) 3D map. These components of the SQRLi enable successful hazard detection and navigation in visibility-impaired environments. The SQRLi is applicable to planetary and lunar exploration by unmanned or crewed vehicles and may be adapted for in-space servicing, assembly, and manufacturing purposes. Beyond NASA missions, the new 3D lidar may be used for vehicular navigation in the automotive, defense, or commercial space sectors. The SQRLi is available for patent licensing.