When projecting imagery into a georeferenced coordinate frame, one needs to have some model of the geographical region that is being projected to. This model can sometimes be a simple geometrical curve, such as an ellipse or even a plane. However, to obtain accurate projections, one needs to have a more sophisticated model that encodes the undulations in the terrain including things like mountains, valleys, and even manmade structures. The product that is often used for this purpose is a...
Topics: NASA Technical Reports Server (NTRS), DIGITAL ELEVATION MODELS, IMAGERY, REFERENCE SYSTEMS, TWO...
A team of JPL researchers has analyzed stereoscopic vision software and produced a document describing its performance. This software is of the type used in maneuvering exploratory robotic vehicles on Martian terrain. The software in question utilizes correlations between portions of the images recorded by two electronic cameras to compute stereoscopic disparities, which, in conjunction with camera models, are used in computing distances to terrain points to be included in constructing a...
Topics: NASA Technical Reports Server (NTRS), ROBOTICS, STEREOSCOPIC VISION, COMPUTER PROGRAMS, TERRAIN,...
Using aerial imagery, the JPL FineCalibration (JPL FineCal) software automatically tunes a set of existing CAHVOR camera models for an array of cameras. The software finds matching features in the overlap region between images from adjacent cameras, and uses these features to refine the camera models. It is not necessary to take special imagery of a known target and no surveying is required. JPL FineCal was developed for use with an aerial, persistent surveillance platform.
Topics: NASA Technical Reports Server (NTRS), AERIAL PHOTOGRAPHY, CALIBRATING, CAMERAS, IMAGE PROCESSING,...
As imagery is collected from an airborne platform, an individual viewing the images wants to know from where on the Earth the images were collected. To do this, some information about the camera needs to be known, such as its position and orientation relative to the Earth. This can be provided by common inertial navigation systems (INS). Once the location of the camera is known, it is useful to project an image onto some representation of the Earth. Due to the non-smooth terrain of the Earth...
Topics: NASA Technical Reports Server (NTRS), AERIAL PHOTOGRAPHY, IMAGING TECHNIQUES, FLYING PLATFORMS,...
This software finds feature point correspondences in sequences of images. It is designed for feature matching in aerial imagery. Feature matching is a fundamental step in a number of important image processing operations: calibrating the cameras in a camera array, stabilizing images in aerial movies, geo-registration of images, and generating high-fidelity surface maps from aerial movies. The method uses a Shi-Tomasi corner detector and normalized cross-correlation. This process is likely to...
Topics: NASA Technical Reports Server (NTRS), IMAGE PROCESSING, REAL TIME OPERATION, SOFTWARE ENGINEERING,...
A paper describes a method devised to increase the robustness and accuracy of tracking of targets by means of three stereoscopic pairs of video cameras on a Mars-rover-type exploratory robotic vehicle. Two of the camera pairs are mounted on a mast that can be adjusted in pan and tilt; the third camera pair is mounted on the main vehicle body. Elements of the method include a mast calibration, a camera-pointing algorithm, and a purely geometric technique for handing off tracking between...
Topics: NASA Technical Reports Server (NTRS), ACCURACY, INVERSE KINEMATICS, ATTITUDE (INCLINATION),...
MatchGUI software, based on MATLAB, automatically matches two images and displays the match result by superimposing one image on the other. A slider bar allows focus to shift between the two images. There are tools for zoom, auto-crop to overlap region, and basic image markup. Given a pair of ortho-rectified images (focused primarily on Mars orbital imagery for now), this software automatically co-registers the imagery so that corresponding image pixels are aligned. MatchGUI requires minimal...
Topics: NASA Technical Reports Server (NTRS), IMAGE PROCESSING, IMAGERY, PATTERN REGISTRATION, GRAPHICAL...
The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features....
Topics: NASA Technical Reports Server (NTRS), CAMERAS, DATA BASES, IMAGERY, POSITION (LOCATION), ROBOTS,...
A solution was developed that matches visible/IR imagery aboard a balloon in Saturn's moon Titan's atmosphere to SAR (synthetic aperture radar) and visible/IR data acquired from orbit. A balloon in Titan's atmosphere must be able to localize itself autonomously both globally and with respect to local terrain. The orbital data is used to provide the balloon imagery with global context. The work is novel in applying mutual information (MI) to orbital vs. aerial data. There are unique challenges...
Topics: NASA Technical Reports Server (NTRS), IMAGE PROCESSING, IMAGING TECHNIQUES, TITAN ATMOSPHERE,...
This software automatically calibrates a camera or an imaging array to an inertial navigation system (INS) that is rigidly mounted to the array or imager. In effect, it recovers the coordinate frame transformation between the reference frame of the imager and the reference frame of the INS. This innovation can automatically derive the camera-to-INS alignment using image data only. The assumption is that the camera fixates on an area while the aircraft flies on orbit. The system then, fully...
Topics: NASA Technical Reports Server (NTRS), CALIBRATING, CAMERAS, INERTIAL NAVIGATION, COMPUTER...
The JPL Robot Vision Library (JPLV) provides real-time robot vision algorithms for developers who are not vision specialists. The package includes algorithms for stereo ranging, visual odometry and unsurveyed camera calibration, and has unique support for very wideangle lenses
Topics: NASA Technical Reports Server (NTRS), COMPUTER VISION, ROBOTS, ALGORITHMS, COMPUTER PROGRAMS,...
In an improvement of the visual-target-tracking software used aboard a mobile robot (rover) of the type used to explore the Martian surface, an affine-matching algorithm has been replaced by a combination of a normalized- cross-correlation (NCC) algorithm and a template-image-magnification algorithm. Although neither NCC nor template-image magnification is new, the use of both of them to increase the degree of reliability with which features can be matched is new. In operation, a template image...
Topics: NASA Technical Reports Server (NTRS), ROBOTS, OPTICAL TRACKING, CROSS CORRELATION, TRACKING...
An architecture for autonomous operation of an aerobot (i.e., a robotic blimp) to be used in scientific exploration of planets and moons in the Solar system with an atmosphere (such as Titan and Venus) is undergoing development. This architecture is also applicable to autonomous airships that could be flown in the terrestrial atmosphere for scientific exploration, military reconnaissance and surveillance, and as radio-communication relay stations in disaster areas. The architecture was...
Topics: NASA Technical Reports Server (NTRS), AIRSHIPS, AUTOMATIC CONTROL, AUTONOMY, RADIO COMMUNICATION,...
A report discusses a computer vision algorithm for position estimation to enable precision landing during planetary descent. The Descent Image Motion Estimation System for the Mars Exploration Rovers has been used as a starting point for creating code for precision, terrain-relative navigation during planetary landing. The algorithm is designed to be general because it handles images taken at different scales and resolutions relative to the map, and can produce mapped landmark matches for any...
Topics: NASA Technical Reports Server (NTRS), COMPUTER VISION, ALGORITHMS, PLANETARY LANDING, IMAGE...
