Autonomous Systems Perception Testbed Campaign at the Sandia National Laboratories' Fog Chamber: Test Data and Documentation


In 2020 and 2021 a new perception testbed was developed at NASA Ames Research center to collect data from an array of sensing systems representative of those that could be found on a future UAM vehicle. Under the Perception task of the Autonomous Systems project, funded by the Aeronautics Research Mission Directorate (ARMD) through the Transformative Tools and Technologies project, this testbed was both built and deployed for testing in the Fog Chamber located at Sandia National Laboratories in Albuquerque, New Mexico. This site contains an outline of the tests, test data, and associated documentation.

In May of 2021, the perception testbed was deployed to the Fog Chamber at Sandia National Laboratories. The testbed featured a FLIR Blackfly visual spectrum camera, a FLIR Boson longwave infrared camera, and a AEye 4Sight M intelligent LIDAR. Within the chamber various fog species, including coastal fog, may be produced consistently. Over the course of five days, more than 40 experiments, calibration runs, baseline tests, and additional tests were performed in the fog chamber with 3 different targets. A human target, a small (less than 10 kg) unmanned aerial vehicle (UAV), and a USAF 1951 resolution target were used in testing. Controlled test variables include, the ambient lighting in the chamber, target distance from the perception testbed, and target type and temperature of the target.

Testbed Sensor Specifications:

More than 2 terabytes of data was collected during the deployment to the Fog Chamber. This data consists of images from both the visual spectrum camera and the longwave infrared camera, range and intensity data from the LIDAR, and fog characterization data from the chamber's own sensing systems. To promote consumption of the data by the public, the data and documentation are here arranged by experiment. Three types of test exist, 1) baseline tests - those that do not feature fog, were used to collect a baseline of a new experimental configuration, 2) fog tests - experiments featuring fog and lasting until significant dissipation of the fog, 3) public affairs office tests - tests featuring humans in the fog to document the tests and provide relatable data for consumption by the broader public.

Characterization of the developed fog within the chamber is done with Sandia's instrumentation which measure both fog particle size distribution and meteorological optical range (MOR). A Spraytec instrument from Malvern Instruments which uses a laser diffraction as a method for measuring droplet size distribution is used to characterize the fog in real-time. Additionally, a transmissometer consisting of a light emitting diode (LED) and a standard photodetector at a set distance across the length of the fog chamber is used to calculate the relative MOR measurement for baseline tests with no fog and fog tests. The data from these instruments is collected into sets representing each day of experimentation (4 days). On a given day, the timestamps of the imagery of LIDAR data may be fit to the timestamps from the environmental data. Environment data for all four days of testing is available in the   fog_chamber_environment_.zip,  file.

Data Structure:

The experiment data is enclosed in .zip files with the name of the given experiment. Within each zip file there are two folders, "Database" - which holds the images from the visible spectrum camera and longwave infrared camera and a metadata.csv file with information about collection sequence and file names. The older folder "Lidar" contains both point-cloud .csv files with associated frame number in the file name and image files taken with the LIDAR's fish-eye lens.


The following table is a list of the Perception Testbed Fog Chamber Experiments with links to their data and associated documentation.


Fog Test Compiled Documentation featuring experimental setup, experiment sequence and all experiment documents:  Sandia_Test_Documentation_v1.pdf,  5 MB

Experiment Table

Experiment Name Link to Dataset .zip File Link to Documentation File Ambient Lighting (on/off) Target Target Distance (meters) Target Temperature (C) Notes
baseline01 baseline01.zip baseline01.pdf On USAF-1951 6.5 m 37 C Boson was out of focus.
baseline02 baseline02.zip baseline02.pdf On USAF-1951 6.5 m 37 C Boson was out of focus.
baseline03 baseline03.zip baseline03.pdf Off USAF-1951 6.5 m 37 C Boson was out of focus.
baseline04 baseline04.zip baseline04.pdf Off USAF-1951 6.5 m 37 C Boson was out of focus.
fog00 Not Available Not Available On USAF-1951 6.5 m 37 C Boson was out of focus.
fog01 fog01.zip fog01.pdf On USAF-1951 6.5 m 37 C Boson was out of focus.
fog02 fog02.zip fog02.pdf Off USAF-1951 6.5 m 37 C Boson was out of focus.
fog03 fog03.zip fog03.pdf Off USAF-1951 6.5 m 60 C Boson was out of focus.
fog04 fog04.zip fog04.pdf On USAF-1951 6.5 m 60 C Boson was out of focus.
fog05 Not Available Not Available On USAF-1951 41 m 60 C Boson was out of focus.
fog06 fog06.zip fog06.pdf Off USAF-1951 41 m 60 C Boson was out of focus. End of testing day 1.
baseline05 Not Available Not Available On USAF-1951 41 m N/A Boson was out of focus.
fog07 Not Available Not Available On USAF-1951 41 m 37 C Lidar data only.
fog08 fog08.zip fog08.pdf On USAF-1951 41 m 37 C Boson was out of focus.
fog09 fog09.zip fog09.pdf Off USAF-1951 41 m 37 C Boson was out of focus.
fog10 fog10.zip fog10.pdf On USAF-1951 17.6 m 37 C Boson was out of focus.
fog11 fog11.zip fog11.pdf Off USAF-1951 17.6 m 37 C Boson was out of focus.
fog12 fog12.zip fog12.pdf On USAF-1951 17.6 m 60 C Boson was out of focus.
fog13 Not Available Not Available On USAF-1951 17.6 m 60 C Boson was out of focus. No LIDAR data.
fog14 fog14.zip fog14.pdf On USAF-1951 17.6 m N/A Blackbody temperature is likely 60 C. Boson was out of focus.
pao01 Not Available Not Available On Human N/A N/A Single human in chamber walking. Boson was out of focus.
fog15 fog15.zip fog15.pdf On USAF-1951 45.6 m 37 C Boson focus adjusted to infinity. Last test of the day, long test.
baseline07 baseline07.zip baseline07.pdf On USAF-1951 45.6 m 20 C Blackbody is at room temperature.
baseline08 baseline08.zip baseline08.pdf On USAF-1951 45.6 m 60 C None.
fog16 fog16.zip fog16.pdf On USAF-1951 45.6 m 60 C None.
Baseline09 baseline09.zip baseline09.pdf On UAV - Oncoming 18.23 m N/A Fog chamber evacuated before test. First UAV test, UAV on tripod, no props. Motors running an up to temp before start of test.
fog17 fog17.zip fog17.pdf On UAV - Oncoming 18.23 m N/A C UAV motors running.
pao02 pao02.zip pao02.pdf On Multiple Humans Various N/A Multiple humans, film crew, collecting with all sensors. Full fog spray.
fog18 fog18.zip fog18.pdf Off UAV - Oncoming 18.23 m N/A UAV motors run during test, no props. Last test of the day.
baseline10 Not Available Not Available On UAV - Oncoming 45.6 m N/A UAV Motors not running during test, must rebaseline.
fog19 Not Available Not Available On UAV - Oncoming 45.6 m N/A UAV motors running.
fog20 fog20.zip fog20.pdf Off UAV - Oncoming 45.6 m N/A UAV motors running.
baseline11 baseline11.zip baseline11.pdf On UAV - Oncoming 45.6 m N/A None.
baseline12 baseline12.zip baseline12.pdf Off UAV - Oncoming 45.6 m N/A None.
baseline13 Not Available Not Available On UAV - Hover 45.6 m N/A None.
baseline14 Not Available Not Available Off UAV - Hover 45.6 m N/A None.
fog21 Not Available Not Available Off UAV - Hover 45.6 m N/A None.
fog22 fog22.zip fog22.pdf On UAV - Hover 45.6 m N/A None.
fog23 Not Available Not Available On USAF-1951 17.6 m 37 C No visible spectrum data, test ended early.
fog24 fog24.zip fog24.pdf On USAF-1951 17.6 m 37 C LIDAR data collection ended early.

NASA Official Responsible for Content


George E. Gorospe
 
 

Last Updated
16 December 2021