In 2020 and 2021 a new perception testbed was developed at NASA Ames Research center to collect data from an array of sensing systems representative of those that could be found on a future UAM vehicle. Under the Perception task of the Autonomous Systems project, funded by the Aeronautics Research Mission Directorate (ARMD) through the Transformative Tools and Technologies project, this testbed was both built and deployed for testing in the Fog Chamber located at Sandia National Laboratories in Albuquerque, New Mexico. This site contains an outline of the tests, test data, and associated documentation.
In May of 2021, the perception testbed was deployed to the Fog Chamber at Sandia National Laboratories. The testbed featured a FLIR Blackfly visual spectrum camera, a FLIR Boson longwave infrared camera, and a AEye 4Sight M intelligent LIDAR. Within the chamber various fog species, including coastal fog, may be produced consistently. Over the course of five days, more than 40 experiments, calibration runs, baseline tests, and additional tests were performed in the fog chamber with 3 different targets. A human target, a small (less than 10 kg) unmanned aerial vehicle (UAV), and a USAF 1951 resolution target were used in testing. Controlled test variables include, the ambient lighting in the chamber, target distance from the perception testbed, and target type and temperature of the target.
Testbed Sensor Specifications:
More than 2 terabytes of data was collected during the deployment to the Fog Chamber. This data consists of images from both the visual spectrum camera and the longwave infrared camera, range and intensity data from the LIDAR, and fog characterization data from the chamber's own sensing systems. To promote consumption of the data by the public, the data and documentation are here arranged by experiment. Three types of test exist, 1) baseline tests - those that do not feature fog, were used to collect a baseline of a new experimental configuration, 2) fog tests - experiments featuring fog and lasting until significant dissipation of the fog, 3) public affairs office tests - tests featuring humans in the fog to document the tests and provide relatable data for consumption by the broader public.
Characterization of the developed fog within the chamber is done with Sandia's instrumentation which measure both fog particle size distribution and meteorological optical range (MOR). A Spraytec instrument from Malvern Instruments which uses a laser diffraction as a method for measuring droplet size distribution is used to characterize the fog in real-time. Additionally, a transmissometer consisting of a light emitting diode (LED) and a standard photodetector at a set distance across the length of the fog chamber is used to calculate the relative MOR measurement for baseline tests with no fog and fog tests. The data from these instruments is collected into sets representing each day of experimentation (4 days). On a given day, the timestamps of the imagery of LIDAR data may be fit to the timestamps from the environmental data. Environment data for all four days of testing is available in the
fog_chamber_environment_.zip, file.Data Structure:
The experiment data is enclosed in .zip files with the name of the given experiment. Within each zip file there are two folders, "Database" - which holds the images from the visible spectrum camera and longwave infrared camera and a metadata.csv file with information about collection sequence and file names. The older folder "Lidar" contains both point-cloud .csv files with associated frame number in the file name and image files taken with the LIDAR's fish-eye lens.
The following table is a list of the Perception Testbed Fog Chamber Experiments with links to their data and associated documentation.
Experiment Name | Link to Dataset .zip File | Link to Documentation File | Ambient Lighting (on/off) | Target | Target Distance (meters) | Target Temperature (C) | Notes |
---|---|---|---|---|---|---|---|
baseline01 | baseline01.zip | baseline01.pdf | On | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
baseline02 | baseline02.zip | baseline02.pdf | On | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
baseline03 | baseline03.zip | baseline03.pdf | Off | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
baseline04 | baseline04.zip | baseline04.pdf | Off | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
fog00 | Not Available | Not Available | On | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
fog01 | fog01.zip | fog01.pdf | On | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
fog02 | fog02.zip | fog02.pdf | Off | USAF-1951 | 6.5 m | 37 C | Boson was out of focus. |
fog03 | fog03.zip | fog03.pdf | Off | USAF-1951 | 6.5 m | 60 C | Boson was out of focus. |
fog04 | fog04.zip | fog04.pdf | On | USAF-1951 | 6.5 m | 60 C | Boson was out of focus. |
fog05 | Not Available | Not Available | On | USAF-1951 | 41 m | 60 C | Boson was out of focus. |
fog06 | fog06.zip | fog06.pdf | Off | USAF-1951 | 41 m | 60 C | Boson was out of focus. End of testing day 1. |
baseline05 | Not Available | Not Available | On | USAF-1951 | 41 m | N/A | Boson was out of focus. |
fog07 | Not Available | Not Available | On | USAF-1951 | 41 m | 37 C | Lidar data only. |
fog08 | fog08.zip | fog08.pdf | On | USAF-1951 | 41 m | 37 C | Boson was out of focus. |
fog09 | fog09.zip | fog09.pdf | Off | USAF-1951 | 41 m | 37 C | Boson was out of focus. |
fog10 | fog10.zip | fog10.pdf | On | USAF-1951 | 17.6 m | 37 C | Boson was out of focus. |
fog11 | fog11.zip | fog11.pdf | Off | USAF-1951 | 17.6 m | 37 C | Boson was out of focus. |
fog12 | fog12.zip | fog12.pdf | On | USAF-1951 | 17.6 m | 60 C | Boson was out of focus. |
fog13 | Not Available | Not Available | On | USAF-1951 | 17.6 m | 60 C | Boson was out of focus. No LIDAR data. |
fog14 | fog14.zip | fog14.pdf | On | USAF-1951 | 17.6 m | N/A | Blackbody temperature is likely 60 C. Boson was out of focus. |
pao01 | Not Available | Not Available | On | Human | N/A | N/A | Single human in chamber walking. Boson was out of focus. |
fog15 | fog15.zip | fog15.pdf | On | USAF-1951 | 45.6 m | 37 C | Boson focus adjusted to infinity. Last test of the day, long test. |
baseline07 | baseline07.zip | baseline07.pdf | On | USAF-1951 | 45.6 m | 20 C | Blackbody is at room temperature. |
baseline08 | baseline08.zip | baseline08.pdf | On | USAF-1951 | 45.6 m | 60 C | None. |
fog16 | fog16.zip | fog16.pdf | On | USAF-1951 | 45.6 m | 60 C | None. |
Baseline09 | baseline09.zip | baseline09.pdf | On | UAV - Oncoming | 18.23 m | N/A | Fog chamber evacuated before test. First UAV test, UAV on tripod, no props. Motors running an up to temp before start of test. |
fog17 | fog17.zip | fog17.pdf | On | UAV - Oncoming | 18.23 m | N/A C | UAV motors running. |
pao02 | pao02.zip | pao02.pdf | On | Multiple Humans | Various | N/A | Multiple humans, film crew, collecting with all sensors. Full fog spray. |
fog18 | fog18.zip | fog18.pdf | Off | UAV - Oncoming | 18.23 m | N/A | UAV motors run during test, no props. Last test of the day. |
baseline10 | Not Available | Not Available | On | UAV - Oncoming | 45.6 m | N/A | UAV Motors not running during test, must rebaseline. |
fog19 | Not Available | Not Available | On | UAV - Oncoming | 45.6 m | N/A | UAV motors running. |
fog20 | fog20.zip | fog20.pdf | Off | UAV - Oncoming | 45.6 m | N/A | UAV motors running. |
baseline11 | baseline11.zip | baseline11.pdf | On | UAV - Oncoming | 45.6 m | N/A | None. |
baseline12 | baseline12.zip | baseline12.pdf | Off | UAV - Oncoming | 45.6 m | N/A | None. |
baseline13 | Not Available | Not Available | On | UAV - Hover | 45.6 m | N/A | None. |
baseline14 | Not Available | Not Available | Off | UAV - Hover | 45.6 m | N/A | None. |
fog21 | Not Available | Not Available | Off | UAV - Hover | 45.6 m | N/A | None. |
fog22 | fog22.zip | fog22.pdf | On | UAV - Hover | 45.6 m | N/A | None. |
fog23 | Not Available | Not Available | On | USAF-1951 | 17.6 m | 37 C | No visible spectrum data, test ended early. |
fog24 | fog24.zip | fog24.pdf | On | USAF-1951 | 17.6 m | 37 C | LIDAR data collection ended early. |
Last
Updated
16 December 2021