Accurate knowledge of the vertical and horizontal extent of clouds and aerosols in the earth's atmosphere is critical in assessing the planet's radiation budget and for advancing human understanding of climate change issues. To retrieve this fundamental information from the elastic backscatter lidar data acquired during the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission, a selective, iterated boundary location (SIBYL) algorithm has been developed and deployed. SIBYL accomplishes its goals by integrating an adaptive context-sensitive profile scanner into an iterated multiresolution spatial averaging scheme. This paper provides an in-depth overview of the architecture and performance of the SIBYL algorithm. It begins with a brief review of the theory of target detection in noise-contaminated signals, and an enumeration of the practical constraints levied on the retrieval scheme by the design of the lidar hardware, the geometry of a space-based remote sensing platform, and the spatial variability of the measurement targets. Detailed descriptions are then provided for both the adaptive threshold algorithm used to detect features of interest within individual lidar profiles and the fully automated multiresolution averaging engine within which this profile scanner functions. The resulting fusion of profile scanner and averaging engine is specifically designed to optimize the trade-offs between the widely varying signal-to-noise ratio of the measurements and the disparate spatial resolutions of the detection targets. Throughout the paper, specific algorithm performance details are illustrated using examples drawn from the existing CALIPSO dataset. Overall performance is established by comparisons to existing layer height distributions obtained by other airborne and space-based lidars.

The Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite was launched in April 2006 to provide global vertically resolved measurements of clouds and aerosols. Correct discrimination between clouds and aerosols observed by the lidar aboard the CALIPSO satellite is critical for accurate retrievals of cloud and aerosol optical properties and the correct interpretation of measurements. This paper reviews the theoretical basis of the CALIPSO lidar cloud and aerosol discrimination (CAD) algorithm, and describes the enhancements made to the version 2 algorithm that is used in the current data release (release 2). The paper also presents a preliminary assessment of the CAD performance based on one full day (12 August 2006) of expert manual classification and on one full month (July 2006) of the CALIOP 5-km cloud and aerosol layer products. Overall, the CAD algorithm works well in most cases. The 1-day manual verification suggests that the success rate is in the neighborhood of 90% or better. Nevertheless, several specific layer types are still misclassified with some frequency. Among these, the most prevalent are dense dust and smoke close to the source regions. The analysis of the July 2006 data showed that the misclassification of dust as cloud occurs for ,1% of the total tropospheric cloud and aerosol features found. Smoke layers are misclassified less frequently than are dust layers. Optically thin clouds in the polar regions can be misclassified as aerosols. While the fraction of such misclassifications is small compared with the number of aerosol features found globally, caution should be taken when studies are performed on the aerosol in the polar regions. Modifications will be made to the CAD algorithm in future data releases, and the misclassifications encountered in the current data release are expected to be reduced greatly.

The CALIOP lidar, carried on the CALIPSO satellite, has been acquiring global atmospheric profiles since June 2006. This dataset now offers the opportunity to characterize the global 3-D distribution of aerosol as well as seasonal and interannual variations, and confront aerosol models with observations in a way that has not been possible before. With that goal in mind, a monthly global gridded dataset of daytime and nighttime aerosol extinction profiles has been constructed, available as a Level 3 aerosol product. Averaged aerosol profiles for cloud-free and all-sky conditions are reported separately. This 6-yr dataset characterizes the global 3-dimensional distribution of tropospheric aerosol. Vertical distributions are seen to vary with season, as both source strengths and transport mechanisms vary. In most regions, clear-sky and all-sky mean aerosol profiles are found to be quite similar, implying a lack of correlation between high semi-transparent cloud and aerosol in the lower troposphere. An initial evaluation of the accuracy of the aerosol extinction profiles is presented. Detection limitations and the representivity of aerosol profiles in the upper troposphere are of particular concern. While results are preliminary, we present evidence that the monthly-mean CALIOP aerosol profiles provide quantitative characterization of elevated aerosol layers in major transport pathways. Aerosol extinction in the free troposphere in clean conditions, where the true aerosol extinction is typically 0.001 km⁻¹ or less, is generally underestimated, however. The work described here forms an initial global 3-D aerosol climatology which we plan to extend and improve over time

Clouds cover about 70% of the Earth's surface and playa dominant role in the energy and water cycle of our planet. Only satellite observations provide a continuous survey of the state of the atmosphere over the whole globe and across the wide range of spatial and temporal scales that comprise weather and climate variability. Satellite cloud data records now exceed more than 25 years in length. However, climatologies compiled from different satellite datasets can exhibit systematic biases. Questions therefore arise as to the accuracy and Capsule:Cloud properties derived from space observations are immensely valuable for climate studies and model evaluati~n; this assessment has revealed how their statistics may be affected by instrument capabilities and/or retrieval methods but also highlight those well determined.2

Two different cloud climatologies have been derived from the same NASA–Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP)-measured attenuated backscattered profile (level 1, version 3 dataset). The first climatology, named Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations–Science Team (CALIPSO-ST), is based on the standard CALIOP cloud mask (level 2 product, version 3), with the aim to document clouds with the highest possible spatiotemporal resolution, taking full advantage of the CALIOP capabilities and sensitivity for a wide range of cloud scientific studies. The second climatology, named GCM-Oriented CALIPSO Cloud Product (CALIPSO-GOCCP), is aimed at a single goal: evaluating GCM prediction of cloudiness. For this specific purpose, it has been designed to be fully consistent with the CALIPSO simulator included in the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package (COSP) used within version 2 of the CFMIP (CFMIP-2) experiment and phase 5 of the Coupled Model Intercomparison Project (CMIP5). The differences between the two datasets in the global cloud cover maps—total, low level (P > 680 hPa), midlevel (680 < P < 440 hPa), and high level (P < 440 hPa)—are frequently larger than 10% and vary with region. The two climatologies show significant differences in the zonal cloud fraction profile (which differ by a factor of almost 2 in some regions), which are due to the differences in the horizontal and vertical averaging of the measured attenuated backscattered profile CALIOP profile before the cloud detection and to the threshold used to detect clouds (this threshold depends on the resolution and the signal-to-noise ratio).