Cast shadows caused by sparse clouds usually degrade spaceborne and airborne imagery. They result from the decrease of the direct solar beam due to the presence of a non-transparent cloud. The reduction of the downwelling solar flux density can be quantified during an air campaign, if the aircraft flies beneath the cloud and is equipped with an add-on instrument that measures the total downwelling solar irradiance. The objective of this work is to exploit such data for the de-shadowing of airborne hyperspectral imagery. Initially, the specific illumination and viewing conditions during the image acquisition, which allow the use of at-sensor downwelling irradiance data for the de-shadowing of airborne hyperspectral imagery, are outlined. Then a methodology is proposed that estimates the radiometric enhancement coefficients from the at-sensor irradiance data and correlates them with the image data using a shadow map. Improvements of the quality of the shadow maps are suggested. Performance assessment showed that at-sensor irradiance data could be satisfactorily utilized for compensating the cast shadow effects on remotely sensed imagery. It also highlighted the importance of generating and using an accurate shadow map and the particular difficulties for the air campaign planning raised by the requirement of exploitable at-sensor irradiance data.