In this chapter we review the main difficulties encountered in Automatic Speech Recognition (ASR) when the type of communication channel is not known. This is a typical ASR challenge when an arbitrary type of microphone is used, in telephonebased applications or hands-free speech recognition. For promising domains such as computer telephony and cars, the ability to handle these challenges is becoming a requirement more than a desired feature. The main technical problems encountered involve speaker and task variability, the usability of the user interface, the ambient noise which distorts the input speech signals, reverberation and echoes, the use of microphones with different characteristics, the variable quality of the support channels (e.g. telephone channels are noisy and have different characteristics), and the variable distance arid direction to the microphone introduced by hands-free recognition. This chapter presents these sources of variability/distortion along with their influence on ASR.