We review the synthesis of semiconductor nanocrystals/colloidal quantum dots in organic solvents with special emphasis on earth-abundant and toxic heavy metal free compounds. Following the Introduction, section 2 defines the terms related to the toxicity of nanocrystals and gives a comprehensive overview on toxicity studies concerning all types of quantum dots. Section 3 aims at providing the reader with the basic concepts of nanocrystal synthesis. It starts with the concepts currently used to describe the nucleation and growth of monodisperse particles and next takes a closer look at the chemistry of the inorganic core and its interactions with surface ligands. Section 4 reviews in more detail the synthesis of different families of semiconductor nanocrystals, namely elemental group IV compounds (carbon nanodots, Si, Ge), III-V compounds (e.g., InP, InAs), and binary and multinary metal chalcogenides. Finally, the authors' view on the perspectives in this field is given.