Deep learning (DL) is one of the core subsets of the semantic machine learning representations (SMLR) that impact on discovering multiple processing layers of non-linear big data (BD) transformations with high levels of abstraction concepts. The SMLR can unravel the concealed explanation characteristics and modifications of the heterogeneous data sources that are intertwined for further artificial intelligence (AI) implementations. Deep learning impacts high-level abstractions in data by deploying hierarchical architectures. It is practically challenging to model big data representations, which impacts on data and knowledge-based representations. Encouraged by deep learning, the formal knowledge representation has the potential to influence the SMLR process. Deep learning architecture is capable of modelling efficient big data representations for further artificial intelligence and SMLR tasks. This chapter focuses on how deep learning impacts on defining deep transfer learning, category, and works based on the techniques used on semantic machine learning representations.