Hotel review is frequently used as a main input in sentiment analysis process. It aims at helping travellers easily find more accurate information about hotel aspects in selecting hotels for their journeys. Based on the review datasets, hotel service organizers may evaluate guests' responses towards the services provided by the hotels. Hotel organizers, in turn, may also know the hotel aspects which need improvement for the next experiences. The common problems are because the processed data do not focus on small scale so that wrong selection of terms from review document frequently appears. The problem that often arises is that the amount of data that is processed is not limited to a small scale, so there are often errors in taking terms from a review document. Meanwhile, these terms are the main input source used for the assessment of aspect categorization and aspect-based sentiment analysis. So, we need aspect categorization and aspect-based sentiment analysis methods that can work automatically on a large scale with good accuracy results. In this study, first, the results of the pre-processing were processed using TF-ICF to obtain terms from reviews based on aspect keyword variables in each hotel aspect category. Next, LDA was used to get the hidden topic of each term. The aim was to obtain better terms accuracy results. Then, the aspect categorization process was carried out using BERT embedding and semantic similarity with the aim of obtaining more significant differences in similarity results in each aspect category so that the determination of aspect categories from a review could be more accurate. The results of the aspect extraction obtained an evaluation of the aspect categorization for each precision 0.86, recall 0.92, and f1-measure 0.89. Furthermore, BERT sentiment analysis method is used in the aspect-based sentiment analysis process. Finally, the evaluation result of aspect-based sentiment analysis obtained for each precision, recall, and f-1 measure are 0.96, 0.98, and 0.97.