Abstract. With the rapid development of location-based social networks (LBSNs), Point-of-Interest (POI) recommendation which can benefit both users and service providers has attracted much academic and industrial interest. Although various aspects of users' behavior data have been utilized in POI recommendation, challenges such as data sparsity and how to accurately model users' preferences exist. In this paper, we propose a model named as Geo-STFM which exploits social, temporal and geographical information for POI recommendation based on factorization machines. Specifically, we first give a precise analysis of the self-similar and other-similar characteristics in users' behaviors, and accordingly propose an improved factorization machines (FM) model with social and temporal regularization terms. Then, geographical information is fused into the model to build a POI recommender system. The experimental results on two real-world data sets show that our proposed method achieves remarkable improvements compared to the state-of-the-art POI recommendation techniques.