Design and Implementation of Crawler Program Based on Python

Ma, Xiaolong; Yan, Min

doi:10.1088/1742-6596/2033/1/012205

Search citation statements

Order By: Relevance

Paper Sections

Select...

Crawler Technology1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2022

Publication Types

Select...

Article1

Other1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Web crawler, also known as web spider [8], is a program that can automatically browse web pages, grab web page information, analyse and store it. The key technologies of web crawler are mainly reflected in three aspects: Web page acquisition, web page analysis and data storage [9].…”

Section: Crawler Technologymentioning

confidence: 99%

Analysis and prediction of second-hand house price based on random forest

Zhang

Huang

Zhang

et al. 2022

Applied Mathematics and Nonlinear Sciences

View full text Add to dashboard Cite

Using Python language and combined with data analysis and mining technology, the authors capture and clean the housing source data of second-hand houses in Chengdu from Beike Network, and visually analyse the cleaned data. Then, a Random Forest (RF) model is established for 38,363 data elements. According to the visual analysis results, the model variables are revalued, the key factors affecting house prices are studied and the optimised model is used to predict house prices. The experiment shows that the deviation between the house price predicted by the RF model and that predicted by the real house price is small; it also indicates the accuracy of the RF model and demonstrates its good application value.

show abstract

Section: Crawler Technologymentioning

confidence: 99%