A regular expression generator based on CSS selectors for efficient extractionfrom HTML pages

doi:10.3906/elk-2004-67

Cited by 6 publications

(4 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Metode lain yang dapat digunakan untuk mengambil data secara otomatis atau disebut dengan automated web scraping di antaranya HTML Parsing, Regex, DOM Parsing, dan Xpath [8]. Metode ini dilakukan dengan pengambilan data secara otomatis dengan cara menemukan pola ekstraksi dari satu atau banyak halaman web yang diinginkan [9]. Hal ini tentunya dapat meminimalisir waktu yang dibutuhkan dalam pengambilan data.…”

Section: Pendahuluanunclassified

See 1 more Smart Citation

Implementasi Web Scraping untuk Pengambilan Data Pada Website E-Commerce

Rizquina,

Ratnasari

2023

JTEKSIS

View full text Add to dashboard Cite

Data is new mind; data adalah emas; data adalah tambang baru; merupakan perumpamaan yang sudah tidak asing di era digitalisasi seperti saat ini. Data dapat dimanfaatkan di antaranya untuk meningkatkan efisiensi operasional, memacu inovasi dalam suatu bisnis, memahami kebutuhan pengguna, dan mendorong pengambilan keputusan. Pengambilan data dari e-commerce dapat dilakukan, salah satunya melalui teknik web scraping dengan menggunakan Python dan library seperti Selenium, Beautifulsoup, dan Time. Metode web scraping pada Shopee dan Tokopedia yang digunakan pada penelitian ini adalah HTML Parsing dan CSS Selector. Penelitian ini menemukan bahwa metode HTML Parsing dan CSS Selector tidak dapat digunakan untuk web scraping pada Shopee dikarenakan adanya mekanisme deteksi bot dan CAPTCHA. Namun, metode ini berhasil digunakan pada Tokopedia. Dilakukan sebanyak 10 kali percobaan web scraping pada dua halaman produk yang menghasilkan sekitar 160-166 data pada setiap kali percobaannya, dengan duplikasi sebanyak 3-18 data. Waktu eksekusi program rata-rata adalah 1 menit 0,5 detik.

show abstract

Section: Pendahuluanunclassified

“…Metode ini melibatkan pemilihan elemen berdasarkan kelas CSS, id, nama tag, dan atribut lainnya. CSS Selector memiliki pola yang singkat dan mudah untuk ditulis [9]. Pseudo code untuk pengambilan data web scraping pada penelitian ini ditunjukkan pada Gambar 3.…”

Section: Seleniumunclassified

Implementasi Web Scraping untuk Pengambilan Data Pada Website E-Commerce

Rizquina,

Ratnasari

2023

JTEKSIS

View full text Add to dashboard Cite

show abstract

“…That is, to give the presentation style and user interface design of the web page. According to the author [25], cascading style sheet selectors are patterns that are used to select HTML elements. In addition, CSS technology is useful to adopt font size in a new responsive web suitable for different screen sizes, including tiny devices [26].…”

Section: Bootstrapmentioning

confidence: 99%

Web Application with Machine Learning for House Price Prediction

Jáuregui-Velarde,

Andrade-Arenas,

Hernandez Celis

et al. 2023

Int. J. Interact. Mob. Technol.

View full text Add to dashboard Cite

Every year, the price of a house changes due to different aspects, so accurately estimating the buying and selling price is a problem for real estate agencies. Therefore, the research work aims to build a Machine Learning (ML) model in Azure ML Studio and a web application to predict the buying and selling price of two types of houses: urban and rural houses, according to their characteristics, to minimize the forecast error in prediction. Following the basic stages of machine learning construction, we build the prediction model and the Rational Unified Process (RUP) methodology to build the web application. As a result, we obtained a model trained with a linear regression algorithm and a predictive ML model with a coefficient of determination of 95% and a web application that consumes the prediction model through an Application Programming Interface (API) that facilitates price prediction to customers. The quality of the prediction system was evaluated by expert judgment; they evaluated efficiency, usability, and functionality. After the calculation, they obtained an average quality of 4.88, which indicates that the quality is very high. In conclusion, the developed prediction system facilitates real estate agencies and their customers the accurate prediction of the price of urban and rural housing, minimizing accuracy errors in price prediction. Benefiting all people interested in the real estate world.

show abstract

“…Cascading Style Sheets (CSS for short) is a style sheet language that gives HTML-based web pages a more presentable appearance. In addition, it is a way to make a web page its unique look and feel by modifying things like font, size, and color (Uzun, 2020). In this particular research project, this programming language was utilized to design the overall appearance of the front-end interfaces.…”

Section: (V) Cascading Style Sheetsmentioning

confidence: 99%

IOT based-system for telecom tower fire detection and aviation obstruction light monitoring

Ndayitezibiganza

View full text Add to dashboard Cite

Telecommunication towers are radio masts, typically tall structures designed to support antennas for telecommunications and broadcasting. Many telecommunication towers in Habari Node are installed in remote locations, on top of tall buildings, and sometimes on hilltop areas that are not easily accessible. These make them prone to natural hazards, equipment, fuel and battery theft, and electricity faults. In some cases, these issues can cause the malfunction of the aviation obstruction light and fire outbreaks. This challenge affects prompt mitigations during breakdown and the challenges of aviation obstruction light and fire outbreaks. However, technological inputs have been developed to tackle these challenges. However, many of these technologies are associated with low performance due to lack of real-time interventions and auto-report to the systems' concerns, awareness, and inadequate information. Hence, the study used qualitative methods of data collection which led to develop a cost-effective, versatile system that can detect, extinguish, and send early alerts about fire, aviation obstruction light, and electricity power issues. The proposed system was developed to monitor and control the telecommunication tower using ESP32 WROOM-32D as a microcontroller, fire sensor, buzzer, BH1750 ambient light, LDR darkness sensor, relays, Pzem-004t, ThingSpeak cloud, and the global service message module (GSM) to alert all tower’s technicians and firefighters. The results revealed the prompt performance of the system in detecting and extinguishing fire. Also, the it can monitor aviation light for tower safety and turn on the automatic voltage and current regulator (AVCR) during overcurrent or overvoltage. Furthermore, the designed system has the capacity to initiate and send short message service (SMS) and call as an alert to check through mobile and web-based application

show abstract

A regular expression generator based on CSS selectors for efficient extractionfrom HTML pages

Cited by 6 publications

References 14 publications

Implementasi Web Scraping untuk Pengambilan Data Pada Website E-Commerce

Implementasi Web Scraping untuk Pengambilan Data Pada Website E-Commerce

Web Application with Machine Learning for House Price Prediction

IOT based-system for telecom tower fire detection and aviation obstruction light monitoring

Contact Info

Product

Resources

About