An Improved Crawler Based on Efficient Ranking Algorithm

Abstract

With the increase in number of pages being published every day, there is a need to design an efficient crawler mechanism which can result in appropriate and efficient search results for every query. Everyday people face the problem of inappropriate or incorrect answer among search results. So, there is strong need of enhance methods to provide precise search results for the user in acceptable time frame. So this paper proposes an effective approach of building a crawler considering factors of URL ranking, load on the network and number of pages retrieved. The main focus of the paper is on designing of a crawler to improve the effective ranking of URLs using a focused crawler.

A Preliminary Study on Mechanism and Measurement of Trustworthiness on a Crowdsourcing Platform

“… Due to the complicated mechanisms and tedious measurements of trustworthiness implementation, automation is a necessity to reduce human error. An intelligent agent is needed to perform intelligent ranking [22] of the participants based on their performance of the assigned tasks. Time duration is another parameter that needs to be considered by the intelligent agent.…”

“…Time duration is another parameter that needs to be considered by the intelligent agent. The implementation will require the use of machine intelligence [22] to successfully execute the ranking and accuracy measurement.…”

Technical Job Recommendation System Using APIs and Web Crawling

“…Crawling. Nowadays, many companies do not list their job openings on the common job listing portals on the web [35][36][37][38][39][40][41][42][43][44][45][46][47][48][49]. It was decided to individually crawl the API calls [50,51] of these companies' personal job portals.…”