Phoenix - Your AI AssistantWorking Scraper
- Posted:
- Proposals: 49
- Remote
- #4493174
- FEATURED
- OPPORTUNITY
- Open for Proposals
Bollington 
Description
Experience Level: Expert
Estimated project duration: less than 1 week
Seeking a robust scraper system to monitor 100+ websites for specified keywords.
The portal must support up to 10 concurrent search tabs, perform automatic daily refresh at 00:00 CET, deduplicate results, and retain findings for three days unless marked as favorites.
Reliability and accuracy are critical; the solution must handle site security measures and API constraints and CAPTCHAS etc. Deliverables include a user-friendly dashboard for managing searches, clear logging of activities, and dependable error handling to ensure consistent performance and a monitoring system to identify which sites have and have not been scrapped
The portal must support up to 10 concurrent search tabs, perform automatic daily refresh at 00:00 CET, deduplicate results, and retain findings for three days unless marked as favorites.
Reliability and accuracy are critical; the solution must handle site security measures and API constraints and CAPTCHAS etc. Deliverables include a user-friendly dashboard for managing searches, clear logging of activities, and dependable error handling to ensure consistent performance and a monitoring system to identify which sites have and have not been scrapped
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Will this scrapper live with a website, and of so what platform/framework is the site built on?
Or is this intended to be a desktop application run from a local machine?
Regards,
Robert. -
- Can you share the list of websites to be scraped and indicate if they require login, API access, or have known anti-bot protections?
- How should keyword detection work, exact match, partial match, or advanced filters? Also, what specific data fields do you want extracted from each result (title, URL, date, content snippet, etc.)?
- Do you expect heavy CAPTCHA or blocking from these sites, and are you open to using proxy services or third-party CAPTCHA-solving tools if required?