phoenix
phoenixPhoenix - Your AI Assistant
Inactive session will be ended in 24 hours
End Session

Working Scraper

  • Posted:
  • Proposals: 59
  • Remote
  • #4493174
  • OPPORTUNITY
  • Awarded
Micheal B.
Emmanuel L.Yasir Ali M.Isaac J.Μuhammad Κamran Μ. + 54 others have already sent a proposal.
  • 6

Description

Experience Level: Expert
Estimated project duration: less than 1 week
Seeking a robust scraper system to monitor 100+ websites for specified keywords.

The portal must support up to 10 concurrent search tabs, perform automatic daily refresh at 00:00 CET, deduplicate results, and retain findings for three days unless marked as favorites.

Reliability and accuracy are critical; the solution must handle site security measures and API constraints and CAPTCHAS etc. Deliverables include a user-friendly dashboard for managing searches, clear logging of activities, and dependable error handling to ensure consistent performance and a monitoring system to identify which sites have and have not been scrapped

New Proposal

Login to your account and send a proposal now to get this project.

Log in

Clarification Board Ask a Question

  • Mahmood U.

    can you please tell if the target websites require login access or heavy anti-bot protections (CAPTCHA, Cloudflare) for the scraper system?

  • Amit G.

    Can you share those 100+ website which you want to scrap?

    And also share the paid API for heavy CAPTCHA or unblocking tools like paid proxy or third party API etc?

  • Robert B.

    Will this scrapper live with a website, and of so what platform/framework is the site built on?
    Or is this intended to be a desktop application run from a local machine?

    Regards,
    Robert.

  • Asad C.

    - Can you share the list of websites to be scraped and indicate if they require login, API access, or have known anti-bot protections?

    - How should keyword detection work, exact match, partial match, or advanced filters? Also, what specific data fields do you want extracted from each result (title, URL, date, content snippet, etc.)?

    - Do you expect heavy CAPTCHA or blocking from these sites, and are you open to using proxy services or third-party CAPTCHA-solving tools if required?