Phoenix - Your AI AssistantWebscaper / searcher
- Posted:
- Proposals: 55
- Remote
- #4467958
- FEATURED
- OPPORTUNITY
- Open for Proposals
Bay Minette 
Description
Experience Level: Expert
I collect a fountainpens and there are many sites on the internet that sell them.
i need an intelligent webscraper / internet crawler that gathers all the listings into a system for me which i can access via simple web interface.
i can provide a list of known sites i need to scrape (these include all of the vinted sites as well as global craigslists, FB Market place, ebay as well as various other niche sites)
the system should have a daily as well as 3 day archive so that it refreshes at 00:00CET every day and scans for new listings every few hours or at least twice a day.
the system needs to remove duplicate listings as well as those listings which are historic and sold
this needs to be completed in a couple of days.
i need an intelligent webscraper / internet crawler that gathers all the listings into a system for me which i can access via simple web interface.
i can provide a list of known sites i need to scrape (these include all of the vinted sites as well as global craigslists, FB Market place, ebay as well as various other niche sites)
the system should have a daily as well as 3 day archive so that it refreshes at 00:00CET every day and scans for new listings every few hours or at least twice a day.
the system needs to remove duplicate listings as well as those listings which are historic and sold
this needs to be completed in a couple of days.
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
1. Which exact sites/URLs are in scope for V1, and can we exclude sources that don’t provide an approved API/feed?
2. Do you require logged-in scraping (FB/eBay accounts), or only public pages / official APIs?
3. What’s the minimum “web interface” for V1: filter + search + export (CSV), or full dashboard with user accounts?