Description of requirements/features: I need a car parts website to be scraped professionally.
The website needs logging in and has blocked attempts to be scraped before.
I had trouble finding someone to scrape it because of the mentioned above challenges and some developers even declined the project.
I thought it only fair to say this from the start.
If you can do that I can share info and my website ( wordpress) so you can take a look at the requirements.
HANI M.100% (11)
Create an account now and send a proposal now to get this project.Sign up
Clarification Board Ask a Question
could you please share the website URL?
Its a perfect skill set of me. Lets discuss in brief.
Are you in a rush or flexible on deadline?
Can we have a quick discussion?
Please open PMB for a brief discussion over the project.
Thanks & Regards,
can you provide more details about this scrap module.
looking forward to hear from you
Hello HANI M
I would like to discuss exact brief so kindly let me know suitable time to discuss further ?
Would you prefer custom PHP? In a favorable cost. I can do that for you.
If you have to login to the website to access the data are you sure it is not proprietary? Do you have to pay to login? Can I have the URL of the site you want scraped please? What exactly do you need scraped? Entire pages, some content, just data? Then what do you want to do with it? Are we making new web pages or populating a database with the scraped data.HANI M.10 Nov 2016
I do have access of the site, because I am a dealer with them. They even provided me with a CSV file of their data, But it lacked fitment information ( maker , model, year) . I had a lot of trouble in getting fitment info and no results to complete the data from data bases . Even if I got them I will still need to combine them which is extra difficulty.
So I thought that scraping is going to be a solution for this.Terrance A.10 Nov 2016
Thanks Hani, How many pages you want to scrape and where are we adding them to your WordPress site. There are at least two plugins I can think of that will scrape a site and add the scraped data to WordPress posts or pages. Is this the kind of thing you want to do? Will we be adding the items to a catalog(no purchase option) or a shopping cart(purchase option)?
Perhaps at this point a short Skype conversation might be in order. Without quite a bit more detail there is no way to offer an accurate bid and timeline.
I will send a proposal and if you reply to it I will send you my Skype name and phone number so we can discuss exactly what your needs and requirements are.
As per your job description i have few questions before going to start:
1. Kindly let me know which WP theme currently are you using ?
2. I need admin & ftp details for the work or enter into to have a look .
3. What is your URL for your website?
4. Do you want totally rebuild your current site?
5. Are you comfortable to discuss things over Skype with me so that we can share details and I will share my appropriate work accordingly .
Thanks and waiting for your reply.