I need a bot to crawl / scrape a list of URL's and collect data
- or -
Post a project like this$$$
- Posted:
- Proposals: 14
- Remote
- #1927365
- Expired
Product Manager with extensive web , seo and mobile development experience.
Islamabad
18 years expert in PHP, MySQL, HTML, CSS, JavaScript, jQuery, Ajax, Bootstrap, Chrome Extension, VB, VBA, AutIT Programming & Website Data Scraping
Ambala
Web Scraping | Web Design & Development |Mobile App Design & Development | Wordpress Website Development | Salesforce
Oakland
Expert in all web technologies which runs a professional websites in smooth & secure manner with rich SEO integration
Ahmedabad
36011363012324763476295241215346946129747314171036932142971314932381968621
Description
Experience Level: Expert
I have a list of 11 million UK domain names.
I require someone to create a script so I can do the following:
1) Check to see if the website is a Wordpress website.
2) Check the theme's default stylesheet (I.e. http://domain.com/wp-content/themes/themename/style.css)
3) IF the theme has ANY the following conditions, record the URL, Theme Name, Theme URI, Theme Author, Theme URI.
- The theme URL contains the word 'child'
- The theme name contains the word 'child'
- The theme name contains the word 'custom'
- The theme description contains the word 'child'
- The theme description contains the word 'custom'
The data must be recorded in a csv.
Open to suggestions on the best way to achieve this.
I have a server the script can run from and access to proxies if required.
I require someone to create a script so I can do the following:
1) Check to see if the website is a Wordpress website.
2) Check the theme's default stylesheet (I.e. http://domain.com/wp-content/themes/themename/style.css)
3) IF the theme has ANY the following conditions, record the URL, Theme Name, Theme URI, Theme Author, Theme URI.
- The theme URL contains the word 'child'
- The theme name contains the word 'child'
- The theme name contains the word 'custom'
- The theme description contains the word 'child'
- The theme description contains the word 'custom'
The data must be recorded in a csv.
Open to suggestions on the best way to achieve this.
I have a server the script can run from and access to proxies if required.
Lewis L.
98% (42)Projects Completed
61
Freelancers worked with
54
Projects awarded
42%
Last project
17 Apr 2024
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies