Selenium Scraper - Needs my Script editing
- or -
Post a project like this1854
£50(approx. $63)
- Posted:
- Proposals: 10
- Remote
- #2330233
- Awarded
18 years expert in PHP, MySQL, HTML, CSS, JavaScript, jQuery, Ajax, Bootstrap, Chrome Extension, VB, VBA, AutIT Programming & Website Data Scraping
Ambala
Laravel Developer | Web PHP Developer | Codeigniter Developer| WordPress | Woocommerce | Shopify
Muzaffargarh
front-end Developer, programmer, data analyst, web developer,Angular, Node, Web Automation, mobile app, flutter, IOS,
Sunderland
87996223247618824691973455238373323985452415916257501326121892619542
Description
Experience Level: Entry
I have Python / Selenium script that scrapes Facebook event details.
The script i have works perfectly, i just need a few additional features adding.
What my script does:
It logs in to Facebook and retrieves a URL to scrape via a .csv files with URLs to scrape, it then goes to an event page and scrapes the events data then stores that in a .csv file.
The order my script works:
Get Facebook Events Page URL from .csv ---> Goes to Events page ---> Get the list of upcoming events ---> Goes through each event pages and scrapes data until no events left ---> Saves data in .csv ---> Get the next events page URL from .csv files and repeats until no URLS left to scrape in the .csv
My problem and what i need coding:
1) Some event pages dont have any upcoming events, if this is true i need the script to scrape the text that the page display saying "XYZ does not have any upcoming events". See link :https://www.facebook.com/pg/umfkorea/events/ which shows what i mean.
2) I need the script to scrape a few details from the initial events page before it follows the event link. Please see: https://www.facebook.com/pg/coldharbourrecordings/events/
you can see next top each row of events it has a location E.G:
STA Presents: Coldharbour Night w/ Nifra ------> Seattle, WA
Denial Events Presents: Coldharbour x ------> Miami Beach, FL
Markus Schulz в Москве ------> Moscow, Russia
I need to scrapes these locations and add them to a seperate column in the export .csv file my script creates for each event.
3) When the mouse is hovered over an event in the list, a mouse hover box appears that has an image / banner image. I need the file URL / image URL scraped and added to .csv file my script exports along with all the other data it scrapes
Like i said, i already have a working script, the code needs to follow the same as the code i have and add the newly scraped data to my original .csv that the script creates for each event. Please see attached images relating to each of the new features i require.
I also do not want to use any other software, code, etc just selenium so please dont reply saying it would be better using BeautifulSoup, VBA Macro, Scrapy / Docker etc. Just Selenium.
Thanks
Matt
The script i have works perfectly, i just need a few additional features adding.
What my script does:
It logs in to Facebook and retrieves a URL to scrape via a .csv files with URLs to scrape, it then goes to an event page and scrapes the events data then stores that in a .csv file.
The order my script works:
Get Facebook Events Page URL from .csv ---> Goes to Events page ---> Get the list of upcoming events ---> Goes through each event pages and scrapes data until no events left ---> Saves data in .csv ---> Get the next events page URL from .csv files and repeats until no URLS left to scrape in the .csv
My problem and what i need coding:
1) Some event pages dont have any upcoming events, if this is true i need the script to scrape the text that the page display saying "XYZ does not have any upcoming events". See link :https://www.facebook.com/pg/umfkorea/events/ which shows what i mean.
2) I need the script to scrape a few details from the initial events page before it follows the event link. Please see: https://www.facebook.com/pg/coldharbourrecordings/events/
you can see next top each row of events it has a location E.G:
STA Presents: Coldharbour Night w/ Nifra ------> Seattle, WA
Denial Events Presents: Coldharbour x ------> Miami Beach, FL
Markus Schulz в Москве ------> Moscow, Russia
I need to scrapes these locations and add them to a seperate column in the export .csv file my script creates for each event.
3) When the mouse is hovered over an event in the list, a mouse hover box appears that has an image / banner image. I need the file URL / image URL scraped and added to .csv file my script exports along with all the other data it scrapes
Like i said, i already have a working script, the code needs to follow the same as the code i have and add the newly scraped data to my original .csv that the script creates for each event. Please see attached images relating to each of the new features i require.
I also do not want to use any other software, code, etc just selenium so please dont reply saying it would be better using BeautifulSoup, VBA Macro, Scrapy / Docker etc. Just Selenium.
Thanks
Matt
Matt L.
100% (17)Projects Completed
7
Freelancers worked with
7
Projects awarded
50%
Last project
17 Apr 2020
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies