Scraping Projects
Looking for freelance Scraping jobs and project work? PeoplePerHour has you covered.
Web scraping
I am looking at Web scraping software, based on input; to produce a spreadsheet of URL, email address and phone numbers extracted from the contact us pages,using legitimate methods. A URL scrapper will also need to be built into the application. To be able to facilitate the above process.
7 days ago30 proposalsRemoteSeeking Web Scraper for Adjustments to Existing Real Est. Script
I am a Python enthusiast in need of a freelance web scraper for a personal project to make adjustments to an existing Python script that extracts data from Idealista.com. The goal is to refine the script to handle the website’s anti-scraping measures effectively. Project Overview: Script Adjustment: Update and optimize an existing WORKING script to improve data extraction reliability and efficiency. But issues with anti scrapping defence from the website. Anti-Scraping Strategy: Implement simple and cost-effective strategies to overcome scraping blocks. Requirements: Proven experience in modifying existing web scraping scripts. Familiarity with Python and scraping libraries like BeautifulSoup, or others. Understanding of techniques to bypass or handle anti-scraping technologies. Ability to work within a tight budget and deliver quick solutions. Deliverables: An updated, fully functional scraping script. Brief documentation on the changes made and how to handle potential future issues. Project Duration: Quick turnaround expected. Budget: Since this is an adjustment to an existing script, I am looking for a cost-effective solution. Please provide your fixed-rate offer for this adjustment. I can provide my existing code, so you can evaluate changes needed. If you are interested, please respond with: Any initial thoughts or specific techniques you think could be effective. I am looking to start as soon as possible and appreciate your swift response. Thank you!
a day ago16 proposalsRemotepre-funded
I would like some pages scraped which are behind reCAPTCHA
I have a list of 50k webpages of the same design on the same website, each of which includes a piece of text I want to be scraped and exported. The problem is that the page is protected by "I am not a robot" reCAPTCHA. So I would like someone to take my list of 50k URLs and return the the missing line of text for each page in a csv or google sheet. Note that I do not need to code you use - just the end result. Here is a redirect to an example of the pages I need scraped https://www.temporary-url.com/9C6C0 Please check the page first and explain in your answer what the site and the info I need are (this is to make sure people have read the ad fully and checked out the task. Without this, your reply will be marked as spam). Please give me the cost and time it would take to provide them all.
14 days ago28 proposalsRemoteData Scraping from LinkedIn search results
I need a data entry personnel to search out and scrape 200 relevant posts on LinkedIn using the keywords provided, filter the search to the United States, and add data to an Excel sheet. Data needed include: 1. Profile name 2. LinkedIn profile link 3. Post link Recorded a loom to help guide the process: https://www.loom.com/share/1191b16f8a124767a3c1d1f68fb6616b?sid=b8d5833f-3a3d-4e44-bd82-13170a35e165 Document containing keywords to search: https://docs.google.com/document/d/19pXU0P6IvUVO_PrVSre36MmOBQ-CBFLt7oIq3x7FmOM/edit?usp=sharing
6 days ago68 proposalsRemoteI need text scraped form 8000 URLs
I have an Excel with 8000 URLs in column A In Column B I need the text scraped for each of those websites (in plain text)
4 days ago34 proposalsRemoteSave HTML Page Python Script
Hi All I have a python code that work but needs abit of editing. Is this something you can help with today and need to scrape the site today Thanks Phil
8 days ago15 proposalsRemoteopportunity
Build a Webscrape with automaton for Magento 2
I am looking for an expert to develop a (Undetectable) webscraper with automation to scrape products from target site/sites and upload automatically to magento 2 admin so that products are mapped correctly to categories and pages on a new site. The scraper should be able to scrape from target site: 1. Product Name 2. Description 3. All images 4. Price 5. SEO; Meta title and description and all google attributes 6. Product weight 7. All other features *The scraper should also be able to remove out of date products from site or run regular schedules. The target site ; selfridges.com is an example so to qualify for this project, you will be required to scrape one category of products to make sure it works and that you can fulfill this task
7 days ago28 proposalsRemoteopportunity
I need News Bot in C or C++, Phyton Language
Hello, I need a News Bots written in C, C++ or Phyton language that has features. I need 30 News bots that will scrape Latest News some Big News Sites's Category Pages or Rss Pages, Translate scraped data from source site language to target site language and post the news articles with image and features like News Title , Tags ect in Wordpress Sites with same or different categories via crons. Bot's main system will be same for all 30 bots, you can create one bot scraping from 30 different sites or you can create 30 different bots. I will give extra details in workstream But I will refuse freelancers who give low price in proposal and ask extra money later. I have fixed budget. You can pass this task if this money doesnt make you happy.
6 days ago22 proposalsRemoteI need Linkedin profiles of the owners of a Google map scraping
I need you to do the following: 1. Scrape all the 'IT-consultancy' companies in The Netherlands from Google Maps including their details and website 2. Provide all the LinkedIn profile URLs of these companies 3. Scrape the # of employees of these companies (as listed in Linkedin) 4. Provide the LinkedIn profiles of the owner(s) of these companies Given the sheer size, this needs to be done automatically and not manually. Budget TBD.
14 days ago29 proposalsRemoteSeeking No-Code Architect for Automation Project
We are seeking a talented no-code architect to assist us with a project focused on web scraping, content filtering, and process automation. The ideal candidate will have expertise in identifying and configuring the best no-code tools and platforms for our requirements, enabling us to automate processes and extract valuable insights without traditional coding. Responsibilities: Evaluate project requirements and objectives for web scraping, content filtering, and automation. Research and assess available no-code platforms, tools, and integrations suitable for the project's needs. Recommend and select the most suitable no-code solutions for web scraping, data filtering, and automation tasks. Configure and set up integrations between selected no-code tools and platforms to achieve seamless automation. Provide guidance and best practices for leveraging no-code solutions effectively to meet project goals. Requirements: Proven experience as a no-code architect or consultant, with a strong track record of implementing successful no-code solutions. Comprehensive knowledge of various no-code platforms, tools, and integrations, particularly those suitable for web scraping and automation. Familiarity with web scraping techniques, data extraction methods, and content filtering processes. Strong problem-solving skills and the ability to assess project requirements to recommend suitable no-code solutions. Excellent communication skills and the ability to collaborate effectively with project stakeholders. If you're passionate about harnessing the power of no-code tools to automate processes and drive efficiency, we'd love to hear from you! Please provide details of your relevant experience and examples of previous projects involving no-code architecture and automation. Budget: Flexible, depending on experience and scope of work. Duration: Short-term project with potential for ongoing collaboration. Deadline for Applications: [Insert deadline or state "Open until filled"] We look forward to reviewing your proposals and discussing how we can work together to achieve our project goals. Thank you for considering this opportunity!
5 days ago13 proposalsRemotePython Developer - Scraping Expert
Hi All I have a python code that work but needs abit of editing. Is this something you can help with today? Thanks Phil
21 days ago31 proposalsRemoteData scrape consolation
An expert consultation is sought regarding modern artificial intelligence techniques for efficient data scraping. For over nine years, traditional scraping methods using common websites have been employed to gather information from Google Maps and LinkedIn. However, newer AI technologies promise scraping capabilities at significantly reduced costs compared to established solutions. Rather than using code or tools directly, the consultant would identify and briefly describe the ten best scraping platforms that leverage artificial intelligence to deliver high-quality data rivaling industry leaders, but at optimized pricing. In return for a10 minute consultation providing these top scraping website recommendations, a £10 payment will be provided. The aim is to uncover the highest data value possible through cutting-edge AI scraping alternatives.
a month ago27 proposalsRemoteCreate chatgpt bot scraping content from PC
Seeking programmer to create ChatGPT bot to self train on my data in my PC in word, pdf, excel and ppt, and also outlook. And use that to generate responses on chatgpt 4. Every day new files will be added to the folder. The bot needs to retrain whenever new file is added or when manually prompted. Must have experience with ChatGPT, content scraping, etc. Urgent start, 2 day turnaround needed.
16 days ago9 proposalsRemoteopportunity
Data Extraction and Input
Hi all, I am looking for help to pull some price modelling data from an website and place it into an excel file that replicates how it is shown on the web page. There is a lot of data and I do not think it can be exported, it needs to be done manually. I do not think it is viable to scrape the data. Once we have pulled the data we then need to build charts / data filtering to display the data correctly. My feeling is that the freelancer that does the job will need to be an expert an MS excel. It would be easier to do a Zoom call to show the freelancer the system and explain fully what is required so the price below is a placeholder. Thanks!
4 days ago64 proposalsRemoteWebsite & Product Admin for Magento 2
I need someone with experience in web administrative duties . Your task will be: 1. Scraping & Uploading all products and images to magento 2 2. Positioning and ensuring consistency on site products; 3. Sourcing lifestyle product imager and banners 4. Removal of out of stocks and obsolete products to make space for new 5. Google, facebook and all social media adverts product uploading 6. SEO / META updating 7. check website for coding errors 8. Other duties as required Absolute must meet these requirements and have experience working with excel, web scraping Can work part time any days or evening
24 days ago29 proposalsRemoteI need a Python programmer to write code for horse race betting
We are seeking a skilled Python programmer to develop a comprehensive betting system for horse races. The project entails scraping odds from various betting websites and updating the system in real-time to reflect any changes. The successful candidate will have a strong understanding of Python programming, web scraping techniques, and database management. They will be responsible for designing and implementing a user-friendly interface, integrating secure payment gateways, and ensuring the system's stability and performance. The project offers an exciting opportunity to work on a cutting-edge technology project and contribute to the growth of the betting industry.
25 days ago30 proposalsRemoteAmazn flex block grabber with website!!
I seek an experienced developer to build a server-based application for automatically securing delivery blocks offered through the Amazn Flex platform. The goal is to programmatically monitor for and secure time slots before other users are able to manually. Drawing from examples like Compinche, Flexbee, and Thunderflex, the solution should incorporate web scraping and notification capabilities to effectively grab blocks in a timely manner. Professional proficiency working with similar programs that automate processes through APIs or web monitoring is required. Strong Python or similar scripting skills are necessary to develop the network-level monitoring and response automation required to outpace manual reservation. Solid website development expertise is also needed to incorporate an easy-to-use frontend for configuration and monitoring successful bookings. The website must have English and Spanish language and send SMS notifications These are similar web pages to the one I want to create: https://compinche.io/ https://flexbee.io https://flexernow.com/ https://thunderflex.us/ https://flex-grabber.com/
12 days ago21 proposalsRemotePython / Machine Learning
I am in urgent need of a competent Python developer. I am keen on finding someone versatile and flexible. If you have some experience and/or interest in making money in the stock market, hence; will be value added. Required Skills: - General Python proficiency: You should be able to touch on a variety of Python programming tasks including, but not limited to web scraping, data analysis, and automation tasks. Based on the initial tasks, your role may grow to encompass a wider range of skills and tasks. - Adaptability: Since the specific version of Python to be used was not specified, you should be fluent in both Python 2.x and Python 3.x. However, we might prefer 3.x, which is more recent and has more features. If you are adaptable, proficient in Python, and ready to tackle different kinds of tasks, then this project is for you. Please make your bid outlining your skills and experience with Python. Looking forward to your proposals! I have many other task, the budget is depends on the task and agreement by discussion.
25 days ago16 proposalsRemote
Past "Scraping" Projects
Data Scraping
I need an Excel file of the website URLs of all test preparation companies, listed in Yelp for the 387 metropolitan areas listed under the Rankings heading at https://en.wikipedia.org/wiki/Metropolitan_statistical_area. For example, in the St. Louis metropolitan area, Yelp lists 52 companies at https://www.yelp.com/search?find_desc=Test+Preparation&find_loc=Saint+Louis%2C+MO&start=50. You will need to click the "Test Preparation" button that appears just below the company name to filter the list to only companies that offer that service. You will need to click the company name and then copy the company website link on the right side. I don't know how many websites there are for all 387 metropolitan areas so I will pay $25 for each set of 1,500 URLS. When you have finished with the first set, I will contract with you for another set and so forth until all the URLs have been listed. Please start at the top of the list of metropolitan areas with New York-Newark-Jersey City and work down the list from there.
Data Scraping
I need a list of all test preparation companies, with their contact information, listed in Yelp for the 387 metropolitan areas listed at https://en.wikipedia.org/wiki/Metropolitan_statistical_area. For example, in the St. Louis metropolitan area, Yelp lists 52 companies at https://www.yelp.com/search?find_desc=Test+Preparation&find_loc=Saint+Louis%2C+MO&start=50. You will need to click the "Test Preparation" button that appears just below the company name to filter the list to only companies that offer that service. You will need to click the company name and then the company website link on the right side to access those websites. The company information must include the URL of the Yelp page, company name, phone number, website address, any physical address broken down into Address, City, State and Zip Code fields, and email address listed anywhere on the site, especially in the Contact Us page if that exists. Before you respond to this post, please make sure that your software can access the company websites by clicking the appropriate buttons on the Yelp page for each company.