Data Scrapping Projects
Looking for freelance Data Scrapping jobs and project work? PeoplePerHour has you covered.
Seeking Web Scraper for Adjustments to Existing Real Est. Script
I am a Python enthusiast in need of a freelance web scraper for a personal project to make adjustments to an existing Python script that extracts data from Idealista.com. The goal is to refine the script to handle the website’s anti-scraping measures effectively. Project Overview: Script Adjustment: Update and optimize an existing WORKING script to improve data extraction reliability and efficiency. But issues with anti scrapping defence from the website. Anti-Scraping Strategy: Implement simple and cost-effective strategies to overcome scraping blocks. Requirements: Proven experience in modifying existing web scraping scripts. Familiarity with Python and scraping libraries like BeautifulSoup, or others. Understanding of techniques to bypass or handle anti-scraping technologies. Ability to work within a tight budget and deliver quick solutions. Deliverables: An updated, fully functional scraping script. Brief documentation on the changes made and how to handle potential future issues. Project Duration: Quick turnaround expected. Budget: Since this is an adjustment to an existing script, I am looking for a cost-effective solution. Please provide your fixed-rate offer for this adjustment. I can provide my existing code, so you can evaluate changes needed. If you are interested, please respond with: Any initial thoughts or specific techniques you think could be effective. I am looking to start as soon as possible and appreciate your swift response. Thank you!
18 days ago21 proposalsRemoteopportunity
Improve our ChatGPT API
We currently have a project developed that uses OpenAI's ChatGPT API to allow users to ask questions about their data. That data is being imported from a Google API and is currently being sent to the API in a prompt to ChatGPT. This is very inefficient and also limits us to 500 characters of data per questions. We want to improve this by using 'Assistants' sending users data in a file format instead to allow larger data sets. Think of 'Chat with PDF' but instead of a PDF we need CSV. We also need someone to see our current API work (done by another developer) and see if it can be optimised in any way. The current project is built in Codeigniter (PHP). Any questions please ask. Please do not apply if you haven't previously worked with OpenAI's API. Please quote 'Streaming' in your message to me so I know you are not blindly applying to this job. Budget can be increased with work, it's just a placement. OpenAI Assistants - https://platform.openai.com/docs/assistants/overview
3 days ago46 proposalsRemotepre-funded
Give us a feedback
Help with Data Science. Business Intelligence. Data Analytics You are working with data. You use data visualisation tool(s) and have something to say about it. Watch our 3-minute video, and have a 30-minute call where you can tell me about the tools you are currently using in your work. Expert Data Visualization Specialist: Power BI / Tableau / Qlick / Klipfolio / FusionCharts / any other. Tell us about your working day, show us a project which you are working on in your current tool
9 days ago13 proposalsRemoteHelp With Finalising NHS Data Security & Protection Assessment
Hello, I am the owner of a small courier brokerage that serves the healthcare sector, including NHS trusts. We are currently in the process of completing an NHS assessment for Data Security and Protection, and I am looking for a specialist who can assist us in finalising the assessment. PROJECT DETAILS Our company has made significant progress in the NHS assessment, but we require expert assistance with the following specific tasks to ensure full compliance: 1. Information Asset Register (IAR) and Record of Processing Activities (ROPA) • We need to create an IAR and ROPA. The IAR should detail where and how personal and sensitive information is held and safeguarded within our organisation. Similarly, the ROPA should provide clear insights into the types of personal data shared externally, including methods and security measures. • Both documents should be in line with current data protection legislation and reflect the latest operational realities of our business. • Templates and guidelines are available below, but professional expertise is required to tailor these to our specific operational context. https://www.digitalcarehub.co.uk/data-security-protecting-my-information/how-to-document-your-data-processing/ 2. Training Needs Analysis for Data Security and Protection • A document relating to our training needs analysis specific to data security, protection, and cyber security is required. This analysis must reflect the current requirements of our staff, including any new roles or changes in data handling processes. • The document should be prepared for annual review and approval by our designated data security officer. • A template is available below. https://www.digitalcarehub.co.uk/resource/training-needs-analysis/ REQUIREMENTS • Proven experience in data security compliance, particularly within the UK and NHS frameworks. • Familiarity with NHS data protection assessments and requirements. • Excellent documentation and communication skills. PROJECT TIMELINE We are looking to complete this project within the next 2 weeks. APPLICATION INSTRUCTIONS If you are interested in this project, please submit a proposal with the following: • A brief outline of your experience with NHS data security and protection requirements. • Your approach to ensuring compliance in a small business setting. Thank you for considering this opportunity. Martin PS: PS: Disregard the budget listed for this project; it was entered merely for placement purposes.
7 days ago14 proposalsRemoteopportunity
Data Extraction and Input
Hi all, I am looking for help to pull some price modelling data from an website and place it into an excel file that replicates how it is shown on the web page. There is a lot of data and I do not think it can be exported, it needs to be done manually. I do not think it is viable to scrape the data. Once we have pulled the data we then need to build charts / data filtering to display the data correctly. My feeling is that the freelancer that does the job will need to be an expert an MS excel. It would be easier to do a Zoom call to show the freelancer the system and explain fully what is required so the price below is a placeholder. Thanks!
20 days ago80 proposalsRemote2DVisualisation Transformations
Seeking a skilled freelancer to create visually stunning 2D visualisations for my project. The ideal candidate should have a strong understanding of design principles, typography, and colour theory, and be able to transform data into engaging and informative graphics. The visualisations should be visually appealing, easy to understand, and tailored to the specific audience. Key responsibilities: * Understand the project requirements and data to be visualised. * Create visually appealing 2D visualisations using appropriate software and tools. * Transform data into engaging and informative graphics. * Meet deadlines and production schedules.
8 hours ago7 proposalsRemoteopportunity
Excel Data Consolidate&CSV Formatting for Shopify Product Upload
We are looking for a skilled freelancer to assist us in consolidating data from various product ranges stored in separate Excel sheets. The task involves merging Excel sheets when necessary and pulling relevant data, such as prices, to match product codes from different sheets. The ultimate goal is to generate a comprehensive CSV file that adheres to the required template for Shopify product uploads. Some products contain variants, which requires expertise in bulk Shopify uploads to ensure accurate listing of main products alongside their variants. Key Responsibilities: - Consolidate data from multiple Excel sheets into a unified file, accommodating products and their variants. - Match product codes with corresponding prices and other essential information, maintaining consistency throughout. - Ensure accuracy and completeness of data across all product entries, including variants. - Format the final CSV file to meet the specifications of the Shopify platform for hassle-free uploading. - Validate the CSV file to verify compatibility and smooth integration with Shopify's product management system. Requirements: - Proficiency in Excel and CSV file manipulation, with a focus on managing product variants. - Experience with bulk Shopify uploads, particularly in accurately listing main products alongside their variants. - Attention to detail and precision in data entry and manipulation tasks. - Ability to meet project deadlines and deliverables effectively. - Strong communication skills to provide regular updates and address any inquiries promptly. If you possess the requisite skills and are interested in collaborating on this project, please submit your proposal detailing your relevant experience and your approach to completing the task. We welcome any portfolio samples or past projects demonstrating your expertise in data management and bulk Shopify uploads, particularly concerning product variants.
2 days ago35 proposalsRemoteopportunity
Creating a SQL database on Google
We are a marketing agency that has built our own custom software. in the course of the upgrade, we are looking to update the location of the database from zapier tables to Google SQL database. We have 12 tables of information that we would like to be newly formatted on Google SQL. You don't need to help with the transfer of data, this would just be about making sure that the SQL database is properly set up. We need a setup of the Google SQL to be able to properly store the 12 tables worth of information, with each field having formatting rules that they would follow. What's more, we will be having AI read from this, so if the data is not properly formatted we would need a rule to revert the data to something that won't confuse the AI.
2 days ago23 proposalsRemotePower BI Developer
Key Responsibilities: Develop functional & operational reports & dashboards. Build automated reports and dashboards with the help of Power BI and other reporting tools. Understand business requirements to set functional specifications for reporting applications. Be experienced in tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, MDX, Power BI, and DAX Be able to quickly shape data into meaningful reports and analytics solutions. Have knowledge of database fundamentals such as multidimensional database design, relational database design, and more. Analyse data sources and ensure data quality and integrity. Design and develop efficient data models in Power BI, ensuring optimal performance and scalability. Transform raw data into meaningful insights by implementing appropriate data transformations. Develop visually appealing and user-friendly dashboards, reports, and interactive visualizations in Power BI. Implement complex calculations and custom measures to meet business requirements. Leverage DAX (Data Analysis Expressions) to create advanced calculations. Integrate data from various sources into Power BI, ensuring seamless connectivity and data refresh. Utilize Power Query to clean, transform, and shape data for reporting purposes. Collaborate with cross-functional teams, including business analysts, data engineers, and IT teams, to ensure alignment with overall business goals. Conduct regular stakeholder meetings to gather feedback and make necessary adjustments to BI solutions. Provide training and documentation for end-users to ensure effective use of Power BI reports and dashboards. Monitor and optimize the performance of Power BI reports and dashboards. Ability of learning new tools to enhance the data quality and visualizations. Qualifications and Skills: Bachelor’s degree in computer science, Information Systems, or a related field. Proven experience as a Power BI Developer or similar role. Strong knowledge on Azure Data Lake, Data Factory and other data services Strong proficiency in Power BI, including data modelling, DAX, and Power Query. Solid understanding of relational databases and SQL. Experience in ETL processes and data integration. Excellent analytical and problem-solving skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Preferred Qualifications: Microsoft Power BI certification. Experience with other BI tools (Tableau, QlikView, etc.). Knowledge of data warehousing concepts. Familiarity with cloud platforms (Azure, AWS) for BI solutions.
11 days ago19 proposalsRemoteWeb Scraping
I have a series of projects whereby we would like to take the contact data of travel agents from membership directory websites. An example of this, is this site. https://www.abta.com/abta-member-search/results?search=London Another example is this site. https://www.etoa.org/member-search/?term=&type=&country=United+Kingdom&v_s_m=&d_s=&p_s=&c_r_l=&y_e=&c_a_p_s=&c= We need directory data extracted and ideally we would like the data to be in a spreadsheet with name, email address, telephone number, Company name etc. We have 11 websites we would like the data from. And multiple ofther projects too. Kind regards, Nicola
10 days ago74 proposalsRemoteModelling and simulation with NetLogo
I need a developer or data analyst who is skilled at creating agent-based models with NetLogo. I have an existing model which I would like to analyse and extend for optimised performance.
2 days ago6 proposalsRemoteI need B2C data for a UK area:
Sussex, population; 250,000. I need consumer/B2C email addresses for this area towards that figure - needs to be homeowners and I just need the name, address, telephone and email addresses nothing else. I will literally accept the cheapest bid...
23 days ago30 proposalsRemoteFull stack dev
I need a good front and back end Dev to integrate 3rd party APIs like address look up and implement a server email system so we collect user data from a website form on our admin email account.
a day ago53 proposalsRemoteA few really nice looking excle graphs
We are seeking a skilled freelancer to create visually appealing Excel graphs based on a provided dataset. The project requires the creation of 3-4 graphs, preferably stacked bar charts, to effectively present the data. The freelancer should have a strong understanding of Excel and graphic design principles to deliver high-quality graphs that meet our requirements. Attention to detail, ability to work independently, and timely delivery are essential for this project. If you have a passion for data visualization and excel, we would love to hear from you.
21 hours ago18 proposalsRemoteGoogle BigQuery specialist to handle data migration
Looking for a skilled BigQuery specialist to facilitate the migration of analytical data from Google Analytics into BigQuery. Namely, this involves the transfer of lifetime Google Analytics 3 data as well as the backfilling and ongoing synchronisation of Google Analytics 4 information. The selected candidate will configure BigQuery and design optimised storage schemas to preserve all pertinent metrics and dimensions from GA3 while ensuring comprehensive historical datasets from GA4. Automated scripting must also be set up to upload new GA4 data on a daily basis and implement retention policies addressing privacy regulations. Data integrity and performance are top priorities. You should demonstrate extensive experience architecting similar analytics solutions on BigQuery. The ability to future-proof the platform through an elastic data architecture and support ongoing needs as they evolve is indispensable. Please provide examples of past projects, rates, and anticipated timelines.
15 days ago15 proposalsRemoteControl smart relay to pull data and trigger action
Hello, We are looking for a suggestion of a smart relay unit that could be connected to take an input signal from a fire alarm relay box. It can be connected via WiFi or Ethernet. A custom script should then be made. One a signal is received, it should lookup all users from our Microsoft365 AD. It should then send a predefined text message to all the users’ mobile number using an API such as PureSMS.uk Many thanks, James
12 days ago15 proposalsRemoteWoocommerce sign up form.
I need a form on Woocommerce that captures certain information, then charges £35 to the customer and sends us the data. It also needs to not allow under 18's to complete the form.
7 days ago37 proposalsRemoteWordpress expert familiar with API and datadriven templates
We are in search of a web developer for WordPress who is familiar with the WordPress API and the concept of data-driven pages. We need page templates built which will show data from a separate system.
15 days ago90 proposalsRemoteopportunity
Update my Golf Scoreboard and link to API
Update my entry form with new golfers and betting odds and share link (to correct domain) Link to golf API Add entries to live scoreboard as last time add 'CUT' functionality (can be manual typing after round 2 or via API data)
9 minutes ago2 proposalsRemoteopportunity
Scorecards and Dashboards
Im looking for somone who can create an automated scorecard and dashboard for a client. You'll need to pull data from several systems and create a good looking dashboard which updates a minimum of daily.
6 days ago45 proposalsRemote