Travel scraper web app
- or -
Post a project like this1824
£241(approx. $302)
- Posted:
- Proposals: 5
- Remote
- #2370239
- OPPORTUNITY
- Awarded
Description
Experience Level: Expert
Estimated project duration: less than 1 week
Hi,
I am looking for a developer to help me build simple flight scraper web app that allows users to see the prices of a flight in different countries. This is because the prices of the exact same booking are different depending on the regional ip address of the country where the booking is made.
The web app consists of three core components: the expedia flight scraper which I have already built in python, the proxy system architecture, and the front-end.
There are lots of existing flight scrapers online with different scraping logic, which may be better suited. Which ever the developer recommends can be used. The flight info to be scraped is the price, airline, arrival & destination time, duration and number of stops. All info is on the same results page and each country has the the same page structure. It will simply be duplicated to run concurrently across 5 regional proxies: UK, US, Germany, India, South Korea.
An ip from a proxy server in each region (5 in this case) is required to get around the geo restriction and obtain the true price. I'm happy to use what ever proxy service the developer recommends. Only one page will be scraped (one for each country) each time the user makes a request, so I don't think IP rotation will be necessary, but I am completely open to any and all suggestions.
I've attached a mockup depicting the inputs and functionality of the front-end. Storing the cheapest results in a database for display and flight tracker function can be handled separately, though these can be added to the job for additional cost if the developer is competent and capable enough.
Although this is a single project, If successful the developer could also build the hotel version on top of this framework, which will be exactly the same but for hotels. I will probably want to add more features over time so there will almost certainly be recurring work with this.
The use case of the system from a user perspective is outlined below:
1. User inputs flight info (one way or round trip, origin & destination, dates, passengers, cabin)
2. User presses search which deploys the 5 scrapers
3. The scrapers obtain the flight info and parse the prices into gbp
4. The prices are displayed in a table for easy price comparison
5. Other flight details could either be displayed in the table, or revealed on button hover to save space.
Please do not hesitate to contact me for further details.
Many Thanks,
Nathan
I am looking for a developer to help me build simple flight scraper web app that allows users to see the prices of a flight in different countries. This is because the prices of the exact same booking are different depending on the regional ip address of the country where the booking is made.
The web app consists of three core components: the expedia flight scraper which I have already built in python, the proxy system architecture, and the front-end.
There are lots of existing flight scrapers online with different scraping logic, which may be better suited. Which ever the developer recommends can be used. The flight info to be scraped is the price, airline, arrival & destination time, duration and number of stops. All info is on the same results page and each country has the the same page structure. It will simply be duplicated to run concurrently across 5 regional proxies: UK, US, Germany, India, South Korea.
An ip from a proxy server in each region (5 in this case) is required to get around the geo restriction and obtain the true price. I'm happy to use what ever proxy service the developer recommends. Only one page will be scraped (one for each country) each time the user makes a request, so I don't think IP rotation will be necessary, but I am completely open to any and all suggestions.
I've attached a mockup depicting the inputs and functionality of the front-end. Storing the cheapest results in a database for display and flight tracker function can be handled separately, though these can be added to the job for additional cost if the developer is competent and capable enough.
Although this is a single project, If successful the developer could also build the hotel version on top of this framework, which will be exactly the same but for hotels. I will probably want to add more features over time so there will almost certainly be recurring work with this.
The use case of the system from a user perspective is outlined below:
1. User inputs flight info (one way or round trip, origin & destination, dates, passengers, cabin)
2. User presses search which deploys the 5 scrapers
3. The scrapers obtain the flight info and parse the prices into gbp
4. The prices are displayed in a table for easy price comparison
5. Other flight details could either be displayed in the table, or revealed on button hover to save space.
Please do not hesitate to contact me for further details.
Many Thanks,
Nathan
Nathan B.
100% (4)Projects Completed
4
Freelancers worked with
3
Projects awarded
33%
Last project
30 Mar 2021
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies