Web site scraper
- or -
Post a project like this2320
$$
- Posted:
- Proposals: 6
- Remote
- #1809670
- Awarded
Full Stack Developer : WordPress | Shopify | Next.js | Nuxt.js | RN ( Mobile App Development)
Kanpur
187335215198122708731465917455451808468
Description
Experience Level: Intermediate
General information for the business: We work with Insurance agents to cross sell business and commercial insurance products
Database management system (DBMS): Microsoft Access
Description of requirements/functionality: We need a web scraper to help create a comprehensive Insurance agent and Insurance agency data base.
https://fortress.wa.gov/oic/consumertoolkit/Search.aspx
We can search this site for single searches of agents, agencies or companies but we need to see a bigger data structure to find the types of agencies that have affiliations called appointments. These types of Appointments help agents perform their work. Both agents and agencies have appointments.
Companies are the resource agents and agencies use to get appointments.
We want to build a comprehensive resource of data that is a combined search of agents, agencies and companies.
We would like to search the full data set for agents that are affiliated with multiple appointments, search agencies that have certain appointments and search companies that provide appointments for certain products.
It takes far too long to do this using the site and the information the way it is provided.
I have screen shots of the data fields we would like from each of the three different search types.
From the main data we would like to search.
Search Agents; Types of insurance(Licensing information), appointments (need to string multiple company names into the search string) Types of Agencies the agent can represent. Export to XLS or MBD - we need a GUI to search the data and generate usable data formats. Report: Agent name, address, city state zip and phone. Types of insurance products. Appointments and related fields as shown on screen capture sheets
Same for Agency- see screen capture
Same for Company - See screen capture
CMS and Admin requirements: Need to be able to rerun the scrape to refresh the data- until the website changes- new script would be required
Need to report and export data
Extra notes: Have screen shots available to show data records
Database management system (DBMS): Microsoft Access
Description of requirements/functionality: We need a web scraper to help create a comprehensive Insurance agent and Insurance agency data base.
https://fortress.wa.gov/oic/consumertoolkit/Search.aspx
We can search this site for single searches of agents, agencies or companies but we need to see a bigger data structure to find the types of agencies that have affiliations called appointments. These types of Appointments help agents perform their work. Both agents and agencies have appointments.
Companies are the resource agents and agencies use to get appointments.
We want to build a comprehensive resource of data that is a combined search of agents, agencies and companies.
We would like to search the full data set for agents that are affiliated with multiple appointments, search agencies that have certain appointments and search companies that provide appointments for certain products.
It takes far too long to do this using the site and the information the way it is provided.
I have screen shots of the data fields we would like from each of the three different search types.
From the main data we would like to search.
Search Agents; Types of insurance(Licensing information), appointments (need to string multiple company names into the search string) Types of Agencies the agent can represent. Export to XLS or MBD - we need a GUI to search the data and generate usable data formats. Report: Agent name, address, city state zip and phone. Types of insurance products. Appointments and related fields as shown on screen capture sheets
Same for Agency- see screen capture
Same for Company - See screen capture
CMS and Admin requirements: Need to be able to rerun the scrape to refresh the data- until the website changes- new script would be required
Need to report and export data
Extra notes: Have screen shots available to show data records
Daniel D.
100% (5)Projects Completed
2
Freelancers worked with
2
Projects awarded
50%
Last project
27 Apr 2018
United States
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Hi Daniel,
Screen Captures are missing.
Could you provide me to look more on this job ?
Thanks
Sumit
SaS Technologies -
Hi Daniel,
Do you have a website for your business please.
Many thanks and regards,
Shelley -
Missing attachment
549851549662549368
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies