Web Data Scraping and Automation Developer - Python

We are seeking an experienced developer for a web data scraping and automation project. The project involves extracting specific data from multiple URLs, and we are looking for a reliable, long-term developer with expertise in Python and Selenium.

Project Details:

Objective: Extract specific data from a list of URLs where the data is visible only after redirection.

URL Sample:

Caterpillar battery patents: [URL](https://ppubs.uspto.gov/pubwebapp/external.html?q=(CATERPILLAR.AS.)AND((BATTERY.TTL.)OR(BATTERIES.TTL.)OR((BATTERY%20ADJ%20ELECTRIC).AB.)OR((BATTERY%20ADJ%20PACK).AB.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).AB.)OR((BATTERY%20ADJ%20ELECTRIC).DETD.)OR((BATTERY%20ADJ%20PACK).DETD.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).DETD.)OR((CELL%20ADJ%20CHEMISTRY).DETD.)OR((BATTERY%20ADJ%20MANAGEMENT).DETD.))&db=USPAT
Volvo battery patents: [URL](https://ppubs.uspto.gov/pubwebapp/external.html?q=(((AB%20ADJ%20VOLVO).AS.)OR((VOLVO%20ADJ%20CONSTRUCTION).AS.))AND((BATTERY.TTL.)OR(BATTERIES.TTL.)OR((BATTERY%20ADJ%20ELECTRIC).AB.)OR((BATTERY%20ADJ%20PACK).AB.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).AB.)OR((BATTERY%20ADJ%20ELECTRIC).DETD.)OR((BATTERY%20ADJ%20PACK).DETD.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).DETD.)OR((CELL%20ADJ%20CHEMISTRY).DETD.)OR((BATTERY%20ADJ%20MANAGEMENT).DETD.))&db=USPAT

Data Extraction: Extract specific data as shown in the attached screenshot.

Approach: Store URLs in a CSV file and iterate through each URL. Concatenate values based on the header in a data frame.

Requirements:

Proficiency in Python and Selenium for web scraping and automation.
Experience with similar web scraping projects.

Reliability and a long-term commitment, as we have similar projects planned for the future.
How to Apply:

If you meet the above requirements and have experience with similar web scraping jobs, please submit your proposal. Include details of your relevant experience, your approach to this project, and any relevant references.

We look forward to working with a skilled developer for this and future projects.

-Manish