
Python script for collecting html-pages in AWS
- or -
Post a project like this1820
€80(approx. $93)
- Posted:
- Proposals: 10
- Remote
- #2887571
- Awarded
WordPress Expert✮Shopify Expert✮Graphic Designer✮AutoCAD 2D & 3D✮CV Writer & Designer✮Fullstack developer

Website Developer, Graphic Designer, Transcriber, Content writer, CAD Expert, Python Developer, Photo Editor, Web Scrapper, JAVA developer, Android developer, Wix/Shopify Expert,

146940736365732543778246148940667829700241244165395592315373552147640




Description
Experience Level: Entry
The script will be written in python3.
I will use the script in AWS, so experience in AWS will be nice.
I wrote this program with a easy macrotool and it works fine on windows. My macro has only one problem, not every website responds to a simple https request. Maybe the header or user agent my macro is sending is not what the webserver wants. I think this can be done better with BeautifulSoup.
I need the python-script working in AWS EC2
These are the steps of the script:
-Connect to PostgreSQL-database in AWS-Cloud.
-Send SQL-Query (is finish designed) and read first line
-Use the read parameters from the database
-Start a Loop
-sent https Request to a Webserver in internet and save the html-file complete on storage(S3)
-Test if html-file is saved
-Send SQL-Query (is finish designed) to database for success
-Wait 10 seconds
-Next loop pass
You can use my working macro as a template.
I will use the script in AWS, so experience in AWS will be nice.
I wrote this program with a easy macrotool and it works fine on windows. My macro has only one problem, not every website responds to a simple https request. Maybe the header or user agent my macro is sending is not what the webserver wants. I think this can be done better with BeautifulSoup.
I need the python-script working in AWS EC2
These are the steps of the script:
-Connect to PostgreSQL-database in AWS-Cloud.
-Send SQL-Query (is finish designed) and read first line
-Use the read parameters from the database
-Start a Loop
-sent https Request to a Webserver in internet and save the html-file complete on storage(S3)
-Test if html-file is saved
-Send SQL-Query (is finish designed) to database for success
-Wait 10 seconds
-Next loop pass
You can use my working macro as a template.

global infopool UG
100% (15)Projects Completed
13
Freelancers worked with
8
Projects awarded
73%
Last project
31 Dec 2021
Germany
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies