
Webcrawler webspider phyton – crawler
- or -
Post a project like this1885
€30(approx. $35)
- Posted:
- Proposals: 4
- Remote
- #2813644
- Awarded
Description
Experience Level: Entry
Hey there,
i am looking for a webcrawler that should crawl the following website. Specific description is attached.
https://www.foerderdatenbank.de/SiteGlobals/FDB/Forms/Suche/Foederprogrammsuche_Formular.html?resourceId=0065e6ec-5c0a-4678-b503-b7e7ec435dfd&input_=23adddb0-dcf7-4e32-96f5-93aec5db2716&pageLocale=de&filterCategories=FundingProgram&templateQueryString=&submit=Suchen
Currently it has 1943 DataSets.
Requirements:
1) The Information shall be stored in an array, each time I crawl the website. Plus (if possible and not a lot of work), please let it save as csv, json, excel, mysql, postgresql and mongodb.
2) I need a short manual how to use it
3) it shall be used on Windows.
4) The code shall be modifiable/accessible.
5) It shall crawl relatively slow – I don’t want to attack the website
6) True/False statements shall be stored as boolean, numbers as numbers, the rest as text or arrays.
7) Please let me know, if I forgot to adress some important requirement.
In red are the „dimension“ of the items in the array. In blue are the datasets for those dimension.
For example red „D“ contains all the possible dimensions, black „D“ is the specific data of this dataset.
Already thanks a lot!
Best regards,
Jascha
i am looking for a webcrawler that should crawl the following website. Specific description is attached.
https://www.foerderdatenbank.de/SiteGlobals/FDB/Forms/Suche/Foederprogrammsuche_Formular.html?resourceId=0065e6ec-5c0a-4678-b503-b7e7ec435dfd&input_=23adddb0-dcf7-4e32-96f5-93aec5db2716&pageLocale=de&filterCategories=FundingProgram&templateQueryString=&submit=Suchen
Currently it has 1943 DataSets.
Requirements:
1) The Information shall be stored in an array, each time I crawl the website. Plus (if possible and not a lot of work), please let it save as csv, json, excel, mysql, postgresql and mongodb.
2) I need a short manual how to use it
3) it shall be used on Windows.
4) The code shall be modifiable/accessible.
5) It shall crawl relatively slow – I don’t want to attack the website
6) True/False statements shall be stored as boolean, numbers as numbers, the rest as text or arrays.
7) Please let me know, if I forgot to adress some important requirement.
In red are the „dimension“ of the items in the array. In blue are the datasets for those dimension.
For example red „D“ contains all the possible dimensions, black „D“ is the specific data of this dataset.
Already thanks a lot!
Best regards,
Jascha

Jascha H.
100% (19)Projects Completed
18
Freelancers worked with
15
Projects awarded
22%
Last project
12 Jan 2025
Germany
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies