
Create a python RSS feed collector application
- or -
Post a project like this2023
€50(approx. $58)
- Posted:
- Proposals: 5
- Remote
- #2745673
- Awarded
Description
Experience Level: Entry
Estimated project duration: 1 day or less
I need a 'simple' python app to be developed to gather rss/atom feeds and store in a db
preferred modules
- feed parser
Input:
table (SQL) with rss url feeds
output
new rss messages (vs previous run) written to database (SQL)
table meta : per news item: load date , source, message, + json object with all the retrieved data
(sql db can be sqlite, however later can be a amazon rds postgres instance)
log table to indicate
- run through
- RSS feed issues
- rss not responding/...
- parsing issues
errors should be max handled and clean connection open & close
the goal is to run this script every 5-10 min on a was micro instance & needs to run through 1000 RSS feeds easily
scheduling CRON first then Airflow
answers need to show you read this text
preferred modules
- feed parser
Input:
table (SQL) with rss url feeds
output
new rss messages (vs previous run) written to database (SQL)
table meta : per news item: load date , source, message, + json object with all the retrieved data
(sql db can be sqlite, however later can be a amazon rds postgres instance)
log table to indicate
- run through
- RSS feed issues
- rss not responding/...
- parsing issues
errors should be max handled and clean connection open & close
the goal is to run this script every 5-10 min on a was micro instance & needs to run through 1000 RSS feeds easily
scheduling CRON first then Airflow
answers need to show you read this text

Matej K.
100% (12)Projects Completed
2
Freelancers worked with
2
Projects awarded
50%
Last project
3 Dec 2020
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies