Python / Rails scrapper to DB

General information for the business: Catalog portal
Description of requirements/functionality: Hello,

I need a scrapper script with the following features:

- Be able to scan a public website from a public query (no cookies, no login)
- Create a list of pages and scrape the content into a Sqlite DB (maybe other, we would discuss about that)
- Manage the script as a cron job able to update data with version controller
- Upload images from scrapped pages to a object storage folder as (S3 or digitalocean space)

Thanks
Regards
Specific technologies required: Python or Rails
OS requirements: Linux
Extra notes: For structure of data a SQL DB seems sugested but this aspect will be discussed with the developer.