Experienced programmer required to develop code to scrape a website

I'm looking on behalf of a company to collect some public domain information from a British government website (the Charity Commission). They let you look at the data, but you can only access a maximum of 500 records, out of a database of 162,000 on each search. I'm looking to 'scrape' the entire database at once, and then scrape data from pre-selected records, identifiable through the sequential number that every registered record has as it's unique identifier. I'm guessing that I need a short piece of script (in python?) to scrape the database and export it as csv or xml.

I've seen it done elsewhere, but they've struggled to capture the whole thing.
I also want to capture data on the most recent files established, so would be looking to scrape all "new" registrants so as to provide a separate file.

This information is publicly available.