Scraping specific sub pages from a list of 6,200 sites

I have a list of some 6,200 URl of colleges and universities in the USA. I tried using BeautifulSoup to do the following task but ended up empty-handed because I couldn't deal with all the exceptions. I would like to create a table that has one row for each college/university and as many columns as they have web pages beneath their URL that contain the phrase "geographic information". There are many institutions that have zero responses, some that have a few, and a few that have many pages. All I want in this table is a list of all the URLs for the respective sub-pages containing the search phrase, I will then manually go through all of them to see whether they are useful for me.
In order to be able to repeat the task myself, I am seeking the source code that creates such a table. The language is secondary (I prefer Python or R but it could be any other commonly used language). How much effort do you think this would be and hence how much would be the total costs?
Cheers,
Jochen