
PHP MYSQL HTML REGEX web scrapping, mods and additional features
5130
$$
- Posted:
- Proposals: 3
- Remote
- #143857
- Archived
Description
Experience Level: Intermediate
This project is based on modifications of an open source set of scripts that capture data from both web scrapping and manual data entry.
The requirements are to modify and extend the scripts to capture more data than was originally programmed. A clear understanding of the snippet of code below is needed to successfully complete this project.
An additional component with be ongoing feature additions and maintenance of the scripts.
This project is slated for 3 phases.
1. Mod current script to pull new data.
2. Extending db and statistics to include new user input data.
3. Submission system.
website for open source scripts:
http://www.videodb.net/blog/
You may review the code base here:
http://videodb.cvs.sourceforge.net/viewvc/videodb/videodb/
The snippet of code for clarity of understanding of project.
preg_match('/\s*Directors?:\s*(.*?)/si', $resp['data'], $ary);
preg_match_all('/(.+?)/si',$ary[1], $ary, PREG_PATTERN_ORDER);
// TODO: Update templates to use multiple directors
$data['director'] = trim(join(', ', $ary[1]));
Phase 1:
add the following new data pulls from example imdb page:
http://www.imdb.com/title/tt1403865/combined
scripts currently uses:
http://www.imdb.com/title/tt1403865/
Directors, Writers, Cinematographers, Editors, Producers, Stars
instead of full cast listing, and Plot tag if possible, technical data.
all other data may remain functioning.
These should become fully functional such as existing for current data pulls.
Phase 2:
in edit mode, add tick boxes for new data sets. simular to genres that
exist now. but they will have no interaction with imdb. data is
generated local, displays local, edits local.
Phase 3:
Will be an end user submission page for the data fields that have been manually added to each title. The submission page will be publicly available but will be held for admin moderation and approval prior to publishing to the public data sets.
Skills Required:
php, mysql, web-scraping, statistics, javascript, ajax, html, css, data-entry
The requirements are to modify and extend the scripts to capture more data than was originally programmed. A clear understanding of the snippet of code below is needed to successfully complete this project.
An additional component with be ongoing feature additions and maintenance of the scripts.
This project is slated for 3 phases.
1. Mod current script to pull new data.
2. Extending db and statistics to include new user input data.
3. Submission system.
website for open source scripts:
http://www.videodb.net/blog/
You may review the code base here:
http://videodb.cvs.sourceforge.net/viewvc/videodb/videodb/
The snippet of code for clarity of understanding of project.
preg_match('/\s*Directors?:\s*(.*?)/si', $resp['data'], $ary);
preg_match_all('/(.+?)/si',$ary[1], $ary, PREG_PATTERN_ORDER);
// TODO: Update templates to use multiple directors
$data['director'] = trim(join(', ', $ary[1]));
Phase 1:
add the following new data pulls from example imdb page:
http://www.imdb.com/title/tt1403865/combined
scripts currently uses:
http://www.imdb.com/title/tt1403865/
Directors, Writers, Cinematographers, Editors, Producers, Stars
instead of full cast listing, and Plot tag if possible, technical data.
all other data may remain functioning.
These should become fully functional such as existing for current data pulls.
Phase 2:
in edit mode, add tick boxes for new data sets. simular to genres that
exist now. but they will have no interaction with imdb. data is
generated local, displays local, edits local.
Phase 3:
Will be an end user submission page for the data fields that have been manually added to each title. The submission page will be publicly available but will be held for admin moderation and approval prior to publishing to the public data sets.
Skills Required:
php, mysql, web-scraping, statistics, javascript, ajax, html, css, data-entry
James L.
0% (0)Projects Completed
1
Freelancers worked with
1
Projects awarded
0%
Last project
22 May 2012
United States
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies