Medium website crawler (using nodejs)
- or -
Post a project like this1097
$15
- Posted:
- Proposals: 3
- Remote
- #3225675
- Awarded
Description
Experience Level: Entry
There should be an input button where a user can input a tag name and your crawler should crawl 10 latest blogs and parse the data like Details, title, blog, tags, responses (it should be done in backend).
Show list of blogs with creator name, title, and details
While data is being crawled, in the frontend display the blogs that are crawled. It should be real time(without reloading)(e.g. Let say 3 blogs are crawled so it should display like this.)
crawling..
pending..
pending..
pending..
pending..
pending..
pending..
When user clicks on a blog, it should open in a new page with (title, blog, tags, responses and source url) (as it is displayed on the Medium Blog).
Responses should be searchable, if user searches for a particular keyword then it should
display responses that contains only those keywords.
There should be an option of “next 10 blogs”, it should crawl next 10 blogs with the above tag.
When user click on a tag then it should crawl 10 latest blogs of that tag.
Display how much time it took to crawl individual page.
If no blogs are found it should suggest other tags related to the tag that user has searched
Display Search History
All crawled data, tags and responses should be stored in database with proper associations.
Show list of blogs with creator name, title, and details
While data is being crawled, in the frontend display the blogs that are crawled. It should be real time(without reloading)(e.g. Let say 3 blogs are crawled so it should display like this.)
crawling..
pending..
pending..
pending..
pending..
pending..
pending..
When user clicks on a blog, it should open in a new page with (title, blog, tags, responses and source url) (as it is displayed on the Medium Blog).
Responses should be searchable, if user searches for a particular keyword then it should
display responses that contains only those keywords.
There should be an option of “next 10 blogs”, it should crawl next 10 blogs with the above tag.
When user click on a tag then it should crawl 10 latest blogs of that tag.
Display how much time it took to crawl individual page.
If no blogs are found it should suggest other tags related to the tag that user has searched
Display Search History
All crawled data, tags and responses should be stored in database with proper associations.
Abhishek K.
100% (2)Projects Completed
2
Freelancers worked with
2
Projects awarded
25%
Last project
2 Apr 2018
India
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies