
Updates to PHP based URL Checker
- or -
Post a project like this1167
£50(approx. $67)
- Posted:
- Proposals: 6
- Remote
- #3720364
- Completed
Digital Solutions|Designer & Developer|Shopify|App Development|WordPress|Data Scraping|Lead Generation|Animation

WordPress Expert | Web & App Developer | SEO Specialist | Content Writer | Blockchain | Python | OpenAI | Machine Learning

Digital Web & AI Automation Agency | Expert in WordPress, Shopify & Custom Development



Shopify & WordPress Development |Laravel | Shopify APP| AWS Expert |SEO Expert | Mobile APPS

11+ years of exp. in Graphics Designing, Web Designing and Web Development

151375638114783151005227480474323421078875
Description
Experience Level: Entry
---Overview---
So what I have a currently is rather simple PHP page which connects to the MySQL server (MariaDB) and simply runs;
"SELECT FROM Firmware"
The PHP page paginates these results as the database currently stands at over 2,700 entries which simply cannot be parsed all at once due to it running into the maximum script execution time allowed by my hosting provider.
The script then checks the URL's it gets back from the database and populates them in a table (25 results per page) with a simple Tick if they're online and a Cross if they're not (using the FontAwesome library). Whilst this works, with so SO many links to check, it is impossible to notice older files that may have gone offline as the table really only is useful for the latest uploaded files.
What i would like is for some key stats to show at the top. Something like this dashboard example.
https://workplace.datto.com/managerhelp/Content/Resources/Images/MSPPortal/Dashboard.png
I like the “pie charts” showing the ratio of online to offline files, along with the total online and total offline file counts.
However, if I have some files offline, id like to be able to click the pie chart and it to “filter” my table to show me the offline files so I can fix them without digging through 100 pages to see which ones are offline.
Due to the maximum PHP execution time, these 2,700+ rows cannot all be fetched and parsed at once. I would imagine the only way to do this is to load a set figure (maybe 100?) at one time and use AJAX or something to load in the remaining chunks of data. You can of course play with the number of results fetched per query and find the servers limits to ensure the page loads in a timely manner. It would be good to have some kind of indicator on the page to show me that the results are still loading.
Many times, just the most recent 25 files are enough for me to see, i add somewhere between 5 and 50 results a day. But i always want to make sure that all of the older files are offline.
---Ultimate Goals---
- One Pie chart at the top of the page showing total number of files and how many are off/online.
- Table (as i currently have) showing the status of all of the files individually.
- The ability to click the pie chart to filter the table to the offline files, regardless of what page in the results table the offline file is on.
---Limitations---
- Maximum PHP execution time with my host is somewhere around 60 seconds, you need to work with this in mind on a growing database with approx 500 additions per year.
- Language should be mainly PHP/HTML, any additional language used should be well commented.
As for what happened last time, the developer i hired got the pie charts working, but he couldn't work around the maximum execution time of the server. All the charts showed was the status of whatever was on that current page which was totally useless.
If the entire page has to change to make this work, that is totally fine, the absolute critical thing is to be able to see the status of all files and to be able to see very quickly if any of the files are offline.
So what I have a currently is rather simple PHP page which connects to the MySQL server (MariaDB) and simply runs;
"SELECT FROM Firmware"
The PHP page paginates these results as the database currently stands at over 2,700 entries which simply cannot be parsed all at once due to it running into the maximum script execution time allowed by my hosting provider.
The script then checks the URL's it gets back from the database and populates them in a table (25 results per page) with a simple Tick if they're online and a Cross if they're not (using the FontAwesome library). Whilst this works, with so SO many links to check, it is impossible to notice older files that may have gone offline as the table really only is useful for the latest uploaded files.
What i would like is for some key stats to show at the top. Something like this dashboard example.
https://workplace.datto.com/managerhelp/Content/Resources/Images/MSPPortal/Dashboard.png
I like the “pie charts” showing the ratio of online to offline files, along with the total online and total offline file counts.
However, if I have some files offline, id like to be able to click the pie chart and it to “filter” my table to show me the offline files so I can fix them without digging through 100 pages to see which ones are offline.
Due to the maximum PHP execution time, these 2,700+ rows cannot all be fetched and parsed at once. I would imagine the only way to do this is to load a set figure (maybe 100?) at one time and use AJAX or something to load in the remaining chunks of data. You can of course play with the number of results fetched per query and find the servers limits to ensure the page loads in a timely manner. It would be good to have some kind of indicator on the page to show me that the results are still loading.
Many times, just the most recent 25 files are enough for me to see, i add somewhere between 5 and 50 results a day. But i always want to make sure that all of the older files are offline.
---Ultimate Goals---
- One Pie chart at the top of the page showing total number of files and how many are off/online.
- Table (as i currently have) showing the status of all of the files individually.
- The ability to click the pie chart to filter the table to the offline files, regardless of what page in the results table the offline file is on.
---Limitations---
- Maximum PHP execution time with my host is somewhere around 60 seconds, you need to work with this in mind on a growing database with approx 500 additions per year.
- Language should be mainly PHP/HTML, any additional language used should be well commented.
As for what happened last time, the developer i hired got the pie charts working, but he couldn't work around the maximum execution time of the server. All the charts showed was the status of whatever was on that current page which was totally useless.
If the entire page has to change to make this work, that is totally fine, the absolute critical thing is to be able to see the status of all files and to be able to see very quickly if any of the files are offline.
Chris H.
100% (15)Projects Completed
13
Freelancers worked with
11
Projects awarded
67%
Last project
7 May 2023
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies