RGPV Alerts Retriever Ver 2.0 (2020.4)

RGPV Alerts Retriever Ver 2.0 2020.4 Project - Aaditya Jain Blog - Aditya Jain - AadityaJain-Dev

Project Name: RGPV Alerts Retriever Ver 2.0



Aim: To solve all the issues of previous version & make it more fast & reliable.



Language: PHP
Database: Mysql
Server: Apache
Others: Simple HTML DOM Pharser

Status: [Live]
Source Code: https://github.com/AadityaJain-Dev/RGPV-Important-Alerts-Scraper
Project / YouTube link: [None]

Just because something doesn’t do what you planned it to do doesn’t mean it’s useless. - Thomas Edison

Description: The previous version was fine, I decided to save the URL separately so that its database can also be used with rgpvnotes.in application also, but I didn't take into account the human error element, In my database scheme I am just checking news text for uniqueness, but sometimes the RGPV is posting an update & then later changing just its URL. My script is missing these updates. so I have to fix it.




Problem: In some cases, RGPV only updates the URL of the news & my script is missing those updates because we are only checking the text.

Solution I suggest: The solution I am thinking of is easy enough, we can combine the text of the news with the URL & generate its MD5 hash, the ash will be compared for uniqueness rather than text, the chances of md5 collision is very low so that should not be a problem. It is much better than our current approach and easy enough to implement in a few minutes.



Todo list:

  • None so far.

Comments