Select From Trending Websites List
Development complete – see notes below:
This feature has been added into v.1.0.5 of feedit, however at the moment the list isn’t dynamically generated. When browsing in the feedit app, it gets the “recommended websites” list from this website, you can submit a suggestion for a website to be added to the list by using the contact form.
A separate suggestion for the dynamic part of this will be created so it’s not forgotten about. That will take considerable development so we’ll need to see if the demand for it is there.
Where would the list come from?
That is a very good question but initial thoughts are…
We currently have a master list of scrapers, this is a list of sites which are known to be working with feedit.
This list could be used to populate a list of websites which are known to be compatible, there would need to be three bits of data added to this list though…
- Category: To filter websites by category we’d need to know what category it belongs in, it could potentially fit multiple categories.
- Amount of installs: A counter will be needed to track the amount of times it’s been added.
- Date: It makes sense to cater for a “newly added” filter too. The date the website was added to the scraper would allow for this.
Currently the master list of scrapers is grabbed during the updates and isn’t in a database format. This would need to change.
A new feature would need to be developed for this website which allows users to somehow share details of their custom scrapers, this would most likely be done by creating a forum on the website. In all likelihood it would just be a basic forum for app support, as I’m really busy with development I won’t have much time to spend on there. Of course, if it became popular then there’s always the scope to expand and get some admin/moderators on board.
As scraper feeds are created as png images, the easiest solution would be for users to set their profile pic/avatar as the scraper feed image. A script could then run every so often (on the website) which scans the images found on the forum and populates a database of scrapers from all the results.
The resulting database would then be used to serve the app with a new master list of scrapers and this list would also have all the necessary data to populate filtered lists of available websites.
How would trending/popular work?
When a user clicks the website to install, a unique encrypted code could be sent to a server which updates the install count in the master list database.