8eaaae19a1
mark nsfw sites as nsfw in site list
2 years ago
0be9fb1c40
Made the code simpler
2 years ago
cf5756578d
updated site list and added favicon to site.md
2 years ago
f4673cc13c
Refractored sites.py, sherlock.py and notify.py.
3 years ago
a0360d4725
chore: make quotes in repo consistent
3 years ago
fbf879611b
chore: add editorconfig
3 years ago
d404fe73fc
Changes made to site_list.py to reduce commit size
4 years ago
5098b67aa6
Changes made to site_list.py to reduce commit size
4 years ago
3a8ed636f5
cleaned up site_list.py and updated site.md
4 years ago
490a26248a
removed ranking from site_list.py and organized data.json by alphabetic
...
order
4 years ago
2b99aeef0f
Fix path to data file when doing site update.
5 years ago
92879af8eb
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# README.md
# sherlock/sherlock.py
5 years ago
bc3e58d599
removed unused variable
5 years ago
d17268e737
Move content into sherlock sub-directory inside of repo. This directory will look very much like what the packaged version of Sherlock will look like when it is installed in the site-packages area.
...
No real restructuring of the code has happened. This just gives a view of the directory structure.
5 years ago
bd70be289b
Change method used to get site ranking. Not only has alexa.com changed the format of their web site, they also seem to have gotten even more picky about people scraping it. So, use their API to query the site data.
...
Not sure why the API was not used earlier. It is much more efficient as much less data is passed. And, it is less likely to have its format changed randomly. It did flake out on some sites one time I used it. But, then it worked reliably next. I am not going to do many requests, as it probably has some query rate limit.
6 years ago
8b6b14fc6a
Fixed mixed of tabs and spaces in a single file.
6 years ago
619d9ab6bc
Fix issue with site name and url
6 years ago
3db3f4558b
Parallelized updating alexa ranking
6 years ago
1442f333c2
Parallelised updating Alexa.com ranking of sites
...
Script now fetches Alexa ranks for sites concurrently on separate threads. Cuts down the time to sync ranks from approximately **5 minutes** to about **18 seconds**.
6 years ago
826af1ec19
remove unused import
6 years ago
9c45146da1
remove unused import
6 years ago
cc2b1cb27a
Improve terminal appearence for site_list.py
6 years ago
40fc51fc32
add rank paramether to site_list.py
...
--rank or -r to update all page ranks
6 years ago
ad4c321f3f
Correct print look
6 years ago
04ee711872
Merge remote-tracking branch 'upstream/master'
6 years ago
46705ad0a1
Add Alexa.com rank updating functionality to site_list.py
6 years ago
f641649be7
Sort "sites.md"
6 years ago
1ed24f5993
correct code
6 years ago
2ef168d924
Add website sorting code to site_list.py
...
Includes a fix in indentation
6 years ago
4ecaad6289
Update script to use with-as structure for files. Add number of supported sites to title. Add status message.
6 years ago
26adc32497
Add script for listing sites in sites.md
6 years ago
Siddharth Dushantha
benni347
Seth Falco
NirajNair
Christopher K. Hoadley
Armin
jenchieh
aditisrinivas97
Avinash Shenoy
ptalmeida
Yahya SayadArbabi
anto-christo