Yahya SayadArbabi
263b8b3b90
Merge branch 'aditisrinivas97-master'
6 years ago
Yahya SayadArbabi
67108071e5
bump version
6 years ago
aditisrinivas97
619d9ab6bc
Fix issue with site name and url
6 years ago
Yahya SayadArbabi
011df7af55
bump version
6 years ago
Yahya SayadArbabi
fd63e1093f
Merge branch 'avinashshenoy97/patch-1'
6 years ago
Avinash Shenoy
3db3f4558b
Parallelized updating alexa ranking
6 years ago
Avinash Shenoy
1442f333c2
Parallelised updating Alexa.com ranking of sites
...
Script now fetches Alexa ranks for sites concurrently on separate threads. Cuts down the time to sync ranks from approximately **5 minutes** to about **18 seconds**.
6 years ago
Yahya SayadArbabi
269df6d549
Merge pull request #151 from ptalmeida/master
...
Fix readme and instrallpackages.sh typo
6 years ago
ptalmeida
8ee50e6717
Fix typo
...
necessery -> necessary
6 years ago
ptalmeida
85d7be3e77
Actually bring README.md up to date
6 years ago
Yahya SayadArbabi
d6b7c0ac55
Merge branch 'ptalmeida-Add-sorgin-by-alexa-rank-functionality'
6 years ago
ptalmeida
8b681158bc
small corrections to rank sort
6 years ago
ptalmeida
78ade00dee
Update outdated REAME.md
6 years ago
ptalmeida
5d972a3138
add --rank -r option to sherlock
6 years ago
ptalmeida
55d43b0ee6
Update requirements.txt
6 years ago
ptalmeida
db0cf7c289
Update requirements.txt
6 years ago
ptalmeida
826af1ec19
remove unused import
6 years ago
Yahya SayadArbabi
2408bb520e
Merge branch 'UltraWelfare/optional_output'
6 years ago
George Tsomlektsis
0e6b8d0dca
Added optional parameters for outputting files and folders.
6 years ago
George Tsomlektsis
f511faab23
Added the ability to load external json files.
6 years ago
ptalmeida
0b96141df0
Merge remote-tracking branch 'upstream/master'
6 years ago
ptalmeida
9c45146da1
remove unused import
6 years ago
ptalmeida
cc2b1cb27a
Improve terminal appearence for site_list.py
6 years ago
ptalmeida
40fc51fc32
add rank paramether to site_list.py
...
--rank or -r to update all page ranks
6 years ago
ptalmeida
ad4c321f3f
Correct print look
6 years ago
ptalmeida
04ee711872
Merge remote-tracking branch 'upstream/master'
6 years ago
ptalmeida
46705ad0a1
Add Alexa.com rank updating functionality to site_list.py
6 years ago
Christopher Kent Hoadley
eae4da7294
Merge pull request #144 from TheYahya/hoadlck-fix-more-sites
...
Fix EyeEm/CreativeMarket/EVE Online False Positives
6 years ago
Christopher K. Hoadley
0709fd3947
Change EyeEm/CreativeMarket/EVE Online detection method to use the newly refurbished "response_url" detection method.
6 years ago
Christopher K. Hoadley
b237b8fe02
Problems with false positives on EyeEm/CreativeMarket/EVE Online. Add these sites to the tests to capture failure.
6 years ago
Yahya SayadArbabi
eec1779a3f
Merge pull request #143 from Czechball/master
...
Updated asciinema
6 years ago
Czechball
4e11364508
Updated asciinema
6 years ago
Yahya SayadArbabi
cd50d34e2e
Merge branch 'ptalmeida-master'
6 years ago
Yahya SayadArbabi
7a93f73b23
bump version
6 years ago
Yahya SayadArbabi
f641649be7
Sort "sites.md"
6 years ago
Pedro Almeida
1ed24f5993
correct code
6 years ago
ptalmeida
2ef168d924
Add website sorting code to site_list.py
...
Includes a fix in indentation
6 years ago
ptalmeida
92479c83e4
Sort websites alphabetically
6 years ago
Yahya SayadArbabi
adab51e580
Merge pull request #138 from sdushantha/master
...
centered the asciinema image
6 years ago
Yahya SayadArbabi
60f968d919
Merge pull request #137 from sdushantha/patch-1
...
replaced % with $ in README.md
6 years ago
Siddharth Dushantha
f1ac90b9ae
centered the asciinema image
6 years ago
Siddharth Dushantha
32920d7c23
replaced % with $
...
All of the other commands start with $, so it is better to be consistant.
6 years ago
Yahya SayadArbabi
a7fff6799d
Merge pull request #136 from sdushantha/master
...
added @sdushantha as the original creator
6 years ago
Siddharth Dushantha
9155d9d490
added @sdushantha as the original creator
6 years ago
Christopher K. Hoadley
a18065c1a7
Bump version. Update usage results in readme.
6 years ago
Christopher K. Hoadley
a538c07ab3
Merge branch 'pr/n133_cclauss'
6 years ago
Christopher Kent Hoadley
8dfe820067
Merge pull request #135 from TheYahya/hoadlck-response_url-site-fixes
...
Response URL Site Detection Strategy Overhaul
6 years ago
Christopher K. Hoadley
65b38592c4
Change "response_url" detection strategy completely.
...
Previously, there was a problem with sites that redirect an attempt to view a non-existing username to the main site. For example, if you try to go to https://devrant.com/users/dfoxxxxxxxxx (a user name that does not exist), then we get a redirect to the https://devrant.com/ root of the site. But, the "response_url" checking algorithm was only looking for the configured error URL being included in the response. So, these sites always indicated that the username was not found.
Update the "response_url" detection method so that the request does not allow redirects. If we get a 200 response of some type, then the username has been found. However, if we get something like a 302, then we know that the username was not found as we are being redirected.
This whole method seems fragile, but I did exhaustively test all of the supported sites, and they all work. So, this change is clearly an improvement.
6 years ago
Christopher K. Hoadley
bb66d6a992
Update Pinterest and WordPress user URLs to exactly match what the site ends up with. If the request does not have the trailing "/", then the site will forward us to that URL.
6 years ago
Christopher K. Hoadley
ae657460c8
Add coverage tests for all sites that use the response URL detection method. This test fails because Sherlock does not handle all of these sites properly.
6 years ago