901074ea4e
Function 'check_proxy', which checks anonimity of a signle proxy by anaylizing return headers received from a request using the proxy in question.
6 years ago
a63bdb3152
Created new file 'load_proxies.py' to store functions for reading proxies from files, and checking proxy anonimity. Created the function 'load_proxies_from_csv' which reads proxies from a .csv file to a list of named tuples.
6 years ago
263b8b3b90
Merge branch 'aditisrinivas97-master'
6 years ago
67108071e5
bump version
6 years ago
619d9ab6bc
Fix issue with site name and url
6 years ago
011df7af55
bump version
6 years ago
fd63e1093f
Merge branch 'avinashshenoy97/patch-1'
6 years ago
3db3f4558b
Parallelized updating alexa ranking
6 years ago
1442f333c2
Parallelised updating Alexa.com ranking of sites
...
Script now fetches Alexa ranks for sites concurrently on separate threads. Cuts down the time to sync ranks from approximately **5 minutes** to about **18 seconds**.
6 years ago
269df6d549
Merge pull request #151 from ptalmeida/master
...
Fix readme and instrallpackages.sh typo
6 years ago
8ee50e6717
Fix typo
...
necessery -> necessary
6 years ago
85d7be3e77
Actually bring README.md up to date
6 years ago
d6b7c0ac55
Merge branch 'ptalmeida-Add-sorgin-by-alexa-rank-functionality'
6 years ago
8b681158bc
small corrections to rank sort
6 years ago
78ade00dee
Update outdated REAME.md
6 years ago
5d972a3138
add --rank -r option to sherlock
6 years ago
55d43b0ee6
Update requirements.txt
6 years ago
db0cf7c289
Update requirements.txt
6 years ago
826af1ec19
remove unused import
6 years ago
2408bb520e
Merge branch 'UltraWelfare/optional_output'
6 years ago
0e6b8d0dca
Added optional parameters for outputting files and folders.
6 years ago
f511faab23
Added the ability to load external json files.
6 years ago
0b96141df0
Merge remote-tracking branch 'upstream/master'
6 years ago
9c45146da1
remove unused import
6 years ago
cc2b1cb27a
Improve terminal appearence for site_list.py
6 years ago
40fc51fc32
add rank paramether to site_list.py
...
--rank or -r to update all page ranks
6 years ago
ad4c321f3f
Correct print look
6 years ago
04ee711872
Merge remote-tracking branch 'upstream/master'
6 years ago
46705ad0a1
Add Alexa.com rank updating functionality to site_list.py
6 years ago
eae4da7294
Merge pull request #144 from TheYahya/hoadlck-fix-more-sites
...
Fix EyeEm/CreativeMarket/EVE Online False Positives
6 years ago
0709fd3947
Change EyeEm/CreativeMarket/EVE Online detection method to use the newly refurbished "response_url" detection method.
6 years ago
b237b8fe02
Problems with false positives on EyeEm/CreativeMarket/EVE Online. Add these sites to the tests to capture failure.
6 years ago
eec1779a3f
Merge pull request #143 from Czechball/master
...
Updated asciinema
6 years ago
4e11364508
Updated asciinema
6 years ago
cd50d34e2e
Merge branch 'ptalmeida-master'
6 years ago
7a93f73b23
bump version
6 years ago
f641649be7
Sort "sites.md"
6 years ago
1ed24f5993
correct code
6 years ago
2ef168d924
Add website sorting code to site_list.py
...
Includes a fix in indentation
6 years ago
92479c83e4
Sort websites alphabetically
6 years ago
adab51e580
Merge pull request #138 from sdushantha/master
...
centered the asciinema image
6 years ago
60f968d919
Merge pull request #137 from sdushantha/patch-1
...
replaced % with $ in README.md
6 years ago
f1ac90b9ae
centered the asciinema image
6 years ago
32920d7c23
replaced % with $
...
All of the other commands start with $, so it is better to be consistant.
6 years ago
a7fff6799d
Merge pull request #136 from sdushantha/master
...
added @sdushantha as the original creator
6 years ago
9155d9d490
added @sdushantha as the original creator
6 years ago
a18065c1a7
Bump version. Update usage results in readme.
6 years ago
a538c07ab3
Merge branch 'pr/n133_cclauss'
6 years ago
8dfe820067
Merge pull request #135 from TheYahya/hoadlck-response_url-site-fixes
...
Response URL Site Detection Strategy Overhaul
6 years ago
65b38592c4
Change "response_url" detection strategy completely.
...
Previously, there was a problem with sites that redirect an attempt to view a non-existing username to the main site. For example, if you try to go to https://devrant.com/users/dfoxxxxxxxxx (a user name that does not exist), then we get a redirect to the https://devrant.com/ root of the site. But, the "response_url" checking algorithm was only looking for the configured error URL being included in the response. So, these sites always indicated that the username was not found.
Update the "response_url" detection method so that the request does not allow redirects. If we get a 200 response of some type, then the username has been found. However, if we get something like a 302, then we know that the username was not found as we are being redirected.
This whole method seems fragile, but I did exhaustively test all of the supported sites, and they all work. So, this change is clearly an improvement.
6 years ago
BlucyBlue
Yahya SayadArbabi
aditisrinivas97
Avinash Shenoy
ptalmeida
George Tsomlektsis
Christopher Kent Hoadley
Czechball
Siddharth Dushantha