Siddharth Reddy
57e75d2e1d
Update data.json
4 years ago
Arnav Mehta
738816becf
Add support for Vero
4 years ago
Roopesh V S
f0418e6f3b
CashMe Fix
4 years ago
Siddharth Dushantha
e919df752c
Merge pull request #769 from deceitfulvision/master
...
Add support for TikTok
4 years ago
Siddharth Dushantha
17757378dd
updated site list
4 years ago
Siddharth Dushantha
cc09fd843b
removed Taringa
4 years ago
Siddharth Dushantha
2dfa049416
removed tracr.co
4 years ago
Siddharth Dushantha
44469e62aa
removed Sherlock
4 years ago
Kilian
f0e572d12d
added newline at end of file
4 years ago
Kilian
2f25ece271
Added TikTok
4 years ago
Kilian
f5fdc1caae
Added TikTok
4 years ago
mehtaarn000
df77122569
Add support for PyPi
4 years ago
Christopher K. Hoadley
bf2daa39ea
Update version.
4 years ago
Christopher K. Hoadley
36793af769
Update documentation on timeout command line option.
4 years ago
Christopher K. Hoadley
c2b07549d4
Restore --print-found option.
...
Now --print-all and --print-found complement each other. The default remains that only the found are reported.
4 years ago
Siddharth Dushantha
dee6b9b24d
fixed ProductHunt false positive by changing error message
4 years ago
Siddharth Dushantha
7e66e65c6b
added regexCheck for RubyGems
4 years ago
Siddharth Dushantha
edb20d6620
updated site list
4 years ago
Siddharth Dushantha
6203e49c26
Moved pr0gramm's "url" to "urlProbe" and added a the correct "url"
4 years ago
Siddharth Dushantha
8f4dbef600
Moved Kik's "url" to "urlProbe" and added a the correct "url"
4 years ago
Siddharth Dushantha
55abaf3a73
added a --print-all flag
...
This flag will output all the sites regardless the QueryStatus.
As mentioned by @hoadlck, this flag is more appropriate than using
--verbose, which is the flag I set to serve the same purpose as
--print-all in the previous commit. More of the discussion about this
flag can been viewed in #747
4 years ago
Siddharth Dushantha
8333aa2370
updated site list
4 years ago
Siddharth Dushantha
6bc8c38635
Print found only by default
...
As mentioned in #718 , it would be more useful for the user of Sherlock
to only get the results of the sites that return a positive result. With
these new changes, if you want to all results to be printed out, then
you can do that by using the --verbose flag.
4 years ago
Siddharth Dushantha
a74938343e
Merge branch 'master' into add-linkedin-search
4 years ago
Siddharth Dushantha
a61850843f
changed error message for linkedin
4 years ago
Siddharth Dushantha
75c51f545b
fixes #371
4 years ago
Siddharth Dushantha
2eb28d629d
updated sites list
4 years ago
Siddharth Dushantha
087de2e990
removed MeetMe
4 years ago
Siddharth Dushantha
0ff88c5814
fixed opennet false positves on usernames with underscores
4 years ago
Siddharth Dushantha
f621ced91c
fixed Taringa false positive with usernames with periods
4 years ago
repl.it user
ddecc14732
added 4pda back
...
credit for this fix goes to @enodr who found the API enpoint which is
currently being used to check for the usernames
4 years ago
Markus Rothlübbers
bf4a495d4e
Update data.json
...
Added new profile page for geocaching
4 years ago
Siddharth Dushantha
9e47603705
removed 4pda due to false positives
4 years ago
Siddharth Dushantha
82e583f5d4
version bump 0.12.6 --> 0.12.7
4 years ago
Siddharth Dushantha
8d50f2bca3
Merge branch 'master' into patch-1
4 years ago
Siddharth Dushantha
0a78232bb0
version bump 0.12.6 --> 0.12.7
4 years ago
Siddharth Dushantha
87483b5ca6
Fixed Clozemaster false positve
4 years ago
Roopesh V S
f6a05e3086
Change Facebook to Pinterest in tests/all.py
4 years ago
Roopesh V S
3116e85b61
Facebook Change Error Type to Status Code
4 years ago
Siddharth Dushantha
bf2d72912f
Merge branch 'master' of https://github.com/sherlock-project/sherlock into master
4 years ago
Siddharth Dushantha
520c0f6461
removed 10 sites due to false positives
...
I found 10 sites that were returning false positives during the tests.
They have been removed for now and will of course be added back
ones fix for them has been found.
From now on, I plan to just remove sites which return false
positves. I can later on find some time to fix those false
positives or accept somone's fix.
4 years ago
Siddharth Dushantha
ce9a5c89fe
changed unclaimed username for BinarySearch to hihowareyou101
...
The previous unclaimed username did not match the username regex
4 years ago
Siddharth Dushantha
dcfa4c758b
changed facebook claimed username to hackerman
4 years ago
Siddharth Dushantha
bedec6b9b7
Merge pull request #737 from roopeshvs/Work-Before-Merge
...
Facebook False Positive Fix
4 years ago
Siddharth Dushantha
c32511eba5
version bump 0.12.5 --> 0.12.6
4 years ago
Siddharth Dushantha
7e3528cd8d
Merge pull request #723 from Moras-del/bugfix
...
fixed missing_sites
4 years ago
Roopesh V S
7f718748dc
Facebook Hacky Fix
4 years ago
Roopesh V S
8649a59188
Added UrlProbe
4 years ago
Roopesh V S
7822fef926
Added Site - Binary Search
4 years ago
pyghost
8e95934079
Update sherlock.py
4 years ago
pyghost
96260176bb
Fixed inconsistent quotes
4 years ago
pyghost
6a723233a7
Added --local argument for local data.json use
4 years ago
Siddharth Dushantha
57df1d904b
Merge pull request #732 from rykkard/site-tryhackme
...
Add TryHackMe
4 years ago
rykkard
04be516432
Add TryHackMe
4 years ago
slickagell
87d6bbf4e8
remove russia in www.chess.com
...
make it to english instance of russia
4 years ago
Siddharth Dushantha
ef8871a993
fixed PayPal false positive, fixes #730
4 years ago
theapocalipse
3b8628a77b
Adding line break at the end of the generated file
4 years ago
Jun
80e58f45cd
Added new site Naver
4 years ago
Siddharth Dushantha
225508f660
added regex checking to BitBucket
...
the regex was made using the username criterias from their sign up page: https://imgur.com/a/BwNooVy
4 years ago
Siddharth Dushantha
66db55d64e
added regex checking for blip.fm
4 years ago
Siddharth Dushantha
9a85f334a9
added regex checking for Audiojungle
...
The regex was created using the username criteria from their webpage: https://imgur.com/a/QJU3ypn
4 years ago
Moras-del
7bcc1db030
fixed missing_sites
4 years ago
Silas Parker
47d6f23930
Add Slashdot
4 years ago
Silas Parker
f05b76fe68
Add MyMiniFactory
4 years ago
Silas Parker
c0fe16275b
Add Munzee
4 years ago
Silas Parker
682d71846f
Add Hackaday
4 years ago
Siddharth Dushantha
b0473eb7e0
changed error checking method for Pling to errorMsg
4 years ago
Siddharth Dushantha
7b9d6d109b
changed pastebin error checking method to errorMsg
4 years ago
Siddharth Dushantha
8a7808e851
fixed false positive for EyeEm and Gravatar
4 years ago
Siddharth Dushantha
e30140c3b2
fixed paypal false positve
4 years ago
Siddharth Dushantha
d32794ff68
removed YandexCollection, fixes #714
4 years ago
Roopesh V S
17c05ab76c
Fixed eBay False Positive on Other Languages
4 years ago
Siddharth Dushantha
8fd7518f7d
version bump 0.12.4 --> 0.12.5
4 years ago
Siddharth Dushantha
070b2363b0
Merge pull request #711 from sherlock-project/add-error-checking-for-version-checking
...
added error checking while checking for updates
4 years ago
Siddharth Dushantha
8d7e72d934
Merge pull request #712 from roopeshvs/master
...
Added Support for Strava
4 years ago
Roopesh V S
827cacc236
Support for Strava
4 years ago
Siddharth Dushantha
15012f0e91
added error checking while checking for updates
4 years ago
Siddharth Dushantha
356ba76fd2
Merge pull request #708 from roopeshvs/master
...
MetaCritic Regex & False Positive Fix
4 years ago
Siddharth Dushantha
f564cc174d
removed F6S due to Google reChaptcha
4 years ago
Roopesh V S
98c030fe1b
MetaCritic Regex Fix
4 years ago
Siddharth Dushantha
60cc6434d9
added version checking
...
If the there is a newer version available on GitHub then the user will
be told. This to encourage users to have the up to date version of
Sherlock which has the newest features.
4 years ago
Siddharth Dushantha
1fcae33003
version bump 0.12.3 --> 0.12.4
4 years ago
Siddharth Dushantha
9684314d70
added uppercase letter to site names that have uppercase
...
For some reason, when adding sites, people were using all lowrcase.
It is more correct to have the correct spelling and case on the site
names.
4 years ago
Siddharth Dushantha
f9774343a7
changed claimed username for GetMyUni from vidheeshnacode to Upneet.Grover17
...
the previous username does not exist anymore
4 years ago
Siddharth Dushantha
171988c001
fixed Memrise false positive
4 years ago
Siddharth Dushantha
75bccae27e
changed claimed username for HackerOne from "blue" to "stok"
...
the user "blue" does not exist
4 years ago
Siddharth Dushantha
ccf2c15a80
fixed 500px false illegal username
4 years ago
Siddharth Dushantha
490a26248a
removed ranking from site_list.py and organized data.json by alphabetic
...
order
4 years ago
Siddharth Dushantha
e27cd6289e
removed rank field from data.json
4 years ago
Siddharth Dushantha
cc8192f45c
removed option to present websites ordered by their Alexa.com global rank in popularity
...
refer to #610 for reason of removal
4 years ago
Siddharth Dushantha
73989aaf5f
Sherlock will from now on not use the local data.json
...
It will now use the data that is in the GitHub repo instead. The reason why we are using
this instead of the local one is so that the user has the most up to date data. This prevents
users from creating issue about false positives which has already been fixed or having outdated data
4 years ago
Siddharth Dushantha
0f51e01686
fixed babyblogRU false positive
...
fix this by using an error message instead of checking the status code
4 years ago
Roopesh V S
8d9ccb200c
Fixed False Positives on Polarsteps
4 years ago
Siddharth Dushantha
d0910478e9
Merge pull request #698 from roopeshvs/master
...
No more False Positives on Wikipedia
4 years ago
Roopesh V S
06166b2add
No more False Positives on Wikipedia
4 years ago
Siddharth Dushantha
10535587f1
Merge pull request #697 from roopeshvs/master
...
No more False Positive on Tinder
4 years ago
Roopesh V S
4d7ed9d608
No more False Positive on Tinder
4 years ago
Siddharth Dushantha
6adfbd046b
Merge pull request #696 from roopeshvs/master
...
PayPal works now
4 years ago
Roopesh V S
7cc341d29e
Added User-Agent
4 years ago
Roopesh V S
f2c8afaa85
PayPal Works now.
4 years ago
Siddharth Dushantha
39279710ce
Merge pull request #695 from roopeshvs/master
...
9Gag Works! Weird.
4 years ago
Roopesh V S
60d7d9565a
www to url oops
4 years ago
Roopesh V S
aff196abec
Added www to urlMain
4 years ago
Siddharth Dushantha
fb572d927c
added regex checking for 500px
...
The criteria for the the 500px usernames was found my looking at the packages when signing up. If it was an invalid username, the request return this error: https://i.imgur.com/JS5PVMz.png
4 years ago
Roopesh V S
23b0122755
9Gag Works! Weird.
4 years ago
Siddharth Dushantha
aa46b17cae
added regex checking for Capfriendly
...
The regex was made using the given information from their "Change Username" page: https://i.imgur.com/TrrOWl5.png
4 years ago
Roopesh V S
a5b70d576b
Fixed CapFriendly Check
4 years ago
Siddharth Dushantha
a5d8394307
added regex checking for Telegram
...
Source: https://core.telegram.org/method/account.checkUsername#parameters
4 years ago
Roopesh V S
b7b17c28ae
Telegram Works Now!
4 years ago
Siddharth Dushantha
269d67f56e
Merge branch 'master' into master
4 years ago
Siddharth Dushantha
a6c4e88818
Merge branch 'master' into add-xboxgamertag-com
4 years ago
William Batista
81cef8cffe
Fixed data.json ranks
...
Just reset ranks back to original
5 years ago
William Batista
bd3de54cae
Fixed Twitter false positive error
...
Simply changed the url from twitter.com to mobile.twitter.com, as the desktop site will return a 200 error regardless of whether the user exists or not
5 years ago
Siddharth Dushantha
ab76bf100e
removed KanoWorld
...
The enpoint that was used to check for usernames no longer exists
5 years ago
Siddharth Dushantha
441e4670a8
Merge pull request #637 from vidheeshnacode/master
...
Updated data.json
5 years ago
Siddharth Dushantha
e3eba76b06
removed unneseary https
5 years ago
Siddharth Dushantha
12db6b2f16
Merge pull request #628 from shelklas/countable
...
Add countable.us
5 years ago
Siddharth Dushantha
6c8538fc72
Merge pull request #625 from VioletFlare/master
...
add nairaland.com
5 years ago
Siddharth Dushantha
2f52bc3fbb
removed Mixer, fixes #680
...
because it has shut down
5 years ago
Siddharth Dushantha
38c987e4ea
version bump 0.12.2 --> 0.12.3
5 years ago
Siddharth Dushantha
3feb9de9b6
Check Python version before executing the main function of Sherlock
...
This will hopefully prevent us from people opening issues where the problem is that the user
is using a version of Python which is lower than 3.6. Sherlock only supports 3.6+
This hack was taken from h8mail created by @khast3x
Source: https://github.com/khast3x/h8mail/blob/master/h8mail/__main__.py
5 years ago
Siddharth Dushantha
db878ab5f9
removed Zomato
5 years ago
Siddharth Dushantha
f3180b73a0
fixed typo bowser --> browser
5 years ago
Siddharth Dushantha
4b60fca69b
removed TamTam
...
Because it return false positives when a username contains a period
5 years ago
Siddharth Dushantha
0c9287eec7
fixed false positive for chatujme.cz by adding regex checking
5 years ago
Siddharth Dushantha
de9cf9f149
removed Coderwall
...
Coderwall was removed because it returns false positives when a username
contains a period
5 years ago
Siddharth Dushantha
6a8118c947
fixed false positive for Ko-fi
5 years ago
Soxoj
6d652bdbca
Remove again sites removed earlier
5 years ago
Diego
29e0941931
quickfix
5 years ago
Diego
ddac47e702
quickfix
5 years ago
Diego Pisani
db542d1dfa
Merge branch 'master' into master
5 years ago
Diego
8506cc699c
remove NSFW content
5 years ago
Siddharth Dushantha
cc2280c795
removed easyen, pedsovet, and radioskot
...
These sites return false positives when using a username which contains
a period. Since we could not find the criteria for the usernames for this site, it will be removed
because of this
5 years ago
Siddharth Dushantha
4f11a3062a
Merge pull request #640 from GandelXIV/MyBranch
...
add TikTok
5 years ago
GandelXIV
870ee33a6d
Changed name "tik tok" to "TikTok Online Viewer"
5 years ago
Siddharth Dushantha
2e9ece3233
made the outputted urls uncolored
...
After the restructring, the outputted urls became green by accident.
This commit makes them "normal" again
5 years ago
Siddharth Dushantha
b0afed1f43
removed pvpru
...
removed pvpru because we are now getting an access denied error
5 years ago
Siddharth Dushantha
89a95037b4
removed Creative Market
...
Creative Market was removed because it now has a captcha
5 years ago
Siddharth Dushantha
88e3f67d68
removed forum.redsun.tf
5 years ago
Diego
1c1ed74e61
add some adult content
5 years ago
Diego
5a2db3a8a6
add aminoapp
5 years ago
Diego
2d2ea6e5b7
add ko-fi
5 years ago
Diego
affd433dd5
Add onlyfans
5 years ago
Diego
c92adbc40f
added mercadolivre
5 years ago
GandelXIV
e468c60bd5
removed newline
5 years ago
GandelXIV
905aa3d8c1
Revert "implemeted freehostin endora, still not working"
...
This reverts commit 7611d819f8
.
5 years ago
GandelXIV
7611d819f8
implemeted freehostin endora, still not working
5 years ago
GandelXIV
8bf31cc864
Update data.json
5 years ago
GandelXIV
252e5f2432
Finnaly working
5 years ago
GandelXIV
f0f91e9227
Update data.json
5 years ago
GandelXIV
20a6a42e53
add tiktok
5 years ago
Vidheesh Nacode
87c50bb50f
Update data.json
...
Added F6S, getmyuni and polarsteps websites as resourses.
5 years ago
Zoldszemesostoros
52a600535b
Add prog.hu, a hungarian programmer forum
5 years ago
shelklas
9eae118aea
Add countable to data.json resource
5 years ago
realprogrammer5000
be6bb0953b
Remove ColourLovers
5 years ago
realprogrammer5000
4174b8bd39
Merge sherlock
5 years ago
realprogrammer5000
02b93c2d85
Fix colorlovers
5 years ago
Me
af127341d6
add nairaland.com
5 years ago
Niboucha Redouane
8cc376a798
Add Freelancer.com
5 years ago
Christopher K. Hoadley
29eb2ddf2d
Update site list and version.
5 years ago
Christopher K. Hoadley
d40f88e3f6
Remove gpodder.net as all usernames are reported as available.
...
The server is returning a HTTP Status 500 (Internal server error) for all queries.
5 years ago
Christopher K. Hoadley
003b6b22bf
Remove Raidforums as all usernames are reported as claimed.
...
The site will not let the query proceed unless Javascript is turned on.
5 years ago
Christopher K. Hoadley
dec49cda87
Remove 9GAG as all usernames are reported as available.
5 years ago
Christopher K. Hoadley
c1a05c314f
Remove Investing.com as all usernames are reported as claimed.
5 years ago
Christopher K. Hoadley
7f298e41e6
Use HTTP Status detection for OpenCollective. The site does give a clean 404 code.
5 years ago
Christopher K. Hoadley
87bffea0e0
Remove TikTok as all usernames are reported as claimed.
5 years ago
Christopher K. Hoadley
7505467020
Update site list and version.
5 years ago
Christopher K. Hoadley
76193fd0b8
Remove ColourLovers as all usernames show as claimed.
...
There is an API available (https://www.colourlovers.com/api/ ), but when there is no match it returns an empty file. So, changes would have to happen before the lack of a response could be used to detect.
5 years ago
Christopher K. Hoadley
c8fdc3e923
Fix tests for VK. Someone claimed the test's unclaimed username.
5 years ago
탁동혁
cdfb97f6e6
Use `is` operator when comparing singletons.
5 years ago
Danny Sepler
3fa85c1576
Clean out unused imports
5 years ago
realprogrammer5000
84ec267bd8
Add Xbox Gamertag
5 years ago
Lucas Hiago
459b248ebc
add linkedin website in search
5 years ago
Christopher K. Hoadley
8619a353e4
Add override to HTTP Status Detection so HEAD request is not used. Configure Instagram to use this option.
...
In most cases when we are detecting by status code, it is not necessary to get the entire body: we can detect fine with just the HEAD response. However, Richard Getz discovered that some sites (e.g. Instagram) will not respond properly if Sherlock only requests the HEAD.
Add a "request_head_only" attribute to the data.json so HTTP Status Detection can be configured either way. It is simpler to support this change in this fashion, as it does not require changes to the tests.
With Richard Getz <richardgetziii@gmail.com>
5 years ago
Christopher K. Hoadley
0ba4980887
Update site list. Update version.
5 years ago
Richard Getz
f2179ca7c9
Updated TikTok to status_code errorType. This fixes the issue of TikTok loading blank profiles.
5 years ago
Christopher K. Hoadley
faac3ff0f3
Get rid of function that formats time.
5 years ago
Christopher K. Hoadley
f26ea67e83
Move loose print functions into QueryNotifyPrint() class.
5 years ago
Christopher K. Hoadley
1d251085b7
Remove verbose option from tests. It is not used anymore.
5 years ago
Christopher K. Hoadley
6caa5a4e35
Restructure all print output to use QueryNotifyPrint() object.
...
Added start and finish methods to base QueryNotify() object in order to get the same type of output.
The only thing not supported in this refactor is the exception text for an error status when we are in verbose mode. This is an area of future work: I think exception information like this would more properly be handled by the logging module.
5 years ago
Christopher K. Hoadley
ae2fd7a729
Add username and site information to Query Result object. This will allow whoever defines a Query Notify object to have all of the context required to do their notifications.
5 years ago
Christopher K. Hoadley
c07d3967aa
Create QueryNotify() base class for notifying the caller about the results.
5 years ago
Christopher K. Hoadley
c054712920
Move response time for query into QueryResult() object.
5 years ago
Christopher K. Hoadley
2a8f97b609
Fix tests for metacritic. Unclaimed username was illegal.
5 years ago
Christopher K. Hoadley
6f3fc3d548
Remove AdobeForums. All usernames are reported available.
5 years ago
Christopher K. Hoadley
5edc3c0a0b
Fix tests. Instagram no longer uses the message detection.
5 years ago
Christopher K. Hoadley
529b37bc60
Change tests so that expected state is first and actual state follows (previous order was confusing). Also use "claimed" and "available" terms when reporting test results.
5 years ago
Christopher K. Hoadley
92879af8eb
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# README.md
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
32385a1d8d
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
e41b485771
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
de0ccfebb7
Add option to skip test if site returns error status (e.g. timeout connecting with site). This makes it easier to interpret the test results.
5 years ago
Christopher K. Hoadley
2c9fb4f295
Change SitesInformation() to use a generator when iterating thru the sites. This avoids the problem of the state (i.e. self.__iteration_index) getting corrupted if any of the methods of a given object needed to iterate for their own purposes while a caller was already iterating thru the same object. The code is also much simpler to follow.
5 years ago
Christopher K. Hoadley
1101af8132
Add @sdushantha suggestion in creating directory.
5 years ago
Christopher K. Hoadley
f48a2980f5
Use SitesInformation() object in tests. For now, use the new SitesInformation() object to calculate the original JSON dictionary: the rest of the code will be updated in the future.
5 years ago
Christopher K. Hoadley
8f6938ecb1
Add option to *not* print out results. Configure tests to there is no print output. This simplifies looking at the error output when the tests fail.
5 years ago
Christopher K. Hoadley
f29cab49e4
Add popularity rank to Site Information object. Add method to retrieve list of names of the sites (sorted by alphabetical or popularity rank).
5 years ago
Christopher K. Hoadley
2e195d4439
Move all writing of output files to occur after query takes place. Use with statement for results file, as that is more graceful on errors. Use try block for result directory creation: this has a smaller window for a race condition.
5 years ago
Christopher K. Hoadley
123e4d47e0
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
ba0a44e0ae
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/resources/data.json
5 years ago
Christopher K. Hoadley
7f87f5fcc4
Add module to store information about the sites. This handles getting the information loaded from the JSON file. For now, use the new SitesInformation() object to calculate the original JSON dictionary: the rest of the code will be updated in the future.
5 years ago
Christopher K. Hoadley
647aea577c
Factor out all print statements from portion of code that determines the query results.
5 years ago
Christopher K. Hoadley
bbb44d7ef9
Add defensive check for unknown Error Type. If it does happen, an exception will be thrown, instead of using the previous site's results.
5 years ago
Christopher K. Hoadley
2a8f83924d
Remove some unneeded imports. Add minor comment.
5 years ago
Christopher K. Hoadley
2a1ab1c281
Add result module to hold results of site queries. The QueryResult() object contains an enumeration for the possible status about a given username on a site, and additional error information that might be handy. Rework all code to use this object instead of the "exists" key in the result dictionary that was used previously.
5 years ago
Christopher K. Hoadley
519ac34346
Extract all print statements from function that gets the response. Also, print out social network for error messages.
5 years ago
Christopher K. Hoadley
6114ca263d
Remove Proxy List Support
...
While doing the restructuring, I am testing in more depth as I change the code. And, I am trying to grok how the proxy options work. Specifically, how the proxy list works. Or, does not work.
There is code in the main function that randomly selects proxies from a list, but it does not actually use the result. This was noticed in #292 . It looks like the only place where the proxy list is used is when there is a proxy error during get_response()...in that case a new random proxy is chosen. But, there is no care taken to ensure that we do not get the same proxy that just errored out. It seems like problematic proxies should be blacklisted if there is that type of failure.
Moreover, there is a check earlier in the code that does not allow the proxy list and proxy command line option to be used simultaneously. So, I can see no way that the proxy list has any functionality: if you do define the proxy list, then there is no way to kick off the general request with a proxy.
I also noticed that the recursive get_response() call does not pass its return tuples back up the call chain. The existing code would never get any good from the switchover to an alternate proxy (even if the other problems mentioned above were resolved).
For now, I am removing the support. This feature may be looked at after the restructuring is done.
5 years ago
Christopher K. Hoadley
9e8e1a5aa4
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
0a455339c2
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
b92b931504
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
b0b7608549
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
f89fe03b34
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
a900d0f674
Merge remote-tracking branch 'origin/master' into restructure_take1
...
# Conflicts:
# sherlock/sherlock.py
5 years ago
Christopher K. Hoadley
571f27f9a5
Clean up code that only reads the headers if we are doing HTTP Status detection. Remove special check for GitHub: everything works fine without it.
5 years ago
Christopher K. Hoadley
2268f8186c
Remove unneeded assignment of results before main Sherlock call.
5 years ago
Christopher K. Hoadley
232a5f7d07
Clarify meaning of "Total Websites" count. It is really "Total Websites Username Detected On".
5 years ago
Christopher K. Hoadley
ecf097e00d
Get rid of global variable amount. This is no longer used.
5 years ago
Christopher K. Hoadley
96ac2f15fd
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
d8c8cd8e7e
Leave the elapsed time for the request in seconds. Move format of time into ms to the presentation layer.
5 years ago
Christopher K. Hoadley
b02ef5e6e2
Use monotonic() time function. This method is guaranteed to not do flaky things during leap seconds or daylight savings times jumps.
5 years ago
Christopher K. Hoadley
d6d6b83b06
Add documentation to extension to FuturesSession() which we use to get timing information. Fix problem where timing hook would not be installed properly if the hooks for the request was already filled out with a tuple. I am not sure if that is even possible, but if it does happen, then I just convert the tuple to a list and go on from there.
5 years ago
Christopher K. Hoadley
578248bf8e
Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time.
5 years ago
Christopher K. Hoadley
8ef999fffd
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
1587df0860
Merge remote-tracking branch 'origin/master' into restructure_take1
5 years ago
Christopher K. Hoadley
d17268e737
Move content into sherlock sub-directory inside of repo. This directory will look very much like what the packaged version of Sherlock will look like when it is installed in the site-packages area.
...
No real restructuring of the code has happened. This just gives a view of the directory structure.
5 years ago