open-source-mirrors
/
sherlock
mirror of https://github.com/sherlock-project/sherlock
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1105 from sherlock-project/cleanup

Browse Source 
Cleaned up the evident false positives
pull/1106/head
Siddharth Dushantha 4 years ago committed by GitHub
parent 829cac07c8 8f8fff9fab
commit 38973bc2b4
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 262 additions and 100 deletions
Show Stats Download Patch File Download Diff File

86
removed_sites.json
Unescape View File

@ -543,5 +543,91 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"GDProfiles": {
"errorType": "status_code",
"url": "https://gdprofiles.com/{}",
"urlMain": "https://gdprofiles.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
},
"AllTrails": {
"errorMsg": "class=\"home index\"",
"errorType": "message",
"url": "https://www.alltrails.com/members/{}",
"urlMain": "https://www.alltrails.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
},
"Cent": {
"errorMsg": "<title>Cent</title>",
"errorType": "message",
"url": "https://beta.cent.co/@{}",
"urlMain": "https://cent.co/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Anobii": {
"errorType": "response_url",
"url": "https://www.anobii.com/{}/profile",
"urlMain": "https://www.anobii.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Kali community": {
"errorMsg": "This user has not registered and therefore does not have a profile to view.",
"errorType": "message",
"url": "https://forums.kali.org/member.php?username={}",
"urlMain": "https://forums.kali.org/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"NameMC (Minecraft.net skins)": {
"errorMsg": "Profiles: 0 results",
"errorType": "message",
"url": "https://namemc.com/profile/{}",
"urlMain": "https://namemc.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Steamid": {
"errorMsg": "<link rel=\"canonical\" href=\"https://steamid.uk\" />",
"errorType": "message",
"url": "https://steamid.uk/profile/{}",
"urlMain": "https://steamid.uk/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"TripAdvisor": {
"errorMsg": "This page is on vacation\u2026",
"errorType": "message",
"url": "https://tripadvisor.com/members/{}",
"urlMain": "https://tripadvisor.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"YouTube": {
"errorMsg": "This page isn't available",
"errorType": "message",
"url": "https://www.youtube.com/{}",
"urlMain": "https://www.youtube.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Twitter": {
"errorMsg": "This account doesn’t exist",
"errorType": "message",
"url": "https://twitter.com/{}",
"urlMain": "https://twitter.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"allmylinks": {
"errorMsg": "Page not found",
"errorType": "message",
"url": "https://allmylinks.com/{}",
"urlMain": "https://allmylinks.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
} }

163
removed_sites.md
Unescape View File

@ -1068,4 +1068,165 @@ As of 2021-01-15, Ebay seems to be very laggy and take too long to return a resp
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
``` ```
## GDProfiles
As of 2021-06-27, GDProfiles takes way too long to respond. Must be an issue on their side.
```
"GDProfiles": {
"errorType": "status_code",
"url": "https://gdprofiles.com/{}",
"urlMain": "https://gdprofiles.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
},
```
## AllTrails
As of 2021-06-27, AllTrails has a chapta which prevents us from checking for usernames on the site.
```
"AllTrails": {
"errorMsg": "class=\"home index\"",
"errorType": "message",
"url": "https://www.alltrails.com/members/{}",
"urlMain": "https://www.alltrails.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
}
```
## Cent
As of 2021-06-27, there is not way of checking if a username exists on Cent
```
"Cent": {
"errorMsg": "<title>Cent</title>",
"errorType": "message",
"url": "https://beta.cent.co/@{}",
"urlMain": "https://cent.co/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
```
## Anobii
As of 2021-06-27, Anobii returns false positives and there is no stable way of checking usernames.
```
"Anobii": {
"errorType": "response_url",
"url": "https://www.anobii.com/{}/profile",
"urlMain": "https://www.anobii.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```
## Kali Community
As of 2021-06-27, Kali Community requires us to be logged in order to check if a user exists on their forum.
```
"Kali community": {
"errorMsg": "This user has not registered and therefore does not have a profile to view.",
"errorType": "message",
"url": "https://forums.kali.org/member.php?username={}",
"urlMain": "https://forums.kali.org/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```
## NameMC
As of 2021-06-27, NameMC uses chapta through CloudFlare which prevents us from checking if usernames exists on the site.
```
"NameMC (Minecraft.net skins)": {
"errorMsg": "Profiles: 0 results",
"errorType": "message",
"url": "https://namemc.com/profile/{}",
"urlMain": "https://namemc.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
```
## SteamID
As of 2021-06-27, Steam uses chapta through CloudFlare which prevents us from checking if usernames exists on the site.
```
"Steamid": {
"errorMsg": "<link rel=\"canonical\" href=\"https://steamid.uk\" />",
"errorType": "message",
"url": "https://steamid.uk/profile/{}",
"urlMain": "https://steamid.uk/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```
## TripAdvisor
As of 2021-06-27, Trip takes too long to return a response. As of now, the reason is not known.
```
"TripAdvisor": {
"errorMsg": "This page is on vacation\u2026",
"errorType": "message",
"url": "https://tripadvisor.com/members/{}",
"urlMain": "https://tripadvisor.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
```
## YouTube
As of 2021-06-27, there is no way of checking if a username exists on YouTube. We'll have to take a deeper look
into this as YouTube is must have site in Sherlock.
```
"YouTube": {
"errorMsg": "This page isn't available",
"errorType": "message",
"url": "https://www.youtube.com/{}",
"urlMain": "https://www.youtube.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```
## Twitter
As of 2021-06-27, Twitter returns false positives. A solid solution has not been found yet but Twitter is temporarly removed. We will find a solution ASAP.
```
"Twitter": {
"errorMsg": "This account doesn’t exist",
"errorType": "message",
"url": "https://twitter.com/{}",
"urlMain": "https://twitter.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```
## AllMyLinks
As of 2021-06-27, AllMyLinks has added a chapta using Cloudflare and this prevents us from checking for usernames.
```
"allmylinks": {
"errorMsg": "Page not found",
"errorType": "message",
"url": "https://allmylinks.com/{}",
"urlMain": "https://allmylinks.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
}
```

113
sherlock/resources/data.json
Unescape View File

@ -50,21 +50,6 @@
"username_claimed": "julian", "username_claimed": "julian",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"AllTrails": {
"errorMsg": "User could not be found.",
"errorType": "message",
"url": "https://www.alltrails.com/members/{}",
"urlMain": "https://www.alltrails.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
},
"Anobii": {
"errorType": "response_url",
"url": "https://www.anobii.com/{}/profile",
"urlMain": "https://www.anobii.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Apple Discussions": { "Apple Discussions": {
"errorMsg": "The page you tried was not found. You may have used an outdated link or may have typed the address (URL) incorrectly.", "errorMsg": "The page you tried was not found. You may have used an outdated link or may have typed the address (URL) incorrectly.",
"errorType": "message", "errorType": "message",
@ -262,14 +247,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"Cent": {
"errorMsg": "<title>Cent</title>",
"errorType": "message",
"url": "https://beta.cent.co/@{}",
"urlMain": "https://cent.co/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Championat": { "Championat": {
"errorType": "status_code", "errorType": "status_code",
"url": "https://www.championat.com/user/{}", "url": "https://www.championat.com/user/{}",
@ -287,10 +264,12 @@
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"Chess": { "Chess": {
"errorMsg": "Missing page... somebody made a wrong move.", "errorMsg": "usernameSuggestions",
"errorType": "message", "errorType": "message",
"regexCheck": "^[a-z1-9]{3,25}$",
"url": "https://www.chess.com/member/{}", "url": "https://www.chess.com/member/{}",
"urlMain": "https://www.chess.com/", "urlMain": "https://www.chess.com/",
"urlProbe": "https://www.chess.com/callback/user/valid?username={}",
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
@ -576,11 +555,12 @@
"username_claimed": "adam", "username_claimed": "adam",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"Freelancer.com": { "Freelancer": {
"errorMsg": "\"users\":{}", "errorMsg": "\"users\":{}",
"errorType": "message", "errorType": "message",
"url": "https://www.freelancer.com/api/users/0.1/users?usernames%5B%5D={}&compact=true", "urlProbe": "https://www.freelancer.com/api/users/0.1/users?usernames%5B%5D={}&compact=true",
"urlMain": "https://www.freelancer.com/", "urlMain": "https://www.freelancer.com/",
"url": "https://www.freelancer.com/u/{}",
"username_claimed": "red0xff", "username_claimed": "red0xff",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
@ -591,13 +571,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"GDProfiles": {
"errorType": "status_code",
"url": "https://gdprofiles.com/{}",
"urlMain": "https://gdprofiles.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis"
},
"Gamespot": { "Gamespot": {
"errorType": "status_code", "errorType": "status_code",
"url": "https://www.gamespot.com/profile/{}/", "url": "https://www.gamespot.com/profile/{}/",
@ -827,14 +800,6 @@
"username_claimed": "dansbecker", "username_claimed": "dansbecker",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"Kali community": {
"errorMsg": "This user has not registered and therefore does not have a profile to view.",
"errorType": "message",
"url": "https://forums.kali.org/member.php?username={}",
"urlMain": "https://forums.kali.org/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Keybase": { "Keybase": {
"errorType": "status_code", "errorType": "status_code",
"url": "https://keybase.io/{}", "url": "https://keybase.io/{}",
@ -905,11 +870,11 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"LiveLeak": { "Itemfix": {
"errorMsg": "channel not found", "errorMsg": "<title>ItemFix - Channel: </title>",
"errorType": "message", "errorType": "message",
"url": "https://www.liveleak.com/c/{}", "url": "https://www.itemfix.com/c/{}",
"urlMain": "https://www.liveleak.com/", "urlMain": "https://www.itemfix.com/",
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
@ -989,14 +954,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"NameMC (Minecraft.net skins)": {
"errorMsg": "Profiles: 0 results",
"errorType": "message",
"url": "https://namemc.com/profile/{}",
"urlMain": "https://namemc.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"NationStates Nation": { "NationStates Nation": {
"errorMsg": "Was this your nation? It may have ceased to exist due to inactivity, but can rise again!", "errorMsg": "Was this your nation? It may have ceased to exist due to inactivity, but can rise again!",
"errorType": "message", "errorType": "message",
@ -1192,7 +1149,7 @@
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"ProductHunt": { "ProductHunt": {
"errorMsg": "Page Not Found", "errorMsg": "We seem to have lost this page",
"errorType": "message", "errorType": "message",
"url": "https://www.producthunt.com/@{}", "url": "https://www.producthunt.com/@{}",
"urlMain": "https://www.producthunt.com/", "urlMain": "https://www.producthunt.com/",
@ -1467,14 +1424,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"Steamid": {
"errorMsg": "<div class=\"alert alert-warning\">Profile not found</div>",
"errorType": "message",
"url": "https://steamid.uk/profile/{}",
"urlMain": "https://steamid.uk/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Strava": { "Strava": {
"errorMsg": "Strava | Run and Cycling Tracking on the Social Network for Athletes", "errorMsg": "Strava | Run and Cycling Tracking on the Social Network for Athletes",
"errorType": "message", "errorType": "message",
@ -1574,14 +1523,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"TripAdvisor": {
"errorMsg": "This page is on vacation\u2026",
"errorType": "message",
"url": "https://tripadvisor.com/members/{}",
"urlMain": "https://tripadvisor.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"TryHackMe": { "TryHackMe": {
"errorType": "status_code", "errorType": "status_code",
"url": "https://tryhackme.com/p/{}", "url": "https://tryhackme.com/p/{}",
@ -1597,16 +1538,6 @@
"username_claimed": "jenny", "username_claimed": "jenny",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"Twitter": {
"errorType": "status_code",
"headers": {
"User-Agent": ""
},
"url": "https://mobile.twitter.com/{}",
"urlMain": "https://mobile.twitter.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Typeracer": { "Typeracer": {
"errorMsg": "Profile Not Found", "errorMsg": "Profile Not Found",
"errorType": "message", "errorType": "message",
@ -1798,14 +1729,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"YouTube": {
"errorMsg": "Not Found",
"errorType": "message",
"url": "https://www.youtube.com/{}",
"urlMain": "https://www.youtube.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"Zhihu": { "Zhihu": {
"errorType": "response_url", "errorType": "response_url",
"errorUrl": "https://www.zhihu.com/people/{}", "errorUrl": "https://www.zhihu.com/people/{}",
@ -1821,14 +1744,6 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"allmylinks": {
"errorMsg": "Page not found",
"errorType": "message",
"url": "https://allmylinks.com/{}",
"urlMain": "https://allmylinks.com/",
"username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7"
},
"aminoapp": { "aminoapp": {
"errorType": "status_code", "errorType": "status_code",
"url": "https://aminoapps.com/u/{}", "url": "https://aminoapps.com/u/{}",
@ -1844,7 +1759,7 @@
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
}, },
"babyRU": { "babyRU": {
"errorMsg": "\u0423\u043f\u0441, \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430, \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0432\u044b \u0438\u0441\u043a\u0430\u043b\u0438, \u043d\u0435 \u0441\u0443\u0449\u0435\u0441\u0442\u0432\u0443\u0435\u0442", "errorMsg": "Страница, которую вы искали, не найдена",
"errorType": "message", "errorType": "message",
"url": "https://www.baby.ru/u/{}/", "url": "https://www.baby.ru/u/{}/",
"urlMain": "https://www.baby.ru/", "urlMain": "https://www.baby.ru/",
@ -1852,7 +1767,7 @@
"username_unclaimed": "noonewouldeverusethis" "username_unclaimed": "noonewouldeverusethis"
}, },
"babyblogRU": { "babyblogRU": {
"errorMsg": "<title>BabyBlog \u2014 \u043a\u0440\u0443\u043f\u043d\u0435\u0439\u0448\u0435\u0435 \u0441\u043e\u043e\u0431\u0449\u0435\u0441\u0442\u0432\u043e \u0440\u043e\u0434\u0438\u0442\u0435\u043b\u0435\u0439</title>", "errorMsg": "<title>Сообщество родителей на BabyBlog — крупнейшее сообщество по беременности, развитию и воспитанию детей</title>",
"errorType": "message", "errorType": "message",
"url": "https://www.babyblog.ru/user/info/{}", "url": "https://www.babyblog.ru/user/info/{}",
"urlMain": "https://www.babyblog.ru/", "urlMain": "https://www.babyblog.ru/",
@ -2261,4 +2176,4 @@
"username_claimed": "blue", "username_claimed": "blue",
"username_unclaimed": "noonewouldeverusethis7" "username_unclaimed": "noonewouldeverusethis7"
} }
} }

Write Preview
Loading…
Cancel
Save