Sign in to follow this  
Followers 0
snover

Resolve redirections of URL shrinking / URL redirection services

3 posts in this topic

From URL Shrinking Website != spam, and suggested to be posted here to not get lost:

The spam is already being processed for links. There will only need to be a couple of extra steps to be able to report the actual spamvertised site instead of just the redirection service.

1. Match the link domain against a list of known shortening domains

2. Optionally, opportunistically check an unknown domain to see if it is a URL shortening service if the domain part is <= 9 characters or so — this will help so that nobody has to manually add domains to the list, but it may add too much overhead or garbage in the lookup table, slowing things down

3. Do a HEAD request and cache the resulting Location header

Unlike the problem of rotating DNS records, shortening service URLs are idempotent, so they really only need to be looked up once. Obviously, of course, this proposed method won’t catch ANY redirect, but it ought to take care of most of the shortening services.

I know that SpamCop does not consider the spamvertised site reporting to be a particularly important or high-priority thing, but I would love to see this nevertheless if attitudes ever changed in this regard. :)

Share this post


Link to post
Share on other sites

Admin action: extracted from http://forum.spamcop.net/forums/index.php?showtopic=4345 (a FAQ entry) and moved to the 'New Feature Request' Forum section.

Feature request:

Please make your reporting tool parse well-known url-shortening/forwarding services (like bit.ly) so we can report abuse to the correct webhoster!

Admin action: Then after moving into the other Forum section, see that the same data was Posted into another existing Topic, so moved this "New Post" into the existing Discussion.

Edited by Wazoo

Share this post


Link to post
Share on other sites

I have the same feature request:

Please make your reporting tool parse well-known url-shortening/forwarding services (like bit.ly) so we can report abuse to the correct webhoster!

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0