Community management insight at ManagingCommunities.com

Global Grind Kills Top Frame Bar, Full Content Scraping; Adds Direct Source Links

May 1, 2010


On Monday, I detailed and reported on Global Grind’s practice of content scraping. In short, they were copying full articles from an array of online publications, both small and large. They would then display this content on their website without any direct source links. The only link on the page, which was not very prominent, would be an internal link to Global Grind’s own top frame bar.

For those who followed the DiggBar situation, this was the DiggBar – but much worse because not only were they framing content, they were completely lifting content from other sources and competing directly with those original publications for traffic and revenue. They even allowed this content to be indexed by Google News, a highly exclusive news engine that most individual writers or small publishers can only dream of being listed in.

After attempting to have them remove my content and adopt more responsible practices, I found that they were doing this to many publishers and decided that I needed to bring the issue to a higher level of consciousness. This took the form of my article, in which I laid out the problems and potential solutions.

I’m happy to report that Global Grind has made changes and committed to making additional changes that have or will address all of the issues that I raised in my post. Let’s talk about what has happened over the past 6 days.

The Reaction

I was overwhelmed by the positive reaction to my piece. As I write, it has been tweeted 108 times, according to TweetMeme, and shared 15 times on Facebook. The story was also picked up on Plagiarism Today, Black Web 2.0 and Nah Right, among other sites, while Rafi Kam offered code to block the Global Grind frame from your site.

Myself and Jonathan Bailey of Plagiarism Today hosted a wonderful episode of the Copyright 2.0 Show that was a lot of fun, even with the subject at hand. We had some awesome interaction from the chat room and some very funny moments. I actually stayed on camera for an extra hour after the show was over, joking and talking to people. We also discussed the issue on the SitePoint Podcast, another show that I co-host.

Among those tweeting supportively was Angel Laws and J. Dakar of Concrete Loop, Stacey and Tracey of Neon Limelight, Ricky Ribeiro of Bark Bite Blog, Wayne Kest of The Mad Bloggers, Zillz of Zilla Says, Jia of Miss Jia, Liz Burr and Chuck Creekmur, the co-founder and CEO of AllHipHop.com, among many others. I even received tweets about it from Miss Info at HOT 97 and Baratunde Thurston.

But, that is just a small sampling of the people who spread the word about the story. Like I said, I was a bit overwhelmed by it and very grateful for everyone who shared the story with their friends and audiences. If you tweeted the story or spread the word in any way, thank you, I really appreciate it. It’s because of this support that we were able to make things better.

In a way, I’m glad this happened because it gave me an opportunity to meet (online) and/or exchange messages with a bunch of cool people I wouldn’t have otherwise known. I’m really thankful for that and look forward to meeting some of them in person.

One thing that was very rewarding about this whole situation was helping people and the people who told me something like “wow, I knew this was going on, but I didn’t know what I could do. I thought I had no options.” They didn’t know about the Digital Millennium Copyright Act (DMCA) and they didn’t think they had any recourse. Now they know they do.

The Reaction from Some Global Grind Editors

There were a couple of Global Grind editors that made commented online. One was trying to lessen the importance of these scraping tactics and suggested that my writing included lies and that those that agreed with it were haters. I found this remark interesting because one of the people who tweeted about the story remarked to me that, if a black person had written the story I wrote, they would have been called a hater.

That’s a pretty sad state for us to be in. The idea of hating = criticism must die. I plan to write more about this soon. But, in short, constructive criticism is not hating. Me not liking your record is not hating. If criticism is hating, we end up surrounded by yesmen and yeswomen. We never get better, we never improve – we simply stay the same.

The second editor was a little more approachable, but also made the comment that they were a work in progress and that bloggers should work with them, etc. If we were talking about a 15 year old kid, saying that you are a work in progress is acceptable. If some small mistake had been made, saying that you are a work in progress may be acceptable. But, you don’t say you are a work in progress when you make such an obvious misstep. Pretty much any veteran writer – or attorney – would have told you that full text scraping was an absolute wrong that would lead to trouble.

And as far as people working with you – you have to earn that. Global Grind has done serious harm to the relationships that would potentially have with online writers. They have to earn that back, it’s not a given. No one will want to work with you after you’ve done this to them. You just have to fix it and hope that, one day, they do.

I followed this editor on Twitter, found her talking about how bloggers needed to chill out, and unfollowed her. The vast majority of bloggers that I spoke with, spoke about this issue in a mature manner. There’s no need to chill out – it’s a serious issue and a serious wrong that needed to be corrected.

The Real Reaction from Global Grind

Now, let’s talk about progress. For the past few days, I’ve been talking via e-mail and telephone with Michael Skolnik, who was just named co-president of Global Grind. We have been talking through the various issues and how they can be fixed. Jonathan Bailey was kind enough to offer his thoughts as part of this process, as well.

Following my initial article and these conversations, there is good news (for everyone, including Global Grind). The company has made some immediate changes, with more changes planned, that will completely address the concerns I initially had and even go beyond them.

Off?
Creative Commons License photo credit: SeveStJude

Full Text Scraping Turned Off

The primary focus of my story was the full text scraping. They have stopped this and no new articles should be scraped in full and displayed on their site.

They may or may not continue to automatically index feeds in the future – that is currently being considered – but for any content that is indexed and for any user submitted stories (such as those submitted through their “Grind It!” buttons), the content will be limited by the site itself, to a character limit of 250.

This brings them in line with normally accepted standards. For example, in new submissions, Digg only allows you to include a maximum of 350 characters in the description.

There is one problem, though, and that is that the form on their site – where you can submit new stories manually – still allows you to submit excerpts as long as you want. Snolnik says they will address this by moving to a system where any user submissions will be manually approved and will not be automatically posted on the site, as they are now.

Old Scraped Content is Excerpted (or Will Be)

When I found out that no new articles would be scraped, I said that that was definitely good – but what about the old content that had already been taken and placed on their site?

Global Grind has gone ahead and reduced the majority of previously submitted or indexed content to an acceptable length. Skolnik said that, due to the amount of content, it could not be done in a single swoop, but that any content not yet excerpted will be done within a week.

If you see any content on their site that is a full scrape, I encourage you to contact them with a direct link.

Update (8:15 PM ET on May 5): Global Grind now says that all of the content has been truncated to a maximum of 250 characters. If you find one that isn’t, please contact them or, if you’d prefer, let me know in the comments.

Frame Bar Out, Direct Links In

Though this was not one of my concerns, a lot of publishers will surely be happy to know that they have completely killed the Global Grind top frame bar. It is no more.

As a consequence of this, their source links are now direct links to the original article, rather than internal links that lead to a top frame appearing above content. As I mentioned in the original piece, I felt that it was important that at least one direct source link be included somewhere.

Edit: In the comments, Rafi Kam points out that old links going through the Global Grind top bar still work. See here for an example. As I mentioned, the bar is not really an issue to me – but it may be a good idea to simply redirect those old bar links to the source URL or just kill them off.

Update (5:37 PM ET on May 3): The Global Grind top bar now appears to be officially dead. Instead, the old bar URL now redirects to their on site page for the article, which shows a short quote and  a visible, direct link to the article. See the example I have previously.

More Visible Source Links

Another great change is that, on stories, besides the “See Original Story >>” link near the top, there is now a much more visible link at the bottom of any quoted article that reads “FOR MORE CLICK HERE.”

They have also made it so that the link next to “SOURCE:” on an individual article page now links to the main domain of the site that is mentioned. One other big change is that they have added a direct link to the main domain of the source on their index and category pages. This was a suggestion I made with the idea of moving them beyond general good practice and closer to best practices.

Skolnik says that they will soon be changing it to the actual direct article link, not just the main domain, which will be even better. See the screenshot below for an example of these links.

Update (5:37 PM ET on May 3): That link has now been changed to a direct link to the article. However, I note that the “View Original Story >>” link in the screen shot below has been removed. As long as the quote is short, however, the link at the bottom is sufficient.

Making it Easier for People to Report Copyright Infringement

Jonathan and I both encouraged Global Grind to make it easier for people to report copyright infringement issues and to better respond to them when they do, as some bloggers had mentioned that they had contacted them and not heard anything. Skolnik says that this should no longer be an issue.

I suggested that they adjust their contact page to include a line for “Copyright” and Jonathan suggested designating a DMCA agent. These measures are being considered.

The Last Piece

They have made (or plan to make) the technological changes, which is great. The last piece, and one I have suggested, is some form of public acknowledgment. I feel like it would be a good move for them to post an entry on their site acknowledging these concerns (and linking to my article), taking full responsibility for them, explaining the changes they have made and apologizing for these past errors.

Following that, I think it would be a good idea for them comment on the articles that covered this issue reasonably and do the same thing. Thank them for bringing it up, take responsibility, apologize and explain the changes.

I feel like this will go a long way to helping to start the process of earning that respect back, which is absolutely possible – but not easy. It’s helped by a human touch. Not just making the changes, but putting a public face on them.

Credit Where Credit is Due

Yes, some of these issues never should have been issues as they are simply wrong. Yes, the changes only started happening after I published the post and people started talking about it. And, yes, they haven’t yet acknowledged the issue publicly.

But, with that said, I believe that Skolnik and Global Grind deserve credit for, in the end, listening to the criticism and making the changes. With what they have done and what they plan, for which I take them at their word, they will have gone well beyond what I initially suggested. I made suggestions that would make them a generally respectable player in the space. But, with the changes they make or, hopefully, will make, they’ll be setting a solid example for like minded sites to follow.

And that is a good thing. My goal in writing the post wasn’t to damage anyone or to bring anyone down, but simply to ensure that writers and publications are properly respected and to push Global Grind in the right direction, in a direction that I believe is not only better for online publications, but better for Global Grind, as a business. They have made great and serious changes and they now must follow through on the elements of this plan that are not yet finished and in place. I wish them well.

Pings

8 Responses to “Global Grind Kills Top Frame Bar, Full Content Scraping; Adds Direct Source Links”

  1. Mack of Sound-Savvy says:

    WOW!!! As an affiliate member of Global Grind, these are concerns that I raised months ago and just recently corresponded with Michael Skolnik to get some minimal resolution on my personal issues with the site and some of it’s staff but this is a lot more. I must say this: Mr. Skolnik is a very RECEPTIVE and RESPONSIVE leader over there. I reached out to some of the editors over there DIRECTLY and was dismissed or ignored but he responded to me very quickly and made some changes. I’m glad I’m not the only one who saw the problems and that you guys spoke up. Feel free to keep me in the loop with the progress made on this.

    I see the goal of Global Grind and I see it’s potential but as I told the editors before, that site has been built on the backs of hardworking bloggers and writers and not much, if any, credit was being given by way of direct links and traffic and there was a LOT of plagiarism going on. The next step of changes over there is that they need professional and passionate writers and editors over there to gut and rebuild.

  2. rafi says:

    Awesome work Patrick. Good to see Global Grind implicitly acknowledge their mistake and I agree that a statement on the issue would do them good as well.

    I’d also like to see the archives scraped content disappear and even those old frame url’s too. They’re no longer linked from the site but it looks like they’re still functioning pages. They should vanish or at least get a meta noindex or a canonical url to the source site.

    But good on GG for taking steps to correct their ways. I guess now i’ll have to update my post / add a new post. At least I didn’t put in the time to make that code into a wordpress plugin. That would have been a wasted effort.

  3. Patrick says:

    Mack – Thanks for the comment. I appreciate it and I agree with you.

    Rafi – Thanks so much for the kind words and for helping with this. :)

    You’re right about the top frame bar still working for content! I went to one site, but I think it was badboyblog.com and that is blocked so that’s why I didn’t see it. I am going to point this out to Michael now and add a small update to my piece. But, I don’t think the canonical solution works. See here: http://www.3dogmedia.com/truth-about-diggs-diggbar/

    I told him that if the archives were excerpted and the direct links were in place, it would be fine to keep the archives. If they were full text, then it wouldn’t be as the copyright issue is still present.

    Thanks again,

    Patrick

  4. rafi says:

    Ah! Thanks for straightening me out on canonical not working across domains.

    Yeah the scraped archives thing needs to go, hopefully they stick to their word about doing it within a week.

  5. Patrick says:

    My pleasure, no worries. They’ve taken care of the majority of full scraped archives as far as I can see (they are now excerpted), but yeah, the remaining ones definitely should be dealt with within a week as they said. Thanks again.

    Patrick

  6. The Kitty Bradshaw says:

    Had it have been a black person who wrote this article, would Global Grind been as swift in their response?! No, I am not harping over spilled milk here… but how long have these issues been in place and before it took one white man to come in and call foul for Global Grind to respond back within one week’s time?! Froggy, I understand you reached out to them prior to this post… but once they associated a race to the font, now all of a sudden things get done? Global Grind just put on a show in front of “Massa”.

    Thank you Froggy for taking a stance, but in my opinion the damage has been done. These issues have gone on for so long, their brand is forever soiled. Not to mention, most of the sites they were scraping weren’t even credible news sources. Russel Simmons speaks out against sites like Media take Out, but they scrape sites just like them?! Global Grind bka the online BET.

    Again, thank you Froggy. When the online black community is being done wrong by our own, we now know where to turn to! *insert sarcasm here*

  7. Patrick says:

    Hello The Kitty Bradshaw,

    Thanks for the comment. I understanding your feelings as far as the brand being soiled, etc. At best, the brand is damaged in the eyes of some and it will take time and work to restore that.

    Honestly, though, I think what led to these changes happening so quickly was the amount of attention that it generated. If I had just written this article, but no one had read it, then I don’t know if the right amount of attention would have been brought to the issue, to make them reconsider their position so swiftly.

    To me, people are people and, if something is done wrong, something is done wrong and I take on issues as they fall in my line of interests. I look at these issues only as a matter of right and wrong. I would hope that members of the “online black community,” as you put it, would not hesitate to ask for my help in a situation like this, even though I myself may be outside of that “online black community.” I hope that makes sense.

    Thanks,

    Patrick

  8. The Kitty Bradshaw says:

    Hi Patrick,

    Again, these issues have been going on well before you came along. There are more than enough people who are/were aware of the issues with Global Grind. In a perfect world the issues would have been resolved back in January 2009. in any event, the wheels are set in motion for change. There is no dispute there…

    -Warmest Regards

Leave a Reply

READ BEFORE COMMENTING: Participation constitutes agreement to my User Guidelines, which are stricter than most other blogs', so please read them before commenting. No advertising (posting links to your site), inflammatory (flaming) remarks, vulgarities (any kind of profanity that you can imagine) or questions about my guidelines or comment deletions. I generally try to maintain a family friendly atmosphere here. Please keep this in mind. Here are a few common examples of comments that will be deleted:

  • Any comment featuring a link to your blog or to any site you are affiliated with - even if you feel it is related - unless I asked for it, specifically. If you have a link to share, awesome, but please contact me directly
  • Asking why your comment was deleted. Please contact me instead. I'm happy to help.
  • Attacking me or fellow commenter instead of attacking their point.
Please be sure to treat your fellow users and my guidelines with respect. I'm happy to have you here.

Please note that all comments made on entries that are at least 14 days old are moderated.

Current day month ye@r *