Scott Hanselman

ACTION REQUIRED: DasBlog Alert! Referral BlackList has changed!

October 04, 2005 Comment on this post [6] Posted in DasBlog | Tools
Sponsored By

TurnoffblacklistACTION REQUIRED - DasBlog Alert: Pass the word on.

UPDATE: 6-Oct-2005 4:00PM

Jay has added a second post clarifying the first. It is not generally believed that DasBlog is the cause of these problems. However, I've pulled the current DasBlog releases while we update it to work around the now-missing MT-BlackList.

An update has also been posted regarding the "original bad programmers" post.

UPDATE: 5-Oct-2005 6:00PM

Jay Allen's recent blog post includes word from Jay that he believes DasBlog is in some part responsible for his bandwidth issues and the resulting end of the BlackList. If this is true, it's profoundly sad. He says "That person is the developer for one of the tools responsible for driving me insane." That person being Omar and I.

DasBlog request(ed) the MT-BlackList only during site startup (seeding, as is recommended) and then subsequently sent an If-Modified-Since HTTP header using the file time which resulted in HTTP 304 Not-Modified headers to be sent back from Jay's site. DasBlog doesn't request the BlackList thousands of times a day.

I am saddened to hear that Jay's been fighting this battle with our, and persumably other, blogging software. If he had left a comment on our SourceForge site or emailed any of the many developers, we'd have changed the retrieval pattern.

Others are blogging that this is representative of bad programmers. Perhaps. Perhaps a breakdown in communication as well. It's true that DasBlog is an Open Source application, created by a number of contributors, myself included. The source is, and has been, public. I suppose as DasBlog's current Project Managers Omar and I should have reviewed the code more? It's public code, and its out there.

To be clear, Jay provided a fantastic barrier between the Spammers and the Bloggers. He did it out of the kindness of his heart, and his contribution is indelible. If DasBlog indeed quickened the MT-BlackList's demise it is unfortunate.

Had anyone mentioned it to any of the team at any point in the months since we added this feature it'd have been fixed within hours.

- Scott

Jay Allen, the guy who maintains and hosts the Referral/Comment Spam Blacklist that DasBlog users use has started banning IP addresses. This is presumably to save bandwidth. However, when the ban happens, he returns an HTML document with details as HTML comments rather than an HTTP 302 Redirect. DasBlog then uses this to build its a Regular Expression. This resulting RegEx will match more referrals than you'd like and can mess up your blog stats. He's also introduced (apparently a while ago) a diff file as a way to mitigate the bandwidth problem.

You can tell if you have this problem if the blacklist.txt file in your /SiteConfig folder is less than 1KB.

The setting to turn off in site.config is <EnableMovableTypeBlackList>false</EnableMovableTypeBlackList> as seen in the screen shot above. If you don't have this setting, or this file then you're not affected.

About Scott

Scott Hanselman is a former professor, former Chief Architect in finance, now speaker, consultant, father, diabetic, and Microsoft employee. He is a failed stand-up comic, a cornrower, and a book author.

facebook twitter subscribe
About   Newsletter
Hosting By
Hosted in an Azure App Service
October 04, 2005 15:37
Which version(s) of DasBlog does this affect? Is it just 1.8.X?

Which setting in the site.config matches the "Enable Movable Type Blacklist" option you highlight in the screen shot above?
October 04, 2005 20:36
Thanks for the heads up!
October 05, 2005 20:00
It looks like Jay has called it quits all together. His website this morning indicates he's done posting the Blacklist. That will be a huge loss for the blogging community!
October 06, 2005 5:01
Looks like this is the program that cause Jay to abandon the MT-Blacklist. Thanks alot...that was a sarcastic thanks.
October 06, 2005 6:02
See details in the updated post above. It was more than DasBlog that could have consumed that much Bandwidth.
October 07, 2005 5:00

I didn't post that ( to rip on you or any other person specifically. Just thought I'd make that small clarification. Your software is not bad at all, considering that it's used by many many people...I somehow doubt that people would voluntarily use software that wasn't working properly if given a choice and ease of finding alternatives.

I may be right, or I may not be. You're right, it also could be a problem with communication. Whatever it is, something went wrong. But the way I see it, there's no reason to dwell or blame anyone specific (I do my best to make sure I never do that on my site, I rant about generalites not specific people). We're all in the fight against spam together, so we might as well work together.

Comments are closed.

Disclaimer: The opinions expressed herein are my own personal opinions and do not represent my employer's view in any way.