Holy Optimization, Batman

A long time ago in a galaxy far away I used to do a lot of newspaper writing but got burned out by that and figured I could reach just as many, if not more, people on the web. So 10 years ago I registered a domain (and then a dozen or so more) and figured I’d be happy if I could ever reach 1 million page views/month which would be a much larger audience than I’m sure my newspaper writing ever had.

Unfortunately, I reached that in 2004 and then became very bored with the writing thing (World of Warcraft didn’t help).

The weird thing is the traffic just keeps increasing. Last Fall, the server was serving up about 1.2 million pages/month. Lately that’s climbed to about 2.5 million pages/month and is still rising. Not bad for something I do in my spare time.

Anyway, what’s also amazing to me is that the server that’s now 2-3 years old is able to keep up, especially given all of the dynamic elements that are part of pretty much every page. Macrobyte has done an excellent job of optimizing Conversant to get the most bang for the buck from hardware.

Conversant — Tagging Since 2001

It’s kind of funny to read things like this, from a Jan. 24, 2006 Wall Street Journal story,

While tech-heads have been using the method for the past year or so, tagging is now moving into the mainstream.

I don’t know if there were other services that allowed it at that time (and Lord knows I searched for them), but Macrobyte built an extensive, completely customizable tagging system into Conversant back in 2001. Conversant is the software that runs this site, and I’ve been extensively tagging all the articles I post here and at my other sites since then.

It’s nice to see the rest of the world finally catching up. And if you’re looking for a very forward-looking company for software development, check out Macrobyte.

One More Yanisar Rave

And while I’m praising Conversant, I should mention that Yanisar Enterprises also did an excellent job of taking my web sites to that sports cliche “next level.”

I hired them to do a redesign of AnimalRights.Net and they also did some basic re-architecturing — the two in combination have sent pages views at the site through the roof.

They were very reasonably priced and very professional. I hope to put them to work redesigning this site very soon.

One More Conversant Rave

A couple years ago I received what I think was the strangest e-mail anyone’s ever sent me. The author of the e-mail was an individual who set up a web site devoted to the same topic as one of my web sites. I liked and respected his site, but the e-mail was to the point — he felt that my site was so well done that his had become pointless and he was shutting it down.

Wow. That floored me. Personally, I don’t think my sites are all that, especially since I get bored or busy quite frequently and just stop posting for months at a time.

Anyway, I’ve said a lot of things about Conversant in the five years since I moved all of my web sites to it (wow, can’t believe that much time has flown by). But the bottom line is this — pick any topic and using Conversant I could build a kick-ass site by myself that others would have to spend thousands of dollars and bring a team of people in to keep updated and organized.

I’m working on a special project now and, of course, I looked at all the sites that I’ll be competing with for attention. They all have made design decisions that leave me scratching my head thinking, “why would they do that?”

The answer is clear on closer inspection — the software they’re using to run their website pretty much limits them to that. So I’ll go live with my site this summer, and by January 2006 I’ll be in the top ten on Google for the search term while they’re still wrestling with their clutzy CMS.

So, in summary, give Conversant a try. It will turn you’re skinny weakling of a website into a muscle-bound one that all the search engines will love in just 15 minutes a day!

Weblogs.Com Outage for Many Conversant Sites

According to Seth Dillingham, Weblogs.Com has started ignoring pings from many Conversant sites, including this one.

Seth writes,

I’ve debugged the pings we’re sending, repeatedly. The server always returns the “thanks for the ping” response that indicates the ping was received successfully. Yet, our sites are never listed. The same is true for pings I’ve sent manually. It appears to be accepting the pings and then ignoring or forgetting them.

The service is run by Dave Winer. I wrote to Dave on May 6th to find out if he knew about the problem. No response. I wrote again on May 8th. Still no response. I wrote again this morning. Still no response.

Wow, there’s a shock. Remember how Dave freaked out when he thought Google and de-indexed his sites and how angry he was because he couldn’t get a response from the company? But, hey, the rules don’t apply to Dave. If he wants a problem to go unresolved for weeks at a time, its not a bug, its a feature.

Since I know the pings are going through correctly, and Dave is ignoring my email, I’m concluding that we’re being intentionally ignored. Why, though? I haven’t a clue. Is it something personal against me? Something technical about Conversant that he doesn’t like? (Then why didn’t he inform me?) Is it some business consideration? (I can’t imagine what that could be, since Dave isn’t in business right now.)

. . .

Being ignored by weblogs.com isn’t the end of the world, but there are a number of blog tracking and categorization systems (including Blogshares) that using its changes.xml files in the heart of their applications. Not being listed means we basically fall off the radar.

Yep. Not a major problem; more of an annoyance. A service so widely used by others probably needs to be in the hands of someone a bit more stable and responsive to fixing outages than Dave.

Dave’s great at innovating and coming up with incredible ideas, but he’s not the person you want in charge of implementation and support.

Sometimes the Developers (Pleasantly) Surprise Me

Seth Dillingham has a funny post here about users who ask him to configure Conversant in weird ways,

A Conversant user recently asked me to custom-configure one of his sites, because he wants to do something that isn’t available via the web-based configuration.

Why not? Because we never saw anybody wanting to do this. We’ve never done it, never tested it.

I set it up for him, but I’m still experiencing heart palpitations.

I know what he means, because I’m the one who requested the odd custom configuration. So far, its worked incredibly well. In a couple months I’ll be able to show off the cool things I’m doing thanks to this bit of wizardry.

But what it really does is speak to just how well Seth’s developed Conversant. A lot of software tends to produce very frustrating roadblocks. Its great if you want to do things the exact same way the developer does them, but start deviating from that plan or start asking “what if I mixed feature A and feature B” together, and most of the time you’re out of luck.

Conversant, on the other hand, does an excellent job of taking a wide variety of basic building blocks and then letting the user mix and match them in pretty much anyway he or she wants. There have been a handful of times where I’ve done something in Conversant and it worked even though Seth said he hadn’t thought of using the feature in that way. When you can do things with software that the developers never intended or thought of, you’ve got an extremely well-done piece of software.

And that’s a great way to describe Conversant.

Personally, I Blame Seth and Mark

There was a time when I was pretty obssessed with the traffic stats for my site. I’ve reached the point, however, where I don’t even think about it anymore and it’s largely the fault of Mark Morgan and Seth Dillingham and their respective companies.

Back in 1999, for example, I was very impressed that my web site served up more than 2,000,000 page views. Heck, I was impressed at the end of 2003, that I racked up an average of almost 16,000 page views/day. My goal was to reach the 34,000 page views/day mark, so I could hit the 1 million/month level.

And then came Seth and Mark and ruined it all for me. First, Seth’s company, Macrobyte, created Conversant, which lets me do a lot of sophisticated categorizing and other content management niceties without having to hire a programmer or become one myself. Then Mark and Yanisar redesigned my most popular site, AnimalRights.Net with an awesome new design.

The result? This server is currently serving up about 70,000 page views per day and growing. That’s just insane.

Why blog? I used to write for a local newspaper with a pretty sizable circulation and on occasion for a large metropolitan newspaper. I’m easily being read by more people now than I could have ever hoped for as a lower level stringer/occasional op-ed writer, and the pay’s about the same (i.e., barely covering my expenses).

Take a Deep Breath and Tag Those Posts — Or Not

More than three years ago, Macrobyte added custom fields option to Conversant, the software I use to manage this and the rest of my web sites. That was like a revelation and I think I’ve exploit the feature more than anyone else using the software — I have some sites that have a couple dozen different fields and close to 2,000 values within those fields. The extensive, detailed categorization that has is one of the reasons my sites have been as successful as they have been.

Now the rest of the world has discovered “tagging” posts with categories (I hate that word “tagging” — sounds like I’m out spraypainting graffiti) thanks to services like Flicker, Del.icio.Us, Technorati and others. And that’s also brought a bit of a blacklash which goes something like this: tagging posts is a pain in the ass and users will quickly abandon it.

Dave Winer captures this view in describing why he doesn’t categorize his posts,

I’ve seen the same thing. I have a very easy category routing system built-in to my blogging software. To route an item to a category, I just right-click and choose a category from a hierarchy of menus. I can’t imagine that it could be easier. Yet I don’t do it.

It’s also very easy to add a new category, or to even reorganize my whole taxonomy. Never do those things either.

A picture named billg.jpgI have a theory that it’s like desktop calendar software, which people were very excited about in 1985 or so (they called them Personal Information Managers or PIMs). Seemed like every new Mac software product had a calendar in it. John Sculley and Mitch Kapor were singing their praises. Users got all excited about them too, and set them up imagining how great it was going to be to finally have an orderly life. They happily entered appointments, until they spaced out or got lazy and didn’t enter one. All it takes is one for the excitement to turn to guilt. You don’t even want to look at the thing because you screwed up. Quickly you never use it. I’ve seen this happen both in my own work, and in others.

The category stuff works the same way. At first I delighted in the ease of routing stuff to categories. Eventually I would only route to one or two categories, and then I stopped altogether. Not because it wasn’t easy enough, but because the guilt had taken over.

People like Dave and others are basing their guilt on a fundamental misconception, however, that categorizing posts has value only if you do it to every single post. But adding metadata has value even if you only end up tagging 1 in 50 posts or 1 in 100 posts.

I’m a categorization freak, but I am also fundamentally lazy and sometimes I just don’t feel like categorizing my posts. So, I don’t. For example, all of the articles on this page are ones that I was just too lazy to bother categorizing when I posted them. And that’s okay.

Even a little metadata can add a lot of value. For example, you might be a hockey fanatic and decide, you know, that the only posts you really care to tag are the ones related to hockey. Why should you feel guilty over not obsessively categorizing everything? You shouldn’t. Go on with your life. Get over it.

The other error I think a lot of people are making is assuming that tags only have value in relation to services like Del.icio.us and Technorati, etc. The single best use of a categorization scheme is to present a page or pages on your site that show, for example, all of your posts about hockey or, taking it to the next level, having an RSS feed of all of your posts about hockey.

What’s the payoff? Traffic. The one thing that most bloggers share is they seem to want more traffic. From my experience, tagging posts and then aggregating them on topical pages will drive traffic to your blog/web site like nothing else. I am definitely not an A-list blogger and get very little traffic directly from other bloggers, but I’m currently averaging about 40,000 page views/day thanks to search engine friendly topical pages.

Of course most people probably aren’t as interested in obsessively categorizing everything as I do, but sites I run where I have done only minimal categorizing, that categorizing has helped push the traffic levels to relatively high numbers compared to what I see other bloggers — even very popular ones — out there reporting they receive.

What Is Conversant?

Seth Dillingham recently created a nice, long summary in outline form to answer the question he hears from clients — What Is Conversant? Its pretty exhaustive, and I don’t really have anything to add to the specifics.

To Seth, Conversant is groupware. To me its a sophisticated toolbox for categorizing, arranging, ordering and indexing information that really is realtively easy to use.

There are some very nice, very easy-to-use blogging software platforms out there like Movable Type. They’re very good and very powerful for what they do, but its difficult to do things outside the blogging model with them.

On the other hand, there are extremely powerful but also extremely difficult-to-use (at least for non-experts) content mangament systems like Mambo. I don’t have time to take a course in PHP to administer my web site.

Conversant lives in the happy middle with all the power of a system like Mambo but with a much shorter learning curve. If you need a site that goes beyond the blogging basics, but don’t want to deal with learning programming or hiring someone to install and code the specifics (as I would have to do if I were going with something like Mambo), Conversant hits the sweet spot in the power vs. convenience tradeoffs.

Christmas Gift from Macrobyte — Improved Performance and Feature Updates

I haven’t posted a fan letter about Conversant in awhile, but since Macrobyte just implemented a number of upgrades/new features this is a good time to re-visit my content management system of choice.

The thing that continues to excite me about Conversant is how it well it balances the power/ease-of-use equation. Over the past six months a friend and I have installed about dozen different CMS systems, with most of those being PHP systems. Some of them are very good.

My favorite was Mambo — its one of thew few open source CMS’s that, with a number of additional modules, would come pretty close to duplicating the features I enjoy in Conversant. The problem is that Mambo and others are much more complex than Conversant. As I told Seth Dillingham, to exploit Conversant to its fullest, you just need to be able to think really logically in order to use Conversant’s macro system to produce whatever results you’re after. With, Mambo and these other systems, you really need to know a lot about PHP (or pay someone who does to help you) to do the sort of things you can easily accomplish on your own with Conversant.

For me, it is important to be able to make complex changes to my site myself, and to be able to do so quickly — I’d prefer to spend my time writing and editing rather than tinkering, and Conversant does an excellent job of providing a lot of power with a minimum of effort.

Anyway, earlier this month Macrobyte upgraded Conversant which resulted in nice speed increase and this week released a new, improved update to the macro processor, which will allow even more complex behaviors to be added (not to mention improving overall performance).

Sound interesting? Get a free personal Conversant site here and give it a whirl.