Live Web

Blog search is mighty thin in Wikipedia. Technorati’s entry is stale. IceRocket and BlogPulse are stubs. BlogScope is minimal.

It’s really wierd. While “real time” is heating up as a topic, real time search seems to have fallen off the radar of everybody other than itself.

Take this piece by Marshall Kirkpatrick in ReadWriteWeb. It begins, Web search, real-time search and social search. That’s a pretty compelling combination and it’s what both Google and Facebook put on the table today in a head-to-head competiton. Then it compares Google, Facebook and Bing at all three, in a chart.

Hey, why not the search engines that have been looking at real time for the duration? Here’s IceRocket on real time search as a string. You get blogs, Twitter, video, news and images. Fast, simple, uncomplicated, straightforward. Like a search engine ought to be.

Here’s the IceRocket trend line for “real time search”. And here’s the BlogScope trend line for “blogging”.

Earth to buzz: You’re obsessing on the wrong thing. “Real time search” isn’t just Twitter and Facebook. It’s blog search too. Always was.

Syndication and real time will matter long after “social” goes passé. (And “social” will matter long after the next buzzthing goes passé.)

For whatever reasons, Google and Bing don’t get it. There are better tools out there for Live Web search. Check ‘em out.

Bonus graph.

In The new Technorati: advertiser-friendly, foreigner-free? Ethan Zuckerman unpacks a bit of what remains (”highly-targeted, advertiser friendly content”) and what’s gone (everything but English) at Technorati. (This blog is still there, at #2659 and falling, with an authority of 549. I was informally advising Technorati when they came up with the authority thing, but I don’t remember what it means, exactly.) I know Ethan also used Technorati’s API to do some very interesting research, but with the API gone, that’s out the window too. And all that’s on top of what I reported on the other day.

While better by far now — relatively — Google Blogsearch (re-branded “Google blogs”) isn’t great. Or not as great as it could be. Or was. The index page, which used to be a Google-esque sea of white space, is now awash in with noise and news. It’s fast, and it’s easy to get an RSS or an Atom feed of any search, which is cool. But it seems to suggest, along with Technorati, that the blogosphere is about current news and trivia.

Blogpulse is still there. I always liked its UI, although the results tended to be old. “Today’s Highlights” are downright stale. It reports “Phillies beat Dodgers in Game 1.” Which was days ago. (MLB.com is up to the second. Phillies ahead at the bottom of the 4th in Game 3.)

BlogScope is one I hadn’t paid much attention to before. Need to dig down a bit. The popularity charting is interesting. Little slow. Owned by the University of Toronto. Interesting.

IceRocket still exists. It also has search for Twitter, Web, MySpace, News, Images and Big Buzz search. All of them are fast. And you can subscribe to RSS feeds of results. Easily. No looking around.

Soooo far… Hey, I’m liking IceRocket. Speedy. Nice UI. Nice slices of times. Trends. Feeds. Nothing fancy, nothing bad, lots good. Go check ‘em out.

The original Technorati was born during a writing project David Sifry and I were doing for Linux Journal. Late at night David pinged me and said “Look at this,” and I was amazed. It was the first search engine for what we then called The Live Web (and now call Real Time). Basically, it was a search engine that just paid attention to RSS, which back then consisted mostly of blogs. (I welcome corrections from David, or anybody, on that. It’s been awhile.) When David made Technorati a company, he put me on its advisory board, and for awhile I had some influence on where it went and what it did. It was also, for many subjects, my primary search engine. If I wanted to follow conversation about a subject, Technorati was where I went first. I also liked the way it allowed me to look at a topic’s trending over the last few weeks or months. Technorati was also a technical pioneer, introducing tag search, along with new standards and practices around tagging in general. After Google Blogsearch came along, I used both, but Technorati was usually my first choice. I especially liked s.technorati.com, which gave the same results through a plain no-bullshit search UI.

Over the years, however, Technorati came to value popularity and buzz more than the kind of stuff I was looking for. Some of the same functionality was there, but it was buried deeper and deeper. For example, feeds of searches. If I wanted to subscribe to feeds of, say, a search for Nokia N900, I could click on something that said (or meant) “get a feed for this search.” Google Blogsearch had the same feature, and made it easy. Still does, giving me a choice of Blog Alerts, Atom and RSS, under a heading that says “Subscribe”. Twitter search, similarly, has “feed for this query”.

Without being able to find that feed easily, I lost interest in Technorati, only going there when I couldn’t find the results I wanted elsewhere. By that time David and most of the other people I knew at Technorati had moved on, so I didn’t have much interest in volunteering advice.

But I learned this morning (via Twitter, naturally) that Technorati had gone through an overhaul. It’s certainly faster and less cluttered. But I still can’t find feeds for searches. Trending seems to be gone, or hidden where I can’t find it. And I have no idea how to do tag searches with it. Maybe that’s because, as CEO Richard Jalichandra explains here, “We’re eliminating many of Technorati.com’s annoyances and some features, especially ones people didn’t use enough to justify the cost. Instead, we’re focusing on delivering the value people really want from us: instead of boiling the ocean to make coffee, we’re aiming to deliver the non-fat soy latte you asked for.”

Well, that “you” isn’t me. Which is cool. Technorati has become less a search company and more a media company. They launched Technorati Media at the same time. It’s a way to buy and sell ads. I wish them well with it. (Hey, Techcruch likes it.)

Meanwhile I’ll stick with Google Blogsearch for my live Web searching.

Wonder what the rest of ya’ll think.

There’s something new on the FM dial in Boston. You might think of it as a kind of urban renewal. Grass roots, up through the pavement. (There’s a pun in there, but you need to read on to get it.)

You might say that fresh radio moved in where stale TV moved out.

Here’s some background. When TV in the U.S. finally went all-digital several months back (June 12, to be precise), one wide hunk of spectrum, from 54 to 88Mhz—where channels 2 through 6 used to be—turned into “white space“. In other words, empty. For most of us this doesn’t matter except in one little spot at the very bottom of the FM dial: 87.7 FM. It’s the first click on nearly every FM radio, yet the FCC licensed no FM stations there, because that notch belonged to TV channel 6 audio. From January 1963 until June 2009, you could hear Channel 6 (WLNE-TV) at that spot on the dial, across much of Southern New England, including the Boston metro. When analog television shut down in June, WLNE moved to Channel 49 with its digital signal. After that, 87.7 was white space too. (Some more background here.)

In a few cases (New York and Los Angeles, for example), somebody would get a license (New York, Los Angeles) to operate a low power analog Channel 6 TV station, leave the picture off and just broadcast the audio, creating a virtual FM station that most listeners didn’t know was licensed as picture-less TV. (LPTV stations are exempt from the digital requirement.) That was pretty clever, but it was also pretty rare. For the most part, 87.7 was all-hiss, meaning it was open for anybody to put up anything, legal or not.

Such as here in Boston. It was a matter of time before somebody put up a pirate signal on 87.7. That happened this week when “Hot 97 Boston,” an urban-formatted Internet station, appeared there. Hot 97 is also known as WPOT, according to this thread here.

I checked here and here to see if it’s legal (on FM), and can find no evidence. But it does sound like a real station. If you’re into urban radio with a local Boston flavor (also with no ads), check it out. The signal isn’t big, but it’s not bad, either. And it’s worldwide on the Net.

[Two days later...] I figured by now the Boston Globe and/or the Boston Phoenix would pick up on this story. So I just tweeted a bulletin. Let’s see what happens.

[Later still...] Dean Landsman reminded me that Brian R. Ballou of the Globe had a report on TOUCH-FM in June 2008. TOUCH is another pirate that appears from its website still to be active, at least on the Web (though at the moment I can’t get it on either FM or the station’s “click here/listen now” link). [And later again (October 13) ...] TOUCH-FM is still on the air. It’s pretty obliterated by other signals here in Cambridge, but I got it well enough to follow this morning in the car when I drove to Boston and back.

I’m on the East Coast for the rest of the current fire season in California. Which is cool, literally. I miss Santa Barbara, but not the fear of destruction (which I generally don’t have there, but I need my rationalizations). Speaking of which, here’s The Mania of Owning Things, my EOF column for August 2009 issue of Linux Journal. I wrote it during the Jesusita Fire, the second fire-bullet we dodged this year.

The column title refers to the last line of this bit of Whitman:

I think I could turn and live awhile with the animals.
They are so placid and self-contained.
I stand and look at them sometimes half the day long.
They do not sweat and whine about their condition.
They do not lie awake in the dark and weep for their sins.
Not one is dissatisfied.
Not one is demented with the mania of owning things.

(For some reason most of those lines didn’t make it into the published piece. So, when you look at it, bear in mind that the top text is part of Whitman and none of me.) Some exerpts (from me, not Whitman):

Ambition and industry in the face of inevitable destruction is the job of life…

I believe in ownership—not for economic reasons, but because possession is 9/10ths of the three-year-old. We are all still toddlers in more ways than we’d like to admit—especially when it comes to possessions.

We are grabby animals. We like to own stuff—or at least control it. Where would a three-year-old be without the first-person possessive pronoun? No response is more human than “Mine!” And yet possessions are also burdens. I have a friend whose childhood home was burned twice by the same nutcase. He’s one of the sanest people I know. I can’t say it’s because he has been relieved of archives and other non-negotiables, but it makes a kind of sense to me. I have tons of that stuff, and I’ve thought lately about what it would mean if suddenly they were all cremated. Would that really be all bad? What I’d miss most are old photos that haven’t been scanned and writing that hasn’t been digitized in some way. But is my digital stuff all that safe either?…

I’ve just started backing (it) up “in the cloud”. But how safe is that? Or secure? Companies are temporary. Servers are temporary. Hell, everything is temporary.

When I was young, I acknowledged death as part of the cycle of life. Now I think it’s the other way around. Life is part of the cycle of death. Life generates fuel for death. It’s a carbon-based refinery for lots of interesting and helpful stuff.

Think about it. Marble. Limestone. Travertine. Oil. Gas. Coal. Wood. Linoleum. Cement. Paint. Plastics. Paper. Asphalt. Textiles. Medicines. Even the heat used to smelt iron and shape glass comes mostly from burning fossil fuel. The moon has abundant aluminum ores. But how would you produce the heat required for extraction, or do anything without the combustive assistance of oxygen? Ninety-eight percent of the oxygen in Earth’s atmosphere is produced by plants. Most of the sources are now dead, their energies devoted to post-living purposes.

The Internet grows by an odd noospheric process: duplication. In “Better Than Free”, Kevin Kelly makes an observation so profound and obvious that you can’t shake it once it sinks in: “The Internet is a copy machine.” As a result, the Net is turning into what Bob Frankston calls a “sea of bits”. This too is an ecosystem of sorts. Is it, like Earth’s ecosystem, a way that death makes use of life? I wonder about that too.

Anyway, the rest is here.

The United States Geological Survey (USGS) has an excellent Earthquake Center for all the earthquakes in the world, which is very handy at a time when many are happening at once, followed in some cases by tsunamis that cross seas to strike coastlines minutes to hours later.

For example, this list of earthquakes of magnitude 5 and greater shows in red both the 8.0 quake that caused tsunamis in the South Pacific, and the 7.6 quake that devastated western Sumatra and also poses a serious tsunami risk — both just in the last few hours. Tonga alone has seen thirteen aftershocks of 5.0 or greater. The Samoa Islands Region has seen twelve.

Bear in mind that the Loma Prieta Quake in 1989 was around a 7.0, and 5.0 earthquakes have caused thousands of deaths as well.

Most of us are great distances from both regions that were just hit, but we are still in position to help. One way is by getting facts straight, and also to keep fail whales from falling on lines that are bound to be congested. Hope this little bit of pointage helps.

Over in Fast Company, Tim Beyers nicely threads quotable pearls from Cluetrain’s four authors, including yours truly, in Twitter’s Investors Missed the Cluetrain – Here’s Why. The context of the story is continued investment in Twitter at a reported $1 billion valuation of the company. (Fast indeed.)

Now that the piece is up, I thought I’d add a few more thoughts of my own.

First, while valuation is unavoidably interesting, value is avoidably important. In other words, it doesn’t get much respect. Not if it’s not being sold.

For example, RSS (currently getting more than 3 billion results on Google). It’s extremely useful. We would hardly have blogging or online journalism without it. But Dave Winer, to his enormous credit, decided not to make RSS itself a business. Instead he decided to release it into the world so countless uses could be made of it, and countless businesses could be built on top of those uses. He made RSS open infrastructure, just as Linus Torvalds did with Linux, and countless other geeks have done with their own contributions to the virtual lumberyard of free building material we use to make the online world. Open building material is valuable beyond calculation, because it has use value rather than sale value. (Eric Raymond explains the difference here.) The leverage of use value on sale value can be very high indeed. Where would Google and Amazon be without Linux and Apache? Where would any of us be without SMTP, IMAP and other email protocols — or, for that matter, the suite of free and open protocols on which the Net itself runs?

Twitter’s creators have chosen to make it a commercial form of infrastructure. This is not a bad thing. In terms of investment valuation (especially at this point in time) it’s a smart thing. But we should not mistake Twitter itself, or even its API, for the kind of true (free and open) infrastructure that comprise the Net and the Web. Nor, for that matter, should we consider Twitter the last word in the category it pioneered and now dominates. At this point in history, Twitter soaks up nearly all the oxygen the microblogging room. Thus there is no widely adopted open infrastructure for microblogging. (Identi.ca and the OpenMicroBlogger folks have worked hard on that, but adoption so far is relatively small.)

But, given time, something will take. I’d place a bet Dave’s RSS Cloud. It’s live, or real-time. It’s open infrastructure. And, as Dave put it here, it has no fail whale. (And now TechCrunch is Cloud-enabled.)

This relates to Cluetrain in respect to what a market is, and what a market does. Markets by nature are open. They are not “your choice of captor.” Cluetrain, at least for me, was a brief against captors, a case for open marketplaces. So, while Twitter may provide means for conversation out the wazoo, it still falls short of what are, for me, more important Cluetrain ideals. I await the fulfillment of those with growing patience.

If you had told me in 1999 that the two hottest names on the Web in 2009 — Facebook and Twitter — would both be silos, I’d have been disappointed. I’d have figured that by now most folks would understand the infrastructural nature of open code, open protocols, open formats. (For more on those expectations, see Making a New World, written a few years back but still relevant as ever.)

With time comes perspective. It is helpful to note that the Web as we know it is barely old enough for high school. (The first popular browser appeared in 1995.) As an environment supporting new forms of business life — ones thriving in an environment of ubiquitous and cheap worldwide connectivity that each participant is in a position to improve — we are at a paleozoic stage in which even the innovative companies continue to follow familiar industrial age models of command and control. That’s why they trap users, customers and whole markets in walled gardens that are value-subtracted simulacra of the whole Net. In the best cases (such as Twitter’s, Facebook’s and Apple’s) they create new markets around new inventions and new ways of doing things, but at the expense of isolation for themselves and all their walled-in dependents. So, even when they embrace (though never completely) openness and other forms of goodness at the engineering level, they remain Old Skool at the corporate level where equally Old Skool investors still place their bets. And, while they speed things up in the early stages — when they are still new and original — they slow things down after their walled markets become large enough to become industrial farms, harvesting income from trapped inhabitants.

The longer that walled farming remains a prevailing business practice, the longer the Industrial Age persists in the midst of the one that succeeds it, and the farther we are from arriving at the Net’s mesozoic: it’s dinoaur age. That age will be characterized, as it was for sentient reptiles, by greater liberty for individuals and greater autonomy for families, tribes and other groups of individuals.

Many of us have long seen that liberation coming — and implicit in the nature of the Net itself. The Cluetrain Manifesto announced it in early 1999 with “we are not seats or eyeballs or end users or consumers. we are human beings and our reach exceeds your grasp. deal with it.” Chris Locke wrote that, and it galvanized the rest of us by giving voice to the liberating nature of the Net itself. Yes, the Net supports silos, but it is not itself a silo. It provides a base infrastructure for freedom, independence and empowerment. It creates wide open spaces for the social and business constructions we call markets. True, the urge by companies to build walled gardens in these wide open spaces persists undiminished. But in time companies will discover how much more value can be created by contributing to open infrastructure, and by offering original products and services based on that infrastructure, than by trapping customers in closed spaces and operating their own private marketplaces. (As, for example, Apple does with its iTunes store, and other phone makers and companies are now copying. This is very paleozoic stuff.)

We are now caught up in “social” everything. Cluetrain’s opening thesis, “markets are conversations,” is often credited for predicting, if not inaugurating, the “social web”. Overlooked in the midst, however, is what I think is a far more important thesis, coined by David Weinberger: “Hyperlinks subvert hierarchy“. Ask yourself, How well do links work in Twitter? Better question: What happens when bit.ly goes down — or out of business? URL shortening needs to be part of the Net’s infrastructure too. Today it isn’t. For more on that, look up Dave Winer and URL shortening: Dave has a history of not being listened to by Google, Twitter and other giants. But he’s right about URL shortening. And about how Twitter can help de-silo it. Single-source commercial URL shorteners are handy and all, but they weaken hyperlinks by making them vulnerable to the failure of one company, or one authority. I am sure Twitter doesn’t mean to weaken hyperlinks (but rather strengthen them, in a way), but that’s what it does by relying on a commercial silo for shortened links. Weakening hyperlinks, at least to me, makes Twitter less valuable, no matter how much investors think it’s worth on some future stock market.

Dave Winer has long advised, “Ask not what the Web can do for you, ask what you can do for the Web”. Answering that generously in the long run will result in maximum value — and valuations in alignment with a more open and value-producing future.

Just arrived at my house in Santa Barbara after a long drive down from Monterey. Most of the way I listened to live coverage of the Station Fire on KNX/1070, both through the car radio (KNX has a huge signal that covers the whole southwest at night) and online over my iPhone, which was plugged into the AUX input of the radio in my rented Ford Focus (not a bad car, by the way).

Here’s KNX’s latest story, with a map.

Here is a set of mashed-up fire maps I just created, courtesy of MODIS and the U.S. Forest Service and Google Earth.

On the Live Web…

• Here are twitter searches for #stationfire and Station Fire.
• Here are Google Blogsearch and Technorati searches for “Station Fire.
• Here are Flickr photos of “stationfire”.
• LATimes on California Wildfires.
• Station Fire on Facebook.

Lots of grist for (and from) the news mills there.

Among other directions, the fire is moving eastward across Mt. Wilson, which looms over Los Angeles from just north of Pasadena. Mt. Wilson is one among many points along the nearest ridge of the San Gabriel Mountains, most of which lie within the Angeles National Forest. Perhaps more significantly, it is the home to nearly all the transmitters of FM and TV stations serving the Los Angeles metro. Also Mt. Wilson Observatory.

Reports say that firefighters (two of which have died so far) are doing their best to protect the Mt. Wilson facilities, but I wonder how long they’ll stay before driving back down. The only road out to the north is the long and winding Angeles Crest Highway — which is closed and may already be burned — and Mt. Wilson Road itself, which goes west through areas colored in the map above. The LATimes says the firefighters will stay there “no matter what”.

I’ve been to Mt. Wilson a number of times, and have often shot it from the air as well. These now comprise “before” pictures of the mountain.

Here is a Bing “birds eye” view of one section of the top of Mt. Wilson. This shot shows the observatory.

This Google Map shows the parking area where I assume firefighting equipment can keep away from advancing fire.

For what little it’s worth, the five zillion channels I get on my Dish Network TV system have nothing I can find on the fire. The locals here in Santa Barbara are running network shows. CNN and HLN are covering two dead guys. CNN has Larry King interviewing Ted Kennedy, and HLN has junk news coverage of Michael Jackson’s creepy autopsy results. As a news environment, TV is a slo-mo suicide victim.

Christopher Musico, writing in the Destination CRM Blog: “According to a new study by research firm Pear Analytics, less than one in ten tweets have any real ‘pass-along value’,as more than 40 percent of tweets are ‘pointless babble.’”

I look forward to seeing more when the whole study is published (here, Christopher says). Meanwhile it’s important to point out that nobody follows everybody (which I assume is what Pear Analytics did). Nor does everybody write for everybody. Or even anybody.

Most of the people I follow write stuff that has pass-along value. And I don’t post anything unless I think it has pass-along value as well.

What I’d like to see is a study probing that value. How many followers blog rather than re-tweet, for example? That’s what I’m doing here. So, rather than just re-tweeting this — GoodCRMQuality or Quantity: Twitter Edition, Part 2 | CRM Magazine Blog: New research finds pointless babble makes up t.. http://bit.ly/1gO6Y — I’m blogging about it.

Think of blogging vs. re-tweeting as digestion vs. bulemia. And I say that as a guy who tosses up plenty of chunks myself.

I love this:

… and I hope the good (or evil, depending on your perspective) folks at Despair.com don’t mind my promoting their best t-shirt yet. (If it helps, I just ordered one.)

You’ll notice that blogging isn’t in the diagram (though Despair does feature it in four other purchasable forms). I bring that up because I think there is a difference between the social media in the Venn diagram and blogging, and that difference is akin to that between weather and geology.  The former have an evanescent quality. I’m still haunted by hearing that users get a maximum number Twitter postings (tweets) before the old ones scroll off. If true, it means Twitter is a whiteboard, made to be erased after awhile. The fact that few know what the deal is, exactly, also makes my point. Not many people expect anybody, including themselves, to revisit old tweets. The four names in the diagram above are also private corporate walled gardens. Blogging itself is not. True, you can blog in a corporate walled garden, but blogging is an independent category. You can move your blog from one platform to another, archives intact. Not easy, but it can be done. More importantly, your blog is yours. That’s why I dig Dave’s Scoble, your blog still loves you post. And why in the comments I said,

FriendFeeds and Facebooks and Microsofts will come and and go. They can be bought and sold, because they’re not human. Robert is human. Companies can’t be charming and lovable. They can, sometimes, for awhile. Ben & Jerrys did. Zappos did. But they got sold. You know, like slaves.

The only publication on Earth that’s all Robert’s is his blog. That’s where his soul is, because he can’t sell it.

It was while pondering the difference between social media and blogging that I posted this tweet today:

Thanks, @dnm54 But I still feel like my posts lately have the impact of snow on water. Too wordy? Not tweety enough? Not sure.

That got some reassuring responses, several playing with the snow-and-water metaphor. That’s one I’ve used often ever since first hearing “Big Ted”, by the Incredble String Band (from their Changing Horses album), played by the great Larry Josephson on his morning show on WBAI, back in the earliest 70s. “Big Ted” was a dead horse, about which the band sang, “He’s gone like snow on the water. Good bye-eeee.”

For a long time I harbored a fantasy about writing a history of radio, titled “Snow on the Water,” because that was its self-erasing quality. It was like unrecorded conversation that way. You get meaning from it, but you don’t remember everything verbatim, for such is the nature of short-term memory. Eight seconds later you might remember what somebody said, but not exactly. Tomorrow you might remember nothing more than having talked to the person.

Now I’m thinking “snow on the water” applies to social media as well. They’re conversational in the literal sense. They’re weather within which tweets fly and fall like flakes, and disappear into the collective unconscious.

On the other hand, blogging is geology. A blog’s posts may be current and timely, and constitute one person’s contribution to conversation around a subject or two, but each post is built to last. It has a “permalink”. Over time posts accumulate like soil deposits. You can dig down through layers of time and find them. What do tweets have? Temp-o-links?

From the beginning I’ve thought of blogging as journalism in the literal sense: Blogs are journals. Yet much of traditional journalism seems to have, on the whole, not much respect for its archives on the Web. Editorial “content” scrolls behind paywalls, doesn’t keep durable URLs, or disappears completely.

Which brings me to this comment by Tom Matrullo, left under this post about advertising. It’s way too deep to leave buried there:

There is no question that advertising requires us to be in the here and now, and not in the there and then, because it seeks to influence our desires and actions. Active repression of time, history, the past is basic to most commerce and commercial speech.

But I’d go further, because this is a large and important topic. Broadcast itself as a medium tends to put the past at a distance, even when it is about the past, because it makes it into spectacle. Something we watch from our NOW, the big now of advertising and current media.

And yet further: no media are more dis-attuned to the past than news media. It is all about the next story. That one last week that was entirely wrong? Ancient history. To be current, in news-speak, is to develop a sort of targeted Alzheimer’s in a certain direction.

Maybe this is one reason why the news media — on the whole, seems to me — have embraced social media of the temporary sort while continuing to put down blogging. Yes, they’ll set up blogs for their writers, but there’s often a second-class quality to those blogs, and the blogs willl get erased after the writer leaves — or even while the writer is still there. Dan Gillmor’s blog at the San Jose Mercury-News disappeared a number of times. Now it’s gone permanently. Dan’s columns are there, if you’re willing to pay $2.95 apiece for them.

It still blows my mind that, on the Web, newspapers give away the news but charge for the olds. Why not charge for the news and give away the olds? That would be in alignment with what they do with the physical paper. People will pay a buck for today’s paper, and nothing for one three days old. In the physical world, old papers are for wrapping fish and house-breaking puppies. If papers gave every old story a true permalink, search engines would find them, could sell advertising on them, and progressively elevate the whole paper’s authority.

I think they don’t do it for two reasons. One is that they’ve always charged for access to “the morgue.” Another is that embalming old papers has always been expensive. For many decades they bound them up like books for storage in libraries. I still have three of these, each for a whole week of New York Times papers from the ’50s and ’60s. The library at the University of North Carolina in Chapel Hill sent them out for recycling in 1975. The whole huge pile was rescued by buddies of mine who ran the recycling operation. The newspaper and the library at the time were modernizing by putting everything on microfilm. At the “Will Newspapers Survive” forum at MIT a couple years ago, I asked the panel (which included Dan Gillmor) about why papers charge for the olds and give away the news. Ellen Foley of the Wisconsin State Joural replied,

Speaking for the nation’s regional papers, one of our biggest problems is that today’s issues are all on microfilm tomorrow, not online. It would cost more than a million dollars to digitize our archives. It’s hard for me to make this argument to our publisher, who is trying to make money and make ends meet.

It’s not in the transcript, but I recall her adding something about how storing archives on disk drives was also expensive. That didn’t sit well with the audience, which knew better.

Anyway, my point is that, on the whole news organizations don’t care much about the past. They care about the present. I think social media tend to do the same thing. I’m not saying this is a bad thing. Nor am I trying to elevate blogging into the Pulitzer sphere. (But hey, why not?)  I’m just trying to get my head around What’s Going On.

Here’s my thinking for now. What I write on blogs isn’t just for the short term. I also have the long term in mind. I’m making geology, not weather. Both have their places. The more durable stuff goes here.

Bonus link.

[Later...] Joe Andrieu has a thoughtful response.

Kevin Marks in The Flow Past Web: even better than the RealTime thing:

Much of the supposed ‘Real-Time’ web is enabled by the relaxation of realtime constraints in favour of the ‘eventually consistent’ model of data propagation. Google Wave, for example, enables simultaneous editing by relaxing the ‘one person can edit at a time’ rule in favour of reconciling simultaneous edits smoothly.

He makes some other good points, such as the changes in the flow speeds of various media types and communicating methods:

At the same time, the latency of text has been moving the other way, from newspapers’ and mail’s daily cycles, to hours for webpages, minutes for blogs down to seconds for SMS, Twitter, Facebook and other activity streams. However, as audio and video have added persistence, text hasn’t lost it – we do have the ability to review and catch up with the past of our flows, or to re-point people to older points in time, as well as marking out times in the future.

Meanwhile I still prefer the “live web”. I think that’s more how it feels, how it seems to the user. I’m a voice in the wilderness on that one, but what the hell. I’ll keep trying.

In Curation, meta-curation, and live Net radio, Jon Udell begins, “I’ve long been dissatisfied with how we discover and tune into Net radio”, but doesn’t complain about it. He hacks some solutions. First he swaps time for place:

I’ve just created a new mode for the elmcity calendar aggregator. Now instead of creating a geographical hub, which combines events from Eventful and Upcoming and events from a list of iCalendar feeds — all for one location — you can create a topical hub whose events are governed only by time, not by location.

Then he works on curation:

I spun up a new topical hub in the elmcity aggregator and started experimenting.

That ran into problems from sources. Still it was…

…great for personal use. But I’m looking for the Webjay of Net radio. And I think maybe elmcity topical hubs can help enable that.

So Jon leverages what Tony Karrer described in Second Calendar Curator Joins to Help with List of Free Webinars, and adds,

What Tony showed me is that you can also (optionally) think in terms of meta-curators, curators, feeds, and events. In this example, Tony is himself a curator, but he is also a meta-curator — that is, a collector of curators.

I’d love to see this model evolve in the realm of Net radio. If you want to join the experiment, just use any calendar program to keep track of some of your favorite recurring shows. (Again, it’s very helpful to use one that supports per-event timezones.) Then publish the shows as an iCalendar feed, and send me the URL. As the meta-curator of delicious.com/InternetRadio, as well as the curator of jonu.calendar.live.com/calendar/InternetRadio/index.html, I’ll have two options. If I like most or all of the shows you like, I can add your feed to the hub. If I only like some of the shows you like, I can cherrypick them for my feed. Either way, the aggregated results will be available as XML, as JSON, and as an iCalendar feed that can flow into calendar clients or aggregators.

Naturally there can also be other meta-curators. To become one, designate a Delicious account for the purpose, spin up your own topical hub, and tell me about it.

I really like Jon’s idea. Sometime this weekend I’ll set up what he’s talking abouthere. Or try. I’ve always found Delicious a little too labor-intensive, but then blogging in Wordpress’ writing window (as I’m doing now) is a PITA too. (One of these days I’ll get my outliner working again. That’s so much easier for me.)

The new radio dial is a combination of tools and each other’s heads. Given how the Net has eliminated distance as a factor in”reception” (a rapidly antiquifying term), the new frontier is time — how we find it. Or, in radio parlance, how we tune across it to find what we want, and then listen live or off stored files, either in our own devices (podcasting) or in the cloud (on-demand).

As we develop whatever this becomes, we need to avoid the usual traps. For example, there is this tendency for developers — commercial ones, anyway — to believe that the only available paths are –

1. Making a commodity
2. Trapping the user

So they do the latter. That’s why we get stuff like the iTunes store, which works with only one brand of mobile devices (Apple’s), and which nearly every other phone maker now, derivatively, wants to copy. (iTunes’ radio tuner, which is nothing more than a directory, works with nothing but itself, near as I can tell. As with most of the iTunes environment, it veers far from Apple’s reputation for ease of use — in addition to being exclusive and non-interoperable.)

What Jon’s doing here is one more among many necessary steps by which control of the marketplace shifts from user-trappers to users themselves.

Speaking of which, there is plenty of user input to the new, improved, and still-improving UI on the Public Radio Player, which now finds programs as well as stations. So, for example, I’m going to be on The Conversation with Ross Reynolds today on KUOW in Seattle, taking about the new 10th Anniversary edition of The Cluetrain Manifesto. The show starts at noon (though my segment comes in a bit later). When I looked up “conversation” on the Player, I found Rick’s show in the list results, and went right there. This goes a long way beyond tuning the way it used to be. But it still has a long way to go.

We’ll get us there.

I dunno why the New York Times appeared on my doorstep this morning, along with our usual Boston Globe (Sox lost, plus other news) — while our Wall Street Journal did not. (Was it a promo? There was no response envelope or anything. And none of the neighbors gets a paper at all, so it wasn’t a stray, I’m pretty sure.) Anyway, while I was paging through the Times over breakfast, I was thinking, “It’s good, but I’m not missing much here–” when I hit Hot Story to Has-Been: Tracking News via Cyberspace, by Patricia Cohen, on the front page of the Arts section. It’s about MediaCloud, a Berkman Center project, and features quotage from Ethan Zuckerman and Yochai Benkler…

(pictured above at last year’s Berkman@10).

The home page of MediaCloud explains,

The Internet is fundamentally altering the way that news is produced and distributed, but there are few comprehensive approaches to understanding the nature of these changes. Media Cloud automatically builds an archive of news stories and blog posts from the web, applies language processing, and gives you ways to analyze and visualize the data.

This is a cool thing. It also raises the same question that is asked far too often in other contexts: Why doesn’t Google do that? Here’s the short answer: Because the money’s not there. For Google, the money is in advertising.

Plain enough, but let’s go deeper.

It’s an interesting fact that Google’s index covers the present, but not the past. When somebody updates their home page, Google doesn’t remember the old one, except in cache, which gets wiped out after a period of time. It doesn’t remember the one before that, or the one before that. If it did it might look, at least conceptually, like Apple’s Time Machine:

If Google were a time machine, you could not only see what happened in the past, but do research against it. You could search for what’s changed. Not on Google’s terms, as you can, say, with Google Trends, but on your own, with an infinite variety of queries.

I don’t know if Google archives everything. I suspect not. I think they archive search and traffic histories (or they wouldn’t be able to do stuff like this), and other metadata. (Mabye a Googler can fill us in here.)

I do know that Technorati keeps (or used to keep) an archive of all blogs (or everything with an RSS feed). This was made possible by the nature of blogging, which is part of the Live Web. It comes time-stamped, and with the assumption that past posts will accumulate in a self-archiving way. Every blog has a virtual directory path that goes domainname/year/month/day/post. Stuff on the Static Web of sites (a real estate term) were self-replacing and didn’t keep archives on the Web. Not by design, anyway.

I used to be on the Technorati advisory board and talked with the company quite a bit about what to do with those archives. I thought there should be money to be found through making them searchable in some way, but I never got anywhere with that.

If there isn’t an advertising play, or a traffic-attraction play (same thing in most cases), what’s the point? So goes the common thinking about site monetization. And Google is in the middle of that.

So this got me to thinking about research vs. advertising.

If research wants to look back through time (and usually it does), it needs data from the past. That means the past has to be kept as a source. This is what MediaCloud does. For research on news topics, it does one of the may things I had hoped Technorati would do.

Advertising cares only about the future. It wants you to buy something, or to know about something so you can act on it at some future time.

So, while research’s time scope tends to start in present and look back, advertising’s time scope tends to start in the present and look forward.

To be fair, I commend Google for all the stuff it does that is not advertising-related or -supported, and it’s plenty. And I commend Technorati for keeping archives, just in case some business model does finally show up.

But in the meantime I’m also wondering if advertising doesn’t have some influence on our sense of how much the past matters. And my preliminary response is, Yes, it does. It’s an accessory to forgetfulness. (Except, of course, to the degree it drives us to remember — through “branding” and other techniques — the name of a company or product.)

Just something to think about. And maybe research as well. If you can find the data.

In his comment to my last post about the sale of WQXR to WNYC (and in his own blog post here), Sean Reiser makes an important point:

One of the unique things about the QXR was it’s relationship with the Times. The Times owned QXR before the FCC regulations prohibiting newspapers ownership of a radio station were enacted. Because of this relationship, QXR’s newsroom was located in the NY Times building and news gathering resources were shared. In a precursor to newspaper reporters doing podcasts, Times columnists and arts reporters would often appear on the air doing segments.

It’s true. The Times selling WQXR seems a bit like the New Yorker dropping poetry, or GE (née RCA) closing the Rainbow Room. (Which has already happened… how many times?) To cultured veteran New Yorkers, the Times selling WQXR seems more like a partial lobotomy than a heavy heirloom being thrown off a sinking ship.

For much of the history of both, great newspapers owned great radio stations. The Times had WQXR. The Chicago Tribune had (and still has) WGN (yes, “World’s Greatest Newspaper”). The Washington Post had WTOP. (In fact, the Post got back into the radio game with Washington Post Radio, on WTOP’s legacy 50,000-watt signal at 1500 AM. That lasted from 2006-2008.). Trust me, the list is long.

The problem is, both newspapers and radio stations are suffering. Most newspapers are partially (or, in a few cases — such as this one — totally) lobotomized versions of their former selves. Commercial radio’s golden age passed decades ago. WQXR, its beloved classical format, and its staff, have been on life support for years. Most other cities have lost their legacy commercial classical stations (e.g. WFMR in Milwaukee), or lucked out to various degrees when the call letters and formats were saved by moving to lesser signals, sometimes on the market’s outskirts (e.g. WCRB in Boston). In most of the best cases classical formats were saved by moving to noncommercial channels and becomimg public radio stations. In Los Angeles, KUSC took over for KFAC (grabbing the latter’s record library) and KOGO/K-Mozart. In Raleigh, WCPE took over for WUNC and WDBS. In Washington, WETA took over for WGMS. Not all of these moves were pretty, but all of them kept classical music alive on their cities’ FM bands.

In some cases, however, “saved’ is an understatement. KUSC, for example, has a bigger signal footprint and far more to offer, than KFAC and its commercial successors did. In addition to a first-rate signal in Los Angeles, KUSC is carried on full-size stations in Palm Springs, Thousand Oaks, Santa Barbara and San Luis Obispo — giving it stong coverage of more population than any other station in Los Angeles, including the city’s substantial AM stations. KUSC also runs HD programs on the same channels, has an excellent live stream on the Web, and is highly involved in Southern California’s cultural life.

I bring that up because the substantial advantages of public radio over commercial radio — especially for classical music — are largely ignored amidst all the hand-wringing (thick with completely wrong assumptions) by those who lament the loss  — or threatened loss — of a cultural landmark such as WQXR. So I thought I’d list some of the advantages of public radio in the classical music game.

1. No commercials. Sure, public radio has its pitches for funding, but those tend to be during fund drives rather than between every music set.
2. More room for coverage growth. The rules for signals in the noncommercial end of the band (from 88 to 92) are far more flexible than those in the commercial band. And noncommercial signals in the commercial band (such as WQXR’s new one at 105.9) can much more easily be augmented by translators at the fringes of their coverage areas — and beyond. Commercial stations can only use translators within their coverage areas. Noncommercial stations can stick them anywhere in the whole country. If WNYC wants to be aggressive about it, you might end up hearing WQXR in Maine and Montana. (And you can bet it’ll be on the Public Radio Player, meaning you can get it wherever there’s a cell signal.)
3. Life in a buyer’s market. Noncommercial radio stations are taking advantage of bargain prices for commercial stations. That’s what KUSC did when it bought what’s now KESC on 99.7FM in San Luis Obispo. It’s what KCLU did when it bought 1340AM in Santa Barbara.
4. Creative and resourceful engineering. While commercial radio continues to cheap out while advertising revenues slump away, noncommercial radio is pioneering all over the place. They’re doing it with HD Radio, with webcasting (including multiple streams for many stations), with boosters and translators, with RDS — to name just a few. This is why I have no doubt that WNYC will expand WQXR’s reach even if they can’t crank up the power on the Empire State Building transmitter.
5. Direct Listener Involvement. Commercial radio has had a huge disadvantage for the duration: its customers and its consumers are different populations. As businesses, commercial radio stations are primarily accountable to advertisers, not to listeners. Public radio is directly accoutable to its listeners, because those are also its customers. As public stations make greater use of the Web, and of the growing roster of tools available for listener engagement (including tools on the listeners’ side, such as those we are developing at ProjectVRM), this advantage over commercial radio will only grow. This means WQXR’s listeners have more more opportunity to contribute positively to the station’s growth than they ever had when it was a commercial station. (Or if, like WCRB, it lived on as a lesser commercial station.) So, if you’re a loyal WQXR listener, send a few bucks to WNYC. Tell them thanks for saving the station, and tell them what you’d like them to do with the station as well.

I could add more points (and maybe I will later), but that should suffice for now. I need to crash and then get up early for a quick round trip to northern Vermont this morning. Meanwhile, hope that helps.

This twitter post, from @KNX1070 four minutes ago, says Michael Jackson is dead. Google News‘ latest, from Fox, says he’s being rushed to the hospital. Here’s the latest Google search, as of 3:42pm Pacific:

A snapshot in time, already changed. (FWIW, the KNX item came up the first time I searched, but not this time. The System That Isn’t, isn’t perfect.) The Twitter results up top are courtesy of a Greasemonkey script.

It is here that we see manifest the split between the Live Web and the Static Web.

I’ve been writing and talking about this split since my son Allen first mentioned the term in 2003.* He saw the World Live Web then as an absence, as unstarted business. Google searched the Static Web of sites and domains that were architected, designed and built like real estate projects. The Live Web would be more alive and human. In it machines wouldn’t answer your questions now. People would.

Now the Live Web is here, big-time. Or, as current parlance would have it, real-time.

I still prefer “live”. Can you imagine if NBC had called its top weekend show “Saturday Night Real-Time”? Or if they announced, “Real time, from New York..”?

Live is better.

If Michael Jackson were still with us, I’m sure he’d agree.

* Here’s the same link: http://www.google.com/search?hl=en&q… . I’m not sure why, but Wordpress isn’t letting me get that link in there. I post the html, find no links in the results, and then when editing find the linked term flanked by partial the letter “a” in angle brackets, sans the slash that closes a link. Not sure what’s up with that. Maybe my tortuously broken connection. Anyway, I have more to add, but won’t bother. Plenty of other reading on the Web anyway. Rock on.