The only bad thing that happened on the trip was a crash on my laptop that trashed my email and some other files. One result is that much of the email sent to my Berkman address  cyber.law.harvard.edu) since late Monday was lost. (Glad I back up almost constantly here at home. I do offsite as well, but lacked the connectivity speed during the trip to fix the problem.)

So if you sent me any email that mattered during that time, please send it again. Thanks.

Or at least bear with that thought through Defrag, which takes place in Denver over today and Thursday, and for which the word “social” appears seventeen times in the agenda. (Perspective: “cloud” appears three times, and “leverage” twice.)

What prompts the crock metaphor is this survey, to which I was pointed by this tweet from Howard Rheingold. (I don’t know if the survey is by students of Howard’s Digital Journalism Workspace class, though I assume so.)

While the survey is fine for its purposes (mostly probing Twitter-based social media marketing) and I don’t mean to give it a hard time, it does a nice job at bringing up a framing issue for social media that has bothered me for some time. You can see it in the survey’s first two questions: What Social Media platforms do you use? and How often are you on social media sites?

The frame here is real estate. Or, more precisely, private real estate. Later questions in the survey assume is that social media is something that happens on private platforms, Twitter in particular. This is a legitimate assumption, of course, and that’s why I have a problem with it. That tweeting it is a private breed of microblogging verges on irrelevance. Twitter is now as necessary to tweeting as Google is to search. It’s a public activity under private control.

Missing in action is credit to what goes below private platforms like Twitter, MySpace and Facebook — namely the Net, the Web, and the growing portfolio of standards that comprise the deep infrastructure, the geology, that makes social media (and everything else they support) possible.

Look at four other social things you can do on the Net (along with the standards and protocols that support them): email (SMTP, POP3, IMAP, MIME); blogging (HTTP, XML, RSS, Atom); podcasting (RSS); and instant messaging (IRC, XMPP, SIP/SIMPLE). Unlike private social media platforms, these are NEA: Nobody owns them, Everybody can use them and Anybody can improve them. That’s what makes them infrastructural and generative. (Even in cases where protocols were owned, such as by Dave Winer with RSS, efforts were made to remove ownership as an issue.)

Tweeting today is in many ways like instant messaging was when the only way you could do it was with AOL, Microsoft, Yahoo, Apple and ICQ. All were silos, with little if any interoperabiity. Some still are. Check out this list of instant messaging protocols. It’s a mess. That’s because so many of the commonly-used platforms of ten years ago are still, in 2009, private silos. There’s a degree of interoperability, thanks mostly to Google’s adoption of XMPP (aka Jabber) as an IM protocol (Apple and Facebook have too). But it’s going slow because AOL, MSN and Yahoo remain isolated in their own silos. Or, as Walt Whitman put it, “demented with the mania of owning things”. With tweeting we do have interop, and that’s why tweeting has taken off while IM stays stagnant. But we don’t have NEA with Twitter, and that’s why tweeting is starting to stagnate, and developers like Dave are working on getting past it.

Here’s my other problem with “social media” as it shows up in too many of the 103 million results it currently brings up on Google: as a concept (if not as a practice) it subordinates the personal.

Computers are personal now. So are phones. So, fundamentally, is everything each of us does. It took decades to pry computing out of central control and make it personal. We’re in the middle of doing the same with telephony — and everything else we can do on a hand-held device.

Personal and social go hand-in-hand, but the latter builds on the former.

Today in the digital world we still have very few personal tools that work only for us, are under personal control, are NEA, and are not provided as a grace of some company or other. (If you can only get it from somebody site, it ain’t personal.) That’s why I bring up email, blogging, podcasting and instant messaging. Yes, there are plenty of impersonal services involved in all of them, but those services don’t own the category. We can swap them out. They are, as the economists say, substitutable.

But we’re not looking at the personal frontier because the social one gets all the attention — and the investment money as well.

Markets are built on the individuals we call customers. They’re where the ideas, the conversations, the intentions (to buy, to converse, to relate) and the money all start. Each of us, as individuals, are the natural points of integration of our own data — and of origination about what gets done with it.

Individually-empowered customers are the ultimate greenfield for business and culture. Starting with the social keeps us from working on empowering individuals natively. That most of the social action is in silos and pipes of hot and/or giant companies slows things down even more. They may look impressive now, but they are a drag on the future.

Defrag wraps tomorrow with a joint keynote titled “Cluetrain at 10″. On stage will be JP Rangaswami, Chris Locke, Rick Levine and yours truly, representing four out of the seven contributors to the new 10th Anniversary Edition of The Cluetrain Manifesto. We don’t have plans for the panel yet, but I want it to be personal as well as social, and a conversation with the rest of the crowd there. Among other things I want to probe what we’re not doing because “social” everything is such a bubble of buzz right now.

See some of ya there. And the rest of you on the backchannels.

So I just went to look up Debora Spar’s Ruling the Waves, on Amazon, and was greeted by the above. Never mind that I wasn’t looking for what they said I just looked at. Consider instead the strangeness of having something with my name on it, as an author, and that I can reasonably be presumed to own recommended to me as a purchase. (As it happens I also own the third item. Dunno if I bought it from Amazon or not.)

For what it’s worth, can I find anywhere in my Amazon account info a place where I can let them know I’m an author and not just a customer.

Am I wrong about that? Is there a way I can let them know that? Is it worthwhile to either of us?

Neither has a picture, either. I just checked my own 31,000-shot gallery, and didn’t find either one. I did find the great Phil Moore, however. Like I said at that link, one of my heroes.

It’s really wierd. While “real time” is heating up as a topic, real time search seems to have fallen off the radar of everybody other than itself.

Take this piece by Marshall Kirkpatrick in ReadWriteWeb. It begins, Web search, real-time search and social search. That’s a pretty compelling combination and it’s what both Google and Facebook put on the table today in a head-to-head competiton. Then it compares Google, Facebook and Bing at all three, in a chart.

Hey, why not the search engines that have been looking at real time for the duration? Here’s IceRocket on real time search as a string. You get blogs, Twitter, video, news and images. Fast, simple, uncomplicated, straightforward. Like a search engine ought to be.

Here’s the IceRocket trend line for “real time search”. And here’s the BlogScope trend line for “blogging”.

Earth to buzz: You’re obsessing on the wrong thing. “Real time search” isn’t just Twitter and Facebook. It’s blog search too. Always was.

Syndication and real time will matter long after “social” goes passé. (And “social” will matter long after the next buzzthing goes passé.)

For whatever reasons, Google and Bing don’t get it. There are better tools out there for Live Web search. Check ‘em out.

Bonus graph.

So many gone things once looked like final stages: AM radio, nuclear bombs, FM, stereo, FM stereo, TV, color TV, quadrophonic sound, answer machines, PCs, online services, bulletin boards, home PBXes, newsgroups, instant messaging, cell phones, HD, browsing, pirate radio, free wi-fi, friending, tweeting.

Yeah, some of those aren’t gone yet, but don’t count on their staying around. Not in their current forms.

Three conditions have been profoundly increased by technology during my brief (62.2 year) lifetime: connectivity, autonomy and abundance. Those have been provided respectively by the Net, personal computing, and data processing and storage. I can now connect with anybody or anything pretty much anywhere I go, as an autonomous actor rather than a captive dependent on some company’s silo or walled garden. I can also access, accumulate and put to use many kinds of information of relevance to myself and my world.

Some creepy dependencies are still involved, such as the ones I have with ISPs and phone companies. But I believe even those will become substitutable services in the long run, much as the best “cloud” services are also becoming substitutable utilities.

I haven’t said that all this is a Good Thing. In fact I’m not sure it is. Meaning I’m not sure it has been good for us, or our world, that we have drifted so far from the hunting and gathering animals we were when we diasporized out of Africa during the last Ice Age. Perhaps we have adapted well without evolving at all. Think about it.

We are, if nothing else (and yes, we are much else) a pestilence on the planet. Few creatures other than rats and microbes are more widespread, or have done more to eat and alter the Earth’s contents and its living dependents. Sure, I’m enjoying it too. But at some point the party ends. When it does, what do we go home to?

Anyway, this all comes to mind while reading Nick Carr’s The eternal conference call. His bottom lines are killer:

The flaw of synchronous communication has been repackaged as the boon of realtime communication. Asynchrony, once our friend, is now our enemy. The transaction costs of interpersonal communication have fallen below zero: It costs more to leave the stream than to stay in it. The approaching Wave promises us the best of both worlds: the realtime immediacy of the phone call with the easy broadcasting capacity of email. Which is also, as we’ll no doubt come to discover, the worst of both worlds. Welcome to the conference call that never ends. Welcome to Wave hell.

It’s the latest among Nick’s Realtime Chronicles. As always, strong stuff.

Over the years, however, Technorati came to value popularity and buzz more than the kind of stuff I was looking for. Some of the same functionality was there, but it was buried deeper and deeper. For example, feeds of searches. If I wanted to subscribe to feeds of, say, a search for Nokia N900, I could click on something that said (or meant) “get a feed for this search.” Google Blogsearch had the same feature, and made it easy. Still does, giving me a choice of Blog Alerts, Atom and RSS, under a heading that says “Subscribe”. Twitter search, similarly, has “feed for this query”.

Without being able to find that feed easily, I lost interest in Technorati, only going there when I couldn’t find the results I wanted elsewhere. By that time David and most of the other people I knew at Technorati had moved on, so I didn’t have much interest in volunteering advice.

But I learned this morning (via Twitter, naturally) that Technorati had gone through an overhaul. It’s certainly faster and less cluttered. But I still can’t find feeds for searches. Trending seems to be gone, or hidden where I can’t find it. And I have no idea how to do tag searches with it. Maybe that’s because, as CEO Richard Jalichandra explains here, “We’re eliminating many of Technorati.com’s annoyances and some features, especially ones people didn’t use enough to justify the cost. Instead, we’re focusing on delivering the value people really want from us: instead of boiling the ocean to make coffee, we’re aiming to deliver the non-fat soy latte you asked for.”

Well, that “you” isn’t me. Which is cool. Technorati has become less a search company and more a media company. They launched Technorati Media at the same time. It’s a way to buy and sell ads. I wish them well with it. (Hey, Techcruch likes it.)

Meanwhile I’ll stick with Google Blogsearch for my live Web searching.

Wonder what the rest of ya’ll think.

Near the start of his Institutional Corruption talk the other day, Larry Lessig sourced the quote above, from Thomas Jefferson. Larry was making a point: that the Framers were interested in personal independence, and not just that of a former colony. The Framers operated, however, in advance of the Industrial Revolution, which was won by Industry and lost by the rest of us — or at least by some of the roles we play in the marketplace.

Such as our roles as customers. While being customers gives us choices among products and services, many of the companies behind those products and services make us dependent on them, in ways we would not prefer if we had a choice. For a measure of how little choice we have, ask yourself how many times you’ve clicked “accept” to “Terms of Service” that typically give all advantages to the seller. Or look the number of cookies stored in your browser.

Well, the tide is turning. We’re finally starting to see a few tools that give users control over how data is collected and used. We’re working on some of those in the VRM community. And they’re a subject of discussion at

at 9:30am on Tuesday, at Harvard Law School, starting with the panel in the title graphic above. You can register here. Even if you show up only for the panel, it’ll help us know how many will be there.

There’s lots more about it at Civilizing the Personal Data Frontier, over at the ProjectVRM blog. Hope to see you there.

Well F*&% me. Dude, after all of these years, you are still micro managing the Windows release!

Now I know why Microsoft is now been relegated to insignificance in the identity market.

The reason is simple. Internal policy, managed by you, prohibits product mangers from keeping up with trends and innovation.

Let me repeat, if the Federated Identity Group made the required changes to the CardSpace selector today, it will be two years–maybe longer–before it makes it to the market.

The bottleneck to this problem–and I suspect a slew of others–is you.

As your friend and long-time competitor/advisor on these issues, I urge you to rethink how this is works. Because it isn’t working.

Craig has such a gentle way of being blunt. My fave line from Craig, addressed to a lame consulting client we shared many years ago: Put down the customer. Step away from the marketplace. I believe that’s what Craig is saying Microsoft is doing here, even if they don’t mean to.

The arguments here were foreshadowed in the architecture of the Web itself, the essence of which has been lost to history — or at least to search engines.

Look up Wikipedia+Web on Google and you won’t find Wikipedia’s World Wide Web entry on the first page of search results. Nor in the first ten pages. The top current result is for Web browser. Next is Web 2.0. Except for Wikipedia itself, none of the other results on the first page point to a Wikipedia page or one about the Web itself.

This illustrates how far we’ve grown away from the Web’s roots as a “hypertext project”. In Worldwide: Proposal for a Hypertext Project, dated 12 November 1990, Tim Berners-Lee and Robert Callao wrote,

Hypertext is a way to link and access information of various kinds as a web of nodes in which the user can browse at will. Potentially, Hypertext provides a single user-interface to many large classes of stored information such as reports, notes, data-bases, computer documentation and on-line systems help…

…There is a potential large benefit from the integration of a variety of systems in a way which allows a user to follow links pointing from one piece of information to another one. This forming of a web of information nodes rather than a hierarchical tree or an ordered list is the basic concept behind Hypertext…

Here we give a short presentation of hypertext.

A program which provides access to the hypertext world we call a browser. When starting a hypertext browser on your workstation, you will first be presented with a hypertext page which is personal to you: your personal notes, if you like. A hypertext page has pieces of text which refer to other texts. Such references are highlighted and can be selected with a mouse (on dumb terminals, they would appear in a numbered list and selection would be done by entering a number)…

The texts are linked together in a way that one can go from one concept to another to find the information one wants. The network of links is called a web . The web need not be hierarchical, and therefore it is not necessary to “climb up a tree” all the way again before you can go down to a different but related subject. The web is also not complete, since it is hard to imagine that all the possible links would be put in by authors. Yet a small number of links is usually sufficient for getting from anywhere to anywhere else in a small number of hops.

The texts are known as nodes. The process of proceeding from node to node is called navigation. Nodes do not need to be on the same machine: links may point across machine boundaries. Having a world wide web implies some solutions must be found for problems such as different access protocols and different node content formats. These issues are addressed by our proposal.

Nodes can in principle also contain non-text information such as diagrams, pictures, sound, animation etc. The term hypermedia is simply the expansion of the hypertext idea to these other media. Where facilities already exist, we aim to allow graphics interchange, but in this project, we concentrate on the universal readership for text, rather than on graphics.

Thus was outlined, right at the start, a conflict of interests and perspectives. On one side, the writer of texts and other creators of media goods. On the other side, readers and viewers, browsing. Linking the two is hypertext.

Note that, for Tim and Robert, both hypertext and the browser are user interfaces. Both authors and readers are users. As a writer I include hypertext links. As a reader with a browser I can follow them — but do much more. And it’s in that “more” category that Sidewiki lives.

As a writer, Sidewiki kinda creeps me out. As Dave Winer tweeted to @Windley, What if I don’t want it on my site? Phil tweeted back, but it’s not “on” your site. It’s “about” your site & “on” the browser. No?

Yes, but the browser is a lot bigger than it used to be. It’s turning into something of an OS. The lines between the territories of writer and reader, between creator and user, are also getting blurry. Tools for users are growing in power and abundance. So are those for creators, but I’m not sure the latter are keeping up with the former — at least not in respect to what can be done with the creators’ work. All due respect for Lessig, Free Culture and remixing, I want the first sources of my words and images to remain as I created them. Remix all you want. Just don’t do it inside my pants.

I’ll grant to Phil and Google that a Google sidebar is outside the scope of my control, and is not in fact inside my pants. But I do feel encroached upon. Maybe when I see Sidewiki in action I won’t; but for now as a writer I feel a need to make clear where my stuff ends and the rest of the world’s begins. When you’re at my site, my domain, my location on the Web, you’re in my house. My guest, as it were. I have a place here where we can talk, and where you can talk amongst yourselves as well. It’s the comments section below. If you want to talk about me, or the stuff that I write, do it somewhere else.

This is where I would like to add “Not in my sidebar.” Except, as Phil points out, it’s not my sidebar. It’s Google’s. That means it’s not yours, either. You’re in Google-ville in that sidebar. The sidewiki is theirs, not yours.

In Claiming My Right to a Purpose-Centric Web: SideWiki, Phil writes,

I’m an advocate of the techniques Google is using and more. I believe that people will get more from the Web when client-side tools that manipulate Web sites to the individual’s purpose are widely and freely available. A purpose-centric Web requires client-side management of Web sites. SideWiki is a mild example of this.

He adds,

The reaction that “I own this site and you’re defacing it” is rooted in the location metaphor of the Web. Purpose-centric activities don’t do away with the idea that Web sites are things that people and organizations own and control. But it’s silly to think of Web sites the same way we do land. I’m not trespassing when I use HTTP to GET the content of a Web page and I’m not defacing that content when I modify it—in my own browser—to more closely fit my purpose.

Plus a kind of credo:

I claim the right to mash-up, remix, annotate, augment, and otherwise modify Web content for my purposes in my browser using any tool I choose and I extend to everyone else that same privilege.

All of which I agree with—provided there are conventions on the creators’ side that give them means for clarifying their original authorship, and maintaining control over that which is undeniably theirs, whether or not it be called a “domain”.

For example, early in the history of Web, in the place where publishing, browsing and searching began to meet, a convention by which authors of sites could exclude their pages from search results was developed. The convention is now generally known as the Robots Exclusion Standard, and began with robots.txt. In simple terms, it was (and remains) a way to opt out of appearance in search results.

Is there something robots.txt-like that we could create that would reduce the sense of encroachment that writers feel as Google’s toolbar presses down from the top, and Sidewiki presses in from the left? (And who-knows-what from Google — or anybody — presses in from the right?)

I don’t know.

I do know that we need more and better tools in the hands of users — tools that give them independence both from authors like me and intermediaries like Google. That independence can take the form of open protocols (such as SMTP and IMAP, which allow users to do email with or without help from anybody), and it can take the form of substitutable tools and services such as browsers and browser enhancements. Nobody’s forcing anybody to use Google, Mozilla, any of their products or services, or any of the stuff anybody adds to either. This is a Good Thing.

But we’re not at the End of Time here, either. There is much left to be built out, especially on the user’s side. This is the territory where VRM (Vendor Relationship Management) lives. It’s about “equipping customers to be independent leaders and not just captive followers in their relationships with vendors and other parties on the supply side of the marketplace”.

I know Phil and friends are building VRM tools at his new company, Kynetx. I’ll be keynoting Kynetx’ first conference as well, which is on 18-19 November. (Register here.) Meanwhile there is much more to talk about in the whole area of individual autonomy and control — and work already underway in many areas, from music to public media to health care — which is why we’ll have VRooM Boston 2009 on 12-13 October at Harvard Law School. (Register here.)

Lots to talk about. Now, more places to do that as well.

Bonus Links:

• Small Pieces Loosely Joined, which digs deeply into many of the core issues touched upon here — and embodies in its title an ideal of the Web, which is that no big entities should be controlling it.
• User Driven Services, by Joe Andrieu
• VRM One-Pager, by Adriana Lukas
• VRM and the Four Party System, by yours truly. Is Sidewiki a fourth party service? Let’s bring it up at the workshop.

[Later...] Lots of excellent comments below. I especially like Chris Berendes’. Pull quote: I better take the lead in remixing “in my pants”, lest Google do it for me. Not fair, but then the advent of the talkies was horribly unfair to Rudolf Valentino, among other silent film stars.