Archive for the 'graph' Category

Speculation on Links, Traffic, and Authority

We can say this: traffic flows along links that we click. For a few years—before google—we could even say this: a link is not a link until we click it.

But now that is wrong because google made links really something else—meaningful signals, not just infrastructure. Links have a deeply important role in pagerank, the backbone of google’s mighty search engine.

Thus the giver of a link tells google that the recipient of a link is notable or significant or worth your time and attention and consideration or engagement. This is authority—on average, at the very least.

Links are signals for authority. That authority is distributed throughout the network, and given Igon values, google built a magnificent business detecting, computing, and centralizing that authority.

* * *

We are not entitled to our own understanding of facts, which take root in the universe. Thus we call facts objective. But we are entitled to our own appreciations of authority. Indeed, appreciation for authority can only take root in ourselves as individuals and groups of individuals. Thus we call authority subjective.

There are very many facts that I will never need to learn or remember. I will rely on google to detect those answers. Like just-in-time inventory, I will have answers only when I need them, when I borrow them, avoiding the mental costs of carrying them in my jammed-up memory.

Likewise, there are very many authorities that I will never need to appreciate. I will rely on google to detect those signals. But unlike facts as stored in someone else’s inventory, something changes about authority when I don’t carry it with me. Something’s lost when I borrow authority—just in time.

Google delivers facts. And facts are facts. But google doesn’t really deliver authorities. It co-opts them.

Maybe this is why Clay Shirky calls it “algorithmic authority.”

So if I were settling a bar bet, I might well say, “Yes, you can trust me. I found that claim by clicking on the top google search return.” The page on which I found the claim doesn’t enter my justification. “Dude, I googled it” might not work for very many justifications today, but Shirky’s quite right that there’s “spectrum” and that “current forces seem set to push [algorithmic authority] further up the spectrum to an increasing number and variety of groups that regard these kinds of sources as authoritative.”

The authority belongs to the algorithm that found the source, not the source itself. Traffic flows along links out to the edges of the network, but authority pulls inward to the center.

* * *

And this is why it seems unfair for folks like Jeff Jarvis to make claims like, “The recipient of links is the party responsible for monetizing the audience they bring.”

News sites should certainly be trying to establish engagement and trust and authority with users who come from google. But insisting that this task is an imperative of the link economy seems to under-appreciate that algorithmic authority centralizes authority. Google pushes the traffic but keeps the trust—or much of it, anyhow.

Maybe the best answer to “What Would Google Do?” goes something like this: build an algorithm that detects and hordes an elusive and highly diffuse resource distributed across a network.

* * *

So Danny Sullivan can jump up and down and yell about WSJ and google and bing: “Do something. Anything. Please. Survive. But there’s one thing you shouldn’t do. Blame others for sending you visitors and not figuring out how to make money off of them.”

Sullivan can exhort newspapers to see google referrals as an opportunity. And they are. Moreover, I have little doubt that many newspapers should be optimizing their pages depending on the referrer, whether that’s google or facebook or twitter or stumbleupon or whatever. But let’s also remember that google changed links. A different kind of traffic now flows along them. And that traffic is fickler—and, yes, less valuable—than we might first imagine.

Picture this! The news graphed.

slate news dotsSlate added a curious addition to its site last week. Its heart is in the right place, and this is a good experiment, not a silly one.

I believe there’s extraordinary value to be unlocked by mapping a world of articles onto the social graph that they describe textually. I’ve written about graphing the news when I awkwardly described a scheme here and geeked out over a pretty picture here. Yes, there is a funny thing about social networks: they often describe the real world as well as sometimes exist as their own worlds. Done right, Slate’s graph could be an eye-opening mechanism for aggregating, sorting, discovering, following, sharing, and discussing the news.

But I don’t think Slate has quite done it right. In short, there’s too much information in the nodes, or the “dots,” as Slate calls them, and there’s too little information in the edges, or the links that connect up those dots. So permit me a little rambling.

We don’t really care all that much about the differences between a person, a group, and company—not at this top level of navigation, anyhow. There are too many dots, and it’s too hard to keep them all the colors straight. Of course, it’s not that hard, but if Slate’s project is fueled by bold ambition rather than fleeting plaudits, it’s just not easy enough. They’re actors. They’re newsmakers. They are entities that can be said to have a unified will or agency. And that’s enough. Make up a fancy blanket term, or just call them “people” and let smart, interested users figure out the details as they dive in.

Moreover, assistant editor Chris Wilson confuses his own term “topic.” At first, he writes, “News Dots visualizes the most recent topics in the news as a giant social network.” Also, “Like a human social network, the news tends to cluster around popular topics.” In this sense, a “topic” is an emergent property of Slate’s visualization. It’s the thing that becomes apparent to the pattern-seeking, sense-making eyes of users. So “one clump of dots might relate to a flavor-of-the-week tabloid story” or “might center on Afghanistan, Iraq, and the military.”

But then Wilson makes a subtle but ultimately very confusing shift. Explaining how to use the visualization, he writes, “click on a circle to see which stories mention that topic and which other topics it connects to in the network.” Problem is, these “topics” are what he has just called “subjects.” As emergent things, or “clumps,” his original “topics” can’t be clicked on. On the contrary, “subjects—represented by the circles below—are connected to one another,” and they’re what’s clickable.

To make matters worse, Wilson then, below the visualization, introduces more confusing terms, as he describes the role played by Open Calais (which is awesome). It “automatically ‘tags’ content with all the important keywords: people, places, companies, topics, and so forth.” The folks at Thomson Reuters didn’t invent the term “tag,” of course; it’s a long-standing if slippery term that I’m not even going to try to explain (because it really, really is just one of cases in which “the meaning of the word presupposes our ability to use it”). At any rate, Wilson seems like he’s using it because Open Calais uses it. That’s fine, but a bit more clarity would be nice, given the soup of terms already around. And there’s really little excuse for dropping in the term “keywords” because, with his technical hat on, it’s just wrong.

I’m terribly sorry to drag you, dear reader, through that intensely boring mud puddle of terminology. But it’s for good reason, I think. Graphing the news is supposed to be intuitive. The human mind just gets it. A picture is worth a thousand words. Taken seriously, that notion is powerful. At a very optimistic level, it encourages us to let visualizations speak for themselves, stripped of language all too ready to mediate them. But at a basic level, it warns us writers not to trample all over information expressed graphically with thousand textual words that add up to very little—or, worse, confusion.

But, yes, okay, about those prenominate the edges, or the links that connect up those dots! I wrote about this long ago, and my intuition tells me that it doesn’t make sense to leave edges without their own substance. They need to express more than similarity; they can do more than connect like things. If they were to express ideas or events or locations while the nodes expressed topics, it seems to me that the picture would be much more powerful. Those ideas, events, or locations wouldn’t sit in light blue “Other” nodes, as Slate has them; instead they would directly link up the people and organizations. The social network would be more richly expressed. And topics, in Wilson’s original sense, wouldn’t be emergent “clumps” but actually obvious connections.

All in all, the visualization is “depressingly static,” as a friend of mine remarked. There may be two levels of zoom, but there’s no diving. There’s no surfing, no seeing a list of stories that relate to both topic x AND topic y. There’s no navigation, no browsing. There’s no search—and especially none involving interaction between the human and computer. There’s no news judgment beyond what newspaper editors originally add. And the corpus is small—tiny, really, representing only 500 articles each day, which isn’t so far from being a human-scale challenge. Visualizations hold the most promise for helping us grapple with truly internet-scale data sets—not 500 news articles a day but 500,000 news articles and blog posts.

It seems unfair to hold Slate to such a high standard, though. It’s very clear that they were shooting for something much more modest. All the same, maybe modesty isn’t what’s called for.

A Modest News Aggregator for the Win

To the extent that sites or services that present professional and amateur content together emerge and become successful, they will do so only after they figure out a way to give users simple, intuitive, and powerful filters that are themselves the channels that carry our conversation and shape our communities.

We will tolerate only the writing we love. Discovering what we love is a job to distribute across very large groups of users with weak ties and small groups of users with strong ties, all empowered by tools far more subtle than those that characterize current state of search. We will act mostly self-interestedly, choosing by facets, sifting, sorting, sharing, appropriating, connected to one another asymmetrically, mostly pulling not pushing, trusting when trustful. We will participate in a gift economy. Reputation will count. Attention is scarce. Something like tunkrank will help, I’m sure.

The nodes are people because people and other actors are central to what it means to be human regardless of whether we’re reading the news, writing the news, starring in it, or all of the above. The edges are the ideas that capture our common interest over time, location, and predilection. It is beautiful, Doc.

What if the news looked like this?

news graph

See here (PDF). HT here.

PS. I wonder what enthusiastic answer David Weinberger might have to this question.

LATER: I’ve talked about a “news graph” before, mentioning “edges and nodes,” but I wasn’t yet thinking this fantastically. Still, I think it’s interesting stuff: “This kind of news graph would, at long last, make the bits of content contigent on the people and the issues they discuss. It’s the elegant organization for news.”

Josh Young's Facebook profile

What I’m thinking

Error: Twitter did not respond. Please wait a few minutes and refresh this page.

What I'm saving.

RSS What I’m reading.

  • An error has occurred; the feed is probably down. Try again later.


Get every new post delivered to your Inbox.