What We Lose As Search Gets Personal

By: John Battelle

Of all the jobs I've had in the past twenty odd years, I'm pretty sure the one that pleased my parents the most was my brief stint as a reporter at the Los Angeles Times, my family's local paper of record. My mother in particular seemed quite proud to see her son's work land on her breakfast table each morning (well, not exactly, I worked at a local edition in Ventura, and my mother lived in Pasadena. Every every once in a while, one of my pieces did make the national edition...).

In any case, when I delivered the news I was leaving the Times to help start a magazine focused on technology, Mom wasn't entirely convinced. "The newspaper," she declared, "is our social glue. It's what keeps us all on the same page. Technology is going to destroy that, everyone will end up reading whatever suits their fancy."

That was back in 1992 (the magazine was Wired), and given what's happened with the newspaper industry in the past 16 or so years, it's hard to argue with either my decision to leave the Times, or my mother's assertion that our culture was on the brink of losing an important component of its "social glue."

Fast forward to two nights ago, when I was talking with my own son about technology. Earlier in the day, he had emailed me from his room downstairs, asking me - for the fourth time - for the link to his Boy Scout troop web page. Mildly irritated, I turned to my browser's toolbar and entered "CA Troop 43" or some such, but the results did not give me the page I wanted. In fact, they gave me a bunch of other Troops - Troop 9, Troop 777 - that happened to have the numbers 4 or 3 on their site for other reasons.

I recalled that my son's troop used an old community application that was difficult for search engines to find, putting it in what search experts call "the deep web" - websites that are easily accessible if you know the exact URL, but near impossible to find using Google.

If I had enabled Google Desktop Search, I could have found that scout website - desktop search scans my entire hard drive and integrates it with my web search, and it turns out, I had the URL in an email folder on my local computer. But desktop search, like Web History, kind of creeps me out. I remembered that I had the URL in an email, searched my mail, and found it that way. Instead of sending it - yet again - to my son, I thought I'd talk to him at dinner and perhaps teach him the value of bookmarks.

This story is getting a bit convoluted, but stay with me. What happened next was interesting. At dinner I gently chided my son for lazy information gathering habits. "I'm not your personal Google," I told him. "Why couldn't you find the URL yourself? Did you even try?"

"Actually dad, I did, and it gave me all sorts of wrong answers - Troop 43 in Texas, and Iowa, but nothing for mine!"

"What did you search for, son?"

"Troop 43, of course!"

"Well that's your first problem. There's a Troop 43 in nearly every state, sometimes in every county, and the one here in Marin is really hard to find because no one links to it. Also, it's on a community domain, one that probably protects its content from search engine crawlers. You should have narrowed your search - like I did, but to be honest, even that wouldn't have helped. You have to search elsewhere - did you think to search your mail?"

As my son contemplated the idea that Google might not be omniscient, something struck me. Faced with the same question - "what is Troop 43's website address" - my son and I both did the exact same thing - we asked Google. I asked the question a little bit differently than did my son, but we both got poor results. Yet due to years of conditioning, we instinctively assumed Google would give us the One Right Answer. That assumption - in particular my son's, who has never used a computer without a browser and Google services - united us.

In ten short years, Google has become our social glue - we all presume that two people, asking roughly the same question, will get pretty much the same answer, and that answer will be correct. For most of the past decade, that was a pretty fair assumption. Google has become a universal search resource, reliable, accurate, and ... consistent.

But for a variety of reasons, that assumption is no longer true. The ongoing goal of all search providers has been to personalize search - to tailor answers to the individual who is doing the searching. Search no longer takes one signal - your query - and finds results against the entire web. Instead it takes many signals - your search history, your geographic location, things you've clicked on in the past, files on your hard drive (if you allow it), and many others - and processes those signals against probable sub sets of data that have a higher chance of providing *you* the best answer. And that answer, increasingly, will be quite different from someone else's, even if that other person asks exactly the same question.

Along the way, I think, something has been lost. It's the same thing my mother lamented as she watched my generation abandon the newspaper - common ground, common spaces - a common set of facts around which we as humans can gather, debate, and connect. And therein lies an opportunity, I sense, to create a new kind of search that is in fact *not* personalized, but rather socialized - shared and common to all.

Comments

[Stephen Baker]

What I like about your story is not only that Google is not omniscient, but that those of us who use it (ie. networked humanity) must learn to think differently, in set theory.

[Glenn Murray]

Found this post through one of your Tweets. Very interesting read. Thanks John.

[Kyle York]

You've become my resource for all things "search". Thanks!

[Jonas Lamis]

Thanks for the post John. How do we bring the "comfort of community" to the results-oriented web that we anticipate? Have a look at my thoughts on trust and transparency in the post-Google era. http://lamisphere.com/2008/10/31/trust-and-transparency-for-intelligent-agents/

[nmw]

Not everyone reads the LA Times. Not everyone uses Google. Not everyone speaks the same language -- not yet, at least.

When I talk about Dot (the language that will supersede English as lingua franca) people look at me with a strange look on their face. I tell them about the differences between commercial (.COM) dialect, the networking dialect and so on -- right down to speaking .DE or .FR or some other European dialect of Dot.

Of course language and culture and legal codes are not all one and the same, but there are very stong correlations among them. I describe such local search phenomena in more detail in the "Wisdom of the Language" (see http://gaggle.info/miscellaneous/articles/wisdom-of-the-language ).

[Ken Chan]

The solution would be to link to the Troop 43 website from your article so that it will appear the next time your son uses Google to find it.

[matthew phan]

Socialised search -- i.e. editorialised content: isn't that what a portal is about? we could see polarisation toward broad portals and individualised search. the only thing i envisage losing is the inability to laugh/commiserate with others about the difficulty of extracting relevant results for certain keywords... but google could easily provide an 'original' or impersonalised search version, to retain that 'commonality'.

[Stephen Gilman]

Virtually every time I have a conversation with my dad, who is retired with a fair bit of free time on his hands, we have a micro-conversation with near-identical words every time. It's getting to be a cliche:

Dad: "Did you see the article in the paper about..."

Me: "Dad, I keep telling you that I get my news on-line, mostly via email subscriptions and RSS. I don't have the time to read an entire newspaper every day. If the story isn't about my employer, or my industry, or another topic of particular interest to me, you can rest assured that I probably didn't read it."

I'm never pleased with myself about the answer, because I ofter discover myself learning new information too late for it to be useful to me. In order to identify an emerging meme or trend you have to consume information broadly and pick the emerging memes out of the morass. By the time the meme or trend hits my email or RSS subscriptions, it's because it has reached a critical mass in the popular consciousness, and by extension it's really too late to take advantage of it.

I have to remind myself that my dad's actually trying to do me a favour by pointing me in the direction of useful information of which I would otherwise be unaware.

[pwarne]

I don't use a Google account 90% of the time. When I do, I turn off search history and clean out cookies every time I close out a browser. Like you, I don't use Google Desktop.

Having the option to search privately, and exercising that option, allows for a "common ground" by reducing the data inputs to two signals - search query and geographical location of your ISP.

Rather than creating a new search engine, maybe those of us who share John's apprehension could just search privately.

[bruno boutot]

an opportunity, I sense, to create a new kind of search that is in fact *not* personalized, but rather socialized - shared and common to all.

Isn't it what AskMetaFilter already is?

[Michele Chaboudy]

thanks, John, for bringing up search behavior that is hard to not to do. . .we all get into habits that we should actively consider breaking or adjusting more often. As a librarian, I've watched even professional researchers succumb to the google habit, including myself. I appreciate your wake up call. I did try Hotbot(one of my favorites)for Troop 43 but to no avail. Great narrative, as always.

[John Battelle]

Thanks for all your very thoughtful comments. I did not want to link because I didn't want to be the one who "fixed" the problem, oddly, I wanted it to happen a bit more "naturally"!
Keep the comments coming, and a new post is on the way...

[webandrank]

Look like my friend and him search online question

[Benigna Marko]

Getting out there is fun. Take it from Benigna Marko who recently visited Las Vegas and loved the city with all the lights. Come out and see the city that really never sleeps, play the slots and have fun. Enjoy life and smile as much as you can. Benigna marko

[Benigna Marko]

The longest search that I have done resulted in this wonderful site. Thank you for posting and I do enjoy google too.

[buy propecia]

Hey Great post. Really a very nice piece of information. Newbies like me get a good idea about this... I'm going to comment now... I think i did it. Thank you..

[pharmacy viagra]

Read your post with great pleasure, thanks for the enlightenment.