comments_imageCOMMENTS: 19

Google's Bias for Bigness

Could the popular search engine's quest for news quality leave alternative sources in the dust?
July 14, 2005  |  
 
 
LIKE THIS ARTICLE ?
Join our mailing list:

Sign up to stay up to date on the latest headlines via email.

 
 
Advertisement
 
So you need a news fix....

You grab some caffeine, jump online and head to Google News to search for the latest news about, say, New York City's planned Freedom Tower.

It crawls across some 4,600 publications, finds news stories and ranks them from top to bottom.

In this case, the morning of June 29, the page flickers and, bam, Google has found and ranked the stories you need: as its top Freedom Tower story it presents a piece by The Minnesota Star Tribune, followed in downward order by The Los Angeles Times, London Free Press, Xinhua news agency (the official service of the Chinese government).

London Free Press? Xinhua? Does this seem somehow off? Google execs seem to think so, but reports of their proposed fixes raise as many questions as they answer. The company is reportedly concerned about biased or incorrect news stories getting ranked above more quality news. As a fix, they have filed a patent for a new technology that ranks a story by the quality of its source. But for a company that commands a superpower level of control over global Web-surfing behavior, even small changes have a huge effect.

Google doesn't comment on its present or future ranking criteria, but its news stories seem to be ranked based on relevance to search words and timeliness, not the reputation of the news source. But for alternative online news services, from CNET to AlterNet, B2B trade publications, and thousands of small radio and television stations that rely on Google News-related traffic, the company's patent application offers reason to worry about just how shallow a pool of sources the site will draw from. It says the new ranking system will consider:
...[The] average length of an article produced by the news source, an amount of important coverage that the news source produces in a second time period, a breaking news score, an amount of network traffic to the news source, a human opinion of the news source, circulation statistics of the news source, a size of a staff associated with the news source, a number of bureaus associated with the news source, a number of original named entities in a group of articles associated with the news source, a breadth of coverage by the news source, a number of different countries from which network traffic to the news source originates, and a writing style used by the news source.
Would this value-laden code pass judgment on the passive voice? Will it consider contract writers in staff size? Will the "breadth of coverage" criteria take into account that niche-market publications often drill into topics -- be it military procurement or schools funding regulations -- more thoroughly than further-reaching news sources like CNN? Or the fact that these publications often break stories that are then picked up by CNN and others?

Brian Dominick, editor of The NewStandard, an online newspaper that lands a fifth of its daily traffic from Google, writes in his blog that for several reasons the proposed Google News changes would "bury" his publication. He recoils at the idea of assigning a "breaking news" score.

"[That's] like rewarding your boyfriend for climaxing first," Dominick writes. "Breaking news is inherently subject to the most errors and the worst journalism. So it might be good to know that an outlet typically has something early on, but that is not a reliable method for evaluating the quality of its reporting."

Though Google News has prided itself on ranking news without human intervention, the patent says its future "human" assessors might evaluate a news source based on its age or, in the case of newspapers, how many Pulitzer prizes it has won.

Feel the tilt yet?

"What concerns many is not so much the supposed increase in objectivity Google painstakingly aspires to create," writes David Miller, a staff writer for WebProNews, a Kentucky-based online journal that would likely be snubbed by Google's proposed algorithms. Miller says the real sin is that "the filtering is taken out of the minds of the users and given to the hands of computer-generated objectivity."

Chris Tolles, vice president for sales and marketing for Topix, a website that helps users find targeted news stories, says Google's plan is conservative and "kind of boring." The impulse to check sources and establish authority, he says, while understandable, assumes the source of a story is more important than the event.

"It shows they have the underlying opinion that the source is a primary driver of value," Tolles said, adding that Google "is taking the editorial point of view of top sources."

The upshot is that Google's proposed change isn't just a misguided and disheartening quest to mainstream online news. It's a demoralizing metamorphosis from a catch-all (mostly) uncensored news aggregator with egalitarian undertones to a purveyor of corporate-driven coverage suitable only for what Lawrence Weschler, formerly of the New Yorker, calls the "temporal frenzy that has come to characterize the increasingly peg-driven, niche-slotted, attention-squeezed, sound-bite media environment of recent years."

"Of course there are ownership issues in mass media with fewer companies owning more and more," says Gary Price, editor of Search Engine Watch. "That is the same with search engines. It's important to have many different voices."

While Google is the most popular search engine, it is not the most popular news service. In fact, last summer Google News ranked far behind Yahoo News, which uses human judgment in its story rankings, according to the latest Nielsen/Netratings. The firm reported that Yahoo News reached a unique audience of nearly 21 million Americans at home and at work in June of 2004, while Google News reached just 6.3 million.

Google is no stranger to complaints about its news retrieval and ranking. Technology consultant and former Reuters executive Vin Crosbie last year pointed out last year that Google News leaned toward a handful of the same sources on its main news page. In blogs and articles, Crosbie claimed that in many cases Google limits its findings to the same dozen or so sources. And within those, Crosbie writes, are several sources owned and operated by governments, including the U.S. (Voice of America), China (Xinhua) and Qatar-owned Al Jazeera.

If Google News follows its patent plans, those sources can likely expect to keep their top billing, while establishment-loving algorithms step over diversity's smaller voices.
Kelly Hearn is a former UPI staff writer who lives in Washington DC and Latin America. His work has appeared in the Christian Science Monitor, American Prospect and other publications.
Email
Print
Share
Post on reddit
Post on stumbleupon
Post on facebook
Post on digg
Post on twitter
Post on delicious
LIKED THIS ARTICLE? JOIN OUR EMAIL LIST
Stay up to date with the latest AlterNet headlines via email


Comments are closed-

Alternative search engine?
Posted by: Cary Onn on Jul 14, 2005 4:24 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I've been waiting for someone to develop a search engine for progressives. Such an engine would look first in progressive sources and list those results first, with the remaining results following.

Or maybe such an engine already exists?

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Alternative search engine? Posted by: bornxeyed
» RE: Alternative search engine? Posted by: codingguy
» RE: Alternative search engine? Posted by: bodhisoma

Comments are closed-

Ol-pa
Posted by: David Willett on Jul 14, 2005 4:45 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
Maybe its time to post more favorite news sources to
"Favorites" and "Bookmarks",
and look to AlterNet for listings of alternative quality
news sources. There always needs to be "Plan 'B'".

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Where's the problem?
Posted by: TerryH on Jul 14, 2005 6:25 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
So don't use google to find your news.

*shrug*

We don't HAVE to be lemmings.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Where's the problem? Posted by: nanobubble
» RE: Where's the problem? Posted by: spyderbaby

Comments are closed-

How about the columbia newsblaster?
Posted by: Here and now on Jul 14, 2005 7:02 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
They were doing it before google. Are they any better? I don't normally use a search engine for news at all.

http://newsblaster.cs.columbia.edu/

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Let the users decide!
Posted by: nanobubble on Jul 14, 2005 7:11 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I fail to understand why Google News doesn't give the user more control. I would love to see a list of all the thousands of publications, and create a white-list or black-list of which publications I want to view.

Even more abstract than that, they could implement a configuration which allows us to dictate which or how much weight of a certain aspect of the algorithm we apply to the headline and search results.

For example, I don't want to view news that has a high 'breaking news' score, because I personally feel that a high breaking-news score means the articles are less reliable and are not accurate. Therefore, I would rate that a low score or zero so I am not subject to sloppy breaking-news article results.

The options are vast, but if Google simply implements its algorithm without giving the user any say or choice, that is the real mistake being made here.

Of course, I consider myself a power-user, so what would the default settings be to johnny blueshirt and jane blackskirt? A minimum amount of applied algorithms or at least a notification of defaultness that is sufficiently explainatory that they are not applying control and their news is potentially subject to imbalanced objectivity or some weighted bias.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

What about "the connection"?
Posted by: verite on Jul 14, 2005 7:50 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
see www.google-watch.org

Sequoia

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

are you big media?
Posted by: cjones on Jul 14, 2005 12:53 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
Are you threatened by this? We should be grateful that a a news service is thinking about quality. I can think of a lot of "big media" outlets that should do the same.

"superpower level of control over global Web-surfing behavior, even small changes have a huge effect." This is a truly ignorant statement. Just because google's proprietary ranking algorithm cannot be easily cracked, doesnt mean it is riddled with malice or a conspiracy. Are you making an argument for quality being assigned by a human? Like the Drudgereport?

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

rtdrury
Posted by: rtdrury on Jul 14, 2005 1:20 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
The Firefox browser allows you to bookmark a group of tabs and load them all at once. To get an objective view of the world, bookmark a variety of news sources and with one click you bring up all their front pages. And if you switch to Linux then you can ask a script programmer out on the web to write you a script that will do a daily search for various keywords in the news and place the results in another tab group in your bookmark file. You can change the keywords by editing a small text file. Mozilla is even better than Firefox, integrating email and html editing with the browser. As far as news sources go, everyone has to do the work and periodically sort through them, compare them, and update your regular group of sources. It's everyone's obligation to the democracy to be objectively informed among other things.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Google's ideological slant Posted by: diegueno
» RE: rtdrury Posted by: Pearl in Colo
» RE: rtdrury Posted by: FlapJackSeven

Comments are closed-

Yahoo beats Google anyday
Posted by: maxpayne on Jul 20, 2005 6:54 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I've done some comparing and I notice that google purposely censors searches leaving irrelevent bs whereas Yahoo gives more results and more relevant ones too. Google should be smashed !

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Of course Google is biased towards large sites... Their PR works that way
Posted by: PriceComparison on Aug 27, 2005 11:43 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
If you read the explanation of how Google calculates PR Page Ranking, you will agree with most people posting here that Google crawls a site with higher PR deeper and rank them higher for any keyword found in it. Therefore Google formula is very biased towards large sites. This makes smaller site more difficult to find.

Andrew @AT@ PriceComparison.com
http://www.PriceComparison.com

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

Alternet Comments:

Comments are closed-

Alternative search engine?
Posted by: Cary Onn on Jul 14, 2005 4:24 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I've been waiting for someone to develop a search engine for progressives. Such an engine would look first in progressive sources and list those results first, with the remaining results following.

Or maybe such an engine already exists?

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Alternative search engine? Posted by: bornxeyed
» RE: Alternative search engine? Posted by: codingguy
» RE: Alternative search engine? Posted by: bodhisoma

Comments are closed-

Ol-pa
Posted by: David Willett on Jul 14, 2005 4:45 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
Maybe its time to post more favorite news sources to
"Favorites" and "Bookmarks",
and look to AlterNet for listings of alternative quality
news sources. There always needs to be "Plan 'B'".

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Where's the problem?
Posted by: TerryH on Jul 14, 2005 6:25 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
So don't use google to find your news.

*shrug*

We don't HAVE to be lemmings.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Where's the problem? Posted by: nanobubble
» RE: Where's the problem? Posted by: spyderbaby

Comments are closed-

How about the columbia newsblaster?
Posted by: Here and now on Jul 14, 2005 7:02 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
They were doing it before google. Are they any better? I don't normally use a search engine for news at all.

http://newsblaster.cs.columbia.edu/

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Let the users decide!
Posted by: nanobubble on Jul 14, 2005 7:11 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I fail to understand why Google News doesn't give the user more control. I would love to see a list of all the thousands of publications, and create a white-list or black-list of which publications I want to view.

Even more abstract than that, they could implement a configuration which allows us to dictate which or how much weight of a certain aspect of the algorithm we apply to the headline and search results.

For example, I don't want to view news that has a high 'breaking news' score, because I personally feel that a high breaking-news score means the articles are less reliable and are not accurate. Therefore, I would rate that a low score or zero so I am not subject to sloppy breaking-news article results.

The options are vast, but if Google simply implements its algorithm without giving the user any say or choice, that is the real mistake being made here.

Of course, I consider myself a power-user, so what would the default settings be to johnny blueshirt and jane blackskirt? A minimum amount of applied algorithms or at least a notification of defaultness that is sufficiently explainatory that they are not applying control and their news is potentially subject to imbalanced objectivity or some weighted bias.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

What about "the connection"?
Posted by: verite on Jul 14, 2005 7:50 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
see www.google-watch.org

Sequoia

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

are you big media?
Posted by: cjones on Jul 14, 2005 12:53 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
Are you threatened by this? We should be grateful that a a news service is thinking about quality. I can think of a lot of "big media" outlets that should do the same.

"superpower level of control over global Web-surfing behavior, even small changes have a huge effect." This is a truly ignorant statement. Just because google's proprietary ranking algorithm cannot be easily cracked, doesnt mean it is riddled with malice or a conspiracy. Are you making an argument for quality being assigned by a human? Like the Drudgereport?

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

rtdrury
Posted by: rtdrury on Jul 14, 2005 1:20 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
The Firefox browser allows you to bookmark a group of tabs and load them all at once. To get an objective view of the world, bookmark a variety of news sources and with one click you bring up all their front pages. And if you switch to Linux then you can ask a script programmer out on the web to write you a script that will do a daily search for various keywords in the news and place the results in another tab group in your bookmark file. You can change the keywords by editing a small text file. Mozilla is even better than Firefox, integrating email and html editing with the browser. As far as news sources go, everyone has to do the work and periodically sort through them, compare them, and update your regular group of sources. It's everyone's obligation to the democracy to be objectively informed among other things.

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

» RE: Google's ideological slant Posted by: diegueno
» RE: rtdrury Posted by: Pearl in Colo
» RE: rtdrury Posted by: FlapJackSeven

Comments are closed-

Yahoo beats Google anyday
Posted by: maxpayne on Jul 20, 2005 6:54 AM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
I've done some comparing and I notice that google purposely censors searches leaving irrelevent bs whereas Yahoo gives more results and more relevant ones too. Google should be smashed !

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]


Comments are closed-

Of course Google is biased towards large sites... Their PR works that way
Posted by: PriceComparison on Aug 27, 2005 11:43 PM   
Current rating: Not yet rated    [1 = poor; 5 = excellent]
If you read the explanation of how Google calculates PR Page Ranking, you will agree with most people posting here that Google crawls a site with higher PR deeper and rank them higher for any keyword found in it. Therefore Google formula is very biased towards large sites. This makes smaller site more difficult to find.

Andrew @AT@ PriceComparison.com
http://www.PriceComparison.com

[« Reply to this comment] [Post a new comment »] [Rate this comment: 1 - 2 - 3 - 4 - 5]

 
Advertisement
From The Blog
 
 
 
 
 
 
 
 
 
 
 
 
 
Most Read
Most Emailed
Most Discussed
On REDDIT
On DIGG
 
loading ...
POWERED BY DIGG'S USERS