Tuesday, December 6, 2011 at 5:00 AM
Sometimes a topic that seems hot, like Occupy Wall Street, doesn't appear on trending lists, leading some activists to accuse Twitter of censorship. But the secret algorithmic formula prefers stories of the moment to enduring hashtags, so it ignores topics that are popular over a long period of time.
Related ArticlesThe Search For Analysts To Make Sense Of 'Big Data'
Businesses' desire to make sense of vast troves of data means mathematicians are in high demand.The Digital Breadcrumbs That Lead To Big Data
The ability to collect bits of data on a massive scale means big changes for many industries.
The list of "trending topics" on the right side of Twitter's home page is a coveted spot because millions of people see it. It often reflects what's hot in the news, from the death of Steve Jobs to Kim Kardashian's latest exploits.
Sometimes a topic that seems hot, like Occupy Wall Street, doesn't trend, leading some activists to charge Twitter with censorship. But the complex algorithms that determine trending topics are intended to find what's trending in the moment, and not what's been around for a long time.
Getting a spot on the trending list has become so important that television programs hire consultants to help them get there.
Jason Pollock, a social media consultant, says the singing competition The Voice set the tone for Twitter interaction. On the show, teams of young singers get coached by stars like Christina Aguilera. The Voice became one of the most popular singing competitions on TV this year with the help of Twitter.
Pollock says that as competitors are training for the competition, they tweet with some help from paid staff. They put pound signs in front of catchy phrases to create hashtags, like #TeamNakia. "They had them really operating fast. ... They had hashtags going and they were asking questions and doing polls and really engaging stuff," Pollock says.
When those hashtags hit the trending topics list on Twitter, more people started to watch The Voice on TV.
"If you start trending on Twitter, people on Twitter will turn that show on," Pollock explains. "Everyone is obsessed about the ratings — well, here's a new tool to up your ratings."
#OccupyWallStreet Not On The List
The trending list can also bring attention to your cause. During the tense moments of Occupy Oakland, freelance journalist Susie Cagle was following the Occupy Wall Street hashtag.
"Just looking at how often I was tweeting, let alone how often others were on the same Occupy Oakland hashtag, there have been times where that hashtag is scrolling and updating so quickly that there's no way I can keep up," she says.
But it struck her as odd that Occupy Oakland wasn't on trending topics, even after weeks of protests.
"To not see those things trending a month in was surprising," she says.
On blogs, some Occupy Wall Street activists charged Twitter with censoring its trending topics list. Why were there trending hashtags like #WhatYouFindInLadiesHandbags or #ThingsThirstyPeopleDo?
Twitter's Matt Graves says it's because the protests had been going on for weeks.
"We look at trending topics as a reflection of what people are talking about more right now in this moment, than they were a minute ago, an hour ago or a day ago," Graves says.
And when Graves says "we," he's really talking about Twitter's secret algorithm that sorts through 250 million tweets a day. It's designed to search for the sudden appearance of a topic in large volume.
"That may mean, for example, when Steve Jobs [died], there are different trending topics around that," Graves says. "It may mean on a local level, when there's an earthquake — whether it's in Oklahoma or California — being able to go and see, well, is 'earthquake' trending in Oklahoma right now?"
Getting Used To An Algorithmic Editor
There had been thousands of tweets for Occupy Wall Street regularly over many weeks, so Twitter's algorithms stopped putting it on the trending topics list. In some ways, Twitter's algorithms act like a lot of human news editors who are more interested in the latest news than an ongoing story, says Tarleton Gillespie, a communications professor at Cornell University.
"It's going to be hard for us to think about the involvement of the algorithm in a way that we could understand the involvement of an editor ... [who] might step in and say, 'I don't want to run this story' or 'I think this one's more important than that one,' " Gillespie says. "What does it mean that an algorithm decided that something was more important than something else?"
Gillespie points to the Amazon best-seller list. In that case, it seems like a simple unbiased calculation.
"Naively, you would say, 'Well, the most-selling book is No. 1 and the second-selling book is No. 2,' " he says.
But a couple of years ago, there was a dust-up because all the gay-themed books disappeared from the list. It turns out that Amazon doesn't let any adult books in its best-sellers, and someone accidentally put the gay-themed books in that category.
"It's a curated list," Gillespie says. "It's a list that will never show us if something that they or their publishers had classified as adult would ever show up there."
Everything from restaurant reviews to your friend's baby pictures to your local news is getting served up to you by an algorithm. As much as programmers may think their algorithms will deliver objective results, those calculations may be just as biased as a real human being. [Copyright 2011 National Public Radio]
This article is filed in: Technology, Around the Nation, Digital Life, Business, U.S. News, Home Page Top Stories, News
Some dairy farms use high-tech robot milking machines that also clean udders and monitor cow health.
Pizza Delicious Bought An Ad On Facebook. How'd They Do?
What happens when two guys who sell pizza out of a window in New Orleans buy an ad on Facebook?
Facebook's Growth And Reach At A Glance
Review key moments in its history, see where it's most popular and compare executive stock holdings.
Is Facebook Worth $100 Billion?
For Facebook to live up to its valuation, the company will need to redefine the ad industry.
LightSquared Files For Bankruptcy Protection
The company amassed more than $1 billion in assets and $1 billion in debts according to its filing.
News updates from WGBH