Bring on the #moron filter

The post I made a couple of days ago about Twitter’s coverage of the sustained terror assault on the city of Mumbai was by far the most viewed post we’ve made here. It obviously struck a chord. Bits of it ended up on CNN Asia.
In that post, I was responding to the social melee forming around the end of a dirty big fire-hose of re-tweeting, rumour and shocked reaction. The thing I felt most strongly about when the terror was actually unfolding second-by-bloody-second was the triumphal glee that some contributors were expressing that Twitter was ahead of the mainstream media in reporting ‘the event’. In some peoples’ minds the main event was the defeat of CNN by Twitter and the ‘victory’ of social media in general. It was pretty ridiculous even at that stage as a very large proportion of the total tweetage was actually reporting what was happening on television - and then the re-tweets with added conjecture that followed.
A very few people indulged in really ugly displays of aggression and hate and this has, sadly, continued.


Yes, it does sound bad.
Some people say that this is just the way a real conversation works, you just put up with the noise and disparate views, but that’s nonsense. In meatspace you either walk away from the twats or you ask them to keep their voices down. In fact, the only conversations in any way ‘like’ the busiest period of the other night’s hashtag Mumbai event are shouty drunken lock-ins, the 11.45 booze-train burger queue at London Bridge Rail Station on a Thursday night, or a football riot. In any case, at that stage we weren’t looking for ‘conversation’ - it was precisely because Twitter was ahead of the curve and there was little ‘official’ information that we wanted to know so badly what was really going on. At that really critical early stage, working out what was happening was made much more difficult by these morons. It may sound elitist but, clearly, all views are not equal.
And this problem didn’t just affect rubber-necking news-junkies like me, it also made it more difficult to for those people who actually really needed to find emergency numbers, or ask for ask for blood donations. It must have been truly horrible if you were there trying to find out if a loved one was okay. The sheer volume of rubbish tweeting made it more difficult to find useful links. There were plenty of them, but maybe 6 out 10 tweets were just noise.
Sadly, it’s unlikely to be the last time Twitter is used in this way, and so I’ve been wondering if there are ways to introduce a filtered version of the next event-stream on a #Mumbai scale. I’m not suggesting replacing the #[insert event name] search stream - but offering an additional, optional stream that has been ‘filtered’ by a team of trusted curators. In a blog post he made yesterday JP Rangaswami (Confused of Calcutta) put it like this:
Sometimes I think about all this as a giant virtual switchboard manned by volunteers, willing and able to help. We should be thinking about how we can improve all this. How we can set up this virtual switchboard effectively. How we can help quash rumours. How we can take the load off the security and emergency services people.
Who could we trust to do this? People on Twitter with a certain level of reputation? People who have passed what would basically be a crowd-sourced audition? And what about brand-endorsed twitterers? Instead of childishly bashing CNN why don’t we all work together to create a global panel of ‘trusted twitterers’ with them - of people who have passed certain filters? Of course, even to think about doing that would require a new attitude to old media. We’ll have to get over the “CNN is so over, dude…” tendency. We must stop thinking that it’s necessary to continually demonstrate and celebrate the power of social media. And we need to be honest about how it needs to evolve and get better. I don’t feel as optimistic as JP does about the self-corrective power of the crowd. I’m not sure it’s good enough to say that because real-life crowds always result in Chinese whispers we should accept it as an inevitable fact of life on Twitter in all circumstances. Of course, it is inevitable - in the sense that we won’t change human nature - but we can use Twitter in many different ways, and one way to improve it for some specific circumstances would be to engineer a social editorial filter. Don’t we want Twitter to evolve, to mature, to become even better? What we use today is a very immature version of what all media might become - ever-present, real-time/near-real-time, personal, participatory. It can continue to be all of these things *and* we can make it better too.
The solution I’ve been pondering is deliberately technology-lite, and that’s because we need to come up with something now. I reckon you could probably do this using a Tumble-log - most of the effort would be involved in creating a network of trusted curators and agreeing some basic groundrules. Nevertheless, it would also be healthy to consider technological solutions. I found one service on the night that claims to have created an algorithm based on filtering contributions at the beginning of an ‘event’ (see below). I can’t work out how and I can’t see much evidence of it. Apologies if I’m missing something - can anyone tell me how it works? (It’s called Tweetip and you can find it here).

And then there’s the The Dashboard of Doom: a horizontally scrolling mash-up of the leading Mumbai related #hashtags, Flickr-streams and Dipity timelines.

Please drop me a line to let me know what you think about ‘the next time’, and how we might clean the signal up a bit.
I’ll leave you with a selection of some of the more striking screen-grabs I’ve taken from the #Mumbai stream over the last few days. And cheers to my brother Ben, who helped out with this and the last post.








Veckan som gick - vecka 48 at Same Same But Different 30 Nov 2008 6:27 pm
[...] gjorde. Och Tim Moldon fortsätter att titta på baksidorna med Twitterrapporteringen och föreslår ett #moron-filter. Och kritiken som kommit handlar också om att Twitter inte är att lita på - en kritik som [...]
Mel Exon 30 Nov 2008 6:27 pm
Very thought-provoking piece. On the night itself I badly wanted better filters, at first because I was trying to locate a friend in Mumbai; then later, once I knew he was safe, I just wanted to lose the mob. Eventually I switched off…it was overwhelming and only got worse.
Yet the fact remains that Twitter is set up as a conversation, for anyone to join. The egalitarian in me does not want to see that change. Whilst a group of professional overseers may be the way to go, we risk losing what makes Twitter unique.
Perhaps instead we need a simple, primary or secondary filter which is always used to denote ‘utility’ about any given subject? If it’s personal opinion or commentary, send your tweet elsewhere.
I have (perhaps too much) faith in the ability of the crowd to moderate itself - we just need some rules to follow. As I scanned through 25-50+ Mumbai tweets a minute, it was hard to find and then keep up with the genuinely useful. As you say, the signal needed cleaning up. What if we had had a simple hashtag which separated out genuine information associated with the attack (covering how to obtain information about family & friends in the city to on-the-ground reports & calls for help, for example) from the chatter (sympathetic, bigoted or otherwise)? I would hope it would have been respected. A start, at least.
If not, god help us… time to bring on the wikipedia-style moderators.
Overall, it strikes me the topic raised here goes beyond Twitter and its relationship with the terrible events in Mumbai. It’s both the oldest and the newest of questions - can you, should you, try to control the crowd?
tweetip 30 Nov 2008 6:27 pm
Hi Tim,
Our tumblr is a log of our work, mixed with markers, timelines, odd bits. It’s not a news source.
Did you see the mumbai timeline we posted? It’s a snapshot of the very beginning of the event. We can’t show everything, but within that screen grab we feel the “trajectory” of the event can be forecast. But it’s not for folks who want all the details. That’s not what we’re aiming at.
Our aim is within the screen grab we posted today - the Wordle Cloud on tweets we posted PRIOR to the 1st tweet within the mumbai event. We’re filtering & tagging the twitter firehose for pre-conscious connections which when combined provide a possible forecast of a major event. Not always bad, but that’s where our world is right now.
Re your idea of worldwide storytellers - love it - so much so we began to code a desktop app called ‘TwitterProbe’ which would allow one to create their own filtering around events and then reblog/retweet as needed. This project is on hold for several reasons: 1) we need the twitter firehose which is not yet available publicly 2) we no longer have funding to support the program. Something may change in the future, but we’ve moved our focus to the forecasting.
hth,
Michael
Danny Brown 30 Nov 2008 6:27 pm
Completely agree 100%. There’s no doubt that Twitter could be used as an invaluable media tool, but there needs to be some major filtering and fact-finding to really make it stand out.
Do we have a dedicated and recognized group of journalists or news centers delivering the Tweets? Is citizen reporting the answer?
It’s hard to say what the answer is, and sadly until then it looks like we’re stuck with the chaff along with the wheat…
jeff 30 Nov 2008 6:27 pm
Twitter is young, and the way it’s being used is constantly evolving. The #mumbai feed this week was a new stage in its evolution.
As has been with Twitter’s use to date, I believe that users will determine how it’s used in the future. A peer reviewer system, when you have over 100 tweets a minute, will never work, and it also defeats the purpose and appeal of Twitter.
For users, in Twitter’s present form, I believe the solution to avoiding all the comment noise is using more detailed searches, such as #mumbai and emergency, or #mumbia and emergency and phone.
Unfortunately, I think you will see an increase in twitter feed spam and trolling. Dropping links into your web site within the busy #mumbai feed is a sure way to increase traffic to your web-site, and oddly, I only observed a little of it this week.
Better feed search tools is the answer in my opinion. Twitter could promote subsections of #mumbai for example. Further empower the users, instead of installing regulators.
Kashif 30 Nov 2008 6:27 pm
Hi, Social Media has its boons and banes. Also, SM is not always Citizen Journalism so we shouldn’t expected the contributors to follow the norms and protocols of Journalism. Its just common people who have found a new tool to express their anger, frustration and joy. Yes, we do have trolls and stalkers here, but they are found in real life too and it would be too harsh to label them as #moron
links for 2008-12-01 30 Nov 2008 6:27 pm
[...] Bring on the #moron filter on the need of establishing some human & automated filters; a kind of authority in the real-time diffusion of information. (tags: filter information twitter flux) [...]
Crisis,Twitter and Noise 30 Nov 2008 6:27 pm
[...] others have been pondering on various aspects of Citizen Journalism using Social Media tools and how could the noise be reduced from this [...]
Mayank Dhingra 30 Nov 2008 6:27 pm
Hi Tim,
Nice post and for one I am happy to see at least some people thinking on how to improve the system(Twitter here) rather than basking in the glory of self-proclaimed victory of Social Media over Conventional Media.
I too had a tough time keeping track of relevant tweets on #mumbai and was quick to change to #taj for the want of selected(and less) tweets.
About your proposal of having a selected group of people having more authority than other, I am not too sure if it will be possible/achievable. However an easier solution could be if some people start tagging new and useful information with a different tag #mumbainews or something.
Twitter zur Krisenkommunikation? « Net Thoughts 30 Nov 2008 6:27 pm
[...] eine größere Verlässlichkeit der Bürgerberichte in Ausnahmesituationen erreichen könnte. So überlegt etwa Tim Malbon, eine Twitter-Community in Zusammenarbeit mit CNN zu [...]