What does the Twitter “sarcasm detector” tell us?

They Say sarcasm detectorJohn Rentoul told us in yesterday’s Independent that he had found a tool which analysed what was being said about party leaders on Twitter, taking into account whether the comment was sarcastic or not.

I spoke to Karo Moilanen at the company about how “sentiment analysis” works. He told me the algorithm detects positive and negative sentiments associated with the leaders, and can even recognise a double negative as a positive, for example, “kill bacteria”.

What about sarcasm, I asked, thinking about how Twitter works. “We have a rudimentary sarcasm detector,” he said. “There are patterns which tend to correlate with sarcasm.” But how accurate is it? “Sarcasm is hard for people to detect. Human accuracy can be as low as 40 per cent.”

TheySay “trains” its computer programme by feeding it texts that humans have marked as being sarcastic. “Algorithms can hence learn that sarcasm tends to involve cases in which someone likes something negative,” said Moilanen, “or conflicting or abrupt changes of sentiment between strongly positive and negative words and phrases.” He said that computer algorithms can detect sarcasm between 55 and 95 per cent of the time, depending on the study, with an average of 77 per cent.

Mentions of Clegg and Farage were marginally positive while mentions of Cameron and Miliband were marginally negative.

Proportionately, though, Clegg’s volume is significantly lower than the others. This may be because Liberal Democrats may not be directly talking about him. It would be interesting to see what the score was on party names rather than leaders’ names. Cameron has by far the most mentions – 14k compared to almost 6k for Farage and, surprisingly, only 5.2k for the Leader of the Opposition.  Low volume and negativity might suggest that Labour has a bit of a social media problem.

The pictures of the leaders that they use are pretty awful, but it might be fun to keep half an eye on They Say over the next few months.

There are a lot of very positive things we could be tweeting about Nick Clegg. Our 48 good things Nick Clegg has done could give you some ideas.

* Caron Lindsay is Editor of Liberal Democrat Voice and blogs at Caron's Musings

Read more by or more about , , or .
This entry was posted in News.
Advert

One Comment

  • It’s an interesting confirmation of something I realised years ago in the days when I was writing Focus which is that it is a waste of time using irony or sarcasm because by and large people don’t ‘get’ it.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

*
*
Please complete the name of this site, Liberal Democrat ...?

Advert



Recent Comments

  • Geoffrey Payne
    (continued from previous message)...
  • Geoffrey Payne
    No one likes to talk about it, not even the Liberal Democrats, but we have a public sector funding crises. Our most successful campaigns; sorting out the sewage...
  • Geoffrey Payne
    We have to always be prepared for the unexpected. It is good politics therefore to claim that there may be an early General Election. However the usual rule a...
  • Tim Rogers
    As well as Ukraine and Gaza it is possible that Burma is about to implode. All the coups in West Africa remain unresolved. Venezuela might have a go at Guyana. ...
  • Tim Rogers
    I know that nobody will like it but we are already in a second cold war. The Moscow Beijing axis will grow,especially in Middle East and Africa. The Americans w...