What does the Twitter “sarcasm detector” tell us?

They Say sarcasm detectorJohn Rentoul told us in yesterday’s Independent that he had found a tool which analysed what was being said about party leaders on Twitter, taking into account whether the comment was sarcastic or not.

I spoke to Karo Moilanen at the company about how “sentiment analysis” works. He told me the algorithm detects positive and negative sentiments associated with the leaders, and can even recognise a double negative as a positive, for example, “kill bacteria”.

What about sarcasm, I asked, thinking about how Twitter works. “We have a rudimentary sarcasm detector,” he said. “There are patterns which tend to correlate with sarcasm.” But how accurate is it? “Sarcasm is hard for people to detect. Human accuracy can be as low as 40 per cent.”

TheySay “trains” its computer programme by feeding it texts that humans have marked as being sarcastic. “Algorithms can hence learn that sarcasm tends to involve cases in which someone likes something negative,” said Moilanen, “or conflicting or abrupt changes of sentiment between strongly positive and negative words and phrases.” He said that computer algorithms can detect sarcasm between 55 and 95 per cent of the time, depending on the study, with an average of 77 per cent.

Mentions of Clegg and Farage were marginally positive while mentions of Cameron and Miliband were marginally negative.

Proportionately, though, Clegg’s volume is significantly lower than the others. This may be because Liberal Democrats may not be directly talking about him. It would be interesting to see what the score was on party names rather than leaders’ names. Cameron has by far the most mentions – 14k compared to almost 6k for Farage and, surprisingly, only 5.2k for the Leader of the Opposition.  Low volume and negativity might suggest that Labour has a bit of a social media problem.

The pictures of the leaders that they use are pretty awful, but it might be fun to keep half an eye on They Say over the next few months.

There are a lot of very positive things we could be tweeting about Nick Clegg. Our 48 good things Nick Clegg has done could give you some ideas.

* Caron Lindsay is Editor of Liberal Democrat Voice and blogs at Caron's Musings

Read more by or more about , , or .
This entry was posted in News.

One Comment

  • It’s an interesting confirmation of something I realised years ago in the days when I was writing Focus which is that it is a waste of time using irony or sarcasm because by and large people don’t ‘get’ it.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

If you are a member of the party, you can have the Lib Dem Logo appear next to your comments to show this. You must be registered for our forum and can then login on this public site with the same username and password.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

Please complete the name of this site, Liberal Democrat ...?


Recent Comments

    No recent comment found.