What does the Twitter “sarcasm detector” tell us?

They Say sarcasm detectorJohn Rentoul told us in yesterday’s Independent that he had found a tool which analysed what was being said about party leaders on Twitter, taking into account whether the comment was sarcastic or not.

I spoke to Karo Moilanen at the company about how “sentiment analysis” works. He told me the algorithm detects positive and negative sentiments associated with the leaders, and can even recognise a double negative as a positive, for example, “kill bacteria”.

What about sarcasm, I asked, thinking about how Twitter works. “We have a rudimentary sarcasm detector,” he said. “There are patterns which tend to correlate with sarcasm.” But how accurate is it? “Sarcasm is hard for people to detect. Human accuracy can be as low as 40 per cent.”

TheySay “trains” its computer programme by feeding it texts that humans have marked as being sarcastic. “Algorithms can hence learn that sarcasm tends to involve cases in which someone likes something negative,” said Moilanen, “or conflicting or abrupt changes of sentiment between strongly positive and negative words and phrases.” He said that computer algorithms can detect sarcasm between 55 and 95 per cent of the time, depending on the study, with an average of 77 per cent.

Mentions of Clegg and Farage were marginally positive while mentions of Cameron and Miliband were marginally negative.

Proportionately, though, Clegg’s volume is significantly lower than the others. This may be because Liberal Democrats may not be directly talking about him. It would be interesting to see what the score was on party names rather than leaders’ names. Cameron has by far the most mentions – 14k compared to almost 6k for Farage and, surprisingly, only 5.2k for the Leader of the Opposition.  Low volume and negativity might suggest that Labour has a bit of a social media problem.

The pictures of the leaders that they use are pretty awful, but it might be fun to keep half an eye on They Say over the next few months.

There are a lot of very positive things we could be tweeting about Nick Clegg. Our 48 good things Nick Clegg has done could give you some ideas.

* Caron Lindsay is Editor of Liberal Democrat Voice and blogs at Caron's Musings

Read more by or more about , , or .
This entry was posted in News.
Advert

One Comment

  • It’s an interesting confirmation of something I realised years ago in the days when I was writing Focus which is that it is a waste of time using irony or sarcasm because by and large people don’t ‘get’ it.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

*
*
Please complete the name of this site, Liberal Democrat ...?

Advert

Recent Comments

  • Barry Smith
    @Mike Peters - Part of the reason we have so many MPs is that the government is almost entirely made up of them, while the Americans go for a system where the P...
  • Steve Trevethan
    Are dominant theories always correct? Might it be appropriate to judge theories by their practical outcomes? Might policies based on current Neo-liberal t...
  • Tim Rogers
    Iran attacks Qatar. So if Qatar asks for help we will now have to consider. Of course we may never be asked so have to wait and see....
  • Simon R
    @Steve: Yes, people did once, a long time ago, believe the Earth was flat and not so long ago that it was the centre of the Universe - although I'm not sure it...
  • Sue Doughty
    Have a lovely day Mary. Great to see the well deserved recognition for all you have done....