John Rentoul told us in yesterday’s Independent that he had found a tool which analysed what was being said about party leaders on Twitter, taking into account whether the comment was sarcastic or not.
I spoke to Karo Moilanen at the company about how “sentiment analysis” works. He told me the algorithm detects positive and negative sentiments associated with the leaders, and can even recognise a double negative as a positive, for example, “kill bacteria”.
What about sarcasm, I asked, thinking about how Twitter works. “We have a rudimentary sarcasm detector,” he said. “There are patterns which tend to correlate with sarcasm.” But how accurate is it? “Sarcasm is hard for people to detect. Human accuracy can be as low as 40 per cent.”
TheySay “trains” its computer programme by feeding it texts that humans have marked as being sarcastic. “Algorithms can hence learn that sarcasm tends to involve cases in which someone likes something negative,” said Moilanen, “or conflicting or abrupt changes of sentiment between strongly positive and negative words and phrases.” He said that computer algorithms can detect sarcasm between 55 and 95 per cent of the time, depending on the study, with an average of 77 per cent.
Mentions of Clegg and Farage were marginally positive while mentions of Cameron and Miliband were marginally negative.
Proportionately, though, Clegg’s volume is significantly lower than the others. This may be because Liberal Democrats may not be directly talking about him. It would be interesting to see what the score was on party names rather than leaders’ names. Cameron has by far the most mentions – 14k compared to almost 6k for Farage and, surprisingly, only 5.2k for the Leader of the Opposition. Low volume and negativity might suggest that Labour has a bit of a social media problem.
The pictures of the leaders that they use are pretty awful, but it might be fun to keep half an eye on They Say over the next few months.
There are a lot of very positive things we could be tweeting about Nick Clegg. Our 48 good things Nick Clegg has done could give you some ideas.
* Caron Lindsay is Editor of Liberal Democrat Voice and blogs at Caron's Musings
One Comment
It’s an interesting confirmation of something I realised years ago in the days when I was writing Focus which is that it is a waste of time using irony or sarcasm because by and large people don’t ‘get’ it.