Saturday, July 6, 2013

The Arab Spring, Zest Cloudio and Butterflyzer

One of the goals that I'm really trying to drive Butterflyzer toward is finding a middle ground between the level of detail that hard-core social network analysts get into, and the incredibly over-simplified executive dashboard approach that so many of the social media analysis startups are providing. A big part of this is providing fluid, interactive visualization. So far a lot of that has been based on graph visualization, but we're also experimenting with integrating other approaches.
One of the cool things that we've got lying around to play with are a bunch of tweets collected during the start of the Arab Spring. We've used a lot of different techniques for visualizing and analyzing this data, but when the Eclipse toolset came along recently, I thought it would be an interesting way to quickly see what exactly people were really talking about. I think the results speak for themselves. Thanks to Stephan Schwiebert for this . One of the downsides of this approach is that unlike in our graph visualizations, you lose concept proximity. So for example, looking at the cloud you can instantly see that Tunisia and Lebanon are frequently mentioned, but what you can't see is how frequently they are used together. That's what our graph visualization tools do now, and I think there are some neat possibilities for marrying the two approaches.
Butterflyzer work has kicked back into high gear, and I'm currently collecting live streaming data from Twitter on the OccupyWallStreet movement. I can't wait to put together a similar word cloud for it. Obviously, a lot has changed in Egypt in the nine months since this data was collected. Who knows what will have changed here nine months from now?
Methodology: The data was collected from 10,000 tweets between Jan 23 and 29th containing the word "egypt". We then extracted word counts, removing common english words and other noise, and then visualized the remaining words with Cloudio, sizing for frequency of use. - Full Post

No comments:

Post a Comment