This post is a follow-up to last year’s How to Create Topic Clouds with Lexos, where I showed how Lexos can be used to visualise topic models produced by Mallet. From time to time, colleagues have wondered whether it would be possible to use Lexos to perform cluster analysis on the topics Mallet produces. The motivation for doing this is simple enough; topics are often very similar, and it would be useful to have some statistical measure of this similarity to help us decide where groups of topics really should be interpreted under some meta-class. Some added urgency has arisen in discussions for the 4Humanities WhatEvery1Says Project, which is topic modelling a large collection of public discourse about the Humanities. We’ve begun considering whether doing cluster analysis on topic models can help us to refine our experiments.
The first step is finding a way to massage the Mallet data into a form we can submit to clustering algorithms. Lexos already transforms Mallet output into a topic-term matrix, which is then used to make word clouds using the top 100 words in each topic. Essentially, the topics are treated just like text documents (or at least slices of them).… Read more…
I’m at the DH 2014 conference in Lausanne, Switzerland, and enjoying it immensely, despite cold and rainy weather which should be impossible in July. I’ve just delivered my paper “Play as Process and Product: On Making Serendip-o-matic” (abstract here), along with colleagues Mia Ridge and Brian Croxall (co-author Amy Papaelias couldn’t make it but contributed remotely). Iʼll blog more on the conference itself in a separate post, but for now I thought Iʼd put my portion of the presentation online. Hereʼs Miaʼs portion, and here Brian’s portion.
Play as Process and Product: On Making Serendip-o-matic
Hi, Iʼm Scott Kleinman, and my job is to introduce you to the One Week | One Tool experience which led to the creation of Serendip-o-matic. One Week | One Tool was a summer institute sponsored by the National Endowment for the Humanities. It was organised by Tom Scheinfeldt and Patrick Murray-John, and hosted by the Roy Rosenzweig Center for History and New Media at George Mason University. The idea for One Week | One Tool was inspired by models of rapid community development and advertised as a digital “barn-raising”, in which a diverse group of twelve DH practitioners would gather “to produce something useful for humanities work and to help balance learning and doing in digital humanities training.” The entire process from conception to release was to occur in six days.… Read more…