When two Boston-area organisations rolled out an interactive data visualisation website last month, it represented one of the largest public uses yet for the open-source project Weave - and more are on the way.
Three years in development so far and still in beta, Weave is designed so government agencies, non-profits and corporate users can offer the public an easy-to-use platform for examining information. Want to see the relationship between low household incomes and student reading scores in Eastern Massachusetts? How housing and transportation costs compare with income? Or maybe how obesity rates have changed over time? Load some data to generate a table, scatter plot and map.
In addition to viewing data, mousing over various entries lets you highlight items on multiple visualisations at once: map, map legend, bar chart and scatter plot, for example. Users can also add visualisation elements or change data sets, as well as right-click to look up related information on the Web.
The benefits of Weave's interactivity go beyond the visual appeal of selecting an area on a chart and seeing matches highlighted on a map, said consultant James Farnam, project coordinator for the Connecticut Data Collaborative and an early Weave backer. "You're creating subsets of data on the fly," he said. With a single click on a scatter plot, "you can recalculate regression lines and relationships that you're testing."
Users are already working on a set of quality tests within Weave to help find data errors visually, he said.
A Wikipedia of data
Data visualisation tools have long been in the hands of the technically savvy, but Weave aims to help organisations democratise them, creating what project head Georges G. Grinstein calls a Wikipedia of data - a way for anyone interested in a topic to explore and analyse information about it, instead of leaving the task solely to computer and data specialists.
"Now [you're] engaging the public in a dialog with the data," said Grinstein, director of the University of Massachusetts at Lowell's Institute for Visualization and Perception Research. "That's why Weave is open source and free" - even though it contains some university-patented technology (the institution agreed to allow it in the software).
About 25 to 30 students have worked on the project in its first three years at UMass-Lowell, in partnership with the Open Indicators Consortium, a group of early users and supporters of the project. Grinstein expects work will continue for another three years at UMass-Lowell, and involve whatever additions the open-source community wants to contribute. The project was built using Adobe Flex and ActionScript.
Several more powerful features have already been architected and are just awaiting user-interface design, including collaboration and session-capture expected this summer.
Collaboration will allow people in multiple locations to work on a visualization together in real time, without needing a screen-sharing application such as WebEx, Grinstein said.
Nifty new tools
Session-capture will let users record every step they do in making a visualisation, so they can re-create the process for another visualisation or share their steps with other users. Once privacy issues are worked out, Grinstein said, such session captures could also be used by researchers to better understand how people interact with data - and even offer suggested next steps to new users if they get stuck.
Weave is still somewhat difficult to install, Grinstein admitted, but plans call for a lighter one-click installer by summer as well.
Also on the way: so-called "infomaps," one of the patented technologies within Weave, that can tie a mapping visualisation to a collection of documents. Even if a document isn't geocoded but just mentions, say, "Andover, Massachusetts," Grinstein said, that document would be retrieved if a user clicked on Andover on the Weave-created map. It is, Grinstein said, like Google Maps tied to a body of documents - while also offering multi-visualisation interactivity.
St. Clair said she's become so used to working in Weave that she finds herself getting frustrated in Excel because she can't simply mouse over numbers and see matching data highlighted on a nearby chart.
"You start not being satisfied with filtering data in spreadsheets," Farnam agreed.
Interaction, St. Clair added, "starts to morph the way you think about data."