Menu Close

SXSW Interactive: Data and Revelations

I am typing on a laptop in the Samsung blogger lounge at SXSW. Given this easy opportunity to blog, I wanted to share the overarching theme for my experience so far (3 days in) to SXSW Interactive. Data. It is all about data. APIs exposing data. People visualizing data. Using data to make business and policy decisions. Graphing data to keep track of web site and application performance. Privacy of data. Crowdsourcing data. Data about social media behavior. And on and on!

It has been a common thread I have traced from session to session, conversation to conversation. I expect someone with less of a database and metadata fixation might see something else as the overall meme, but I have a purse full of cards pointing me to new data sources and a notebook full of URLs to track down later to defend my view.

I keep catching myself giving mini-lessons on archives and preservation of electronic records like some sort of envoy from another universe. While I feel like a strong overall tech person at an archives conference, I feel like a data and visualization person here. This morning two of my sessions were over in the same hotel that SAA in Austin was hosted in and it was strange to be in that hotel with such a different group of people. I have managed to connect with an assortment of digital humanities folks. Someone even managed to find space for and plan an informal event for tomorrow night: Innovating and Developing with Libraries, Archives, and Museums.

My list of tech to learn (HTML5, NoSQL) and projects to contemplate and move forward (mostly ideas for visualizations using all the data everyone is sharing) is getting longer by the hour. It has been a process to figure out how to get the most I can out of SXSW. It is definitely more a space for inspiration than for deep diving into specifics. Letting go of the instinct that I am supposed to ‘learn new skills’ at a conference is fabulous!

Heading to Austin for SXSW Interactive

Anyone out there going to be at SXSWi? I would love to find like-minded DH (digital humanities) and GLAM (Galleries, Libraries, Archives & Museums) folks in Austin. If you can’t go, what do you wish I would attend and blog about after the fact?

No promises on thoroughness of my blogging of course. I never have mastered the ‘live blogging’ approach, but I do enjoy taking notes and if the past is any guide to the future I usually manage at least 2 really detailed posts on sessions from any one conference. The rest end up being notes to myself that I always mean to somehow go back to and post later. Maybe I need to spend a month just cleaning up and posting old session summaries (or at least those that still seem interesting and relevant!).

Drop me a comment below or contact me directly and let me know if you will be in Austin between March 10 and 15. Hope to see some of you there!

Creative Funding for Text-Mining and Visualization Project

The Hip-Hop word count project on Kickstarter.com caught my eye because it seems to be a really interesting new model for funding a digital humanities project. You can watch the video below – but the core of the project tackles assorted metadata from 40,000 rap songs from 1979 to the present including stats about each song (word count, syllables, education level, etc), individual words, artist location and date. This information aims to become a public online almanac fueled by visualizations.

I am a backer of this project, and you can be too. As of the original writing of this post, they are currently 47% funded twenty-eight days out from their deadline. For those of you not familiar with Kickstarter, people can post creative projects and provide rewards for their funders. The funding only goes through if they reach their goal within the time limit – otherwise nothing happens, a model they call ‘all-or-nothing funding’.

What will the money be spent on?

  • 45% for PHP programmers who have been coding the custom web interface
  • 35% for interface designers
  • 10% for data acquisition & data clean up
  • 10% for hosting bills

They aim for a five month time-line to move from their existing functional prototype to something viable to release to the public.

I am also intrigued by ways that the work on this project might be leveraged in the future to support similar text-mining projects that tie in location and date. How about doing the same thing with civil war letters? How about mining the lyrics from Broadway musical songs?

If this all sounds interesting, take a look at the video below and read more on the Hip-Hop Word Count Kickstarter home page. If half the people who follow my RSS feed pitch in $10, this project would be funded. Take a look and consider pitching in. If this project doesn’t speak to you – take a look around Kickstarter for something else you might want to support.

Blog Action Day: Flickr Commons Images of Acquiring Water

Water in Bengal
Water in Benal (1944)

In honor of this year’s Blog Action Day theme of Water, I wanted to share some stunning images from the Flickr Commons. The images I have selected, contributed by cultural heritage institutions from around the world, show methods of transportation or acquisition of water. I will let the images speak for themselves below, but next time you go to turn on the tap water in your home – think of all of those for whom getting water is a huge challenge each and every day. While most of the images below are from decades ago, easy access to safe, clean water is still a current issue. Please consider supporting an organization like Charity: Water, a non-profit organization bringing clean and safe drinking water to people in developing nations. 100% of public donations directly fund water projects.

And now.. the photos!

Summer scene, N.Y. - drinking water from street pump (LOC)
1910: Drinking Water from Street Pump, NY
Catskill aqueduct. ... Contract 58. March 4, 1913.
1913, Catskill Aqueduct
Filling an Indian pot with water from the cart
1918, Central France, Filling pot with water from a cart
[Native girls, Marken Island, Holland] (LOC)
1890: Native Girls in Holland
Ways of using a divining rod (LOC)
1910: Ways of using a divining rod
Alice Thompson, Besoco, West Virginia, Is Shown with Milk Bottles Her Neighbors Furnish Her Water with after Her Water Lines Were Cut Off. She Is Divorced From a Coal Miner Who Was Imprisoned for Killing a Man 04/1974
1974: Alice Thompson, Besoco, West Virginia, Is Shown with Milk Bottles Her Neighbors Furnish Her Water with after Her Water Lines Were Cut Off. She Is Divorced From a Coal Miner Who Was Imprisoned for Killing a Man
Faro Caudill drawing water from his well, Pie Town, New Mexico (LOC)
1940: Faro Caudill drawing water from his well, Pie Town, New Mexico

 

Breast Cancer: Join the Army of Women & Help Scientists Find the Cause

In honor of the Army of Women Day, my post today takes a quick look at how the American public  has been delivered various messages about cancer via posters and PSAs.

These two 1930s posters from the Library of Congress focus their message on convincing women to seek treatment from their doctor quickly and not fight their cancer alone.

By the 70s we got PSAs from organizations like the American Cancer Society, focusing on not smoking, doing self-exams and seeing your doctor for ‘regular cancer check-ups’. The clip below features Farrah Fawcett in 1981 (25 years before her own cancer diagnosis):

Almost 30 years later we have a new kind of video appeal. The Army of Women, a program of the Dr. Susan Love Research Foundation, funded by a grant from the Avon Foundation for Women, is recruiting 1,000,000 women (and men!) of all ages and ethnicities to participate in studies to find the cause of breast cancer. Their PSA below recasts the challenge. Now, instead of living a healthy lifestyle and then seeking out doctors for diagnosis and treatment – we are asked to join forces with others to support doctors in their research the cause of breast cancer.

I lost my aunt to breast cancer. I have more friends and family who have fought breast cancer than I can count on one hand. I joined the Army of Women over a year ago.

What can you do?

  • If you are over 18, sign up to join the Army of Women database. The first step is to add your name to the pool of individuals willing to be contacted to hear about research projects in the future. It is free. You are not agreeing to participate in any specific project, just adding yourself to the list so researchers can find the subjects they need as fast as possible.
  • Invite your friends and family to join.

Help us reach a day when the only way that a woman can learn about what it was like to have breast cancer is from memoirs, documentaries and tear-jerker movies. I want to put cancer in the archives (forgive me.. couldn’t resist it!).

SAA2010: SEO and Archives Websites

Just a quick reminder that I will be presenting tomorrow morning at SAA2010 on the topic of search engine optimization and archives websites. I am part of session 502 officially titled Not on Google? It Doesn’t Exist: Findability and Search Engine Optimization for Archives. My specific portion of the presentation is titled ‘Building Archives Websites That Google Will Love’ and will be a general introduction to SEO concepts and why they are important to those involved in the creation of websites for archives and other cultural heritage institutions. It will include some basic tips and techniques.

My two co-presenters, Matt Herbison and Mark Matienzo, will discuss more in depth issues related to website architecture, URLs and increasing links back into your website. We hope you can join us, even though our session is during the less than pleasant 8am Saturday morning time slot. I will be posting my slides after our session and linking to them from my presentations page. I plan to pick up some donuts to sweeten the deal!

ArchivesZ Needs You!

I got a kind email today asking “Whither ArchivesZ?”. My reply was: “it is sleeping” (projects do need their rest) and “I just started a new job” (I am now a Metadata and Taxonomy Consultant at The World Bank) and “I need to find enthusiastic people to help me”. That final point brings me to this post.

I find myself in the odd position of having finished my Master’s Degree and not wanting to sign on for the long haul of a PhD. So I have a big project that was born in academia, initially as a joint class project and more recently as independent research with a grant-funded programmer, but I am no longer in academia.

What happens to projects like ArchivesZ? Is there an evolutionary path towards it being a collaborative project among dispersed enthusiastic individuals? Or am I more likely to succeed by recruiting current graduate students at my former (and still nearby) institution? I have discussed this one-on-one with a number of individuals, but I haven’t thrown open the gates for those who follow me here online.

For those of you who have been waiting patiently, the ArchivesZ version 2 prototype is avaiable online. I can’t promise it will stay online for long – it is definitely brittle for reasons I haven’t totally identified. A few things to be aware of:

  • when you load the main page, you should see tags listed at the bottom – if you don’t at all, then drop me an email via my contact form and I will try and get Tomcat and Solr back up. If you have a small screen – you may need to view your browser full screen to get to all the parts of the UI.
  • I know there are lots of bugs of various sizes. Some paths through the app work – some don’t. Some screens are just placeholders. Feel free to poke around and try things – you can’t break it for anyone else!

I think there are a few key challenges to building what I would think of as the first ‘full’ version of ArchivesZ – listed here in no particular order:

  • In the process of creating version 2, I was too ambitious. The current version of ArchivesZ has lots of issues, some usability – some bugs (see prototype above!)
  • Wherever a collaborative workspace of ArchivesZ were going to live, it would need large data sets. I did a lot of work on data from eleven institutions in the spring of 2009, so there is a lot of data available – but it is still a challenge.
  • A lot of my future ideas for ArchivesZ are trapped in my head. The good news is that I am honestly open to others’ ideas for where to take it in the future.
  • How do we build a community around the creation of ArchivesZ?

I still feel that there is a lot to be gained by building a centralized visualization tool/service through which researchers and archivists could explore and discover archival materials. I even think there is promise to a freestanding tool that supports exploration of materials within a single institution. I can’t build it alone. This is a good thing – it will be a much better in the end with the input, energy and knowledge of others. I am good at ideas and good at playing the devil’s advocate. I have lots of strength on the data side of things and visualization has been a passion of mine for years. I need smart people with new ideas, strong tech skills (or a desire to learn) and people who can figure out how to organize the herd of cats I hope to recruit.

So – what can you do to help ArchivesZ? Do you have mad Action Script 3 skills? Do you want to dig into the scary little ruby script that populates the database? Maybe you prefer to organize and coordinate? You have always wanted to figure out how a project like this could group from a happy (or awkward?) prototype into a real service that people depend on?

Do you have a vision for how to tackle this as a project? Open source? Grant funded? Something else clever?

Know any graduate students looking for good research topics? There are juicy bits here for those interested in data, classification, visualization and cross-repository search.

I will be at SAA in DC in August chairing a panel on search engine optimization of archival websites. If there is even just one of you out there who is interested, I would cheerfully organize an ArchivesZ summit of some sort in which I could show folks the good, bad and ugly of the prototype as it stands. Let me know in the comments below.

Won’t be at SAA but want to help? Chime in here too. I am happy to set up some shared desktop tours of whatever you would like to see.

PS: Yes, I do have all the version 2 code – and what is online at the Google Code ArchivesZ page is not up to date. Updating the ArchivesZ website and uploading the current code is on my to do list!