I will break this down into a number of phases:

• Phase 1: Hardware
• Phase 2: Pull the data off the disk
• Phase 3: Extract the files from the disk image
• Phase 4: Migrate or Emulate

Phase 1: Hardware

Before you do anything else, you actually need a 5.25″ floppy drive of some kind connected to your computer.  I was lucky – a friend had a floppy drive for us to work with. If you aren’t that lucky, you can generally find them on eBay for around $25 (sometimes less). A friend had been helping me by trying to connect the drive to my existing PC – but we could never get the communications working properly. Finally I found Device Side Data’s 5.25″ Floppy Drive Controller which they sell online for $55. What you are purchasing will connect your 5.25 Floppy Drive to a USB 2.0 or USB 1.1 port. It comes with drivers for connection to Windows, Mac and Linux systems.

If you don’t want to mess around with installing the disk drive into our computer, you can also purchase an external drive enclosure and a tabletop power supply. Remember, you still need the USB controller too.

Update: I just found a fantastic step-by-step guide to the hardware installation of Device Side’s drive controller from the Maryland Institute for Technology in the Humanities (MITH), including tons of photographs, which should help you get the hardware install portion done right.

Phase 2: Pull the data off the disk

The next step, once you have everything installed, is to extract the bits (all those ones and zeroes) off those floppies. I found that creating a new folder for each disk I was extracting made things easier. In each folder I store the disk image, a copy of the extracted original files and a folder named ‘converted’ in which to store migrated versions of the files.

Device Side provides software they call ‘Disk Image and Browse’. You can see an assortment of screenshots of this software on their website, but this is what I see after putting a floppy in my drive and launching USB Floppy -> Disk Image and Browse:

You will need to select the ‘Disk Type’ and indicate the destination in which to create your disk image. Make sure you create the destination directory before you click on the ‘Capture Disk File Image’ button. This is what it may look like in progress:

Fair warning that this won’t always work. At least the developers of the software that comes with Device Side Data’s controller had a sense of humor. This is what I saw when one of my disk reads didn’t work 100%:

If you are pressed for time and have many disks to work your way through, you can stop here and repeat this step for all the disks you have on hand.

Phase 3: Extract the files from the disk image

Now that you have a disk image of your floppy, how do you interact with it? For this step I used a free tool called Virtual Floppy Drive. After I got this installed properly, when my disk image appeared, it was tied to this program. Double clicking on the Floppy Image icon opens the floppy in a view like the one shown below:

It looks like any other removable disk drive. Now you can copy any or all of the files to anywhere you like.

Phase 4: Migrate or Emulate

The last step is finding a way to open your files. Your choice for this phase will depend on the file formats of the files you have rescued. My files were almost all WordStar word processing documents. I found a list of tools for converting WordStar files to other formats.

The best one I found was HABit version 3.

It converts Wordstar files into text or html and even keeps the spacing reasonably well if you choose that option. If you are interested in the content more than the layout, then not retaining spacing will be the better choice because it will not put artificial spaces in the middle of sentences to preserve indentation. In a perfect world I think I would capture it both with layout and without.

Summary

So my rhythm of working with the floppies after I had all the hardware and software installed was as follows:

• create a new folder for each disk, with an empty ‘converted’ folder within it
• insert floppy into the drive
• run DeviceSide’s Disk Image and Browse software (found on my PC running Windows under Start -> Programs -> USB Flopy)
• paste the full path of the destination folder
• name the disk image
• click ‘Capture Disk Image’
• double click on the disk image and view the files via vfd (virtual floppy drive)
• copy all files into the folder for that disk
• convert files to a stable format (I was going from WordStar to ASCII text) and save the files in the ‘converted’ folder

These are the detailed instructions I tried to find when I started my own data rescue project. I hope this helps you rescue files currently trapped on 5 1/4″ floppies. Please let me know if you have any questions about what I have posted here.

Update: Another great source of information is Archive Team’s wiki page on Rescuing Floppy Disks.

This post is from from: Spellbound Blog.

Rescuing 5.25″ Floppy Disks from Oblivion

Presenters:

• Adele McAlear author of Death and Digital Legacy
• Dazza Greenwood author of Civics.com
• Evan Carroll and John Romano, co-authors of Your Digital Afterlife
• Jesse Davis cofounder of Entrustet

There was a lot to take in here. You can listen to the full audio of the session or watch a recording of the session’s live stream (the first few minutes of the stream lacks audio).

A quick and easy place to start is this lovely little video created as part of the promotion of Your Digital Afterlife – it gives a nice quick overview of the topic:

Also take a look at the Visual Map that was drawn by Ryan Robinson during the session – it is amazing! Rather than attempt to recap the entire session, I am going to just highlight the bits that most caught my attention:

Laws, Policies and Planning
Currently individuals are left reading the fine print and hunting for service specific policies regarding access to digital content after the death of the original account holder. Oklahoma recently passed a law that permits estate executors to access the online accounts of the recently deceased – the first and only state in the US to have such a law. It was pointed out during the session that in all other states, leaving your passwords to your loved ones is you asking them to impersonate you after your death.

Facebook has an online form to report a deceased person’s account – but little indication of what this action will do to the account. Google’s policy for accessing a deceased person’s email requires six steps, including mailing paper documents to Mountain View, CA.

There is a working group forming to create model terms of service – you can add your name to the list of those interested in joining at the bottom of this page.

What Does Ownership Mean?
What is the status of an individual email or digital photo? Is it private property? I don’t recall who mentioned it – but I love the notion of a tribe or family unit owning digital content. It makes sense to me that the digital model parallel the real world. When my family buys a new music CD, our family owns it – not the individual who happened to go to the store that day. It makes sense that an MP3 purchased by any member of my family would belong to our family. I want to be able to buy a Kindle for my family and know that my son can inherit my collection of e-books the same way he can inherit the books on my bookcase.

Remembering Those Who Have Passed
How does the web change the way we mourn and memorialize people? Many have now had the experience of learning of the passing of a loved one online – the process of sorting through loss in the virtual town square of Facebook. How does our identity transform after we are gone? Who is entitled to tag us in a photo?

My family suffered a tragic loss in 2009 and my reaction was to create a website dedicated to preserving memories of my cousin. At the Casey Feldman Memories site, her friends and family can contribute memories about her. As the site evolved, we also added a section to preserve her writing (she was a journalism student) – I kept imagining the day when we realized that we could no longer access her published articles online. I built the site using Omeka and I know that we have control over all the stories and photos and articles stored within the database.

It will be interesting to watch as services such as Chronicle of Life spring up claiming to help you “Save your memories FOREVER!”. They carefully explain why they are a trustworthy digital repository and why they backup their claims with a money-back guarantee.

For as little as $10, you can preserve your life story or daily journal forever: It allows you to store 1,000 pages of text, enough for your complete autobiography. For the same amount, you could also preserve less text, but up to 10 of your most important photos. – Chronicle of Life Pricing

Privacy
There are also some interesting questions about privacy and the rights of those who have passed to keep their secrets. Facebook currently deletes some parts of a profile when it converts it to a ‘memorial’ profile. They state that this is for the privacy of the original account holder. If users are ultimately given more power over the disposition of their social web presence – should these same choices be respected by archivists? Or would these choices need to be respected the way any other private information is guarded until some distant time after which it would then be made available?

Conculsion
Thanks again to all the presenters – this really was one of the best sessions for me at SXSWi! I loved that it got a whole different community of people thinking about digital preservation from a personal point of view. You may also want to read about Digital Death Day – one coming up in May 2011 in the San Francisco Bay Area and another in September 2011 in the Netherlands.

Image credit: Excerpt from Ryan Robinson’s Visual Map created live during the SXSW session.

This post is from from: Spellbound Blog.

SXSWi: You’re Dead, Your Data Isn’t: What Happens Now?

Digital lives is a joint project of UCL, British Library and University of Bristol

What? We need a better understanding of how people manage digital collections on their laptops, pdas and home computers. This is important due to the transition from paper-based personal collections to digital collections. The hope is to help people manage their digital archives before the content gets to the archives.

How? Talk to people with in-depth narrative interview. Ask people of their very first memories of information technology. When did they first use the computer? Do they have anything from that computer? How did they move the content from that computer? People enjoyed giving this narrative digital history of their lives.

Who? 25 interviewees – both established and emerging people whose works would or might be of interest to repositories of the future.

Findings?

• They created a detailed flowchart of users’ reported process of document manipulation.
• Common patterns in use of email showed that people used email across all these platforms and environments. Preserving email is not just a case of saving one account’s messages:
  • work email
  • Gmail/Yahoo
  • mails via Facebook
  • Twitter
• Documented personal information styles that relate skills dimension to data security dimension.

The one question I caught was from someone who asked if they thought people would stop using folders to organize emails and digital files with the advent of easy search across documents. The speaker answered by mentioning the revelations in the paper Don’t Take My Folders Away!. People like folders.

My Thoughts

This session got me to think again about the SAA2008 session that discussed the challenges that various archivists are facing with hybrid literary collections. Matthew Kirschenbaum also pointed me to MITH’s white paper: Approaches to Managing and Collecting Born-Digital Literary Materials for Scholarly Use.

I am very interested to see how ideas about preserving personal digital records evolve. For example, what happens to the idea of a ‘draft’ in a world that auto-saves and versions documents every few minutes such as Google Documents does?

With born digital photos we run into all sorts of issues. Photos that are simultaneously kept on cameras, hard drives, web based repositories (flickr, smugmug, etc) and off-site backup (like mozy.com). Images are deleted and edited differently across environments as well. A while back I wrote a post considering the impact of digital photography on the idea of photographic negatives as the ‘photographers’ sketchbooks’: Capa’s Found Images and Thoughts on Digital Photographers’ Sketchbooks.

I really liked the approach of this project in that it looked at general patterns of behavior rather than attempting to extrapolate from experiences of archivists with individual collections. This sort of research takes a lot of energy, but I am hopeful that basically creating these general user profiles will lead to best practices for preserving personal digital collections that can be applied easily as needed.

As is the case with all my session summaries from DH2009, please accept my apologies in advance for any cases in which I misquote, overly simplify or miss points altogether in the post above. These sessions move fast and my main goal is to capture the core of the ideas presented and exchanged. Feel free to contact me about corrections to my summary either via comments on this post or via my contact form.

This post is from from: Spellbound Blog.

DH2009: Digital Lives and Personal Digital Archives

I really want a t-shirt with the Bit-Rot guy on it!

This post is from from: Spellbound Blog.

Another Thrilling Digital Adventure With Team Digital Preservation

He then proposes 3 approaches to monetizing these efforts and leveraging the resulting digitized video:

1. Media-Centric Wikipedia – complete with an expectation that social media contributions would provide “scalable way for creating editorial metadata, such as descriptions and story summaries that would be costly to otherwise create”. This makes me think of Flickr Commons for video.
2. Education Site – akin to NBCU’s iCue site I mentioned in my post about NBC News Archive footage on Hulu. “Efforts like this provide educational/subscription opportunities as well as sponsorship/advertising opportunities—what advertiser doesn’t want to get in front of 13 – 18 year olds?”
3. News Site Extension – described as “bolting the news archive onto the existing site”. The major benefit of this is that “more content provides more SEO opportunity and, hence, larger audience reach.”

Baker concludes:

In a market where traditional media is struggling to create unique and compelling online experiences and business models, the archive represent a differentiator that can jump-start audience building and monetization initiatives. Not only is it an important representation of world history that must be saved for “preservation-sake”, the archive represents a large, untapped online opportunity.  Who will be first to realize its potential?

The ultimate goal of all three of these scenarios is to offset the extreme expense of digitization of thousands of hours of news footage. I think it is refreshing to see a perspective from outside the cultural heritage corner of the world that still sees video archives as rich resources worth preserving. I also like seeing ideas that are pitched in manner that should catch the attention of those making budgets and struggling with finding funding for large digitization efforts.

Image Credit: Flickr photo OSU Spring Game 2006 Media Lineup by Chris Metcalf

This post is from from: Spellbound Blog.

Video News Archives: Digitization as Good Business

In honor of this year’s Blog Action Day theme of Poverty, I want to point people to examples of ways in which poverty is documented in archives, manuscript collections and elsewhere.

The most obvious types of records that document poverty are:

• Photographs: Calisphere’s themed collections for the period 1929-1939: The Great Depression include images of the Dust Bowl Migration as well as general photos documenting Hard Times. The Library of Congress When They Were Young photo retrospective of childhood has a number of striking images.
• Music: Such as what can be found in the Library of Congress American Folklife Center.
• Newspapers: Which can include everything from human interest stories to classified ads – increasingly available online from sources including Google News Archive Search and the fee based NewspapeArchive.com.
• Census Records: The Census website has a special section dedicated to  US Census Bureau poverty statistics, including a page of links to other sites dedicated to poverty research and statistics.

There are also organizations dedicated to research on poverty – such as the Chronic Poverty Research Centre, University of Kentucky Center for Poverty Research and National Poverty Center. The archival records from groups such as these could show ways that organizations have addressed poverty over time, as well as the history of poverty itself.

Archives do their best job with records produced in the process of carrying out tasks related to business or personal life, and many of those who are living in the greatest poverty aren’t generating (or saving) their own records. Is being documented by photographers, news articles and the Census Bureau the same thing as telling your own story through an oral history or having your photographs, personal papers or other life documents archived? One of the most fascinating things about primary source materials in general, and archival records in specific, is the first hand view that it can lend the researcher. That sense of stepping into their shoes – of having a chance to retrace their steps.

There are certainly institutions whose records cast light on the lives of those in poverty such as homeless shelters, social service agencies and health clinics – but I would put forth that we are rarely capturing the first person voices of those living in poverty. I am realistic. I know that those dealing with the basic issues of food, shelter and personal safety are likely not thinking about where to record their oral history or how to get their personal papers into an archive or manuscript collection. That doesn’t mean that I don’t wish there wasn’t a better way. These are people who deserve to be represented with their own voice to the people of the future.

I am enamored of the idea of recording people’s own stories as is being done in each of the following examples:

• StoryCorps which has arranged for all their interviews to be preserved by the Library of Congress’s American Folklife Center
• Memory Archive which, as of October 2008, has 5 stories listed on the Poverty category page
• The Oxford Project covered in the CNN article Photo project gives voice to ‘backbone of America’

I want to end my post with an inspirational project. Photographer Camilo José Vergara has been photographing the built environment in poor, minority communities across the United States since 1977.  He has re-photographed the same locations many times over the years. This permits him to create time lapse series of images that show how a space has changed over time. He has published a number of books (the most recent of which is American Ruins) as well as having created an interactive website.

The Invincible Cities website documents Harlem, NY, Camden, NJ and Richmond, CA. After selecting one of these three locations you are greeted by a map, timeline and photographs. You can walk through time at individual locations and watch storefronts change, buildings get demolished and fashions shift. The interface lets you select images by location, theme and year. My description can’t do it any justice – just go explore for yourself: Invincible Cities. The site explains that his next goal is to create a ‘Visual Encyclopedia of the American Ghetto’ (VE for short) that covers all of the United States.

In the March 2008 PopPhoto.com article Camilo Jose Vergara: 30 Years Documenting the American Ghetto, we find the following interesting quotes from the photographer:

“Once photography at its best and most prestigious became art and the rewards went to photographer artists, the field became uninterested and unable to significantly contribute to the creation of a historical record, that is to the making of an inventory of our world and to illustrate how it changes,” asserts Vergara, adding that the Internet is an ideal way to bypass traditional museums. “You can realize a larger world that can support a different kind of photography.”

The Internet is especially well-suited to housing a multi-layered history of the ghettos’ evolution. Advances in technology allow the designers to arrange images in complex ways: links take the viewer to a page that gives census data; click on a color-coded street map on the left side of the screen to pinpoint exact addresses of panoramic views, artifacts, architectural details, building interiors or street-level views. “These kinds of things were unimaginable when I started the project,” he says.

Can we expect projects like this  to give individuals of the future a real taste of what life was like for the poor in US cities or around the world? Should part of our efforts at diversity of representation in the historical record specifically address preservation of the records and manuscripts of those living in poverty? Lots to think about! I hope this post has introduced you to new resources and projects. Please share any I missed in the comments below.

This post is from from: Spellbound Blog.

Blog Action Day 2008: Poverty in the Archival Record and Beyond

The official title of Session 203 was Getting Our Hands Dirty (and Liking It): Case Studies in Archiving Digital Manuscripts. The session chair, Catherine Stollar Peters from the New York State Archives and Records Administration, opened the session with a high level discussion of the “Theoretical Foundations of Archiving Digital Manuscripts”. The focus of this panel was preserving hybrid collections of born digital and paper based literary records. The goal was to review new ways to apply archival techniques to digital records. The presenters were all archivists without IT backgrounds who are building on others work … and experimenting. She also mentioned that this also impacts researchers, historians, and journalists.For each of the presenters, I have listed below the top challenges and recommendations. If you attended the sessions, you can skip forward to my thoughts.

Norman Mailer’s Electronic Records

• Speaker: Gabriela Redwine from University of Texas at Austin’s Harry Ransom Center
• Featured Collection: Norman Mailer Papers

Challenges & Questions:

• 3 laptops and nearly 400 disks of correspondence
• While the letters might have been dictated or drafted by Mailer, all the typing, organization and revisions done on the computer were done by his assistant Judith McNally. This brings into question issues of who should be identified as the record creator. How do they represent the interaction between Mailer & McNally? Who is the creator? Co-Creators?
• All the laptops and disks were held by Judith McNally. When she died all of her possessions were seized by county officials. All the disks from her apartment were eventually recovered over a year later – but it causes issues of provenance. There is no way to know who might have viewed/changed the records.

Revelations and Recommendations:

What is accessioning and processing when dealing with electronic records? What needs to be done?

• gain custody
• gather information about creator’s (or creators’) use of the electronic records. In March 2007 they interviewed Mailer to understand the process of how they worked together. They learned that the computers were entirely McNally’s domain.
• number disks, computers (given letters), other digital media
• create disk catalog – to reflect physical information of the disk. Include color of ink.. underlining..etc. At this point the disk has never been put into a computer. This captures visual & spacial information
• gather this info from each disk: file types, directory structure & file names

The ideal for future collections of this type is archivist involvement earlier – the earlier the better.

Papers of Peter Ganick

• Speaker: Melissa Watterworth
• Featured Collection: Papers of Writer and Small Press Publisher Peter Ganick, Thomas J Dodd Research Center, University of Connecticut

Challenges & Questions:

• What are the primary sources of our modern world?
• How do we acquire and preserve born digital records as trusted custodians?
  
• How do we preserve participatory media – maybe we can learn from those who work on performance art?
• How do we incrementally build our collections of electronic records? Should we be preserving the tools?
• Timing of acquisition: How actively should we be pursuing personal archives? How can we build trust with creators and get them to understand the challenges?
• Personal papers are very contextual – order matters. Does this hold true for born digital personal archives? What does the networking aspect of electronic records mean – how does it impact the idea of order?
• First attempt to accession one of Peter Ganick’s laptops and the archivist found nothing she could identify as files.. she found fragments of text – hypertext work and lots of files that had questionable provenance (downloaded from a mailing list? his creations?). She had to sit down next to him and learn about how he worked.
  
• He didn’t understand at first what her challenges were. He could get his head around the idea of metadata and issues of authenticity. He had trouble understanding what she was trying to collect.
  
• How do we arrange and keep context in an online environment?
• Biggest tech challenge: are we holding on for too long to ideas of original order and context?
• Is there a greater challenge in collecting earlier in the cycle? What if the creator puts restrictions on groupings or chooses to withdraw them?
• Do we want to create contracts with donors? Is that practical?

Revelations and Recommendations:

• Collect materials that had high value as born digital works but were at a high risk of loss.
  
• Build infrastructure to support preservation of born digital records.
• Go back to the record creator to learn more about his creative process. They used to acquire records from Ganick every few years.. that wasn’t frequent enough. He was changing the tools he used and how he worked very quickly. She made sure to communicate that the past 30 years of policy wasn’t going to work anymore. It was going to have to evolve.
• Created a ‘submission agreement’ about what kinds of records should be sent to the archive. He submitted them in groupings that made sense to him. She reviewed the records to make sure she understood what she was getting.
• Considering using PDFa to capture snapshot of virtual texts.
• Looked to model of ‘self archiving’ – common in the world of professors to do ongoing accruals.
• What about ‘embedded archivists’? There is a history of this in the performing arts and NGOs and it might be happening more and more.

George Whitmore Papers

• Speaker: Michael Forstrom: Beinecke Rare Book and Manuscript Library, Yale University
• Featured Collection: George Whitmore Papers

Challenges & Questions:

• How do you establish identity in a way that is complete and uncorrupted? How do you know it is authentic? How do you make an authentic copy? Are these requirements as unreasonable and unachievable?

Revelations and Recommendations:

• Refresh and replicate files on a regular schedule.
• They have had good success using Quick View Plus to enable access to many common file formats. On the downside, it doesn’t support everything and since it is proprietary software there are no long term guarantees.
• In some cases they had to send CP/M files to a 3rd party to have them converted into WordStar and have the ascii normalized.
• Varied acquisition notes.. and accession records.. loan form with the 3rd party who did the conversion that summarized the request.. they did NOT provide information about what software was used to convert from CP/M to DOS. This would be good information to capture in the future.
• Proposed an expansion of the standards to include how electronic records were migrated in the <processinfo> processing notes.

Questions & Answers

Question: As part of a writers community, what do we tell people who want to know what they can DO about their records. They want technical information.. they want to know what to keep. Current writers are aware they are creating their legacy.

Answer: Michael: The single best resource is the interPARES 2 Creator Guidelines. The Beineke has adapted them to distrubute to authors. Melissa: Go back to your collection development policies and make sure to include functions you are trying to document (like process.. distribution networks). Also communities of practice (acid free bits) are talking about formats and guidelines like that Gabriela: People often want to address ‘value’. Right now we don’t know how to evaluate the value of electronic drafts – it is up to authors.

Question: Cal Lee: Not a question so much as an idea: the world of digital forensics and security and the ‘order of volatility’ dictate that everyone should always be making a full disk copy bit by bit before doing anything else.

Comment: Comment on digital forensic tools – there is lots of historical and editing history of documents in the software… also delete files are still there.

Question: Have you seen examples of materials that are coming into the archive where the digital materials are working drafts for a final paper version? This is in contrast to others are electronic experiments.

Answer: Yes, they do think about this. It can effect arrangement and how the records are described. The formats also impact how things are preserved.

Question: Access issues? Are you letting people link to them from the finding aids? How are the documents authenticity protected.

Answer: DSpace gives you a new version anytime you want it (the original bitstream) .. lots of cross linking supports people finding things from more than one path. In some cases documents (even electronic) can only be accessed from within the on site reading room.

Question: What is your relationship is like with your IT folks?

Answer: Gabriela: Our staff has been very helpful. We use ‘legacy’ machines to access our content. They build us computers. They are also not archivists, so there is a little divide about priorities and the kind of information that I am interested in.. but it has been a very productive conversation.

Question: (For Melissa) Why didn’t you accept Peter’s email (Melissa had said they refused a submission of email from Peter because it didn’t have research value)?

Answer: The emails that included personal medical emails were rejected. The agreement with Peter didn’t include an option to selectively accept (or weed) what was given.

Question: In terms of gathering information from the creators.. do you recommend a formal/recorded interview? Or a more informal arrangement in which you can contact them anytime on an ongoing basis?

Answer: Melissa: We do have more formal methods – ‘documentation study’ style approaches. We might do literature reviews.. Ultimately the submission agreement is the most formal document we have. Gabriela: It depends on what the author is open to.. formal documentation is best.. but if they aren’t willing to be recorded, then you take what you can get!

My Thoughts

I am very curious to see how best practices evolve in this arena. I wonder how stories written using something like Google Documents, which auto-saves and preserves all versions for future examination, will impact how scholars choose to evaluate the evolution of documents. There have already been interesting examinations of the evolution of collaborative documents. Consider this visual overview of the updates to the Wikipedia entry for Sarah Palin created by Dan Cohen and discussed in his blog post Sarah Palin, Crowdsourced. Another great example of this type of visual experience of a document being modified was linked to in the comments of that post: Heavy Metal Umlaut: The Movie. If you haven’t seen this before – take a few minutes to click through and watch the screencast which actually lets you watch as a Wikipedia page is modified over time.

While I can imagine that there will be many things to sort out if we try to start keeping these incredibly frequent snapshot save logs (disk space? quantity of versions? authenticity? author preferences to protect the unpolished versions of their work?) – I still think that being able to watch the creative process this way will still be valuable in some situations. I also believe that over time new tools will be created to automate the generation of document evolution visualization and movies (like the two I link to above) that make it easy for researchers to harness this sort of information.

Perhaps there will be ways for archivists to keep only certain parts of the auto-save versioning. I can imagine an author who does not want anyone to see early drafts of their writing (as is apparently also the case with architects and early drafts of their designs) – but who might be willing for the frequency of updates to be stored. This would let researchers at least understand the rhythm of the writing – if not the low level details of what was being changed.

I love the photo I found for the top of this post. I admit to still having stacks of 3 1/2 floppy disks. I have email from the early days of BITNET.  I have poems, unfinished stories, old resumes and SQL scripts. For the moment my disks live in a box on the shelf labeled ‘Old Media’. Lucky me – I at least still have a computer with a floppy drive that can read them!

Image Credit: oh messy disks by Blude via flickr.

As is the case with all my session summaries from SAA2008, please accept my apologies in advance for any cases in which I misquote, overly simplify or miss points altogether in the post above. These sessions move fast and my main goal is to capture the core of the ideas presented and exchanged. Feel free to contact me about corrections to my summary either via comments on this post or via my contact form.

This post is from from: Spellbound Blog.

SAA2008: Preservation and Experimentation with Analog/Digital Hybrid Literary Collections (Session 203)

Does your institution have a disaster plan?
If not, the list of resources include a detailed set of Free Disaster Plan Templates. Today is the perfect day to download one and start planning.

A full disaster plan too overwhelming? SAA also provides a tidy list of easy MayDay activity ideas including:

Create or Update Your Contact Lists
One of the most important elements of disaster response is knowing how to contact critical people – emergency responders, staff, and vendors. Make sure your staff members have an up-to-date list that includes as much contact information as possible: work and home phone numbers (including direct lines at work), mobile phone numbers, work and home email addresses, and any other relevant addresses. Staff at many institutions hit by hurricanes in 2005 discovered that they couldn’t use work email or phone numbers because work systems were completely out of commission; those who had an alternative phone number or email address often could connect.

Make Sure Boxes Are Off the Floor
Any number of causes – a broken pipe, a clogged toilet, fire sprinklers – may result in water in your storage areas. If shelf space is limited, use pallets for clearance. Make sure nothing is on the floor where it can be soaked.

Don’t have precious cultural heritage materials under your care? Okay then, how about you? Do you have a Family Disaster Plan and a Disaster Supplies Kit ready?

Image Credit: Society of American Archivists MayDay 2008 Logo.

This post is from from: Spellbound Blog.

MayDay 2008: Do you have a disaster plan?

The IMLS Connecting to Collections Bookshelf is intended to provide small and medium-sized libraries and museums with essential resources needed to improve the condition of their collections. The Bookshelf includes books, DVDs, and other collections resources, as well as a Guide to Online Resources and a User’s Guide to all of the materials. It addresses such topics as the philosophy and ethics of collecting, collections management and planning, emergency preparedness, and culturally specific conservation issues.

The Heritage Preservation has created both a 48 page Bookshelf User’s Guide, with a page dedicated to each resources selected for the bookshelf, and a Guide to Online Resources to be used as a companion to the bookshelf. The Bookshelf User’s Guide has a brilliant section at the end giving you pointers to specific sections of the various Bookshelf resources to answer special questions – such as ‘Where can we find information on raising funds for collections care?’ and ‘How can I prioritize the needs of our collections?’.

What is interesting is that it took me a while to realize that each of the institutions that is awarded The Bookshelf will actually receive the books. My past experience with O’Reilly’s Safari Books Online made me assume that the books would be only accessed online. The Safari Books Online site requires a paid membership, but then provides access to an ever growing electronic reference library. The total number of resources is listed as currently over 5,000. One level of membership, Safari Library, provides unlimited access to all the resources (currently listed as $42.99 a month or $472.89 per year) while the less expensive membership level, Safari Bookshelf (currently listed as $22.99 a month or $252.99 a year), provides access to up to ten titles at a time.

Seeing those prices got me wondering, what will the receivers of this bookshelf be getting and what it’s total cost would be? I found my way to a list of the books and resources that will be included. Between the Internet and the 48 page guide to the Bookshelf I found the following information about each element of the Bookshelf. IMLS has broken the bookshelf down into three subsections as shown below:

Bookshelf: The Core Collection

• IPI Media Storage Quick Reference – booklet and quick reference wheel ($25, but you can also download the PDF of the booklet for free)
• Framework for preservation of museum collections wall chart – 26 x 36.25” wall chart ($25, laminated version $56.25)
• Preservation Management for Libraries, Archives and Museums, Gorman, G. E., and Sydney J. Shep, eds., 2006 ($125)
• Heritage Preservation: Capitalize on Collections Care ($2)
• Heritage Preservation: Emergency Response and Salvage Wheel ($12.95 for individuals, $7.95 non-profit/government rate)
• Heritage Preservation: Field Guide to Emergency Response, book and DVD ($29.95)
• International Review of African American Art: Collecting, Conservation, and Collaborations – “Strengthening the Three C’s”, 21.4, 2007. This is a special issue funded by a grant from the IMLS. It is not clear to me if it will be available to order as a back issue – but if so, back issues are $8.
• A Legal Primer on Managing Museum Collections, Malaro, Marie C., 1985. (link to 2nd edition, 1998 – $29.07)
• Museum Handbook Part I: Museum Collections, National Park Service, 2006. (free online version)
• Caring for American Indian Objects: A Practical and Cultural Guide, Ogden, Sherelyn, ed., 2004. ($26.37)
• The Nature of Conservation: A Race Against Time, Ward, Philip., 1986. (out of print and reprinted for the bookshelf, available used for approximately $25)

Bookshelf: Nonliving Collections

• Promoting Preservation Awareness in Libraries, Drewes, Jeanne M. and Julie A. Page, eds, 1997 ($100 new, available under $1 used)
• The Care of Prints and Drawings, Ellis, Margaret Holben., 1995. ($26.31)
• Caring for Your Family Treasures, Long, Jane S. and Richard W. Long., 2000. ($24.95, Heritage Preservation Member Price – $18.00)
• The National Trust Manual of Housekeeping: The Care of Collection in Historic Houses Open to the Public, 2006. ($87.36)
• Photographs: Archival Care and Management, Ritzenthaler, Mary Lynn and Diane L. Vogt O’Connor, 2006. ($84.95, SAA Member price – $59.95)

Bookshelf: Living Collections

• Dr. Burgess’s Mini Atlas of Marine Aquarium Fishes, 2d ed., Burgess, Warren E. 1992. ($28.76 new, as little as $5.55 used)
• Zoo and Wild Animal Medicine, 6th ed. Fowler, Murray E. and R. Eric Miller., 2007. ($139.50)
• The Darwin Technical Manual for Botanic Gardens, Botanic Gardens Conservation International (BGCI), 1998. ($26.50, BGCI Member price – $19.00. Note $9.00 shipping to USA)
• Essentials of Conservation Biology, 4th ed., Primack, Richard B., 2006. ($84.95)
• Global Strategy for Plant Conservation, Secretariat of the Convention on Biological Diversity. (free download in 10 languages)
• Building a Future for Wildlife: The World Zoo and Aquarium Conservation Strategy (free download)

Grand Total

The maximum cost (with no membership discounts) to purchase all the components of The Bookshelf would be $951.87. Add in the cost of shipping and printing your own copies from the free downloads and we can probably talk about the monetary value of the Bookshelf being approximately $1000!

Online Acces

While researching all of this I came across a new option on Amazon.com – something they are calling Amazon Upgrade. For an additional fee above and beyond the price you pay for the physical book – you can have immediate and permanent online access to the content of that book. Take a look at the offering explained on the Amazon page for The National Trust Manual of Housekeeping: The Care of Collection in Historic Houses Open to the Public. I assume that they plan to increase the titles for which this is an option. If so, I can envision building an online reference shelf of one’s own – one title at a time. Rather than deciding that something like O’Reilly’s Safari Books Online has enough books to make it worth while for you – you will create your own custom online reference shelf.

The other half of the online access story is of course the number of resources that are posted online for free download (or as living HTML documents being updated over time). These are all the resources from the list above that can be downloaded for free:

• IPI Media Storage Quick Reference
• Museum Handbook Part I: Museum Collections
• Global Strategy for Plant Conservation
• Building a Future for Wildlife: The World Zoo and Aquarium Conservation Strategy

What if all the resources that those who care for collections need were available via an online bookshelf? Now that would be an amazing resource for which many would be happy to pay an annual fee. Perhaps it could be provided as part of the membership fee for one or more of the appropriate professional organizations. An additional benefit to an online collection is the opportunity to receive automatic updates and new editions. I will also keep an eye on the Amazon Upgrade option to see how easy it is for someone to build their own online reference shelf – but I think a purposeful online collection designed for cultural heritage institutions would be even more compelling.

Getting the Bookshelf

A lot of organizations have already received the Bookshelf, but the press release that got me looking at all this mentioned that the next (final?) application period will be from March 1 through April 30, 2008. Recipients will be announced in July of 2008.

If you are considering applying you can find more details about the application process and review the questions you must answer online. But even for those that don’t qualify (federally operated and for-profit institutions are not eligible) – the Bookshelf User’s Guide, the Guide to Online Resources and those resources that may be downloaded for free provide a powerful combination of materials to support institutions and individuals as they care for collections of all shapes and sizes.

Note: All prices quoted in this post were valid as of January 27th, 2008. Image shown above from IMLS Connecting to Collections Bookshelf page.

This post is from from: Spellbound Blog.

Caring for Special Collections: Exploring the Connecting to Collections Bookshelf

On the Digital Preservation page of the Dioscuri website I found this paragraph on their goals:

To prevent a digital black hole, the Koninklijke Bibliotheek (KB), National Library of the Netherlands, and the Nationaal Archief of the Netherlands started a joint project to research and develop a solution. Both institutions have a large amount of traditional documents and are very familiar with preservation over the long term. However, the amount of digital material (publications, archival records, etc.) is increasing with a rapid pace. To manage them is already a challenge. But as cultural heritage organisations, more has to be done to keep those documents safe for hundreds of years at least.

They are nothing if not ambitious… they go on to state:

Although many people recognise the importance of having a digital preservation strategy based on emulation, it has never been taken into practice. Of course, many emulators already exist and showed the usefulness and advantages it offer. But none of them have been designed to be digital preservation proof. For this reason the National Library and Nationaal Archief of the Netherlands started a joint project on emulation.

The aim of the emulation project is to develop a new preservation strategy based on emulation.

Dioscuri is part of Planets (Preservation and Long-term Access via NETworked Services) – run by the Planets consortium and coordinated by the British Library. The Dioscuri team has created an open source emulator that can be ported to any hardware that can run a Java Virtual Machine (JVM). Individual hardware components are implemented via separate modules. These modules should make it possible to mimic many different hardware configurations without creating separate programs for every possible combination.

You can get a taste of the big thinking that is going into this work by reviewing the program overview and slide presentations from the first Emulation Expert Meeting (EEM) on digital preservation that took place on October 20th, 2006.

In the presentation given by Geoffrey Brown from Indiana University titled Virtualizing the CIC Floppy Disk Project: An Experiment in Preservation Using Emulation I found the following simple answer to the question ‘Why not just migrate?’:

• Loss of information — e.g. word edits

• Loss of fidelity — e.g. WordPerfect to Word isn’t very good

• Loss of authenticity — users of migrated document need access to original to verify authenticity

• Not always possible — closed proprietary formats

• Not always feasible — costs may be too high

• Emulation may necessary to enable migration

After reading through Emulation at the German National Library, presented by Tobias Steinke, I found my way to the kopal website. With their great tagline ‘Data into the future’, they state their goal is “…to develop a technological and organizational solution to ensure the long-term availability of electronic publications.” The real gem for me on that site is what they call the kopal demonstrator. This is a well thought out Flash application that explains the kopal project’s ‘procedures for archiving and accessing materials’ within the OAIS Reference Model framework. But it is more than that – if you are looking for a great way to get your (or someone else’s) head around digital archiving, software and related processes – definitely take a look. They even include a full Glossary.

I liked what I saw in Defining a preservation policy for a multimedia and software heritage collection, a pragmatic attempt from the Bibliothèque nationale de France, a presentation by Grégory Miura, but felt like I was missing some of the guts by just looking at the slides. I was pleased to discover what appears to be a related paper on the same topic presented at IFLA 2006 in Seoul titled: Pushing the boundaries of traditional heritage policy: Maintaining long-term access to multimedia content by introducing emulation and contextualization instead of accepting inevitable loss . Hurrah for NOT ‘accepting inevitable loss’.

Vincent Joguin’s presentation, Emulating emulators for long-term digital objects preservation: the need for a universal machine, discussed a virtual machine project named Olonys. If I understood the slides correctly, the idea behind Olonys is to create a “portable and efficient virtual processor”. This would provide an environment in which to run programs such as emulators, but isolate the programs running within it from the disparities between the original hardware and the actual current hardware. Another benefit to this approach is that only the virtual processor need be ported to new platforms rather than each individual program or emulator.

Hilde van Wijngaarden presented an Introduction to Planets at EEM. I also found another introductory level presentation that was given by Jeffrey van der Hoeven at wePreserve in September of 2007 titled Dioscuri: emulation for digital preservation.

The wePreserve site is a gold mine for presentations on these topics. They bill themselves as “the window on the synergistic activities of DigitalPreservationEurope (DPE), Cultural, Artistic and Scientific knowledge for Preservation, Access and Retrieval (CASPAR), and Preservation and Long-term Access through NETworked Services (PLANETS).” If you have time and curiosity on the subject of digital preservation, take a glance down their home page and click through to view some of the presentations.

On the site of The International Journal of Digital Curation there is a nice ten page paper that explains the most recent results of the Dioscuri project. Emulation for Digital Preservation in Practice: The Results was published in December 2007. I like being able to see slides from presentations (as linked to above), but without the notes or audio to go with them I am often left staring at really nice diagrams wondering what the author’s main point was. The paper is thorough and provides lots of great links to other reading, background and related projects.

There is a lot to dig into here. It is enough to make me wish I had a month (maybe a year?) to spend just following up on this topic alone. I found my struggle to interpret many of the Power Point slide decks that have no notes or audio very ironic. Here I was hunting for information about the preservation of born digital records and I kept finding that the records of the research provided didn’t give me the full picture. With no context beyond the text and images on the slides themselves, I was left to my own interpretation of their intended message. While I know that these presentations are not meant to be the official records of this research, I think that the effort obviously put into collecting and posting them makes it clear that others are as anxious as I to see this information.

The best digital preservation model in the world will only preserve what we choose to save. I know the famous claim on the web is that ‘content is king’ – but I would hazard to suggest that in the cultural heritage community ‘context is king’.

What does this have to do with Dioscuri and emulators? Just that as we solve the technical problems related to preservation and access, I believe that we will circle back around to realize that digital records need the same careful attention to appraisal, selection and preservation of context as ‘traditional’ records. I would like to believe that the huge hurdles we now face on the technical and process side of things will fade over time due to the immense efforts of dedicated and brilliant individuals. The next big hurdle is the same old hurdle – making sure the records we fight to preserve have enough context that they will mean anything to those in the future. We could end up with just as severe a ‘digital black hole’ due to poorly selected or poorly documented records as we could due to records that are trapped in a format we can no longer access. We need both sides of the coin to succeed in digital preservation.

Did I mention the part about ‘Hurray for open source emulator projects with ambitious goals for digital preservation’? Right. I just wanted to be clear about that.

Image Credit: The image included at the top of this post was taken from a screen shot of Dioscuri itself, the original version of which may be seen here.

This post is from from: Spellbound Blog.

Digital Preservation via Emulation – Dioscuri and the Prevention of Digital Black Holes