The BPL is pleased to announce that they have now moved into the “beta launch” phase of the rollout of the Hydra-based Digital Commonwealth repository platform.

The new URLs are:
Search (public discovery): http://search.digitalcommonwealth.org/
Admin (ingest & management): http://admin.digitalcommonwealth.org/

Features
Not all features are fully implemented as yet. Here is what’s available:

Public Search app:

  • keyword search
  • faceted browsing of search results by format, subject, date
  • browse by collection, institution, or geographic location
  • image viewer with zooming functionality for viewing hi-res images in detail
  • users can create bookmarks and personalized folders of their favorite items
  • users can create an account, or log in via their BPL/MBLN library card or Facebook account
  • easily share items on Facebook, Twitter, Pinterest, and other social media
  • site designed to play well with tablets and phones

Member Admin app:

    • create digital collections
    • upload images
    • add metadata
    • edit existing objects (might be of special interest to members with items in DSpace)

For admin access, contact Tom Blake (tblake@bpl.org) to get started.

Features to be added soon:

  • batch uploads
  • support for other content types, such as postcards, books, and audio

Content from the initial test (alpha) server is being migrated to the new production-server repository. Upon completion all data from the current Digital Commonwealth DSpace server, http://repository.digitalcommonwealth.org, will be available in the new Fedora/Hydra repository. So far about 80% of the DSpace content is available. More is added every day. Once the complete migration is assured, the process will begin to shut down the DSpace server, currently hosted at UMass Amherst Libraries.

As the new repository is now in “beta,” the public link can be shared with colleagues both inside and outside your institution(s). The BPL will be doing a small amount of promotion for this, but intend to save the grand ribbon-cutting for when the system finally replaces digitalcommonwealth.org. Coming soon! Stay tuned!

We are still actively seeking feedback, suggestions, etc., so feel free to send comments by using the feedback form at http://search.digitalcommonwealth.org/feedback.

Earlier this month the Governor approved the inclusion of $147,532 in the state FY14 budget to continue digitization for Digital Commonwealth members under the BPL’s Library for the Commonwealth program.

This money will continue the digital-imaging services that the BPL has provided in partnership with Digital Commonwealth since 2011 through funding provided by a LSTA grant awarded through the MBLC. The state expenditure attests to the valuable work achieved these past two years by the BPL and Digital Commonwealth. Thousands of significant historical items have been digitized and will soon be made available collectively through a new state-of-the-art repository under development at the BPL that just this past week celebrated its initial public beta release.

With this new funding, the BPL will continue to accept project applications and hope to grow this program to include metadata creation and other services in the near future. The BPL and Digital Commonwealth look forward to working with DC members on their digital projects throughout FY14 and beyond.

For more information about participating in this program, details are provided at the BPL’s project blog.

Here is the latest update from Eben English, Web Services Developer at the BPL, who is helping develop the new Fedora/Hydra repository for the Digital Commonwealth:

The initial development phase for the new digital object management system to store and provide access to digital collections from Digital Commonwealth members is currently underway and will soon be complete. Items and metadata from the existing DSpace repository (http://repository.digitalcommonwealth.org) have begun to be migrated into the new system, and functionality for the item ingest forms as well as the end-user search interface is in the process of being implemented. It is anticipated that all basic objects from the DSpace repository will be ingested by the end of April, and support for (and ingest of) more complex digital objects (items with multiple images, books, oral histories, etc.) will be added by the end of May.

The new repository will be debuted at the Digital Commonwealth annual conference on May 1 – the 3:00 breakout session, “Digital Commonwealth 2.0: Creating Online Digital Collections with the Redesigned Repository System,” includes a full demonstration of the application, while a related session at 1:45, “Digital Commonwealth 2.0 and Metadata,” will demonstrate how to create metadata for digital objects using the new system.

For a full schedule of the conference and program descriptions, view this PDF document.

Digital Commonwealth is pleased to announce the release of an Omeka replacement for the digital harvesting Portal. Now when you navigate to http://digitalcommonwealth.org, instead of accessing the old Portal you access a new site built on the open-source Omeka repository platform. We pursued this replacement to allow us to continue providing customer services while the Boston Public Library (BPL) develops a permanent repository solution that will combine our old Portal functionality with the member digital collections hosted currently in our DSpace repository.

First some background information

The Digital Commonwealth technology infrastructure has always been difficult to grasp. From the beginning our system structure consisted of two platforms: (1) the primary system running our Portal at http://digitalcommonwealth.org that harvested member metadata records and made them discoverable through a robust interface and (2) a DSpace digital repository (http://repository.digitalcommonwealth.org) to host digital collections for those members who lacked the means to host their own content. Metadata about the digital content stored in the DSpace repository has also been discoverable via the search tool in the Portal.

At the time Digital Commonwealth’s original system was developed, Open Source repository solutions for providing OAI-PMH harvesting (such as Omeka) were not available. DSpace, for example, only recently began offering that functionality.  Our initial  Portal was a solution developed by an independent programmer. Although the system was quite advanced for its time – offering faceted browsing, thumbnails, and indexing – it was difficult to maintain and prone to inexplicable service interruptions. The back end also restricted our abilities to harvest new collections or update information pages and provide timely updates of our organizational goals and achievements. These latter limitations were considered particularly critical this past year as Digital Commonwealth undertook several major initiatives and attracted many new members.

The two major components of our system (the Portal and DSpace repository) were originally hosted on a server at the BPL and then later moved to the library at the University of Mass Amherst who have generously hosted our server services for the past few years.  As time went by we began to face several challenging issues.  One, our server was aging and needing replacement. Two, it was hard to maintain both components of the system and difficult to make adjustments and upgrades.

We were weighing options for a replacement of our aging system when the BPL stepped up with an offer to help establish a second generation Digital Commonwealth. They offered to construct the repository side, focusing on technology by developing and managing a new state-of-the art system that would combine the services and functionalities of DSpace and the Portal. We forged a partnership, explained in this blog post, and the BPL went on to hire two programmers and are now well on their way to making their offer a reality. A member of the BPL development team offers some details about their project in this recent blog post.

At the same time, Digital Commonwealth began the process of becoming a 501(c)(3) nonprofit organization. We have also revamped our bylaws and have begun work on a new strategic plan. Another part of this transition to what may be termed Digital Commonwealth 2.0 was to establish Omeka as a transitional system until the BPL repository was ready for prime time.

Omeka

For simplicity purposes, the new Omeka system was meant to replicate the old Digital Commonwealth Portal as much as possible. We retained the same basic design for example. Although we sacrificed some functionality, such as faceted searching, and have limited the harvesting of some collections, such as the Massachusetts State Library and UMass Amherst because of their size and complexity, we have gained much in our ability to continue maintaining active services. Omeka provides a much more stable and easily maintained system that is also much more easily updated and kept current.

Keep in mind that this is a temporary “bridge” solution while the real replacement of our old system is under development. We appreciate your patience as we navigate this complicated transition to the next exciting phase of Digital Commonwealth.

As a previous blog post has noted, Digital Commonwealth and the Boston Public Library have embarked on a partnership that will soon result in a new state-of-the-art digital repository that will provide a range of vastly improved hosting and presentation services to Digital Commonwealth members. Based on the Fedora Commons/Hydra open-source repository system, development of the new architecture is well under way thanks to the hiring of two programmers by the BPL. Its initial public release is planned for April, 2013, to coincide with the debut launching of the Digital Public Library of America.

Fedora 

For those of you not familiar with Fedora Commons, the name Fedora is an acronym that stands for Flexible Extensible Digital Object Repository Architecture. It is often confused with the Fedora Red Hat Linux operating system, but has no relationship. Rather, it is a flexible, modular, repository platform for the management and dissemination of digital content. First developed at Cornell University, the Fedora Commons and DSpace organizations joined forces in 2009 to establish DuraSpace. Both repository platforms are now managed and developed under the auspices of the DuraSpace nonprofit group.

Hydra  

The Hydra Project  is an open-source application framework which is supported by a community of partner institutions including Stanford, University of Virginia, Notre Dame, and other major research universities. Hydra adds additional functionality for creating customizable digital object ingest workflows on top of Fedora’s stable and highly scalable file management back-end. Other components of the system include Solr for indexing and retrieval and Blacklight as a front-end interface for discovery and access to the content stored in the Fedora repository.

New BPL Digital Commonwealth Repository

The new platform will provide a reliable technical infrastructure for Digital Commonwealth, with the benefits of greater stability, increased control, and the ability to support an extensible and flexible application which offers more detailed description of collections and items, efficient management of digital objects, and an array of interactive and user-friendly features for both contributing institutions and end-users.

The development of the new repository by the BPL will proceed in stages. Its initial release in April simply aims to replicate the basic functionality of the existing Digital Commonwealth repository (http://repository.digitalcommonwealth.org/) using the Hydra framework and an updated metadata schema for description based on MODS. All objects and metadata records that are currently in the repository will be migrated to the new platform prior to this release. Records currently harvested by the Digital Commonwealth Portal will also be harvested by and made available in the new repository. Since OAI-PMH harvesting may not be added prior to this initial release, however, the inclusion of the Portal records may have to occur at a later date.

Features of the new repository will include:

  • Deposit of simple digital objects (images, text) in the repository via a web-based upload form
  • Creation and description of collections to organize digital objects
  • Description of digital objects using a “basic” or “advanced” metadata entry form
  • Keyword searching (basic and advanced)
  • Faceted browsing by collection, institution, format, subject, date, etc.
  • Feature-rich interaction with digital images (zooming, panning, etc.)
  • Ability for end-users to create, manage, and share personal collections of items

All functionality will be contained within the web application — there will be no need for contributors to download or install any software locally or deal with upgrades or migrations. Additional functionality, such as support for batch uploading of items, deposit of more complex digital objects (such as double-sided postcards, books, oral histories, video, etc.), GIS-based graphical browsing, and embedded audio/video players, is currently in the planning stages and will be added in future releases, which are expected to be released frequently.

The Digital Commonwealth Portal, Repository, Technology, and Standards (PRTS) committee is working closely with the BPL on the development of this new system.

Please direct any questions, comments, or concerns to digitalcommonwealth@gmail.com.