Friday, August 10, 2018
DIGITAL DIRECTIONS: Fundamentals of Creating and Managing Digital Collections, Oct. 2018
Tuesday, August 09, 2011
Save My Memories: Digital Photo Storage
- Learn
- Prepare
- Protect
- Recover
- Resources
Universal Photographic Digital Imagins Guidelines, v. 4.0
Thursday, July 14, 2011
Blog Post: What Skills Does a Digital Archivist or Librarian Need?
I often hear from students and others with questions about the skills they need to compete in the job market. What programming languages should I learn? How much do I need to know about specific digital formats? Which standards should I study in detail?
“No, no–those are the wrong questions!”
That’s what I want to shout when I hear this line of inquiry. But I don’t yell because it’s rude and because I know the impulse flows from my own bias toward broader, more adaptive skills.Read his complete answer, especially if you're a student wondering about the skills you really need!
Thursday, April 28, 2011
Event: JPEG 2000 Summit
Monday, August 09, 2010
METRO's Digitization LibGuide
I believe that this guide was recently updated, which is always good to see. Often resource lists are placed online and then forgotten which leads to broken links and outdated information.
METRO has been very active in digitization for a number of years. It recently released its book Digitization in the Real World, which contains case studies of small and medium-size organizations that have embarked on digitization program.
Wednesday, July 21, 2010
Free or open source software
Monday, May 10, 2010
Event: 4th International Conference on: Preservation and Conservation Issues in Digital Printing and Digital Photography
27-28 May 2010
Institute of Physics, London
Organised jointly by the IOP Printing and Graphics Science Group and the University of the Arts London (Materials and the Arts Research Centre - MATAR), in association with the Society for Imaging Science and Technology.
Programme
The two-day international conference aims to inform those responsible for the preservation of digitally printed materials about developments in digital photography and printing technologies and progress in research on inks and substrates and their significance for conservation and preservation issues and techniques. We also hope to develop links between related industries and the conservation/preservation world.
The event is aimed at an international audience of photographers, conservators, preservation personnel, conservation scientists and those working in the digital printing, ink and paper industries.
Further information about the conference is available at http://ppp10.iopconfs.org/
Registration Open
To register for the conference, please visit the website at http://ppp10.iopconfs.org/
Enquiries:
Dawn Stewart
The Institute of Physics,
76 Portland Place,
London W1B 1NT, UK.
Tel: +44(0)20 7470 4800
Fax: +44(0)20 7470 4900
E-mail: dawn.stewart@iop.org
Thursday, October 01, 2009
JPEG2000 report commissioned by the Wellcome Library available online
The Wellcome Library, anticipating a growth in digitisation of library materials as it takes forward an ambitious digitisation program, recognises the value of efficiency in storing its digital content whilst maintaining the high levels of quality and open standards required for long-term preservation. However, JPEG2000 comes in a variety of "flavours" and comprises 12 "parts", as explained in the JPEG2000 specification.
Seeking to determine exactly which JPEG2000 format to use to meet the aims of long-term storage and accessible delivery services, the Library commissioned a report by Simon Tanner, Director of King's Consultancy Service (KDCS). The report was written in conjunction with Robert Buckley of Xerox Corporation, an expert in the technical specifications of the JPEG2000 format.
As a result of the recommendations and conclusions provided in the report, the Wellcome Library will adopt a "visually lossless" lossy compression to gain at least 75% storage savings in comparison to a TIFF version (depending on the type of material being digitised). The recommended compression parameters will produce an image with no visible difference in image quality, but the compression is irreversible - i.e. the original bit stream will not be possible to reconstruct. As the Library will be digitising physical items that can (if necessary) be re-digitised, it was considered an acceptable compromise.
Embedding multiple resolution layers and tiling will facilitate dissemination, allowing a single image file to address multiple needs (such as thumbnails, screen resolution, and print resolution). In future, the Library will incorporate a web delivery system that can exploit these characteristics to create on-the-fly derivatives that can be viewed through a browser or downloaded (e.g. JPEG and PDF).
The full report is available under the Creative Commons Attribution Non-Commercial 2.0 license, and can be viewed and downloaded from the image viewer below (toggle full screen to read) or here.
Technorati tag: JPEG2000
Monday, May 18, 2009
JPEG 2000 survey results
First, thanks very much to those who responded this past fall to our survey of digital project staff regarding JPEG 2000 implementation at your institutions. We have made the results available via our institutional repository at: http://digitalcommons.uconn.edu/libr_pubs/16/And then (second email) they announced that they had presented their findings at IS&T Archiving 2009 Conference. The final report is available at http://digitalcommons.uconn.edu/libr_pubs/19/ and the presentation is online at http://digitalcommons.uconn.edu/libr_pres/21/
You may choose to download the survey results as a standalone .xls spreadsheet file or, if you prefer a somewhat smoother viewing experience, download and extract the .html version contained in the zip file at the same URL.
From our abstract:
The survey results reveal several key areas that JPEG 2000's user community will need to have addressed in order to further enhance adoption of the standard, including perspectives from cultural institutions that have adopted it already, as well as insights from institutions that do not currently have it in their workflows. Current users are concerned about limited compatible software capabilities with an eye toward needed enhancements. They realize also that there is much room for improvement in the area of educating and informing the cultural heritage community about the advantages of JPEG 2000. A small set of users, in addition, alerts us to serious problems of cross-codec consistency and they relate file validation issues that would likely be easily resolved given a modicum of collaborative attention toward standardization. Responses from non-users disclose that there are lingering questions surrounding the format and its stability and permanence, stoked largely by a dearth of currently available software functionality, from the point of initial capture and manipulation on through to delivery to online users.
JPEG 2000 is being adopted by more and more organizations. Surveys and reports like this will help us understand who is using it and why, as well as the issues or concerns that they run into. One day, JPEG 2000 may be the norm. For now, it's still a decision that people must make. I hope more continue to say "yes" to it.
Technorati tag: JPEG2000
Wednesday, December 31, 2008
Digitization 101: 2008 Year in Review
- Google: (posts on Google)
- continued to grow its books digitization program by adding more collections/libraries to it.
- branched into digitizing magazines.
- joined an effort to digitize newspapers.
- added photos from Life magazine to its image collection.
- settled issues related to copyright and its book digitization efforts.
- Microsoft ended its book digitization efforts (post).
- A side-by-side demonstration of four automated book scanners was done in Germany (post, post). Since most organizations could never do that, it was good to see a group take on the task. Also good to see that a report to be written on it.
- JPEG2000 has gained wider acceptance. (related posts)
- "Digital preservation" discussed as not being the correct term. Should we instead use words that describe the outcome not the process? (post)
- My work on the New York State Regents Advisory Council on Libraries. This has taught me things about libraries, library support agencies, and state budgets that I would have never learned otherwise. (posts)
- Writing Federated Search Report and Tool Kit for Free Pint. This report took much effort and thankfully has been well-received. (post)
- The changes coming to my work life in 2009. Actually, when you teach at the college level, there is a lot of work that must be done before classes begin, so I've already been working at my new job, but officially begin in a few days. I am definitely looking forward to the balance and interplay of teaching and consulting. (post)
- Google will continue to grow. I do wonder if/when Google will find itself with the same fate as DEC, IBM and others (fallen and no longer relevant).
- Organizations and government entities will start to ask questions (more loudly) about the wisdom of relying on major corporations for creating, managing and preserving digital assets.
- More organizations will cooperate to build sustainable digitization programs. Not only will libraries, museums and archives cooperate, but for-profit organizations will also find it useful to collaborate (on digitization, equipment and software development, and digital archives).
- Shifting budgets will cause organizations to be more creative. An unusual benefit of a down economy is that organizations turn to more creative solutions; solutions that they would ignore in good economic times.
- Unfortunately, many small organizations will still be unable to digitize materials that deserve broader access. I keep waiting for something that will help all small organizations jump on the digitization bandwagon...and waiting...and waiting.
If you are reading this blog and would like to receive updates in email or through your RSS reader, it is easy to subscribe to this blog to that can happen. Having updates delivered to you can make reading any blog easier for you.
Finally, may you have a Happy New Year! I know that 2008 has been a tough year for many people and organization because of the economy. At the moment, 2009 looks like it will throw us more challenges. However, may you and your organization find ways of getting through 2009 with your sanity, budget, etc. intact.
Related blog posts:
- Thank you (and some statistics) (2007)
- Digitization 101 Year in Review: Words to Take into 2007 (2006)
- Digitization 101 Year in Review: News (2006)
- Digitization 101 Year in Review: Influences (2006)
Technorati tags: JPEG2000,Copyright,Digitization,Digital Preservation,Regents,RAC,Book,Federated Search
Monday, October 13, 2008
Blog posts from IPRES 2008
At the close of day 1, we heard a summary of the findings of the international survey on the impact of copyright law on digital preservation. That indicated that the UK had one of the strictest set of constraints of all the countries looked at - in terms of who is permitted to carry out certain acts in the name of preservation and what those acts are. Other countries have more relaxed exemptions and that doesn’t appear to be causing the major rightsholdfers [sic] any significant financial loss. That should give us hope for some change in the law in the UK at least. And Horst Foster, making the keynote speech opening day 2, appeared to echo this at the European level, implying that the case for change had been made and accepted, although he was notably cautious about making any promises as to when this change might come about. -- da blogQuestions: should we just ignore the copyright problems like Internet Archive and Google? -- Digital Curation Blog
Trends in archives and libraries are toward JPEG2000 as an image storage format, even though it has to be converted before browsers can use it. Oya Rieger, talking about digitization of books, cited the smaller file size compared to JPEG, and the support of archival features such as incorporation of metadata into the file.Oya Rieger has been speaking about their large scale book digitisation processes. They first entered an agreement with Microsoft, and later with Google; they were naturally very disappointed when Microsoft pulled out, although this did give them unrestricted access to the books digitised under that programme. On the down-side, they suddenly found they need 40 TB of storage to manage these resources, and it took a year or so before they could achieve this. Oya related their work to the OAIS preservation reference model, and it was interesting to see not only that infamous diagram, but also a mapping of actual tools to the elements of the process model. It’s worth looking at her paper to see this; I noted that they were using ADORe for the archival storage layer, but there were several other tools that I did not manage to note down. -- Digital Curation BlogPREMIS is gaining traction as a format for preservation metadata. For instance, the British Library is using PREMIS 1.1, along with METS and MODS, for an eJournal archiving project. The article is available on the D-Lib site.
Stephen Abrams gave a presentation on JHOVE2, which is still in the design and prototyping stages. It's getting obvious from various discussions that the problems in JHOVE are becoming more of a concern. -- File Format Blog
Alex Ball is talking about the problems in curating engineering and CAD data. In what appears to be a lose-lose strategy for all of us, engineering is an area with extremely long time requirements for preserving the data, but increasing problems in doing so given the multiple strangleholds that IPR has: on the data themselves, on the encodings and formats tied up in specific tightly controlled versions of high cost CAD software, coupled with “engineering as a service” approaches, which might encourage organisations to continue to tightly hold this IPR. An approach here is looking for light-weight formats (he didn’t say desiccated but I will) that data can be reduced to. They have a solution called LiMMA for this. Another approach is linking preservation planning approaches with Product Lifecycle Management. In this area they are developing a Registry/Repository of Representation Information for Engineering (RRoRIfE). Interesting comment that for marketing purposes the significant properties would include approximate geometry and no tolerances, but for manufacturing you would want exact geometry and detailed tolerances. -- Digital Curation BlogRichard Wright talking about storage and the “cost of risk”. In early days dropping a storage device meant losing a few kilobytes, now it could be GBytes and years of work. Storage costs declining and capacity increasing exponentially roughly related to Moore’s law (doubling every 18 months). Usage is going up, too, and risk is proportionate to usage, so risk is going up too. Risk proportional to no of devices and to size and to use… plus the more commonly discussed format obsolescence, IT infrastructure obsolescence etc. So if storage gets really cheap, it gets really risky! -- Digital Curation Blog
Question from Steve Knight about how we move to a position where there is a market for digital preservation solution? -- Digital Curation BlogSarah Jones on developing a toolkit for a Data Audit Framework: to help institutions to determine what data are held, where they are located and how they are being managed. 4 pilot sites including Edinburgh and Imperial already under way, UCL and KCL in planning. Detailed workflow has been developed as a self-audit tool. Four phases in the audit process, the second being identifying and classifying the assets; looks like major work. Turns out the pilots are related to department level rather than institutions, which makes sense knowing academic attitudes to “the Centre”! I did hear from one institution that it was difficult getting responses in some cases. Simple online tool provided. DAF to be launched tomorrow (1 October) at the British Academy, together with DRAMBORA toolkit. -- Digital Curation Blog
In discussion, we felt that the point of David’s remarks was that we should understand that perfection was not achievable in the digital world, as it never was in the analogue world. We have never managed to keep all we wanted to keep (or to have kept) for as long as we wanted to keep it, without any damage. -- Digital Curation BlogOne recurring them, picked up at the outset by Lynne Brindley and in Steve Knight’s closing remarks, was that ‘digital preservation’ is not the term to be using in discussions with our institutions and the world, echoing remarks on the DCC blog which Brian later picked up on here. Steve prefers the phrase ‘permanent access’. which is indeed outcome-focussed. However, we’ve also said in PoWR that preservation isn’t always forever, so I would prefer something a little more all-embracing - ‘long-lived access’ might fit. -- JISC PoWR
Technorati tags: Copyright, Digitization, Digital Preservation, iPRES2008
Wednesday, September 03, 2008
Survey concerning JPEG2000
David Lowe's survey announcement said:
I am writing to solicit your help with a survey of library-related digital project staff regarding the implementation of the JPEG 2000 standard for digital images (specifically still images and not motion). We estimate that this task will take approximately 15 minutes of your time. It is available now at [this link].
The survey will remain open until October 31, 2008. We will post survey results via a report uploaded to our institutional repository, digitalcommons.uconn.edu. Please note that in our report, personal information from the survey will not be revealed, and any comments used will remain unattributed.
Technorati tag: JPEG2000
Monday, August 11, 2008
Article: A Format for Digital Preservation of Images: A Study on JPEG 2000 File Robustness
Digital preservation requires a strategy for the storage of large quantities of data, which increases dramatically when dealing with high resolution images. Typically, decision-makers must choose whether to keep terabytes of images in their original TIFF format or compress them. This can be a very difficult decision: to lose visual information though compression could be a waste of the money expended in the creation of the digital assets; however, by choosing to compress, the costs of storage will be reduced. Wavelet compression of JPEG 2000 produces a high quality image: it is an acceptable alternative to TIFF and a good strategy for the storage of large image assets.
Moreover, JPEG 2000 may be considered a format that can guarantee an efficient robustness to bit errors and offers a valid quality with transmission or physical errors: this point of view is confirmed by the case study results that we report in this article, concerning image quality after occurrence of random errors by a comparison among different file formats. Easy tools and freeware software can be used to improve format robustness by duplicating file headers inside or outside the image file format, enhancing the role of JPEG 2000 as a new archival format for high quality images.
Technorati tag: JPEG2000
Friday, August 01, 2008
Blog post: Update on BigTIFF
What is BigIFF? It's a technical standard. Quoting McGath:
BigTIFF changes the TIFF format by using 64-bit offsets and otherwise keeping everything else as much the same as possible. This means it can describe really large images. It also means that software that handles TIFF can be modified to handle BigTIFF with relatively little programming effort.
Technorati tags: Standards, Digital Image
Wednesday, July 23, 2008
Presentation: JPEG2000 for Archives and Libraries
Technorati tag: JPEG2000
Tuesday, July 08, 2008
Slides from Archiving in Practice with JPEG2000 available online
The presentation slides are now online from a session hosted by the JPEG2000 in Archives and Libraries Interest Group of the LITA division of ALA. The session was Archiving in Practice with JPEG2000.
Technorati tag: JPEG2000
Tuesday, June 10, 2008
Comments requested on draft version of BCR CDP Imaging Best Practices
BCR is inviting public comment on the draft version of BCR CDP Imaging Best Practices. It is intended to serve as a guide for practitioners in cultural heritage institutions that seek to create digital images from physical objects. Originally published by the Colorado Digitization Program in 2003 as the Western States Digital Imaging Best Practices, this updated version reflects the many changes that have occurred in the digitization field during the last five years.
We will accept comments on the document until close of business, Friday, June 13, 2008. Thank you for your contributions.
Technorati tag: Digitization
Sunday, May 25, 2008
Event: Preserving Photographs in a Digital World
- George Eastman House
- Rochester Institute of Technology
- Image Permanence Institute
Program Fee: $1,495
Thursday, February 21, 2008
Press Release: JPEG 2000 a great step forward for the archival community
The Digital Preservation Coalition has examined JPEG 2000 in a report published today. The report concludes that JPEG 2000 represents a great stride forward for the archival community. The format now allows for greater compression rates and a recompression rate that is visually lossless.
The findings come as the Digital Preservation Coalition launch its latest Technology Watch Report written by Dr. Robert Buckley, a Research Fellow with Xerox, ‘JPEG 2000 – a practical digital preservation standard?’. The report looks in-depth at the new format and the challenges it has to cope with. JPEG 2000 is widely used to collect and distribute a variety of images from geospatial, medical imaging, digital cinema, and image repositories to networked images. Interest in JPEG 2000 is now growing in the archival and library sectors, as institutions look for more efficient formats to store the results of major digitisation programmes.
The report is aimed at organisations involved in the management and storage of digital information. The in-depth report will help archives, libraries and other institutions make informed decisions about JPEG 2000 format and their future storage needs.
JPEG 2000 can reduce storage requirements by an order of magnitude compared to an uncompressed TIFF file. Dr. Buckley says, “This new format has come at a time of heightened awareness about the access to digital documents. Any format that can assist archives and libraries to do this is welcome.”
The format will also enable users to open as much of the file as they need at that time. This means a viewer, for example, could open a gigapixel image almost instantly. This is achieved by retrieving a decompressed low–resolution display sized image from the JPEG 2000 codestream. Coupled with this, the users’ ability to zoom, pan and rotate an image have been enhanced.
Adrian Brown, head of digital preservation, The National Archives said: “This is a very timely addition to the DPC's Technology Watch Report series as many organisations are themselves reviewing the JPEG2000 format. This concise, comprehensive and clear guide will be of interest to practitioners across the digital preservation community.”
The report concludes that JPEG 2000 offers much more flexibility and features than JPEG, but at the cost of greater complexity. It is however a great stride forward, and of major significance for the information management community.
To download a pdf of the report please go to: www.dpconline.org/graphics/reports/index.html#twr0801
For further information please contact, Tim Matthews, tim.matthews@nationalarchives.gov.uk, or 020 8392 5277.
For further information on the DPC please contact, Frances Boyle, fb@dpconline.org or 01904 435320.
About The Digital Preservation Coalition (DPC)
The Digital Preservation Coalition (DPC) is a cross sectoral member organisation established in 2001 to foster joint action to address the urgent challenges of securing the preservation of digital resources in the UK and to work with others internationally.
Technorati tag: JPEG2000