cataloging « The LibraryThing Blog

Archive for the ‘cataloging’ Category

Tuesday, June 19th, 2018

Five million more Library of Congress records

We’ve recently imported 5,148,400 new records from the Library of Congress into OverCat, LibraryThing’s data repository. This brings the total number of records in OverCat to nearly 78 million! That’s 78 million high-quality library (MARC) records you can use in cataloging on LibraryThing.

This new dataset was produced by the Library of Congress from records in the 2014 Retrospective file sets—the most recent currently available. The Library of Congress provides these MARC records as part of its MARC Open Access program. Although LibraryThing adds MARC records to Overcat as members search for them, this is our first mass update from Library of Congress data since OverCat debuted in 2010.

Thanks to developer CCatalfo‘s efforts to make this happen. Notice anything different in OverCat? Join the discussion and tell us about it on Talk.

Wednesday, May 3rd, 2017

BOOM! Add Books Adds 749 Library Sources, 38 New Countries

UPDATE: As of today (May 19th), we’ve reached a grand total of 2,160 working library sources, covering 110 countries! See the updated map at right reflecting our latest stats. New countries include: Ethiopia, Egypt, Bahrain, Nepal, Belarus, Luxembourg, (Northern) Cyprus, and the US Virgin Islands.

Last week we announced six new data sources: Amazon in India, Brazil, Italy, Mexico, Spain and China.

Today we’re announcing a far larger advance in sources—a leap from 426 working library sources last week to 1,175 working library sources today! For this, as we will explain, we have LT members to thank.

All told, we’ve gone from sources in 40 countries before, to sources in 78 countries now, covering many new regions and languages.

Entirely new sources total 668, but another 81 were fixed—sources that had died sometime in recent years. Other “working” sources were tweaked, fixing search and character-set problems.

Dead sources accumulated because LibraryThing didn’t have the staff resources, or a good system to monitor and edit existing sources. We now have a new, interactive system for adding, editing and testing library sources. And we have also opened this up to members, starting with a hand-picked set of librarians and library workers with experience handling these systems (z39.50 servers).

We expected we’d get help, but we were astounded by how much. Top honors go to davidgn, who added more than 500 new libraries, and fixed many as well. Members lesmel and bnielsen also contributed considerably, together with LT staffer Chris Catalfo, who wrote the code for the new system. A round of applause for all!

New Sources, New Countries, New Languages

At the top of this post is an animation demonstrating the growth of the sources—initial sources, new countries (red), and finally, where we are today.You can see the individual frames here, here, and here.

You can see big advances in Central and South America, which went from one source in one country to 35 sources in nine countries. Africa went from 0 countries to six, and many were added in Eastern Europe, the Middle East, and East Asia. The countries that already had many sources also grew—the UK went from 44 to 60, Canada from 42 to 106 and the USA from 261 to 544! (The generosity and public-spiritedness of American public and academic libraries in providing open z39.50 connections is truly remarkable.)

Some of the most useful and important new sources are:

North America: Brooklyn Public Library, California State Library, Massachusetts Historical Society (USA), National Library Service for the Blind and Physically Handicapped (USA), Maine State Library (Maine), Vancouver Public Library (Canada), University of Toronto (Canada), University of Waterloo (Canada), University of Ottawa (Canada), Instituto Politécnico Nacional (Mexico).

South America: Pontificia Universidad Javeriana (Colombia), Biblioteca Nacional Mariano Moreno (Argentina), Universidade de São Paulo (Brazil), Pontificia Universidad Católica del Perú (Peru).

Europe: London School of Economics (UK), University of Warwick (UK), University of Cyprus (Cyprus), Armenian Libraries Union Catalog (Armenia), FENNICA and VIOLA, the national bibliography and discography of Finland, Latvian Academic Union Catalog, Biblioteca Nacional de Portugal (Portugal), Universidade de Coimbra (Portugal), Universitat Politècnica de Catalunya (Spain/Catalonia), Universidad de Sevilla (Spain).

Africa and the Middle East: University of Ghana, American University of Kuwait, American University of Beirut, University of Lagos (Nigeria), Qatar Faculty of Islamic Studies, Sultan Qaboos University (Oman), National University of Lesotho, Ege Üniversitesi (Turkey).

Asia and Oceanea: University of Melbourne (Australia), Okayama University (Japan), National Taiwan University, University of Macao, Africa University (Zimbabwe).

A New, User-Editable Sources System

As mentioned above, the updates were made possible by a new system which allows select LibraryThing members to edit and add library sources. Those members are able to change any out of date connection parameters, which have been a perennial problem as libraries change systems and settings over time.

See the screenshots on the right for how it works.

How can you help?

Post your feedback and questions on Talk. If you have a library you’d like to be able to use in cataloging your books here on LibraryThing, post them on that same Talk thread! Going forward, you can post about it in the Recommended Site Improvements group at any time.

If you’re a librarian or library professional who’d like to help with updating and adding new sources, get in touch with our developer Chris Catalfo (ccatalfo) and we’ll add you to the group Library Add Books Sources Maintenance, which opens up source editing. Because the details are so technical, and there’s some danger of messing things up, we’re making group membership by request only.

Labels: cataloging, new features

Friday, April 21st, 2017

Six New Sources: Amazon India, Italy, Brazil, Spain, Mexico, and China

We’re pleased to announce the addition of six new Amazon sites to LibraryThing’s cataloging sources. They are:

Amazon.in (India)
Amazon.it (Italy)
Amazon.com.br (Brazil)
Amazon.es (Spain)
Amazon.com.mx (Mexico)
Amazon.cn (China)

This is big news, because although we’ve had academic library sources for these countries and languages, Amazon has far more books for most readers, and is always faster.

UPDATE: Books, Music, and Movies

Initially these sources were available for books only. However, we’ve now added movies and music data from all but one of them. Amazon Brazil only has data for books available. Amazon India, Italy, Spain, Mexico, and China all have the option to search their books, music, and movies data.

To use them, go to Add Books, look under “Search where?” on the left-hand side of the page, and click “Add from 1077 sources.”

If you run into any issues, or have other feedback or questions, post them on Talk.

LibraryThing in Not-English?

Many members don’t know, but LibraryThing is available in more than a dozen languages, including ones for the new sources:

Brazilian Portuguese (br.LibraryThing.com)

All translations have been done by members—an amazing amount of love and effort. Other sites include French, Germany, and our best-maintained translation, Catalan. See all of them.

Labels: cataloging, new features

Monday, September 14th, 2015

Music and movie cataloging (but we’re still a book site)

Short version: LibraryThing is and will remain a book site. But we never stopped people from cataloging other media, like movies and music. We’re now making it much easier to do. Check it out and add your non-book library at https://www.librarything.com/addbooks.

Medium version: LibraryThing is a book site, and will remain so. But many members, especially our small libraries, have always cataloged other media, such as movies and music. We allowed it, but didn’t support it well at all. In particular, we disabled non-book searching on Amazon, allowing it only on our library sources.

A few months ago we introduced a robust concept of media format. We’ve now opened up cataloging other media on the Amazon sources, which are far easier and better for the purpose.

Check it out at https://www.librarything.com/addbooks

Long version:

Why Are We Doing This? Adding other media has been planned for years. The main driver has been small libraries—churches, community centers, small museums, etc.—a major constituent of LibraryThing’s success. Although small libraries mostly collect books, they don’t limit themselves to books any more than public and academic libraries do. Our failings in the area really hurt us.

This change means that LibraryThing is now a “complete” cataloging system. This lets us reach small libraries as we never could before—something we plan to do even more strongly when TinyCat debuts.

We are also conscious that many “regular” members wanted to catalog their non-book libraries. I want to, anyway, and I know I’m not alone.

Worried? We are conscious of some members’ worries, for example that LibraryThing is “turning into” a movie site. These are valid concerns. Here’s how we responded and will respond:

Movies have been on LibraryThing for a long time.

LibraryThing is a site for book lovers and readers. This isn’t going to change.
Books get me and the rest of the team up in the morning. That isn’t going to change.
LibraryThing has had movies and music since the beginning—hundreds of thousands are already cataloged. Directors and composers have had author pages since the beginning. The recommendations system has recommended movies and music since the beginning. If movies “pollute” LibraryThing, it’s been polluted for a long time.
Now, however, we know what’s a book, a movie, and so forth. Knowing means we can adapt the site’s features to deal with that. As a start, by popular request, we’ve changed our site search to “facet” by format. Other accomodations, like a way to refuse all non-book recommendations, can certainly be considered.
We don’t expect a crushing influx of non-book media or members. But if LibraryThing appeals to new people who want to catalog all their media, that isn’t a bad thing.

New Features. The following features have been added, or changed, in order of importance.

Add Books sources now include music, movies and combined sources for all the Amazon national sites (e.g., “Amazon.com books, music and movies”).
To build awareness, we’ve added one “Amazon books, music and movies” source to all members’ sources. If you don’t want it, the new Add Books sources system makes it easy to delete. There are also sources for just movies and just music.
Amazon-added movies and music have covers, based on the ASIN, not the ISBN. This change also gives LibraryThing ebook covers.
We’ve added media-based faceting in site search.
You can search both Amazon and Overcat by UPC.

Cataloging Non-Books Media. Movies and music aren’t books, but libraries catalog them with some of the same basic structure and concepts. Movies and music have titles, publication dates, subjects, Dewey classifications, etc. “Authors” is more complex. Library records generally mix directors, actors, producers and screenwriters into one set of contributors, with their roles not always marked. Amazon records are better here, clearly delineating the various roles. But they don’t have the name-control libraries have.

We’ve solved this as follows:

When possible, movies get director as their main author. This is always possible with Amazon records, but not with library records.
We’ve improved how we handle author names from Amazon, leveraging Amazon data against what we know from tens of millions of library records. So, for example, we’re handing “The Beatles” as “The Beatles” not “Beatles, The.” This change improves Amazon cataloging generally.
Where listed, actors, producers, musicians and so forth get secondary author status and roles. This means that actors have LibraryThing author pages. (But they had them before, as noted above. If this proves a problem, we can mark them somehow as a site-wide feature.)
We’ve improved media format detection of MARC records within Overcat, especially for odd MARC formats, like DANMARC (a specialized MARC format used in—you guessed it—Denmark).

Let Us Know. Let us know what you think on Talk.

Labels: cataloging, new feature, new features

Friday, September 11th, 2015

Edit and reorder sources in Add Books

Good news: We’ve improved the sources system within Add Books a lot.

Bad news: We had to transition to an entirely new sources system. Most members kept their sources, but some members and some sources couldn’t go into the new system easily. If you lost sources, you may need to choose them again. Fortunately, the new system’s a lot better at that.

You can find the new options on Add Books:

Everything now happens in a light box. The “Your Sources” tab allows you to reorder and delete sources.

You can browse and choose sources, divided into “Featured” and “All Sources” on the other two tabs.

As you’ll notice, a fair number of our sources are currently down. We’re working to get as many up again as possible, and add new ones. If you’d like to help and know something about Z39.50 connections, you’ll find we give our current connection details when you click the yellow warning marker.

You’ll also see other, very significant new stuff. But that’s a matter for another blog post!

Three cheers to our developer Ammar for the add-books changes!

Labels: cataloging, new features

Wednesday, June 24th, 2015

New Feature: MARC Import

This is not a bobcat

MARC is the library standard for bibliographic records. We’ve always parsed MARC records behind the scenes, when members searched one of our 700 library sources, or our Overcat collection. A few years ago, we introduced the ability export your LibraryThing collections as MARC records, even if your records didn’t start out in MARC.

Now, we’re adding the last piece: MARC importing, for all the small but professionally-cataloged libraries that use LibraryThing.

Try it Out. Check it out on Import or directly to MARC Import.

How it works. To use MARC import, you’ll need to have your library data in a .marc file format. Depending on how large a file you’ve got, the import process may take a few minutes. The good news is, you’ll receive a notification from LibraryThing once it’s ready. From there, you’ll be able to review your import options—just like you would with any other import—and select the collections, tags, etc. you’d like to apply to the items you’re importing.

What is MARC? MARC stands for Machine-Readable Cataloging. It represents a set of digital formats for describing items held by libraries: books, maps, CDs/DVDs, etc. You name it, if it’s in a library, MARC can handle it. Libraries the world over use MARC to standardize their item records in such a way that information about different types of items can all be fed into (and retrieved from) cataloging systems uniformly.

MARC fields are denoted by numerical tags, that indicate what type of information is contained in that field. For example, the title of a given work is always in field 245.

Don’t Upload The New York Public Library! This is for small—or, better the tiny—libraries that use MARC records and LibraryThing. Uploads are capped at 10,000 records total, so don’t try to upload 100,000 records. “Regular” libraries, big and small, should check out LibraryThing for Libraries, a remarkable suite of catalog enhancements.

Questions? Comments? Let us know what you think on Talk.

Labels: cataloging, new features, small libraries

Tuesday, May 15th, 2012

Harvard University’s 12 million records now in LibraryThing

Short version. Our “Overcat” search now includes 12.3 million records from Harvard University!

Long version. On April 24 the Harvard Library announced that more than 12 million MARC records from across its 73 libraries would be made available under the library’s Open Metadata policy and a Creative Commons 0 public domain license. The announcement stunned the library world, because Harvard went against the wishes of the shared-cataloging company OCLC, who have long sought to prevent libraries from releasing records in this way. (For background on OCLC’s efforts see past blog posts.)

It took a while to process, but we’ve finally completed adding all 12.3 million MARC records (3.1GB of bibliographic goodness!) to LibraryThing. They’ve gone into OverCat, our giant index of library records from around the world—now numbering more than 51 million records! As a result, when searching OverCat under “Add books,” you’ll now see results “from Harvard OpenMetadata.”

This release (“big data for books,” as David Weinberger calls it) is, to put it mildly, a Very Big Deal. Harvard’s collections are both deep and broad, covering a wide variety of languages, fields, and formats. The addition of these 12 million records to OverCat has significantly improved our capacity for the cataloging of scholarly and rare books, and greatly enhanced our coverage generally.

Kudos to Harvard for making this metadata available, and we hope that other libraries will follow suit.

For more on the metadata release, see Quentin Hardy’s New York Times blog post, the Dataset description, or the Open Metadata FAQ. And happy cataloging!

Come discuss here.

Harvard requests and we’re happy to add: The “Harvard University Open Metadata” records in OverCat contain information from the Harvard Library Bibliographic Dataset, which is provided by the Harvard Library under its Bibliographic Dataset Use Terms and includes data made available by, among others, OCLC Online Computer Library Center, Inc. and the Library of Congress.

Labels: cataloging, open data

Tuesday, October 25th, 2011

Occupy Libraries!

It’s been fascinating to watch the rise of libraries at the various Occupy sites around the world, particularly the impressively-large collection at Occupy Wall Street known as the People’s Library. We reached out and suggested a LibraryThing account for the collection, and the volunteer librarians in Zucotti Park responded enthusiastically.

The OWSLibrary catalog now includes more than 3,300 titles, and it’s quite a rich and varied collection (check out the tag mirror). We’ve got a Talk thread where members are posting the books they share with the library; as of this morning, I share 100 titles with them, everything from E.O. Wilson to Annie Dillard to Strunk & White. If you’re signed into LibraryThing, you can see what you share with the OWS Library here.

The OWSLibrary folks also have an active blog, Twitter, and Flickr presence (they’ve even got library stamps!). Many authors have visited to speak, lend support, and sign books, and there’s now even an Occupy Wall Street Poetry Anthology.

More than 1,300 writers have signed the Occupy Writers petition in support of the Occupy movement, including Margaret Atwood, Neil Gaiman, Junot Díaz and more.

You can read some good coverage of the Occupy library movement in American Libraries, the Chronicle of Higher Education, and the Wall Street Journal.

On Friday, local librarian JustinTheLibrarian, Tim and I went downtown on our lunch break and cataloged the Occupy Maine library, a small collection housed at Portland’s Spartan Grill restaurant (which also serves a very tasty gyro).

Occupy Sacramento’s library is also up on LibraryThing, and we’ve been in touch with various other Occupy libraries; if your city’s library joins up, we’d love to know about it!

While you may agree or disagree with the Occupy movement as a whole, we think what they’re doing with books and libraries is simply awesome. And we’re very happy to be a part of it.

Labels: cataloging, flash mob, flash-mob cataloging, libraries

Thursday, February 10th, 2011

LibraryThing gets work-to-work relationships!

Today we’ve launched some new ways to display relationships between works.

The concept covers works that contain other works, or are contained by them. It also covers retellings, abridgments, parodies, commentaries on and so forth.

Thus, LibraryThing members will be able to add relationships that show:

The Golden Compass as contained inside His Dark Materials
Wide Sargasso Sea as a (non-series) prequel to Jane Eyre
Elizabeth Eisenstein’s The Printing Revolution in Early Modern Europe as an abridgment of The Printing Press as an Agent of Change
Bored of the Rings as a parody of The Lord of the Rings

A core concept here is that this is only for work-level relationships. Therefore, we are not doing “translation of,” “facsimile edition of,” etc. Members are asked to connect only existing works, not make up new, so-far uncataloged works.

Come discuss rules, concepts and ideas in the Talk topic.

We’ve got a lot more coming that builds and expands on these capabilities, so stay tuned!

Many thanks to the members of Board for Extreme Thing Advances group, who’ve been helping us develop and refine this feature. They have already added some 4,500 contains/contained-in relationships across LibraryThing.

Labels: cataloging, work pages, works

Tuesday, February 1st, 2011

Flash-Mob Cataloging: NCSU & Arts Together

A hearty gang of 21 volunteer catalogers from the Metadata & Cataloging Department at North Carolina State University Libraries helped out over two weekends in January at the Arts Together community school (LT Profile page) in Raleigh, adding their preschool book collection to LibraryThing.

The catalogers added the school’s monthly curricular themes as collections in the catalog (February, for example, is “The Animal Kingdom/Feelings“) and supplemented those with a series of tags. Coordinator Erin Stalberg reports that her favorite tag is “Community Helpers” – if you check out the titles so tagged, you’ll soon see why!).

See more photos from the flash-mob here.

Over the two weekends, the flash-mob teams added a total of 1,145 books – well done! We were happy to send a box of stickers and t-shirts to the volunteers, and always encourage similar projects! If you’re interested in forming a flash mob for a library near you, check out Tim’s blog post, the How To Flash-Mob with LibraryThing wiki and the Flash Mob Cataloging Talk group. If your organization could use the help of a flash-mob, please get in touch with me and I’ll be happy to help coordinate it!

Labels: cataloging, flash mob, flash-mob cataloging, NCSU

Archive for the ‘cataloging’ Category

Tuesday, June 19th, 2018

Five million more Library of Congress records

Further reading

Wednesday, May 3rd, 2017

BOOM! Add Books Adds 749 Library Sources, 38 New Countries

New Sources, New Countries, New Languages

A New, User-Editable Sources System

Friday, April 21st, 2017

Six New Sources: Amazon India, Italy, Brazil, Spain, Mexico, and China

Monday, September 14th, 2015

Music and movie cataloging (but we’re still a book site)

Friday, September 11th, 2015

Edit and reorder sources in Add Books

Wednesday, June 24th, 2015

New Feature: MARC Import

Tuesday, May 15th, 2012

Harvard University’s 12 million records now in LibraryThing

Tuesday, October 25th, 2011

Occupy Libraries!

Thursday, February 10th, 2011

LibraryThing gets work-to-work relationships!

Tuesday, February 1st, 2011

Flash-Mob Cataloging: NCSU & Arts Together

Recent Posts

Recent Comments

Archives

Categories

Meta