Archive for the ‘cataloging’ Category

Tuesday, June 19th, 2018

Five million more Library of Congress records

trash_lc

We’ve recently imported 5,148,400 new records from the Library of Congress into OverCat, LibraryThing’s data repository. This brings the total number of records in OverCat to nearly 78 million! That’s 78 million high-quality library (MARC) records you can use in cataloging on LibraryThing.

This new dataset was produced by the Library of Congress from records in the 2014 Retrospective file sets—the most recent currently available. The Library of Congress provides these MARC records as part of its MARC Open Access program. Although LibraryThing adds MARC records to Overcat as members search for them, this is our first mass update from Library of Congress data since OverCat debuted in 2010.

Thanks to developer CCatalfo‘s efforts to make this happen. Notice anything different in OverCat? Join the discussion and tell us about it on Talk.

Further reading

Labels: cataloging, library of congress

Wednesday, May 3rd, 2017

BOOM! Add Books Adds 749 Library Sources, 38 New Countries

UPDATE: As of today (May 19th), we’ve reached a grand total of 2,160 working library sources, covering 110 countries! See the updated map at right reflecting our latest stats. New countries include: Ethiopia, Egypt, Bahrain, Nepal, Belarus, Luxembourg, (Northern) Cyprus, and the US Virgin Islands.


Last week we announced six new data sources: Amazon in India, Brazil, Italy, Mexico, Spain and China.

Today we’re announcing a far larger advance in sources—a leap from 426 working library sources last week to 1,175 working library sources today! For this, as we will explain, we have LT members to thank.

All told, we’ve gone from sources in 40 countries before, to sources in 78 countries now, covering many new regions and languages.

Entirely new sources total 668, but another 81 were fixed—sources that had died sometime in recent years. Other “working” sources were tweaked, fixing search and character-set problems.

Dead sources accumulated because LibraryThing didn’t have the staff resources, or a good system to monitor and edit existing sources. We now have a new, interactive system for adding, editing and testing library sources. And we have also opened this up to members, starting with a hand-picked set of librarians and library workers with experience handling these systems (z39.50 servers).

We expected we’d get help, but we were astounded by how much. Top honors go to davidgn, who added more than 500 new libraries, and fixed many as well. Members lesmel and bnielsen also contributed considerably, together with LT staffer Chris Catalfo, who wrote the code for the new system. A round of applause for all!

New Sources, New Countries, New Languages

At the top of this post is an animation demonstrating the growth of the sources—initial sources, new countries (red), and finally, where we are today.You can see the individual frames here, here, and here.

You can see big advances in Central and South America, which went from one source in one country to 35 sources in nine countries. Africa went from 0 countries to six, and many were added in Eastern Europe, the Middle East, and East Asia. The countries that already had many sources also grew—the UK went from 44 to 60, Canada from 42 to 106 and the USA from 261 to 544! (The generosity and public-spiritedness of American public and academic libraries in providing open z39.50 connections is truly remarkable.)

Some of the most useful and important new sources are:

North America: Brooklyn Public Library, California State Library, Massachusetts Historical Society (USA), National Library Service for the Blind and Physically Handicapped (USA), Maine State Library (Maine), Vancouver Public Library (Canada), University of Toronto (Canada), University of Waterloo (Canada), University of Ottawa (Canada), Instituto Politécnico Nacional (Mexico).

South America: Pontificia Universidad Javeriana (Colombia), Biblioteca Nacional Mariano Moreno (Argentina), Universidade de São Paulo (Brazil), Pontificia Universidad Católica del Perú (Peru).

Europe: London School of Economics (UK), University of Warwick (UK), University of Cyprus (Cyprus), Armenian Libraries Union Catalog (Armenia), FENNICA and VIOLA, the national bibliography and discography of Finland, Latvian Academic Union Catalog, Biblioteca Nacional de Portugal (Portugal), Universidade de Coimbra (Portugal), Universitat Politècnica de Catalunya (Spain/Catalonia), Universidad de Sevilla (Spain).

Africa and the Middle East: University of Ghana, American University of Kuwait, American University of Beirut, University of Lagos (Nigeria), Qatar Faculty of Islamic Studies, Sultan Qaboos University (Oman), National University of Lesotho, Ege Üniversitesi (Turkey).

Asia and Oceanea: University of Melbourne (Australia), Okayama University (Japan), National Taiwan University, University of Macao, Africa University (Zimbabwe).

A New, User-Editable Sources System

As mentioned above, the updates were made possible by a new system which allows select LibraryThing members to edit and add library sources. Those members are able to change any out of date connection parameters, which have been a perennial problem as libraries change systems and settings over time.

See the screenshots on the right for how it works.

How can you help?

Post your feedback and questions on Talk. If you have a library you’d like to be able to use in cataloging your books here on LibraryThing, post them on that same Talk thread! Going forward, you can post about it in the Recommended Site Improvements group at any time.

If you’re a librarian or library professional who’d like to help with updating and adding new sources, get in touch with our developer Chris Catalfo (ccatalfo) and we’ll add you to the group Library Add Books Sources Maintenance, which opens up source editing. Because the details are so technical, and there’s some danger of messing things up, we’re making group membership by request only.

Labels: cataloging, new features

Friday, April 21st, 2017

Six New Sources: Amazon India, Italy, Brazil, Spain, Mexico, and China

We’re pleased to announce the addition of six new Amazon sites to LibraryThing’s cataloging sources. They are:

This is big news, because although we’ve had academic library sources for these countries and languages, Amazon has far more books for most readers, and is always faster.

UPDATE: Books, Music, and Movies

Initially these sources were available for books only. However, we’ve now added movies and music data from all but one of them. Amazon Brazil only has data for books available. Amazon India, Italy, Spain, Mexico, and China all have the option to search their books, music, and movies data.

To use them, go to Add Books, look under “Search where?” on the left-hand side of the page, and click “Add from 1077 sources.”

If you run into any issues, or have other feedback or questions, post them on Talk.

LibraryThing in Not-English?

Many members don’t know, but LibraryThing is available in more than a dozen languages, including ones for the new sources:

All translations have been done by members—an amazing amount of love and effort. Other sites include French, Germany, and our best-maintained translation, Catalan. See all of them.

Labels: cataloging, new features

Monday, September 14th, 2015

Music and movie cataloging (but we’re still a book site)

Short version: LibraryThing is and will remain a book site. But we never stopped people from cataloging other media, like movies and music. We’re now making it much easier to do. Check it out and add your non-book library at https://www.librarything.com/addbooks.

Medium version: LibraryThing is a book site, and will remain so. But many members, especially our small libraries, have always cataloged other media, such as movies and music. We allowed it, but didn’t support it well at all. In particular, we disabled non-book searching on Amazon, allowing it only on our library sources.

A few months ago we introduced a robust concept of media format. We’ve now opened up cataloging other media on the Amazon sources, which are far easier and better for the purpose.

Check it out at https://www.librarything.com/addbooks

trash_moviesmusic

Long version:

Why Are We Doing This? Adding other media has been planned for years. The main driver has been small libraries—churches, community centers, small museums, etc.—a major constituent of LibraryThing’s success. Although small libraries mostly collect books, they don’t limit themselves to books any more than public and academic libraries do. Our failings in the area really hurt us.

This change means that LibraryThing is now a “complete” cataloging system. This lets us reach small libraries as we never could before—something we plan to do even more strongly when TinyCat debuts.

We are also conscious that many “regular” members wanted to catalog their non-book libraries. I want to, anyway, and I know I’m not alone.

Worried? We are conscious of some members’ worries, for example that LibraryThing is “turning into” a movie site. These are valid concerns. Here’s how we responded and will respond:

Screenshot 2015-09-14 14.16.30

Movies have been on LibraryThing for a long time.
  • LibraryThing is a site for book lovers and readers. This isn’t going to change.
  • Books get me and the rest of the team up in the morning. That isn’t going to change.
  • LibraryThing has had movies and music since the beginning—hundreds of thousands are already cataloged. Directors and composers have had author pages since the beginning. The recommendations system has recommended movies and music since the beginning. If movies “pollute” LibraryThing, it’s been polluted for a long time.
  • Now, however, we know what’s a book, a movie, and so forth. Knowing means we can adapt the site’s features to deal with that. As a start, by popular request, we’ve changed our site search to “facet” by format. Other accomodations, like a way to refuse all non-book recommendations, can certainly be considered.
  • We don’t expect a crushing influx of non-book media or members. But if LibraryThing appeals to new people who want to catalog all their media, that isn’t a bad thing.

New Features. The following features have been added, or changed, in order of importance.

  • Add Books sources now include music, movies and combined sources for all the Amazon national sites (e.g., “Amazon.com books, music and movies”).
  • To build awareness, we’ve added one “Amazon books, music and movies” source to all members’ sources. If you don’t want it, the new Add Books sources system makes it easy to delete. There are also sources for just movies and just music.
  • Amazon-added movies and music have covers, based on the ASIN, not the ISBN. This change also gives LibraryThing ebook covers.
  • We’ve added media-based faceting in site search.
  • You can search both Amazon and Overcat by UPC.

Cataloging Non-Books Media. Movies and music aren’t books, but libraries catalog them with some of the same basic structure and concepts. Movies and music have titles, publication dates, subjects, Dewey classifications, etc. “Authors” is more complex. Library records generally mix directors, actors, producers and screenwriters into one set of contributors, with their roles not always marked. Amazon records are better here, clearly delineating the various roles. But they don’t have the name-control libraries have.

We’ve solved this as follows:

  • When possible, movies get director as their main author. This is always possible with Amazon records, but not with library records.
  • We’ve improved how we handle author names from Amazon, leveraging Amazon data against what we know from tens of millions of library records. So, for example, we’re handing “The Beatles” as “The Beatles” not “Beatles, The.” This change improves Amazon cataloging generally.
  • Where listed, actors, producers, musicians and so forth get secondary author status and roles. This means that actors have LibraryThing author pages. (But they had them before, as noted above. If this proves a problem, we can mark them somehow as a site-wide feature.)
  • We’ve improved media format detection of MARC records within Overcat, especially for odd MARC formats, like DANMARC (a specialized MARC format used in—you guessed it—Denmark).

Let Us Know. Let us know what you think on Talk.

Labels: cataloging, new feature, new features

Friday, September 11th, 2015

Edit and reorder sources in Add Books

Good news: We’ve improved the sources system within Add Books a lot.

Bad news: We had to transition to an entirely new sources system. Most members kept their sources, but some members and some sources couldn’t go into the new system easily. If you lost sources, you may need to choose them again. Fortunately, the new system’s a lot better at that.

You can find the new options on Add Books:
searchwhere

Everything now happens in a light box. The “Your Sources” tab allows you to reorder and delete sources.
yoursources

You can browse and choose sources, divided into “Featured” and “All Sources” on the other two tabs.
featured

As you’ll notice, a fair number of our sources are currently down. We’re working to get as many up again as possible, and add new ones. If you’d like to help and know something about Z39.50 connections, you’ll find we give our current connection details when you click the yellow warning marker.

You’ll also see other, very significant new stuff. But that’s a matter for another blog post!

Three cheers to our developer Ammar for the add-books changes!

Labels: cataloging, new features