Archive for the ‘oclc’ Category

Tuesday, March 15th, 2011

VIAF, OCLC and open data

Yesterday I released a service called “LC AuthoritiesThing.” The service solved a problem many have had with the LC Authorities website. Although a fine searchable resource, LC Authorities does not have stable URLs. Links die after a short period and are tied to sessions in a way that prevents sharing URLs during that period. LC AuthoritiesThing provides a window into the LC Authorities site which allows hard, reliable links. Various catalogers have thanked us for making the service, as it will allow them to refer to authority records more easily.

As an update to the post I took notice of VIAF, the Virtual Authority File, recommended to me as a substitute by a cataloger on Twitter. I assumed (apparently wrongly) that VIAF would at some point supercede LC Authorities. And I wrote that VIAF wasn’t a good substitute because it is an OCLC project, and encumbered by licensing restrictions.

Since then, I have received a diversity of communications that I am wrong. Although its data is hosted by and its services were developed and served by OCLC, VIAF is not an OCLC project, and the project has no access terms. Thomas Hickey from OCLC even wrote on this blog that full dumps are also available, although they must be approved somehow by project leaders.

This is welcome news. LibraryThing will be submitting a request for a full VIAF dump, and we’ll see where that goes. We will also look into automated harvesting of the website, or at least the LC portion of the data.

So much so good. But the situation is illustrative. Select people within the library community may believe that VIAF is free. But every public indication is that it is not free.

These indications include:

  1. OCLC copyright notices on every single VIAF.org page, and all VIAF-related pages on OCLC.org.
  2. Links to the OCLC Terms and Conditions from multiple VIAF.org pages, including the Privacy page.
  3. A robots.txt file that prohibits automated access to result pages.
  4. The “About VIAF” project page prominently states “Use of our prototypes is subject to OCLC’s terms and conditions. By continuing past this point, you agree to abide by these terms.”

As all catalogers surely know, the OCLC Terms and Conditions are lengthy and explicit. Among other things they prohibit commercial use, automated use, storage of data, and use of the data for cataloging (!). They state that OCLC has sole and arbitrary discretion to discontinue access to anyone for any reason. They state that exceptions to the terms requires permission in writing from OCLC.

Meanwhile, apart from a blog comment from Thom Hickey, I can find no assertions that OCLC terms don’t apply to VIAF, no mention of dumps or of a process to get them.

VIAF is to be commended for its openness and lack of terms. This is a great move forward for open bibliographic data. But it needs to make greater efforts to make others aware of this state of affairs, and define the level and character of openness. (It’s still unclear to me whether VIAF asserts any ownership, or whether it is all in the public domain.) And VIAF should make efforts to remove multiple statements asserting that OCLC terms apply to VIAF data.

Labels: cataloging, oclc

posted by Tim @2:13 pm 1 Comment »
  • Tweet about VIAF, OCLC and open data

    • Thursday, May 21st, 2009

    Non est potestas: OCLC Policy withdrawn

    Non est potestas super terram quae comparetur ei / There is no power on earth that compares with it (frontispiece to Hobbes’ Leviathan)

    The OCLC Review Board finally put OCLC’s Policy to bed. In a short speech to the OCLC Members Council, board chair Jennifer Younger, affirmed “that a policy is needed, but not this policy.” After the drubbing they got from the ICOLC and ARL—neither of which took into consideration OCLC’s recent push into the software market—you can be sure OCLC will take its board’s advice.

    While the result was the right one, and I’m sure the members are good, conscientious librarians, I’m not going to echo others’ praise about their decision. The writing was on the wall. If they had pushed forward, OCLC would have met even more hostility than it already engendered. The speech itself, like their “push poll” survey, show where the OCLC Review Board’s sympathies lie. I don’t think you could read the ICOLC or ARL reports against it and conclude OCLC “gets” it. It was, as one of my email correspondents put it “all about protecting WorldCat, identifying ‘threats,’ and ‘appropriate use by members.'”

    I think one of Dr. Younger’s phrases nicely encapsulates the flaw in OCLC’s approach, namely “we must revisit the Social Contract between OCLC and its members.” I’d like to go into the phrase a little deeper, not without some fun-poking.

    The Social Contract. The phrase “social contract” is an interesting one. The idea also appeared in the the ARL report*—and may well go have been used before. As everyone knows, it’s a key concept in political theory (hence the Hobbes’ frontispiece above) as the thing that, some believe, makes government power legitimate.

    Why, therefore, does a cooperative need to express itself in terms of state-formation, rather than a voluntary cooperative? Why does OCLC want to cast itself as a government?

    Sitting in OCLC’s Brobdingnagian Dublin, OH headquarters, with thousands of OCLC workers shuttling about like so many ministry secretaries, and an interior hall bedecked with flags like the United Nations, it must be easy to think of OCLC as a sort of “government of libraries.”**

    Architectural criticism aside, OCLC’s answer might be that, unlike cooperatives, a government gets to enforce its will more broadly. If you run afoul of a cooperative, the mutual consent that bound you to the cooperative is withdrawn, and you leave or they kick you out. But if you break the rules of a state, they put you in prison, whether you consent or not. Indeed, while philosophers have sometimes proposed a formal ceremony of consent, states act on non-consenting members all the time. Anarchists go to prison too (indeed, they tend to go to prison for being anarchists). This model, therefore, fits in better with OCLC’s plan to bind former members and non-members use of library data. As a cooperative, OCLC is a purely member institution. With a “social contract,” OCLC get to dictate more like a state.***

    If the idea of OCLC-as-state is accepted, however, there’s a gap between the ARL report‘s idea of a “mutual social contract”—a social contract between citizen equals—and Younger’s description of the “Social Contract between OCLC and its members.” The latter is a nice description of the more antique view of a contract between citizens and their sovereign. Even if libraries accept a government over them, I suspect they would be more comfortable with the more modern view of a contract between equals.

    Nullum timeret? As libraries consider the matter, one factor can be put to rest: Fear.

    Writing for the Next Generation Catalog for Libraries list, Karen Coyle speculated that libraries were responding to OCLC through organizations like ARL and ICOLC, out of a “combination of ‘strength in numbers’ and ‘safety in numbers.'”

    “I’ve seen a remarkable tendency of libraries to not want to confront OCLC. Remember that the proposed policy had penalties for mis-use of records, and severe ones at that (loss of rights to use OCLC records altogether). There is an intimidation factor involved. Agreed, as a member organization the members should not be afraid, but I think they are.”

    That fear should be much diminished. Members spoke up, and OCLC backed down again and again (by my count they postponed, revised, revised, revised, delayed for revision and now shelved). Libraries—and, quite importantly, lots of people who merely love libraries—rose up and forced OCLC to back down.

    The frontispiece to Hobbes’ Leviathan, shown above, quotes the Vulgate of the first clause of Job 41:33, non est super terram potestas quae conparetur ei (“There is no power on earth that compares to him.”). No doubt Hobbes or anyway his cover-designer felt this a good description of the legitimate sovereign.

    But for our purposes, the second clause is particularly apt, qui factus est ut nullum timeret, “There is no power on earth that compares to him, who was made to fear nothing.” Job thought that whales were fearless.

    Well, OCLC, you’ve met the architeuthis. And he is all of us.

    See also:

    *”In the eyes of the community, the guidelines expressed a mutual social contract, and the new Policy represents an authoritarian, unilaterally imposed legal restriction.”
    **The trees growing inside are also a nice touch. The Assyrian throne room just had a carving of a tree, and the White Tree of Gondor was outside. 😉
    ***Similarly, nobody minds if you belong to two cooperatives. But states tend to be jealous about allegiance. AS ICOLC wrote, libraries are involved in a “complex set of relationships,” of which, “OCLC is one vital component among many that libraries will use.” That’s not really a “social contract” idea.

    P
    hoto by Flickr user OZinOH.

    Labels: oclc

    posted by Tim @11:25 am 1 Comment »
  • Tweet about Non est potestas: OCLC Policy withdrawn

    • Tuesday, May 12th, 2009

    OCLC Policy, Good night


    The International Coalition of Library Consortia, a very loose but extremely large group of library consortia, just released a Statement on the Proposed OCLC Policy for Use and Transfer of WorldCat Records.

    For a while there it looked like OCLC was going to succeed in locking down the world’s library data, converting a wonderful sharing and coordination tool into an unbreakable data monopoly. But, together with OCLC’s recent, revealing decision to enter the library systems market, the ICOLC statement effectively ends that possibility. OCLC isn’t getting its new Policy, or anything like it.* Good night, OCLC Policy.

    The details are worth a look. The ICOLC’s statement was short, signing onto the “substantial and broad” concerns highlighted by the Association of Research Libraries. It goes on to add three concerns, two of which address the risk to innovation—a topic the ARL report barely touched on:

    1. The proposed policy appears to freeze OCLC’s role in the library community based on historical and current relationships. We share the concern, voiced by many, that the policy hinders rather than encourages innovation, and we urge the Review Board to carefully examine this issue. It is unclear that the policy has been constructed with a focus on an evolving role of OCLC in enhancing the missions of an international library community with diverse and complex interests.
    2. The scope of the proposed policy goes well beyond any concerns about inappropriate commercial exploitation of WorldCat records. It applies as well to non-commercial uses. ICOLC member consortia are member-created, member-driven innovation agents. Our initiatives are generally non-commercial and undertaken with member approval based on member needs. Any OCLC record use policy should account for the rich and diverse innovation that takes place through many consortia.
    3. The proposed policy is legally murky. There is no mechanism for negotiation of terms and conditions nor is it clear what constitutes acceptance by member libraries. A new policy must address these problems.

    As significant as the content was the list of signatories. Lyrasis, the former Palinet and Solinet, includes over 2,500 members. With “regional base and national scope” (their words), and about to merge with Nelinet, bringing their members to 4,500, Lyrasis is a major player. They’re no longer just a “regional service provider” for OCLC, and can be expected to collaborate or compete with OCLC as its members’ interests lead. They were joined by many of the big regional and state networks out there—MINITEX, NERL, the Florida Center for Library Automation, the Washington Research Library Consortium, the Michigan Library Consortium, WiLS, four Canadian consortia and both the Swedish and Finnish national libraries. Some of the signatories ought to have been sympathetic. Orbis Cascade, a source of much original cataloging, is also an important OCLC partner in developing consortial software. In Ohio, OCLC’s home state, OhioLINK, OHIONET and INFOhio all signed. Other members will add their names to the list as they affirm it.

    The Next Step. It’s time now for the library world to step back and consider what, if anything, they want to do about restricting library data in a fast-moving, digital world. Some, including some who’ve deplored OCLC’s process and the policy, want restrictions on how library data is distributed and used. Once monopoly and rapid, coerced adoption are off the table, that’s a debate worth having, and one with arguments on both sides.

    From my perspective, restrictions on the use and transfer of cataloging data—which is not usually copyrightable and is most frequently created by bodies responsible to the public good—is legally dubious and ethically stingy.

    Instead, libraries should embrace “radical openness,” a commitment to sharing what they know freely, something that looks less radical in light of the library’s historic dedication to the free exchange of information. Selling other people’s library records isn’t a real threat, but, if it were, the answer would be more openness, not less. When you sell tickets, you get scalpers. But nobody makes money selling passes to Central Park. (A few people make money walking dogs around it. Most just enjoy the free grass and sunshine.) And in a world that’s looking less and less friendly to the long-term success of libraries, an unwavering commitment to sharing and openness may well be libraries’ saving grace.

    So, three cheers to ICOLC for speaking up on this issue. Now, librarians and library programmers, let’s get back to work. Let’s earn our freedom.

    Artwork: “Flickr is Freedom.” Creative Commons, Attribution, by Timtak.

    *I note with some interest that Edward Corrado, whose OCLC posts have been very perceptive, isn’t quite as excited about this as I am. Where he wishes the statement was “worded a little stronger” I take great solace in phrases like “The proposed policy appears to freeze OCLC’s role in the library community based on historical and current relationships.” I’m hoping some others weigh in. The library world is, I think, somewhat exhausted by the whole OCLC Policy affair, and now that the organizations are weighing in strongly and negatively, the bloggers and newslist-ers who raised the initial questions—and were excoriated for it—may no longer be as necessary.

    Labels: oclc

    posted by Tim @10:18 pm 0 Comments »
  • Tweet about OCLC Policy, Good night

    • Friday, April 24th, 2009

    OCLC news reactions

    This post follows on The OCLC End Game, posted early this morning.

    Library Journal‘s Josh Hadro did an excellent follow-up article. Besides citing this blog post, Hadro got responses from Carl Grant, president of Ex Libris on OCLC’s tenuous non-profit status—I’ll have another post about that soon—and a number of bloggers. Iris Jastram/Pegasus Librarian’s thoughts deserve quotation:

    “I’m pleased that this is yet another competitor against the current lumbering giants in the ILS market, and I like the idea that (if I understand correctly) this will add a hosted option to the ILS market. … On the other hand, this means that that pesky new policy on the transfer and use of OCLC records really wasn’t just about protecting a bunch of member-produced data after all. There were bigger plans afoot, and these plans involved leaning even farther toward the vendor model rather than the service model. And if OCLC is a vendor rather than a service, that new policy feels even more like a land-grab rather than an effort to protect member investments.”

    Ms. Jastram’s misgivings are comforting to me, at least, as her previous thoughts on the OCLC Policy were more mixed. Ultimately, the fate of OCLC’s Policy will be decided by the people in the middle—the fair-minded people, not the ones who equate OCLC with the Matrix, The Empire or the All Your Bases villain.*

    The Smithsonian Libraries on the OCLC Policy. I missed this, but on April 2 the official blog of the Smithsonian Institution Libraries weighed in on the OCLC Policy and the ACRL/ARL response (PDF), “support[ing] the recommendations” emphasizing a number of points. Among these were:

    • “The policy should recognize and affirm traditional library values of cooperative cataloging and shared bibliographic information without any claim of ownership of the bibliographic records.”
    • “OCLC’s new policy should recognize, and not be in conflict with, existing legal obligations or requirements that may apply to some OCLC member libraries (such as federal libraries).”

    It’s great to see a federal library making such a public statement. Having been passed by in the OCLC Policy discussion—Federal librarians have told me they were amazed OCLC thought it could unilaterally change licensing terms with government entities—and not included on the ARL/ACRL board either, at least one is lending its voice to the criticism. Hooray for them. James Smithson, who left his estate for the “increase and diffusion of knowledge”—and to a country he had never even visited!—would, I think, be proud.

    *Chris Bourg left a comment to the effect that the AYBABTU reference was purely humorous, and she does not consider OCLC a villain, even if she thinks I’ve got a good argument. Now, can anyone think of a way to tape Jay Jordan saying “You have no chance to succeed make your time”? I’m thinking we could sky write it over OCLC headquarters in Dublin, OH and secretly film OCLC employees puzzling it out. Ideally, though, he’d need to wear the bionic monocle.

    I will never run out of interesting Flickr chess images. This one’s by Shyald, from a series.

    Labels: oclc, worldcat, worldcat local

    posted by Tim @5:24 pm 0 Comments »
  • Tweet about OCLC news reactions

    • Friday, April 24th, 2009

    The OCLC End Game

    Two years ago I predicted what OCLC, the library-data organization, was after with it’s WorldCat Local pilot program—”They’re trying to convert a data licensing monopoly into a services monopoly.” To illustrate, I changed the OCLC logo to the Death Star.

    I was hardly alone in this speculation. But this concern was soon overtaken as OCLC brought forth it’s Revised Policy for Use and Transfer of WorldCat® Records. The Policy, which turned a de facto data monopoly into a legally enforceable one, became a focus of intense debate in the library world. On the one side just about every library blogger with a keyboard, and eventually a review board at the ACRL/ARL, raised questions about the idea of anyone “owning” records meant for sharing and most frequently produced by government entities. On the other side, OCLC’s defenders (in truth, mostly employees), talked of OCLC’s “curation” of community content, of “protecting members’ investment,” of the “best interest of libraries,” “OCLC’s public purposes” and of WorldCat.com’s role as an essential “switching mechanism” to local catalog (references: 1, 2, 3).

    Yesterday, OCLC unveiled the end game that brings everything together. As reported by Marshall Breeding in Library Journal:

    “This new project, which OCLC calls “the first Web-scale, cooperative library management service,” will ultimately bring into WorldCat Local the full complement of functions traditionally performed by a locally installed integrated library system (ILS).”

    The new service will be “free” to (paying) WorldCat First Search customers.

    The move to “web scale” (OCLC-speak for “web”) catalogs was an inevitable one, and is a good one. It’s silly to have every library in the country running their own racks of servers. The economics of server architecture, equipment and systems administration make a single, hosted solution economically superior. It makes particular sense for OCLC. With a large percentage of world libraries’ data sitting in servers for copy-cataloging purposes, a locally branded and faceted web-app. catalog was the next logical step.

    The move casts new light on its Policy defenses. OCLC isn’t “curating” library records; it’s leveraging them to enter a new market. It wasn’t “protecting members’ investment,” it was investing members’ money, intended to support OCLC’s core mission, to build a new service. WorldCat isn’t a “switching mechanism” to local catalogs. It will replace them.

    I’d love to follow them. I’d love to make a large-scale hosted library catalog. I think LibraryThing could do a lot better. OCLC is full of smart people, but it develops slowly and has shown singular inability to produce social features that anyone would want to use. I think Talis, AquaBrowser, LibLime and Equinox could do better too. And I think, if library programmers got together, they could make truly open community-run service—something others, like LibraryThing, could provide plug-ins for.

    We’d all love to try, but we aren’t allowed. According to the Policy, you can’t build the sort of truly “web scale” database that would make such a project economically viable. Anything that replicates the “function, purpose and/or size” of WorldCat is not “Reasonable Use.” Any library participating in such a venture would lose its right to OCLC-derived records, something that would literally shutter most public and all academic libraries in the country. When it comes to large-scale online catalogs, there can be no competing with OCLC.

    Let me be clear: I have no problem with OCLC developing software. They do good work. I for one think WorldCat/WorldCat Local is a better product than most server-based OPACs.

    But, now more than ever, OCLC must end its attempts to restrict and monopolize library data. It was ugly and unfair for OCLC to claim ownership over what is largely public data. It is obscene to leverage that data monopoly into a software monopoly.

    Chess images from Flick users malias and furryscaly. Chess outside makes me think of the Deus’ song Slow. What is it with Europeans and outdoor chess sets anyway?

    Labels: oclc, worldcat, worldcat local

    posted by Tim @2:06 am 0 Comments »
  • Tweet about The OCLC End Game