Archive for the ‘1’ Category

Wednesday, August 29th, 2007

Some “Your library” changes

I’ve added two features to the Cover view in Your Library. You can resize your covers with handy plus and minus buttons. And you can sort your books within Cover view (before this you had to do it in List view).

The back story is that I’m rewriting* Your Library rather extensively, both because it needed to be done and to prepare the way for collections (which are finally going to happen!). Your library needs a good scrub before collections arrive. The changes are minor on the surface, but drastic underneath. If you see problems, let us know.**

*What programmers call “refactoring” for no good reason.
**Since there’s been some speculation, we wil NOT be releasing collections today—although it’s our second birthday—or, probably, this week.

Labels: 1

Monday, August 20th, 2007

Introducing Casey Durfee (and the new search)

We just hired Casey Durfee (LibraryThing: caseydurfee), a crackerjack “Library 2.0” hacker. Casey’s first project—faster, better search—debuts today (see below). It’s a big win. We have a long queue of similar projects. Casey will also be heading up LibraryThing for Libraries, our project to get our data into library catalogs.

Casey will be working from Seattle, where he was recently left a job at the Seattle Public Library, managing their library system. Before that Casey worked at SirsiDynix*, so he has a lot of background in the arcane world of library systems—just what we needed for LibraryThing for Libraries. Casey is also responsible for L2, a handy Greasemonkey plug-in that adds Amazon content to library catalogs.

Perhaps the coolest thing Casey has done is a project called Helios, a “faceted” search on the Library of Congress records, done very simply and entirely with open-source software. It was a personal project, and although it’s not a complete solution, it searches the LC better than the LC’s million-dollar catalog. You can see Casey in action, talking about Helios, in this Code4Lib talk on Google Video.

Search. Check out the new work and author searches. They’re based on Solr, a simple but powerful search engine, and the same one Casey used on the LC data. Until now, we were relying on MySQLs fulltext capabilities. We had outgrown it, and slow performance was causing frequent database glitches.

It’s fast, accurate and searches all titles, not just the “leading” (mostly English) ones. But, as with everything we do, it’s not “perfect.” Casey has set up a Talk post about it. He has a variety of knobs he can turn, and is looking for feedback. I’m convinced it’s overzealous on “stemming”—picking up “loves” and “lovely” for “love.” That it even does stemming is quite an improvement from our previous solution. Once we’ve got it working the way we like, we’ll also be adding it to touchstones and elsewhere on the site.

Other projects. Casey is a certified library programmer. (I just play one on TV.) He knows his MARC21 from his UNIMARC, and his “glyphs from his diacritics”.** As time goes by we hope he can work on things like:

  • Rewriting our library-data import, to get all the diacriticals right and squeeze more out of the MARC records.
  • Adding more libraries. We’ve been avoiding UNIMARC libraries (eg., Italy libraries) and, until recently, most SRU/SRW-based ones. We can do better. We have also finagled access to British Library data, so look for us to add that too.

LibraryThing for Libraries. Right now, we have more than 350 libraries asking us about LibraryThing for Libraries. Altay and I have been going through at a snail’s pace. Casey should be able to crank that up a bit. We also think his SirsiDynix experience will come in handy. He’s already written a handy LTFL export script for HIP. He’s well-known in the HIP ILS community, and should move us past our current success among Innovative Interfaces catalogs.

That’s it. Welcome on board, Casey!

*When it was Dynix.
**Whatever that means; suggested by Casey.

Labels: 1

Thursday, August 9th, 2007

Widgets in musth

For about three hours this afternoon some of our blog widgets went crazy, inserting very large covers where small ones were supposed to be. I was fixing a long-standing problem, in which some books never showed up in the widget.* In the course of fixing that problem I created another. Some users were amused, some dumbfounded and some pissed off. All good reations, I think.

Anyway, a few users emailed us, and Christopher stepped in to fix the problem. The widgets are okay now.

To the bloggers affected, my sincere apologies. I should have checked the code more before it went live. The change I made didn’t affect widgets of the type I have on the blog or one of the users with the problem I was fixing, so I missed it. It was a dumb mistake, and I wish I had caught it in ten minutes, not three hours.

By way of making it up, if you had one of these blogs and felt inconvenienced, please write me a note with your blog URL and your address, and I’ll ship you off a CueCat barode scanner. Please take me up on this. It’s the least we an do.


*Basically, LibraryThing had imperfect knowledge of what covers Amazon had available, so we weren’t showing everything we could.

Labels: 1

Tuesday, August 7th, 2007

Will the Dutch-ness ever stop?

We just inked a deal with AquaBrowser, an Amsterdam-based library catalog company. See the Thingology Post.

Labels: 1

Monday, August 6th, 2007

Hallo! (Getting serious about Dutch books)




I’ve added four book sources for Dutch readers: the Dutch Royal Library (KB), the Royal Library of Belgium (KBR) and booksellers Bol.com and Bruna.nl. With luck, they’ll be a few more soon.*

This should be big boost for our Dutch site, LibraryThing.nl. Until now, there was only one Dutch-language source, TU Delft**. Between the four new sources LibraryThing now embraces virtually all in-print Dutch books, 70,000 cover images and millions of older books.

I hope this will make LibraryThing a much more attrative place for Dutch readers to catalog their books and do the other things LibraryThing is about.

Adding Dutch books required extensive work. Giovanni, LibraryThing’s newest (fractional) employee, helped us track down Bol and Bruna data, our first non-Amazon retailer. On my side it involved dealing with five new formats. Fortunately, much of the work will contribute to adding other sources.

There were some wrinkles:

  • Bol and Bruna are a single search on combined data. Neither feed was intended for personal cataloging, and I found holes in both sets that the other could improve. Even so, the data is thin by LibraryThing standards, lacking publication years and other important fields.*** The covers are great.
  • The Bol/Bruna mash-up was an innovation. LibraryThing trusts that both retailers want to let their customers catalog the books they bought at their stores. But if either tells us to stop, we’ll politely give up our affiliate accounts and withdraw their data. In appreciation for their service to Dutch-language readers, we have put Bol/Bruna links on all LibraryThing.nl work pages, not considering which contributed the data.
  • KB was a tough addition, requiring us to parse two new formats, SRU and Dublin Core. Unfortunately, I have yet to figure out how to execute an ISBN search. The KB data is high quality, but slow to retrieve.
  • KBR required the least attractive sort of data parsing, so-called “screen scraping.” Only titles can be searched, and the result list is very basic. But, when a book is selected, the data is good, and retrieval is fast.

We have also been reaching out to other prominent Dutch-language book sites looking to forge relationships and pick up or link to interesting content. Your suggestions would be most welcome.

Lastly, as those who follow it know, LibraryThing.nl has seen some controversy. A lot of excellent work has gone into the translation, which is farther along than any other. But there have also been uncollegial disagreements. In response I have urged members to respect the collective nature of the endeavor and instituted a Three-Times Rule, similar to Wikipedia’s Three Revert Rule. Except in very special circumstances, members may not translate a given phrase the same way more than three times.

Thanks to all. Comments, questions and criticisms wanted—as always.


*We are waiting for approval to add Proxis.be and implementation and/or approval from a number of other libraries in the Netherlands and Belgium.
**For much of LibraryThing’s existence we were also tying into the Catholic University of Leuven, but their Z39.50 server eventually went black.
***We had hoped to further supplement them with KR or KBR data, but we lack a working ISBN search for both.

Labels: 1

Sunday, August 5th, 2007

Welcome Giovanni!

Everyone say hello to LibraryThing’s newest employee, Giovanni Soltoggio—LibraryThing member Gio. Giovanni will be helping us expand outside the United States, tracking down data sources, talking about LibraryThing to Europeans, making important deals over small cups of coffee and so forth.

Giovanni hails from the Italian Alps—a valley called Valtellina—and now lives in Dusseldorf. He reads Italian, German and English. He speaks some Czech. His favorite authors are Haruki Murakami, Niccolò Ammaniti and Lorenzo Licalzi. He is sharp as a tack, but much nicer.

Strictly speaking, Giovanni is only 20% ours. Four days out of five he’s the European Managing Director for BookFinder.com and its European sites JustBooks.co.uk, JustBooks.fr and JustBooks.de (for which he writes the blog). He helped BookFinder make the jump to Europe. We’re very grateful to Bookfinder’s Charlie and Anirvan for letting him moonlight a little.

In a few hours I’m going to blog one of Giovanni’s first projects, finding us a decent store of Dutch bibliographic data and covers. He is working on an Italian one right now. We expect big things from him.

If you want to wish him well, or know of good stores in other languages, he’d love to hear from you.* Drop a message on his profile, or email him at giovannilibrarything.com.


*Finding good data is strangely hard. There are some commercial providers although they largely overlap with what Amazon provides for free. Smaller languages are hard. A few weeks ago we had an Armenian-reader up for a week of Facebook work. I spent much of the last day with him, trying to get hold of a source—any source—of Armenian book data. We would have been happy to link to one bookseller on every page. From a search engine perspective alone, our links are gold to small sites. No luck, alas.

Labels: 1

Thursday, July 26th, 2007

LibraryThing pizza bash Saturday in Cambridge

So, it looks like Saturday is going to involve lightning, so the barbeque has morphed into a pizza party.

But we’re not getting just ordinary pizza! We’ll be ordering from Emma’s Pizza in Cambridge, MA, which is some seriously gourmet stuff (menu).* And we’ll have plenty of chips and hummus too.**

Everyone is invited. Bring a friend. If you can RSVP, great. If not, that’s fine. We’re probably going to need to order the pizza beforehand. We’re going to double the RSVP list. If you like, you can bring something .

When: Saturday, July 28th, 4pm to whenever.

Where: 15 Gurney Street, Cambridge MA (Google map). It’s about 15 minutes walking from the Square. You can also take the 72 (Huron) bus, and ask for the Fayerweather stop.

Parking: The City of Cambridge has declared Saturday LibraryThing day***. You can park anywhere on Gurney Street and between Gurney and Huron on Fayerweather.

Can’t wait to see everyone!


*When Emma’s was at the foot of Gurney Street, when I was young, it was decidedly less upscale. There were no tables—just a counter nobody used—and the ambiance was comprised of Emma berating her meek husband Greg in angry, staccato Armenian all day long. When the current owners bought it they moved it to Kendall Square, avoided marital conflict, added tables and the goat cheese, sun dried tomatoes and artichoke hearts today’s Cambridge requires. Somehow they managed to preserve what was good about it. It’s an amazing pizza.
**Alas, Tim’s trademark sigara börek will not fit with the rest of the meal.
***Untrue.

Labels: 1

Saturday, June 23rd, 2007

ALA 2007: Tim and Abby’s Excellent Adventure

If you’re in Washington, DC going to the American Library Association conference, Abby and I hope to see you around. We don’t have a booth, but I’m on panels today and tomorrow:

*BIGWIG Social Software Showcase, 1:30-2:30 Saturday
*RUSA MARS: Harnessing the Hive: Social Networks in Libraries (10:30-12:00 Sunday), with Meredith Farkas and Matthew Bejune

And Abby and I are wandering the hall in our LibraryThing t-shirts (Tim: black; Abby: yellow), meeting people, crashing happy hours, etc.

PS: Come to “Participatory Networks: Libraries as Conversation” 10:30-12:00 (WCC Room 143B) today (Saturday). It’s almost blank in the program, but it’s a top and extremely interesting guy at Second Life—memo to self: put cards in wallet, not pants pocket.

UPDATE: I posted my “Hive” introduction on Thingology.

Labels: 1

Sunday, June 17th, 2007

Fifteen million books!

Going down, like the Titanic.

LibraryThing has hit fifteen million books.

Number 15,000,000 was a 1963 edition of The Greek Way by Edith Hamilton, added by dukedom_enough at 8:57am on June 15. For his luck, Dukedom earns a free gift membership.

Now begins the countdown to a major milestone: becoming the second largest “library” in the US, and with or soon after that, the second largest in the world, gulp.

LibraryThing is not of course a “real” library. You can’t take the books out, they do a lot more with them, and we have a lot more duplicates. We have only about 2.5 million distinct “titles.” But the comparison gives a sense of relative scale to the enterprise.*

Anyway, the tally is now as follows**:

  1. Library of Congress — 30,011,748
  2. Harvard University — 15,555,533
  3. Boston Public Library — 15,458,022
  4. LibraryThing — 15,081,543
  5. Yale University — 12,025,695

With luck, we’ll settle in behind the Library of Congress in 10-15 days. At 30 million, they’re going to take a while to beat.

When will we hit second in the world? Unfortunately, I can’t find a good list of world libraries by volumes. Everyone concedes that the Library of Congress is the largest library. The rest is foggy. Wikipedia has the British Library at 150 million items, and 22 million volumes. The Bibliothèque nationale and the Berlin State Library are at ten million volumes. (The German National Library is said to have 22 million items, but items aren’t volumes.) The stubby entry for the National Library of China speaks of it as:

“… the largest library of Asia and with a collection of over 22 million volumes (including individually counted periodicals, without these around 10 million), it is the fifth largest in the world.”

Which raises the question, does the ALA Factsheet also count periodical volumes separately?

Tim is dead. (Credit)

Surpassing the BPL in any way feels blasphemous; I love the place so much that comparing LibraryThing to the BPL—well, the lions should eat me for thinking it. But Harvard will be sweet. I lived most of my life in Cambridge, MA, but the bastards rejected me twice—undergrad and grad! So, in that spirit, and with Yalies protecting my back, let’s beat that little pile of books over at Widener.


*There are all sorts of problems with these numbers. In fact, libraries don’t really know how many books they have. LibraryThing has a small percentage of items that aren’t books, and a larger number that are “wished for” other otherwise ephemeral. At the same time, many of LibraryThing’s “books” are composed of multiple volumes. So, we’re in the neighborhood of 15 million anyway.

LibraryThing demonstrates something we always knew—that regular people have a lot of books—probably many times what all the world’s libraries hold. I’ve never seen the relative numbers discussed. It never mattered before, but now that regular people can put their catalogs online and engage in tasks, like tagging and work disambiguation, that bear on age-old issues of library science, it’s not entirely pointless to compare the two.

I want to underscore that, in making the comparison, we mean no disrespect to libraries. I think I’ve got some proof that LibraryThing has always been on libraries’ side. Our first hire, Abby, was a librarian. We have always favored library data, where our many recent competitors only care about Amazon’s data. We link to libraries extensively, something no competitor does. And we are grateful that our work has been of interest to the library world—Abby and I have become minor fixtures on the library speaking circuit.***

**Source: ALA Factsheet: The Nation’s Largest Libraries.

***My Library of Congress talk will be online soon, as will my recent keynote at the Innovative Users Group meeting in Sligo, Ireland.

Labels: 1

Friday, June 15th, 2007

Web 2.0 Award Winner

We won SEOmoz’s Web 2.0 Awards, in the Books category.

2007 Web 2.0 Awards Winner

Not to bite the hand that feeds us, but giving Reader2 honorable mention is very strange. Don’t get me wrong, Reader2 was a worthy opponent. Dmitry and I started the same week, almost two years ago. But Reader2 didn’t get that far, and it hasn’t been actively developed in at least a year. Since then more than two dozen sites have entered the market, many better than Reader2. Odd choice.

Labels: 1

Wednesday, June 13th, 2007

A new post to hang comments on

We’ve hit 259 comments on the last post. That’s a lot of words. I’m making a new one here to clear the baffles.

Labels: 1

Monday, June 11th, 2007

Site back, sorry for the outage.

Update: Clearly, we’re down again. John’s working on figuring out why the problem reappeared and how to fix it. Watch for updates on the home page (Abby)

The site is back up, after having being down for a day and a night. An errant script knocked down the “read” database, and when the box crashed, some of the db files were corrupted. This meant the whole db had to be restored from the master db. In addition to the db itself, some of the log files were also affected. Turns our MySQL is a lot more finicky about how log files are handled than I’d ever known, or hoped to know. After a lot of digging around, everything is back the way it belongs, and all that was lost is a night of sleep–no data was lost.

I’d like to apologize profusely to everyone who was inconvenienced. We’ll put more safeguards into place to try to minimize such outages in the future, hopefully.

Labels: 1

Monday, June 11th, 2007

Downtime

We’re really sorry about the downtime, folks. We’re working hard to get the site back up and running, but it’s taking longer than we’d like. We’ll keep you updated as soon as we know more.

In the meantime, here’s something to do while you wait! I want a new and entertaining bookpile to go on the down page. The rules of this impromptu bookpile contest:

1. Post your pictures to Flickr
2. Tag them “LTdown” (feel free to post the link to your photo in the blog comments here if it doesn’t show up right away)
3. Wait for us to pick a winner.

Update 5:11 pm Eastern: We lost the main “read slave.” No data was lost. (We have five copies at all times.) But are missing a critical machine, and have to rebuild it. John is working to rebuild the machine. I suspect it will not be up tonight.
More updates on the homepage

Labels: 1

Wednesday, June 6th, 2007

TagsAhoy!

LibraryThing’s John McGrath has debuted a new site, TagsAhoy, with a wonderfully simple idea: searcing your tags across multiple sites.

Cross-site tag searching is nothing new; sites like Technorati do it all the time. But TagsAhoy searches your tags, not someone else’s. If you tag a lot, it will come in handy. And you’ll wonder why nobody thought of it before.

So far, TagsAhoy searches LibraryThing, Del.icio.us, Flickr, Gmail, Squirl and Connotea. More will come, and John has promised tag clouds and other cool features. Pattered somewhat on the spare design of another of his sites, Wordie (“LibraryThing for words,” “Flickr without pictures,” etc.) TagsAhoy is super-simple to use.

We at least applaud the name. It’s clunky in the way “LibraryThing” is clunky. Or was. Now all the “-Thing” names are bought up and my sub-Lovecraftian joke is almost trendy. We confidently predict “-Ahoy” will be the next “-Thing”*, or even “-cio.us”, “-r,” “-ster” and “-Space.”**

John recently moved to New Jersey and will be transitioning gradually off LibraryThing work over the next few months, as we look for a new PHP programmer with systems skills (job announcement to be posted soon). With TagsAhoy and whatever else his fertile mind creates, Abby, Altay and I wish him well.

*Research suggests PornAhoy.com is an expired domain. It sounds like a site for people who enjoy watching naked people on boats very very far away. There’s a market for everything.
**John suggests a site of just Web 2.0 suffixes, ThingAhoySter.

Labels: 1

Friday, May 25th, 2007

See all a work’s tags

LibraryThing members have added well over 18 million tags. Of course, they aren’t equally distributed. Popular books now sport thousands or even tens of thousands of tags. Work pages have a small tag cloud for each book, but it only shows the most popular thirty or so.

So I added a link to show all tags for a work. It shows the whole “long tail.” It’s very long indeed. It’s stunning.

Here’s Freakonomics with the standard tag cloud:

Click “show all tags” and you get around five pages of tags. Here’s a piece of that:

If you want to see the actual numbers, you can click the “show numbers” link.

Labels: 1

Monday, May 14th, 2007

LibraryThing for Libraries in Danbury

“You got your chocolate in my peanut butter!”

Over in Thingology I’ve announced the first library to use LibraryThing for Libraries—The Danbury Library in Danbury Connecticut. Works, recommendations, tags—they’ve got it all.

I’ve said I wouldn’t do as much cross-posting, now that we have a combined blog feed (see over on the right). But I thought I’d mention it here, and explain a bit about what it means for LibraryThing.

First, as members of LibraryThing, you should feel proud that your data—anonymous and aggregate, as the Terms of Use say—is helping library patrons to find books. Your passions—the books on your shelves—beat statistical “paths” through books that others can follow. Your tags–the way you think about your stuff–will help people find subjects not covered by traditional subject classification.

For those concerned about development time, I want to emphasize that LibraryThing for Libraries is good for LibraryThing. On the most basic level, it’s going to help our bottom line. That means more programmers making features and fixing bugs. Conceivably, it could mean cheaper accounts.

It also deepens our relationship with libraries, and returns a favor. LibraryThing was built on library data, and we’ve been graciously invited into the library conversation. We are charging for LibraryThing for Libraries, but our prices are in an entirely different league from what libraries are accustomed to pay for their online catalog software. And as these catalogs add “social” features, LibraryThing for Libraries will exert powerful downward pressure on prices. Ultimately, the industry needs a newcomer to take a huge slice of a smaller market. We’re not going to be that company, but we can push the trend along.

LibraryThing for Libraries has also taught us a lot about library catalogs. These are some thorny, mysterious systems! Until now, we’ve relied exclusively on the simplicity of Z39.50 connections, which most libraries don’t have. But we can do more. With out new-found experience, we can start connecting to the remaining 95%. If nothing else, this should help our language reach.

Labels: 1

Wednesday, May 9th, 2007

A very short introduction

At long last, the often requested quickstart guide—A very short introduction to LibraryThing.

It’s intended as a quick overview of LibraryThing’s features, to help new members get started, all the way from signing up to creating a blog widget. It’s hard to come up with the balance of enough information to help without overwhelming, so I’m looking for your feedback. What should be added, changed, deleted, clarified…?

Discussion in this talk post.

Labels: 1

Monday, May 7th, 2007

Going to Book Expo America in New York

Book Expo America, ABA’s annual book industry trade convention is in New York City this year, and I (Abby) am going to be there. I’ll be speaking on Thursday, May 31st (from 1-2pm—mark your calendars!) on a panel called “Using Social Networking to Build Author Brands.”

We just found out that the our competitor, Shelfari, is also going to be at BEA this year, and is apparently using some of their Amazon funding to co-sponsor an event. Hey! Well, not only does LibraryThing appear to have sixty-five times as many book lovers as them, but we think we have a lot more to offer authors, booksellers and publishers and we’re going to prove it.*

Authors. It was at last year’s BEA that we launched the LT Author program. After Tim and I spent a day walking around trying to describe LT in a nutshell**, we realized we had been telling people, “it’s like MySpace, but for booklovers.” Well, MySpace is all about bands and musicians promoting their music. Wouldn’t LibraryThing be a good place for authors to do the same? What better place to promote your new book than a website full of avid bibliophiles?

And so was born the LT Author button, a shiny yellow badge that connects an author’s “author page” with their profile page. So far LibraryThing has snagged 395 authors. (See the complete list.)

Best of all, they’re not just authors who clicked a box. To be part of the program, you have to have a LibraryThing account and put in at least 50 books. What is your favorite author reading? Find out.

Neil Gaiman’s author photo. Members have added over 15,000 pictures and photos of authors (see recently added ones), with alibrarian and leebot leading the pack. They deserve some kudos—it’s actually a pretty intensive process, often involving writing authors, publishers, or photographers for permission, so the sheer number of photos is all the more impressive. Plus, it makes for a nice gallery. 🙂

LibraryThing members have also added over 92,000 links to author pages—links to author home pages, blogs, publisher pages, Wikipedia pages, interviews, articles, fan sites. That’s a lot of links.

Booksellers. We’d love to add more bookstores to our “bookstores that integrate“—adding availability and pricing information on every work page. We’ve got only three so far, but we’ll be adding two major “chunks” of them in the next few months—to at least 100 total. It’s a great way for people to be able to see at a glance if a book is at their local bookstore.

Publishers. So far, we’re not doing anything for publishers! But there’s a big announcement coming soon. Be on the edge of your seats!

So what can we do to make LibraryThing big at BEA this year?

Our big idea so far is a par-tay. Of course, anyone and everyone can find some time to talk to me during BEA, but I’d like to have a big meet-up. Authors, publishers, booksellers, and hey—readers. Anyone in NYC who’s around is invited, not just the book-industry professions allowed to go to BEA (they have to restrict it, because there’s so much free merchandise on offer.)

I made a BEA 2007 group, post there with ideas of where we should meet (I’m thinking maybe a restaurant near the convention center?). New Yorkers, I call on you for suggestions!

We’re also thinking about bring a bunch of CueCats, and giving them out to authors, to entice them into becoming LT Authors… What else?

*[Written by Tim] Shelfari doesn’t release any statistics. But they do release the top 20 bookshelves. The 20th bookshelf on Shelfari has 1,360 books. LibraryThing has 1,378 members with that many. Hence 20/1,378 = 68.9 times as large. You will note that we do not abuse our other competitors–just Shelfari. Some of them are quite good! There’s a good thread going about them. We want people to check them out, and come back to tell us how to improve LibraryThing!
**”This is me in a nutshell: HELP! I’m in a nutshell!”

(photo by Rick Dikeman on Wikipedia, under GNU Free Documentation License)

Labels: 1

Monday, May 7th, 2007

Subjects get faster; the rest will follow

Everything on the web is better if it’s faster. Slow pages are a silent killer.

So we’re working to speed thing up. We’ve long done “situational” caching. But our growth is relentless—we’ll hit 200,000 registered members today—and we’ve had no good, generalized solution. We’ve recently been working on two solutions, for database and page-level caching. Together they should speed up certain cacheable pages, like works, authors and tags. The more resources we can free, the faster the uncacheable pages, like Talk, will become as well.

So far, only subject pages are being cached, eg.,

Subject pages were a big problem. The worst took a minute to load. When Google’s “spider” program went at them, with one request/second, the servers would sweat. Subject pages are now cached whenever someone hits a page, and stays so for at least week.

Subjects are a test. There are some kinks to work out. (For example, changing the non-English translations doesn’t immediately clear all affected pages.) Once we get where we want, we’ll roll it out page-caching wherever we can use it. Query caching will follow.

Labels: 1

Thursday, May 3rd, 2007

Combined blog feed available

I used Yahoo Pipes to make a combined feed for this blog and our Thingology blog. It was easy to do, and the result is pretty useful. The three feeds are as follows:

I also edited the employee list on the right, to add Altay. He is the magic behind the LibraryThing for Libraries Javascript, but almost nobody’s seen that yet, so we’re waiting for his first user feature to give him a proper introduction.

Labels: 1

Wednesday, May 2nd, 2007

Many more Wikipedia citations

You’ll notice many more Wikipedia links from work pages. The total has increased by about 200%, and the coverage by at least that.

This improves what I did in February. That worked by looking for ISBN patterns. Of course, not all books cited in Wikipedia have ISBNs. And even when there is one, many Wikipedia contributors omit it. (As far as I’m concerned, ISBNs look chintzy in a bibliography anyway.)

I’ve redone it, this time also looking for telltale title/author patterns, and running the matches against LibraryThing’s vast and usefully messy dataset. The logic is somewhat fuzzy and therefore imperfect. But I haven’t noticed any problems.

The number of citations expanded a lot.* Some entries exploded. Take Thomas Kuhn’s The Structure of Scientific Revolutions:

Notably, it caught casual references to books, not just structured ones. For example, the article on Science wars mentions Kuhn’s work in running prose, not in the bibliography or footnotes.

I haven’t updated our free Wikipedia citation feed. That maps articles to ISBNs, but the new data is work-based. If anyone wants to use the new data, let me know and I’ll tackle the problem. Cool as I think it would be, I haven’t seen any libraries adding Wikipedia links to their catalogs yet.

*The fact that its a new feed, and the somewhat fluid interactions between ISBN-based and work-based matching make it tricky to estimate, but it looks like a 200% increase.

Labels: 1

Friday, April 27th, 2007

Metacritic links added

I knocked out a quick feature connecting LibraryThing works pages to their corresponding page on Metacritic. Metacritic is like RottenTomatoes, giving brief excerpts from press reviews and boiling them down into a single number (the “Metascore”). Unlike RottenTamatoes, Metacritic covers more than movies. Here’s an example from Sam Harris’ The End of Faith.

Metacritic’s books coverage does not seem as strong as some other categories (560 ISBNs total), but I think it’s useful and interesting. Perhaps some day LibraryThing will collect review snippets itself, but for now Metacritic should be a useful link.

Metacritic was informed of what we were planning, but no money changed hands. Hey, who can turn down a free link?

Labels: 1

Saturday, April 21st, 2007

Tanned, rested and ready

I’m flying back from four talks in four days—Computers in Libraries (twice), the Library of Congress, and Digital Odyssey in Toronto.

The Library of Congress talk was videoed, and will be public in a couple weeks.* It was great fun to do. (Who could pass up the chance to discuss the tag vampire smut with some of the world’s top catalogers?) And as a long-time user and admirer of the Library of Congress, it was quite an honor. I pushed them hard on openning up their data, and the shortcomings of the LC subject system, but they were good natured about it. And my anti-OCLC feelings drew no fire. As one of them put it, only half-kidding, “They wouldn’t be anything without us.”**


Derik A. Badman’s cartoon of Roy Tennant (left) and me (right) giving talks. Actually, Roy’s example was about murdered midget gypsy prostitutes. Well that’s three conferences he won’t be invited to!

At CIL I got a lot of opportunity to show off LibraryThing for Libraries, our new push to put LibraryThing data into library catalogs. Response was positive, even fevered.*** Demos went well, showing book recommendations and tags in a large public library. (“Chick lit” and “cyberpunk” are great examples, but I have to size people up quickly to know which one to use.) There was a certain amount of disbelief about its coolest feature–no back-end integration and working with any system. But anti-system-vendor sentiment is so high that this was welcomed. The first round of libraries should be at least a dozen strong, with both academics and small and large publics.

The highlight of all three conferences was the chance to puts faces to names, often names of blogs. My Google Reader feed is suddenly full of people I know! (But if I start listing I’ll surely forget someone…) I had a couple good meals, one good argument, a great lunch conversation at the LC and, as a coda, a stroll around Toronto.

(later) I’m off the plane now and in D.C., staying with friends for a few days. There’s a lot left to do for LibraryThing for Libraries, but the big initial push is over, and we can throw time back into building new features for LibraryThing. A number of them will revolve around JavaScript. Altay, our new JS guru, will be rolling out some serious magic.

*Among other things they need to synch it up with the “slides.” But I do my talks live, driving around at breakneck speed. The staffer assigned to coordinate the synch looked positively frightened.
**I owe a blog post revising my post about OCLC and MIT. Apparently OCLC didn’t stop them, but MIT legal.
***I came back from one talk to find the booth table littered with business cards. I felt like an NBA star at a nightclub.

Conference coverage:

Labels: 1

Tuesday, April 17th, 2007

5¢/patron, $1/student

From now on if a public library or a college or university wants to buy memberships for everyone in a community, it’s 5¢/patron, $1/student.

(see Thingology)

Labels: 1

Thursday, April 12th, 2007

Drop Everything and Read

No really! One of my favorite bookstores* reminded me that today is “Drop Everything and Read Day”. Sponsored by Ramona Quimby, of course, and celebrated on Beverly Cleary’s birthday. So go to it!

*Harvard Bookstore. They rock.

Labels: 1

Monday, April 9th, 2007

Sneak peek: LibraryThing for Libraries

Over on Thingology I give a sneak peek of the upcoming LibraryThing for Libraries feature—putting LibraryThing in library catalogs.

Labels: 1

Friday, April 6th, 2007

Business 2.0 does the LibraryThing

Business 2.0 finally posted its article about LibraryThing “Beating Oprah at the book club game.” Excellent article. (Terrible photo.)

Labels: 1

Sunday, April 1st, 2007

A new name, a new LibraryThing

Today’s farewell announcement by Library Stuff blogger Steve Cohen is sad news to many. But not to us at LibraryThing. Finally, the name we always wanted has come free!

After a quick round of emails I can announce that Steve has agreed to a complete buyout. LibraryThing has been renamed LibraryStuff.

With the move to LibraryStuff, LibraryThing increases its VMF or “Vague and Miscellaneous Factor,” important in appealing to its target audience—jaded catalogers and information architects sick to death of the cut-and-dried certainties and voodoo-ontology of the Dewey Decimal System and of Library of Congress Subject Headings. LibraryThing held out hope some sort of definite or even “real” Thing, a “false move” which left the Lib2.0 cognoscenti shaking their heads about how the Man was telling them what to think. LibraryStuff promises no such certainties, just stuff. Don’t want the stuff? Fine, we’ll keep it.

The historic buyout brings Steve Cohen on board as legal librarian, book reviewer and resident namer. The terms of Steve’s buyout were not disclosed, but let’s just say Ari and Hallie are set.

First on Steve’s renaming list is our upcoming “Library Services” feature. We were planning to keep the generic “LibraryThing Library Services” name, but adding the tag line Make your OPAC Sing… with LibraryThing! but now that Steve is on board we can expect a major rethink—”Stuff for Libraries from LibraryThing,” etc. We also understand the name “Horizon” has also come free.

The decision to join up with LibraryThing finally puts to rest Steve’s lingering “payola” scandal. Back in August 2005, Steve unwisely accepted a free membership to the one-day-old LibraryThing. Since then, he has been forced to issue disclaimers every time he mentions the site. The scandal boiled over when it was revealed that LibraryThing allowed Steve to enter a family video into our Hanukkah Book Pile contest although the video included no books at all! Subsequent revelations that Steve has also acquired free accounts to Shelfari, Gurulib, Anobii and Amazon have only fueled the outrage. At this point, all he could do was cash in.

Update: Major developments also coming in from OCLC, Google, TechCrunch. Yes, the new logo is in Cooper Black.

Labels: 1

Monday, March 26th, 2007

LibraryThing on Second Life, a start

Yesterday’s hastily-announced Second Life LibraryThing social was a big success. Our friends at Bookmooch graciously allowed us piggyback on their weekly event, and, not surprisingly, membership overlapped a lot.

Many of the LibraryThing members were experiencing Second Life for the first time and arrived late and a little bewildered. (One also arrived naked, having taken off her clothes by mistake and finding it impossible to put them back on again.) We chatted about books and Second Life, and played with and admired the area. I gave out free LibraryThing t-shirts and made people “head boxes,” which float above your head showcasing one of your favorite books. (It’s basically a Second Life LibraryThing book widget—one we hope to make dynamic soon.)

The event ended by a number of members jumping to Info Island, the main library area on Second Life. After getting caught building things without permission, we ran into Lorelei Junot, the administrator there, who gave us a small but very central spot to build on.

Now, what do we do there? John, Abby and I have a lot on our plate right now, so we’re calling on members to help plan and develop our Second Life presence. I think the center of it should be widgets of some sort, not beautiful empty building. (Info Island is so built up that Lorelei was only able to allocate some 91 “prims” to build with, a very small number, but as Jason Fried says, “embrace constraints.”)

Come join the new Second Life group to let us know.

Pictures from the day:


Sitting at the picnic table together, wearing LibraryThing and Bookmooch t-shirts. Justin and I have head boxes. Bucky Tone (the Bookmooch founder John Buckman) faces the camera and hoists a champagne glass.


Shiva999 shows off her new bunny avatar, which does a very funny dance.


Two hours in it’s mostly LibraryThing people, dressed and undressed. Here we are gathering for a group picture.


Lorelei shows us the new LibraryThing plot.


Justin and I drinking next to the “coming-soon” obelisk.

Labels: 1

Friday, March 23rd, 2007

Mea culpa

… mea maxima culpa for the down time today. We had an idiotic technical glitch. The main “read” server got too full (350GB only seems infinite). Freeing up space was no problem; 80% were old log files. But we inadvertently changed permissions on a file which caused errors that “looked” like database corruption. Anyway, we learned our lesson, or at least a lesson.

All data is and was safe. Even if we lost that one, we have four more. And nightly backups.*

Thank you for your patience and support. John and I are going to go cry now.

*The topic of backups is high in my mind these days. My MacBook Pro’s hard drive died Wedndesday. I was amazed how little I lost. Five years ago, a hard drive crash would have sent me to the sanitarium. But LibraryThing is almost entirely online. I lost a few layered Photoshop files, and my Pando Calendar–which will be a HUGE pain to reconstruct. But all the programming is online, as are my emails, the Wiki we use for business documents, etc. That leaves some music—which I will feel no moral qualms at all about copying from the first person I meet who has it—and a season of Battlestar Galactica I wasn’t much interested in seeing again.

Labels: 1