Monday, May 7th, 2007

Subjects get faster; the rest will follow

Everything on the web is better if it’s faster. Slow pages are a silent killer.

So we’re working to speed thing up. We’ve long done “situational” caching. But our growth is relentless—we’ll hit 200,000 registered members today—and we’ve had no good, generalized solution. We’ve recently been working on two solutions, for database and page-level caching. Together they should speed up certain cacheable pages, like works, authors and tags. The more resources we can free, the faster the uncacheable pages, like Talk, will become as well.

So far, only subject pages are being cached, eg.,

Subject pages were a big problem. The worst took a minute to load. When Google’s “spider” program went at them, with one request/second, the servers would sweat. Subject pages are now cached whenever someone hits a page, and stays so for at least week.

Subjects are a test. There are some kinks to work out. (For example, changing the non-English translations doesn’t immediately clear all affected pages.) Once we get where we want, we’ll roll it out page-caching wherever we can use it. Query caching will follow.

Labels: 1

0 Comments:

Leave a Reply