Building a Web-Scale Search Engine with Perl

By Greg Lindahl (‎wumpus‎) from
Date: Wednesday, 5 June 2013 13:30
Duration: 45 minutes
Target audience: Intermediate
Language: English
Tags: continuous deployment nosql petabytes ssd testing xs

Over the past 5 years we've built a web-scale search engine on top of Perl and XS, with 1,500 servers, 20 petabytes of disk and 1/2 petabyte of ssd, a 4 billion webpage crawl and index, and daily code deployments. Along the way we wrote a NoSQL database and a lot of XS, used over 600 CPAN distros, upgraded from 5.8.8 to 5.16, and had a lot of fun. Come hear about the mistakes we made, and the lessons we learned.

Slides and further reading:

Attended by: