Building a Web-Scale Search Engine with Perl
By Greg Lindahl (wumpus) from SVperl.pm
Date: Wednesday, 5 June 2013 13:30
Duration: 45 minutes
Target audience: Intermediate
Language: English
Tags: continuous deployment nosql petabytes ssd testing xs
Over the past 5 years we've built a web-scale search engine on top of Perl and XS, with 1,500 servers, 20 petabytes of disk and 1/2 petabyte of ssd, a 4 billion webpage crawl and index, and daily code deployments. Along the way we wrote a NoSQL database and a lot of XS, used over 600 CPAN distros, upgraded from 5.8.8 to 5.16, and had a lot of fun. Come hear about the mistakes we made, and the lessons we learned.
Slides and further reading: bit.ly/yapcna_blekko_2013
- Zakariyya Mughal (sivoais)
- John Anderson (genehack)
- Turd Furgison (fartfart)
- Bryan Rivera
- Kartik Thakore (kthakore)
- Mateu Hunter (mateu)
- Will Willis
- Kevin Shaum
- Greg Lindahl (wumpus)
- Adam Dutko (StylusEater)
- Denise Paolucci (rahaeli)
- Gerda Shank (gshank)
- Henry Van Styn (vanstyn)
- Gabor Szabo (szabgab)
- Ovidiu Barbu
- Bradley Andersen (elohmrow)
- Athena Yao
- Mike Fragassi (frag)
- Gary Denslow
- Niall Durham (dbcooper)
- Daniel Norman (abnorman)
- Steve Nolte (mcsnolte)
- JT Smith
- parv
- Tim Mullin (Tim)
- Casey West (cwest)
- Stan Schwertly (stan_theman)
- Lee Carmichael (lecar_red)
- Stephen McManus
- Michael McClennen
- Jasper Staab
- Andrew Dougherty (aindilis)
- vroom
- Sean Quinlan (spq_easy)
- Logan Bell (epochbell)
- David Blumenthal
- Ted Lanman
- Nicholas Jackson
- Kenneth Smith
- Georgy Vladimirov
- Nick Melnick (oZ)
- Chuck Hardin
- Matt Nash (mnb)
- renato cron
- Rich Harkins
- Rusty Bourland (saki)
- Christopher Eades (Chro)
- Dan Muey
- Anne Sipes