Letsgetdugg

Ted Dziuba beautifully articulated why deadlines go to crap and seemingly straight forward tasks go out the window. You sir have done a public service for us all, thank you. What I hate is fording endless rivers of horseshit that are in the way of seemingly simple tasks. And I hate it even more when […]

Since Varnish did not work out on Solaris yet again. I have decided to bite the bullet and write a headers normalization patch for Squid 2.7. This patch should produce much better cache hit rates with Squid. Efficiency++ What the patch does: 1. Removes Cache-Control request headers, don’t let clients by-pass cache if it is […]

Clearing stale cache by domain You can clear a site’s cache by domain, this is really nifty if you have Varnish in front of multiple sites. You can log into Varnish’s administration console via telnet and execute the following purge command to wipe out the undesired cache. purge req.http.host ~ letsgetdugg.com Monitor Response codes Worried […]

Update 2010-02-19: Seems other people are also affected by the Varnish LINGER crash on OpenSolaris. This does not address the core problem but removes the “fail fast” behavior with no negative side effects. r4576 has been running reliably with the fix below. In varnishd/bin/cache_acceptor.c if (need_linger) setsockopt(sp->fd, SOL_SOCKET, SO_LINGER, &linger, sizeof linger); Remove TCP_assert line […]

Squid is a fundamental part of our infrastructure at Fabulously40. It helps us lower response times quite considerably. The problem with Squid is that it is quite “dense” when it comes to configuration flexibility. Unless your willing to do a bit of C hacking on it, it does not have much configuration flexibility. This can […]

Once again I have been blind sided by yet another conservative out-of-the-box setting. IPFilter is tuned way too conservative with it’s state table size. Here is how you can tell if your hitting any issues, run ipfstat and check for lost packets. victori@opensolaris:~# ipfstat | grep lost fragment state(in): kept 0 lost 0 not fragmented […]

Update: The following information could be beneficial to some, however my issues actually were with Caviar black drives shipping with TLER disabled. You need to pay Western Digital a premium for their “RAID” drives with TLER enabled. So for anyone reading this, avoid consumer Western Digital drives if you plan on using them for RAID. […]

Recently a primary boot disk went bad on our server and I got blind sided by a non-bootable secondary mirror disk. All the data was intact but I could not boot it. This required a slow re-installation and migration process that took a very long time. • EFI partitioned drives are not ZFS bootable. • […]

I am in the process of evaluating which option to choose for a new production deployment of a Sinatra application. Pros and Cons of the implementations: JRuby Stack: Pros: • Fast for serial execution once warmed up. • Multi-threaded, easy to scale with spiked traffic / shared resources. Cons: • Slow warm up time, app […]

One of our articles on fabulously40 went viral on the tagged.com which is one of the largest social networks in the alexa top 100. The viral aspect was quite apparent when the bandwidth sky rocketed to 30Mb/sec of sustained traffic. We were pushing over 60gigs of image data per day! We broke our bandwidth quota […]