Thursday, December 14, 2006
Senator Tim Johnson Conspiracy Theories
Just seems to me that we should check him for any Polonium that George W. Putin, or one of his minions, left lying around.
Wednesday, December 06, 2006
Employment opportunities redux
Anyway, if you *were* working, and there was anyone that you'd want to have on your team again, let me know who they are. They're not necessarily even traditional QA people. Anyone who is smart, curious and diligent, and who understands how computers work qualifies.
I'm trying to build a different brand of QA. It's the java engineers who are ultimately responsible for the correctness, completeness and scalability of their product -- you can't test in any of those attributes. All QA can do is assess whether those attributes exist and advise the developers on any significant lack.
I'm not looking for someone who knows silktest or loadrunner or even jUnit inside and out. I want someone who can understand the fact that our business is driven by three things: 1. customers can sign up, 2. customers can add movies to their queue, 3. customers get discs shipped to them
Everything else is just syntactic sugar that dresses up our core semantics.
So, as I've mentioned before, I'm looking for a couple of people who are interested in addressing the issue of software quality at Netflix, and I'm NOT looking for a browser-poker or someone who dreams up test cases for an offshore outfit to throw warm bodies at.
If you want to help us run with scissors, apply
Tuesday, December 05, 2006
Free Blockbuster Rentals for Netflix Customers
Thursday, November 30, 2006
Employment opportunities
However, the secret sauce to the business is that we're really a software company. We're solving problems in how to scale the website to serve 20 million members (Java, Oracle). We're working on machine learning problems (like the Netflix Prize) and scaling problems with our recommendations engine (C++, mysql). I'm most closely involvd in figuring out how quality fits in to all of these development processes. I'm changing the role of a QA engineer from someone who pokes at a browser to someone who writes software to test software.
Then there's all the stuff that the back end teams do (logisitics, inventory, order generation). Once all the software's figured out, it has to run somewhere, and we need good system admins, DBAs and managers for those people that can plan for growth and install, configure and deploy to that plan.
The key thing is that we aren't doing this with an army of developers like an eBay, Yahoo or Google. We've got a relatively small team of really smart software engineers solving problems in an efficient and clever manner. A very deeply ingrained cultural value here is to only hire very senior people who understand how to solve problems, and then go and solve them. It's how we've been able to scale from just over 1MM customers when I joined 3.5 years ago to nearly 6MM customers today. The team that builds the website hasn't grown by more than 10-15% over that time, and we've added a ton of new stuff to the site. It's all because we don't scale the business by doing what we were doing just with more people; we scale through clever automation.
There's a list of what's open at our jobs page, but if there's something that anyone's specifically interested in, let me know. We're always looking for the right kind of person more than we're looking for a particular technology or skill.
Tuesday, August 29, 2006
I stuck the equivalent of two dead bodies in the ground today
If you haven't worked with concrete then you may be underestimating, to a great degree, my latest foe. Six bags of portland cement, sand and small rocks. Each bag is 0.45 cubic feet of concrete. A half a cubic foot sounds pretty small. It is pretty small when you're trying to do a footing around the perimeter of a 8'x10' shed foundation. I did six bags on Sunday and six bags today while waiting for an air conditioning repairman to show up. It only took me an hour to mix and distribute the six bags, but that was the longest stinking hour of my life. Add on top of that the effort to get the 360 pounds (hence, the two dead bodies reference) of dry concrete down from the garage to the shed site, and I didn't have to go running this morning to get a workout. I considered whether to cut down the amount of water I was mixing in, to balance out the amount of sweat dripping off me that was falling into the mixing trough.
I actually have about 4 more bags to go, then I can actually start assembling the shed on the flat, level foundation that I've built. I'll try to snap some pictures so you all can mock my efforts.
Friday, August 25, 2006
You looking for a job? I'm looking for someone to work!
------------------------------
Senior Quality Assurance Engineer — Customer Service Automation
The Position:
Join Netflix and help insure that every member who has a problem gets that problem solved quickly and effectively. Working on our customer call center software, you will help the people that help our members.
You will provide your expertise in understanding what to test, as well as how to test. Given a schedule that is always too short and a feature list that is always too long, you'll identify and efficiently evaluate those changes to our software that pose the greatest risk to the smooth and effective operation of the customer service staff.
We are looking for an experienced engineer with a background testing applications involving .NET, Oracle, SQL, PL/SQL, telephony integration, email and customer service application user interfaces.
Responsibilities:
• Validate and verify the correct operation of the customer service application
• Continuously improve and extend the automated regression test suite
You are:
• An advocate for the customer service representatives with regard to usable system design
• An advocate for customer service management with regard to accuracy and completeness of the system
• A bridge between the development organization and the operational groups supporting the system
Qualifications:
• 5+ years of rich GUI client application testing, building and deployment
• Deep experience with Oracle and PL/SQL or equivalent database systems
• Experience with C# and nUnit development and testing
• Experience with testing high-traffic, highly scaling, multi-threaded software design
• Able to work autonomously and flexible enough to shift priorities based on changing needs of the business
• Familiarity with use of .NET Remoting, Web Services, 3rd party .NET controls, TestComplete, Parasoft .TEST and Tuvox are all plusses
• A Bachelors or Masters in Computer Science or equivalent engineering
Harder's getting easier every day
Case in point, today while running, I was tangling with a statistical problem. There are performance monitoring tools built in to the Netflix website server that keep track of how long it takes to do stuff along the way to presenting a page to a member. We call them tracers. We keep track of the average execution time, how many times it's executed and also buckets for ranges of execution time. For example, we keep track of how many times it took less than 10 milliseconds, and how many times it took 10-50 milliseconds, 50-100 milliseconds, etc. Using them, we can diagnose the health of the system and discover if a recent change is the source of site problems.
I am studying whether we can learn if the system is healthy from comparing the skew of that distribution of buckets. I'd worked out a database query that gave me a value for skew, but I was measuring the skew of the number of hits per bucket, instead of the skew of all the values of all the individual hits (which is what I actually want). For example, if the eight buckets have the values of (10, 14, 100, 20, 3, 0, 0, 0), I would a value based on those eight numbers, with a relatively high positive skew of 2.57, because the 100 is a pretty far outlier to the right, making this distribution of eight numbers 'pointy' on the positive end. What I was really after is the skew of the 147 individual data points with 10 instances of value 1, 14 of value 2, 100 for value 3, etc. This would have a much more neutral skew of -0.56 indicating that it's slightly pointy on the left.
Anyway, while pondering all of this, I was running along and didn't even have time to whine to myself about not wanting to be out there running, and it was over before I knew it. I think I made pretty good time today, too.
It's kind of bugging me that I lost track of another thought that I had running. Something to do with just a little bit of peril. Now I can't recall what it was. I guess maybe I need the inverse of an iPod. Something I can run with and dictate the flotsam that crosses my mind, and be able to play it back later.
Tuesday, August 22, 2006
Interesting page from ten years ago
The twist to the story entertained me, and the commentary following the twist moved me. Even though the commentary is going on ten years old, most parts are relevant or even more relevant today.
Tuesday, August 15, 2006
Easy's Getting Harder Every Day
That seemed doable a few weeks ago (even if a little crazy). Lately, though, it's been harder to get up the hills, and even going down the hills has been awkward and sluggish. Now, running across the country seems not only crazy, but impossible. The hardest part of exercise is willfully putting myself into a state of discomfort. I know that I'll feel good when I'm done, but overcoming that inertia is the biggest obstacle. Once I'm going and I'm away from the house, then it's easier to go, but those first several scores of steps are hard.
Thursday, July 13, 2006
I wish I could write
Wednesday, July 12, 2006
Googling me
The ADB Drinking game
"DBs in Vegas" (me)
Google Groups: rec.gambling.poker (me)
Membership Directory (not me)
About STLAHA (not me)
[PDF] Gambler (me)
Radio Days--and Nights (me)
Council defers appointment to Planning Commission -- Los Altos ... (me)
The First Tee of The Seacoast Home Page (not me)
[PDF] TUESDAY, MEETING DATE (me)
Not bad... only three out of ten misses, and the top three were me. Interesting that the oldest stuff is ranked the highest. Not one mention of this blog, though. I guess maybe after this entry gets indexed that I might see more of me.
But it's good for you, isn't it?
I guess that's part of what makes a top-tier athlete: the ability to push past limits and train yourself to go past limits that stop everyone else.
That's probably what makes for a top-tier anything.
Thursday, July 06, 2006
Sudoku Combat
Sunday, June 18, 2006
Well, so much for that.
Thursday, June 15, 2006
Maybe another shot at the Big Dance?
I have registered to play in the PokerStars World Blogger Championship of Online Poker!
This Online Poker Tournament is a No Limit Texas Holdem event exclusive to Bloggers.
Registration code: 2521058
Thursday, June 08, 2006
That $100 Laptop Again
I'd recommend pledging. It was featured on Slashdot a week or two ago and got a big spike in pledges, but it's tapered back off. Projected pledges by the deadline are about 7,000.
Friday, May 05, 2006
Given Up
My average finish was 646, with a stdev of 392. My median finish was 581. If my finishes were normally distributed, I should have had a cumulative chance of finishing 36th or better of 5.96%, but I never made good on it.
After the 9th attempt, I started keeping track of my finishing hands. Of the 18 where I kept track, I got my money in with far the best of it 9 times (things like AA cracked by KK, or AA vs AxQc and four clubs came).
They play being uniformly horrendous didn't really help me as much as I thought it might. It kind of worked against me in that no matter how many times I went in with a 2:1 or 3:1 or 14:1 advantage, there's be some nutcase still out there that would draw out on me.
Thursday, March 16, 2006
Back in the saddle again
I found the combination of:
- free
- often
- convenient
So, I discussed with my lovely wife whether she would divorce me and/or kick me out of the ouse if I decided that I wanted to try and win a seat through this series. This in mind of the fact that I've already taken my yearly foray at the Oaks, as earlier reported. This in mind of the fact that she and I had previously discussed my annual foray being executed on-line, instead of in a cardroom, and that was roundly rejected as the temptation and availability of playing online for money was too disquieting to her.
In preparation for this discussion, I ran an experiment. I installed the client and registered for one of the daily tourneys and then just left the seat unoccupied to be blinded away, just to see how long it lasts. My hypothesis being that with the insanity of free play, I wanted to see how long it took for the 'real' tourney to begin. Turns out that of the 1800, generally 1300 of them are gone in the first hour. My test subject lasted until 283rd place.
That's a lot of crazy and/or dead money in there, I decided.
Armed with these facts, Jen & I had our discussion, and she actually agreed to a trial run. A big part of it is that they dailys generally start after the kids are in bed and are running when we are usually just watching TV or reading in bed, anyway.
So, I get to play in the dailys until:
- I win a seat
- I'm too grumpy in the morning to take care of the kids
I've played in four of them so far, and have not finished higher than the low 400's. Three of these times I went in with the best of it, and the most recent time was ended with a total brain fart with a double gutter on the flop to which I made the idiot end of a straight. I was actually on my A-game up to that point and had about a 4x average stack. I am not as upset and I could be about the brain fart, as up to that point, I'd identified and avoided stupid situations I'd fallen for in the past, as well as having identified and exploited obvious weaknesses in other players to take pots.
So, for now, I'm in and I'm stoked. I still have faint hopes for the Oaks freeroll, but now I've got a second chance.
I figure that given the competition, I'm about a 500:1 against getting a seat. With each of the three rounds taking about 5 hours from start to finish, it could be as little as 15 hours to get a $10k seat. An additional part of their promotion is if you play on FTP money and get to the final table, you get $50k extra prize money, $100k for top three and $10MM if you win the event. The $10MM is $1MM/year for 10 years as part of an endorsement contract, where you have to play 10 hrs/week on FTP and promise to wear only their t-shirts.
Anyway, hopefully see you at the WSOP :)
Friday, March 10, 2006
I Heart Lemurs
Originally, I posted direct links to the pictures, but the host appears to be blocking access from external referrers. Maybe I can cut & post them here...

Monday, March 06, 2006
Not Visiting South Dakota Any Time Soon
This seems reactionary to the point of irrationality. There were, of course, the required quotes from Operation Rescue. It made me think, how come there isn't an 'Operation Choice.'
Instead of Operation Rescue people blocking access to clinics and acting in an intimidating way towards women choosing to exercise control over their reproductive functions, Operation Choice people would provide emotional support and a calm environment within which a woman could make a considered and informed decision about a very important thing going on in her body.