About

Welcome to Panela, Matt Harrison's take on mostly Open Source, Linux, Python, innovation in those areas, other buzzwords and Dick Proenneke. It comes complete with the illustrations as needed. Note the opinions expressed here are merely my opinions and not the opinions of my employer.

about Matt

Calendar

««Nov 2009»»
SMTWTFS
1234567
8910
11
12
1314
151617
18
192021
22232425262728
2930

Mailing List

My RSS Feeds








FOSS Day 2 (the kernel, turbogears, google and gentoo)

posted 2005.11.30 Wed
Today was the second day of FOSS.  I'll jot down my observations from today.

The first talk I attended was from LWN's Jonathon Corbet.  He discussed recent happenings in the Linux kernel.  He noted that the development cycle of the kernel was becoming more "professional", with two week cycles for adding features (and four weeks for fixing bugs).  Jonathon was very well versed in the new developments.  It was refreshing to sit back and here some semi-detailed updates on the kernel.  I haven't updated mine since the 2.6.10 days.

Later I attending a basic introduction to TurboGears given by Swaroop.  It was pretty well attended.  I haven't tried to do much with TurboGears, but this presentation made it feel very similar to the Rails demos I've seen (that's a compliment).  I like that the TG developers are taking advantage of existing projects (and not re-inventing the wheel).  My biggest issue with TG is the Python 2.4 requirement.  How many distros are shipping 2.4 these days?  (Gentoo and ubuntu??)

Speaking of Ruby and Python, there appears to be a bit of interest by the conference attendees in these languages.  Many people were asking about them and what distringuishes them or discussing their use of them.

After some booth work I caught the tail end of "Google: Powered by Linux".  According to the speaker, Arvind Jain, Google is one of "the biggest hardware producers".  He said they actually make their own machines.  Look out Dell you are about to be disrupted by the Gbox!  (They'll probably give them away for free as long as they can monitor the keystrokes ;)).  Their machines also have a failure rate of 1 in 1000.  (For every 1000 computers 1/day will fail).  But they don't care since the Google File System provides them with redundancies.  Next followed some discussion of their grid abstraction layer (that allows programmers to easily develop grid applications using GFS, GWS (Global Work System) and Map Reduce).  Supposedly these tools make it dead simple to create very scalable apps.  (Perhaps ActiveGrid can provide the common folk with similar functionality, since Google's stuff is proprietary and only used by Google). 

Arvind also mentioned something that they will be introducing in the future called "Big Table".  This is their homegrown distributed database.  That's about all the details he gave.  (No it doesn't use flat files).

Other interesting google snippets:  In a two week period of Aug 2004, there were 26,000 worker deaths (so I guess you can estimate the size of their cluster(s) by that).  Also, people have forgotten how to spell since 10% of queries are mispelled.

The last talks I attended were the end of Ebuild 101 and  using Gentoo in Production.   The takeaways here, are that there is a lot of power in portage (and ebuild scripts) that is pretty easy to access and that yes, people actually do use Gentoo in production systems.  BUT, unless one knows what they are doing it is "not recommended".  One the other hand if you do know what you are doing, it can make administration very simple (especially for large numbers of boxes) with no downtime.  I'm very impressed by Gentoo.  I think it is a shining example of open source well executed  (even the documentation is superb).

tags:              

links: digg this    del.icio.us    reddit




1. Swaroop C H left...
2005.11.30 Wed 10:45 am :: http://www.swaroopch.info

First off, I'm glad my talk didn't suck ;-).

And, the TurboGears trunk now works with Python 2.3. See http://www.turbogears.org/svn/turbogears/trunk/CHANGELOG.txt

If you want to know about BigTable, why not see the video? :-) : http://nor folk.cs.washington.edu/htbin-post/unrestricted/colloq/details.cgi?id=437 It's a really interesting talk.


2. Swaroop C H left...
2005.11.30 Wed 10:47 am :: http://www.swaroopch.info

For some strange reason, the URLs I posted have spaces added in-between, so watch out for that...


3. Matt left...
2005.11.30 Wed 11:59 am

Swaroop- Don't know what happened with the spaces in your links. Good job on your preso, btw.

I'm glad that TurboGears is supporting 2.3. I think that is good (and I'm one who likes to run bleeding edge).

Re: BigTable. Thanks for the link. I hadn't heard of it before and from the way that presenter talked about it, you wouldn't thought it was the coronel's secret recipe of 11 herbs and spices....


4. Alan Williamson left...
2005.11.30 Wed 11:07 pm :: http://compiledby.spikesource.com/

Great update Matt, and i love your comment on Google's hardware. Classic. Although I seriously doubt their claim about being the biggest hardware producer, me thinks that's just wishful thinking on their part. I don't imagine they are churning out more boxes than Dell; numbers just don't add up. They will be telling us next they have their own Google Nuclear Plant due to the amount of power they need.

Incidentally, with respect to the URL's make sure you put them in square brackets [] so they become automatically linked as per the WIKI. :)


5. Matthew Marshall left...
2005.12.01 Thu 6:26 am

Most distros seem to have Python 2.4 now. Archlinux, Debian Sarge, SUSE, Vector, Slackware, Ubuntu, and Fedora Core, are all ones I have used recently that include 2.4. I think 2.4 is pretty standard by now.

Anyway, thanks for the post; I wish I could have been there.

MWM


6. Matt left...
2005.12.01 Thu 8:24 am

Matthew- Thanks for the update on python versioning in distros. I'm used to RHEL, FC3 and gentoo. For any new distro they will use 2.4, but if you target it you loose support for legacy systems (hence you have people who have to run legacy for whatever reason who can't use your software). It's kind of a chicken and an egg situation. I mentioned it to Guido at the last Baypiggies meeting and he agreed that it was an issue in people adopting Python 2.4 specific features. (Though some projects are, Bazaar-NG being one example).

I'm really enjoying FOSS, most of the speakers have been good, and I've meet a lot of cool people.

Alan- Do you think that someone from google would lie? ;) I kind of doubted it too, but I'm standing behind my quote here.... Certainly Larry or Sergei could provide a power plant to the city of Mountain View for the "good" of the world ;)