This reminds me - must add the E-3 to the reviews database

.
My take on it - coming from an E-1 I was initially a little disappointed by a few of the compromises when I first picked it up. Just little things like the quality of the dials, the latches and the battery door. I'd still take the E-3 over something like a 5D in terms of build quality, but it's not quite got that 100% pro feel to it that you get with the E-1.
However, Olympus have updated it where it matters. Excellent big bright 100% viewfinder. Useful swivel LCD (I can't see how Live View can be as useful if it's static). Very fast handling compared to the E-1 - though that's just a natural progression due to a few years development in processing. The much more adaptable AF on the E-3 seems like it's a cause of confusion or upset for some, but I've not really had problems with it since the first day when I had it configured incorrectly for the type of shooting I was doing. There is still a lot for me to learn with this AF - almost makes me yearn for the simple 3 point AF of the E-1

. Also with regards to AF - all of my lenses focus faster on the E-3 than on the E-1. Quite noticable, and when using an SWD lens it's as fast as I've experienced with any lens. Let's just hope it doesn't give up accuracy for speed

.
RAW files are definitely a stop or two better in noise compared to my E-1 or E-400. I don't like the JPEG processing so much on the E-3 - I need -2 sharpening and -2 contrast to get anywhere near a natural image. The ISO switch I find a bit fiddly to access, but! Now we have auto-ISO with selectable range - as I'm more than happy with ISO up to 800 on the E-3 I just leave it in auto-ISO mode. Higher ISO is usable too, but only when really required.
All in all - a definite improvement over my E-1 in the areas of picture quality and speed. I'd still happily use the E-1 though as it really is the most joyful camera to use and hold. But - we can't stop the march of technology can we.
[edit]
I must admit I wrote my 'review' after only skimming yours Raist. Now I've read yours in detail I find it an interesting take on the E-3, and nicely contrasting to mine. You seem a bit disappointed how fiddly it is to change settings, and I've not really mentioned it. I guess that just shows how people will always react differently depending on where they're coming from. I'm a pretty slow and methodical photographer so don't mind fumbling around a bit to get the settings I want. I can imagine that if you need to set something up very quickly or you'll miss your shot then your points are well made.