UNIX Consulting and Expertise
Golden Apple Enterprises Ltd. » Posts in 'SUN' category

Timelapse video of Sandia’s Sun Constellation build Comments Off on Timelapse video of Sandia’s Sun Constellation build

Sandia’s Sun Constellation system, Red Sky, has been placed at number 10 on the latest Top 500 supercomputer list. It’s a monster cluster system – 70TB of memory, 47,232 cores, and built up of Sun x6275 blade systems hooked up in a 3D torus with Infiniband interconnects.

Marc Hamilton has posted up a timelapse video on his blog over at Sun showing the system being installed.

Red Sky has replaced Sandia’s existing Thunderbird system, and is actually built in the same place as ASCI Red used to live. The x6275 blades use Intel Nehalem EP processors running at 2.96Ghz, with no local disk fitted to the blades, allowing a much greater density.

Red Sky also features Sun’s new Cooling Door System which pumps cooled water through the cabinet doors. Sandia’s calculations reckon that this will save over 5 million gallons of water a year, compared to traditional air-cooled systems.

Mad Larry seeks to rule all with Sun/Oracle Comments Off on Mad Larry seeks to rule all with Sun/Oracle

I’d still like to know what to call Sun once the merger is complete. Sucle is my favourite, although I suspect it’ll end up being something boring like “Sun, an Oracle company”. While busy decrying the EU investigation into the takeover costing Oracle $100m a day, Larry has also been addressing a technology forum on Monday, and was shy about laying out his plans for world domination.

Key takeaway points from his speech were:

“I would like us to be the successor to IBM”

“We think with the combination of Sun technology and Oracle technology we can succeed and beat IBM – that’s our goal.”

“We are keeping everything. We’re keeping tape. We’re keeping storage. We’re keeping x86 technology and SPARC technology – and we’re going to increase the investment in it.”

“Sun has fantastic technology. We think it’s got great microprocessor technology – it needs a little more investment, but we think it can be extremely competitive. It’s got the leading tape archival systems. We think the Open Storage on their new disk system is absolutely fantastic. Java speaks for itself. Solaris is overwhelmingly the best open-systems operating system on the planet.”

“I shall buy Sun for *seven* *billion* *dollars* muahahahhaha”

“I shall call [Jonathan Schwartz] Mini Me”

Wait, sorry, no – those last two I made up. Although I’m sure Larry is enjoying a Bond villain style evil laugh as he contemplates finally putting the boot in to IBM, whilst stroking his devil goatee.

Joking aside, he’s right – Sun has a lot of really excellent technology, and historically they’ve failed to follow through with most of it. Oracle’s ruthless sales methodology will be striking some fear into some Sun sales managers, but engineers (and customers) should be taking comfort hearing this sort of fighting talk.

Of course, the deal (still!) isn’t done, and it might be a while before we see some systems hitting the market on the back of this enthusiasm. Still, I think Sun have totally neglected the higher end systems, relying on Fujitsu to do the hard graft – with any luck, we should be seeing some big Niagra boxes coming soon.

New SPARC solutions are on their way Comments Off on New SPARC solutions are on their way

The Hotchips conference is over, and with it comes some news from Sun about their SPARC plans. Sun shared details of it’s “Rainbow Falls” processor – the next iteration in the Niagara line.

Boasting 16 cores, each with it’s own cache, it’s an impressive bit of silicon. Each core has 4 Coherency Units (COU). Familiar to anyone who’s played with big Silicon Graphics kit and other cc:NUMA boxes, Coherency Units keep track of memory contents (from L2 cache up to physical RAM).

4 COUs per core, along with 16 seperate L2 caches, is a lot on a single die. To simplify things (and to help improve performance) Sun has added a Core to Cache Crossbar (CCX). Two cores will share a single entry point into the CCX, which is linked to every core on the chip.

It’s essentially a standard switching crossbar – like UPA, Xbow, NUMAlink etc. – except it’s linking cores and L2 caches, not CPUs, RAM, and I/O bays.

All pretty impressive stuff – remember, this is all on the processor die – and it sounds like it would be ideal in a large system. Those M9000 boxes look pretty inviting, especially after the disappointment of the Niagara system board upgrades for the F15k.

And in fact, maybe that’s what Oracle has up it’s sleeve. The Prophets of Larry have said they will be making a major SPARC announcement on October 14th, during Larry’s yearly sermon to the faithful at Oracleworld. (Sorry, guys – I love you really)

With IBM pushing forward development of it’s fearsome Power7 chip, and with Power6 a bit of a monster anyway, Sun clearly needs to keep in the game – especially after (foolishly) canning Rock.

The Oracle announcement will be aimed clearly at blowing the doors off IBM – check their rhetoric and the fuzzy teaser advert on the Sun plus Oracle is Faster page.

Now, there are a number of ways they could bury IBM in the TPC-C benchmarks. Most obvious would be a massive RAC install, probably with Fujitsu’s new 8 way SPARC64 chip. But that wouldn’t really be blowing the Sun SPARC trumpet, would it?

The current top end Niagara box – the T5440 – can have up to four 8 core Niagara CPUs (along with half a terabyte of RAM). It’s pretty good, but again – the only way you can scale is by clustering them. Oracle have an insanely great scalable database solution with Oracle RAC, so it would seem a no-brainer.

However, if Sun are close to releasing Rainbow Falls, they could use the system boards and interconnects from the M9000 chassis to produce a hugely thread-dense NUMA machine. All that coherency hardware makes no sense for a cluster – it’s role is in a big Single System Image (SSI) machine.

We’ll find out in a month.

Oracle have bought Sun 1 comment

Well, this was a bit unexpected – but they were one of the only other companies who could realistically make a move.

Oracle have purchased Sun, at $9.50 a share, in a deal valued at approximately $7.4 billion, or $5.6 billion net of Sun’s cash and debt.

Larry Ellison has shown for years he has the determination and drive to push a company forward – either by crushing the opposition (a favourite term of a DBA friend) or by buying them out.

Owning the whole stack – from storage, through tin, up to software – plus services will give Oracle a huge amount of leverage and visibility. It’ll also mean they can take on IBM directly at pretty much every level.

Interesting times ahead.

You can read the Sun press release at http://www.sun.com/third-party/global/oracle/index.jsp

Update: Oracle have put up a nice page of FAQs and information at http://www.oracle.com/sun/index.html

A review of the Sun Ultra 24 workstation Comments Off on A review of the Sun Ultra 24 workstation

I’m in a position to start ramping up my involvement in OpenSolaris, which has put me in the market for a new workstation. I’ve just had a shiny new Ultra 24 delivered as part of Sun’s extensive Try Before Buy program – so here’s a quick review.

Some Background

Back in the 90s Sun was wildly successful with their UltraSPARC II processor. They had a good crossbar architecture with UPA to plug it into, and with the recent absorption of Cray’s Superserver team, they’d got a scalable platform, in the form of the E10k.

Someone at Sun had the idea of nobbling the multi-processor bits of the chip, increasing yields, boosting speeds and reducing price. The UltraSPARC IIi was born. It got shoved into the fantastic Netra T1 1u server, and then Sun started looking at the IIi chip for their workstation lines.

Marrying the cheap IIi processor with the UPA crossbar and cheap PC components was a stroke of genius, and the resulting Ultra 5 pizza box and Ultra 10 mini tower workstations sold like hotcakes. They were just what people wanted – cheap, binary compatible UNIX workstations that just worked.

Some Opinion on Workstations

It’s that last point that’s important; UNIX workstations have a very different shelf life from a PC. You need balanced performance – a fast CPU is useless if your graphics and disk subsystem can’t keep up. The machine has to last 4-5 years in a typical environment – I worked with an international communications company who are still using Sun Ultra 10 workstations – over a decade after they were first introduced.

This is important, because if you take the PC economics too far, you end up with a machine that costs more than a PC, but still has to be replaced as often. Silicon Graphics got it wrong with their Visual Workstations, and Sun got it right with the Ultra 5 and 10. (You could argue the choice of OS there was more important than the components)

The Sun Ultra 24

It’s with that in mind that you should read on. My main desktop is a Silicon Graphics Fuel – packed with RAM, fast disks, and a dual head graphics card, it’s more than capable of running the 30+ apps I keep going.

As I posted on Siliconbunny a while ago (see Breathing new life into those old Silicon Graphics machines) the rise of web-centric apps means that older UNIX workstations will have a much longer working life than they’ve had before. IRIX and MIPS (and indeed, Silicon Graphics themselves) may no longer be with us, but the Fuel is just as usable as when it was first brought out.

So I won’t be repeating other people’s work on endlessly measuring the machine’s performance with meaningless benchmarks, and quoted random numbers as if they somehow provide a good measure of how good a bit of kit this is.

I’ve got the Ultra 24 for OpenSolaris development work, and given that it has an Intel x86 processor, it also makes it an ideal test bed for messing around with virtualisation. The bar is set pretty high – it needs to ‘just work’ and be as fast and slick as the Fuel, yet still provide the Solaris hacking environment my trusty Ultra 10 did.

First Impressions

On first unboxing the machine, my first impression was that this is a classic Sun workstation. Dull. Beige.

Sun Ultra 24 vs Sun Ultra 10

Seriously, guys – come on. Silicon Graphics gave you a beating for years with their great lineup of super sexy workstations and servers. If you’re justifying a more expensive machine, then make it at least look like it’s worth the extra money – because otherwise you’ll be losing out to cheap crud from Dell or HP. If you’re offering is essentially a PC, this is more important than ever.

The beige tower with the black DVD-ROM drive is instantly identifiable as the replacement for the Ultra 10. A tacky “Intel Inside” sticker on the front isn’t really impressing either. Apple don’t have to plaster their kit with Intel adverts – why are Sun doing it?

Rear views of the two Ultras

Taking it apart was pretty straightforward – a couple of thumb screws and the side slides off. Inside the case is a comprehensive map showing what goes where, and how to remove all the major components. There is a good range of PCI-E slots, which is going to prove very useful over the life of the machine – 10Gb ethernet and extra graphics cards will be added over time.

The major plus here is the SATA drive slots – they take SPUD brackets! I whipped a drive out of a Netra D130 storage tray, removed the SPUD, fitted it to a SATA drive, and it slid right in. Every Sun shop I know has piles of old 4gb and 9gb SCSI drives with SPUDs – now you’ve got a use for them.

The major minus here is the memory slots. There are only 4 (DIMMs installed in matched pairs). With current 2GB DIMMs that gives you a max of 8GB of RAM – which is really weak. The Ultra 10 could handle up to 1GB, at a time when workstations were usually shipping with a max of 256mb. Given laptops take 8GB of RAM now, and that 8GB is the max in my Fuel, I’m really unimpressed with this. I’m hoping that there isn’t a chipset limitation that would stop the machine using 4GB DIMMs later on, because being limited to only 8GB (on a machine that’s ripe for virtualisation work) is – frankly – a crippling limitation.

With the cover off I whipped out the 1GB RAM the Ultra 24 was shipped with, replacing it with 4GB in 2 2GB DIMMs. I also added a couple of GFX1600 cards, which can convert the two DVI outputs from the Nvidia Quadro card to OpenLDI, for use on my SGI 1600SW screens.

Silicon Graphics monitors on a Sun workstation?

Despite their age, the 1600SW remains the greatest display known to man. If you’re using a machine for long periods of time, nothing else will even come close. Any box that can’t be plugged into a 1600SW is dead to me.

Booting up and the OS

Time out.

Dear Sun,
You have OBP, which is – and remains – awesome. I understand you can’t use this with x86. Silicon Graphics solved this with ARCS, and a nice intuitive and powerful graphical UI for booting and configuring their Visual Workstations.
Apple have bypassed the whole legacy BIOS mess with EFI, and it is truly sweet.
So why I am seeing the same crappy AMI BIOS that’s on my £200 laptop when I turn on the Ultra 24?
Fix this, and fix it now.

Really, this is pretty crappy. It drives home the fact that, for all Sun’s engineering, you’re driving a standard (and expensive) PC. That is not the way to re-inforce the brand or display added value. Please, fix it.

You’ll just have time to gag at the rubbish low-res Sun logo (come back, OBP boot banner, I miss you!) before the machine starts a handful of irritating Intel initialisation messages. I don’t care about Intel’s management interface, and I really don’t care about PXE boot – just hide this stuff and make it go away.

Then you’re dropped into the shiny Grub, offering you a boot route into the pre-installed Solaris 10 OS. Pre-installed Solaris sucks, always – fix that default partitioning guys! Besides, I’m here to slap on OpenSolaris – so in goes the LiveCD and away the machine boots.

OpenSolaris starts up surprising quickly. Most impressive, though, is that it recognises the freakish 1600×1024 resolution of the 1600SW straight away, booting cleanly into the GUI. Colour me impressed – this is the sort of slick “it just works” experience I expect.

OpenSolaris has come along in leaps and bounds, and the installation is both fast and painless. Another reboot, and I can login to the desktop. A few quick clicks and I’ve got an extended desktop across both 1600SW screens.

Yes, I know that this is more a feature of OpenSolaris than the Ultra 24 – but the OpenSolaris community need to be congratulated on this level of ease of use. It’s almost as slick as the IRIX GUI, and that’s really saying something.

Loading up loads of apps and starting to push the machine, and it’s clear that there’s a lot of X server optimisation still to be done. Hesitation, window tearing, artifacts – under load, OpenSolaris just doesn’t seem to perform as well as IRIX on the desktop. Is this Nvidia drivers, or X server optimisation, or both? It’s an issue, but it’s not the Ultra 24’s problem, and I can’t fault it here.


The Sun Ultra 24 is a cracking workstation. It’s fast, it’s quiet, and with OpenSolaris it just works. It’s got good room for expansion, although the limited RAM slots could prove to be an issue – especially if you’re playing with virtualisation.

As an entry level UNIX workstation, however, it excels, and is a worthy successor to the line of machines that the Ultra 10 first kicked off.

Top of page / Subscribe to new Entries (RSS)