Reflections on science, technology, and computing — leavened by personal experience


We tend to forget the real reason the Cray-1 was so successful. It was not the innovative vector architecture and memory system, nor was it the plethora of great software. Despite our love of self-similarity, orders of magnitude really matter. It’s worth remembering this as we contemplate future exascale computing system designs and digest the…

Computer architects create something of functional beauty, just as do their cousins who work in the more tangible media of rock and stone. Consider John Cocke and the IBM 801, Ken Batcher and the Goodyear MPP, Tadashi Watanabe and the NEC SX. Similarly, Seymour Cray’s designs balanced many aspects of power engineering, packaging and cooling,…

As an enterprising young faculty member, I asked Professor Slotnick if he had any words of wisdom to offer a young parallel computing researcher, based on his experience with ILLIAC IV. He simply said, “Choose your risks carefully.”

The reason we strive to protect data centers is obvious, their failure often has catastrophic business implications. Without doubt, though, some workloads are less affected by failure than others. If your web search for basket weaving supplies times out, you are probably content to retry the query a few seconds later. If your attempt to…

One of the major lessons from web search and cloud data centers is the power of truly massive scale, near real-time data analysis. When anyone with a cheap cell phone and a web browser can extract data and insights from a non-trivial fraction of the human knowledge base, behavior and culture are transformed. I would…