Reflections on science, technology, and computing — leavened by personal experience


No exponential continues forever, at least outside the mathematics textbooks. All technology-based advances are ultimately limited by something, usually some physical or economic limit. Innovation then shifts to other metrics, against which advances can be measured and valued. Computing is no exception.

Dark silicon, the very phrase sounds ominious and it is, for I believe it will profoundly reshape how we think about computing in the next decade. We soon will have (and in many cases already do have) chips with more transistors than can be concurrently activated. The practical implication is that most of the chip…

The SC09 conference set an attendance record this year – roughly 10,000 attendees at the combined conference and tradeshow – despite the economic malaise of the technology industry and the global economy. One suspects the strong resilience of the conference may be due in part to substantial government investments in very high-performance computing (HPC).

One of the major lessons from web search and cloud data centers is the power of truly massive scale, near real-time data analysis. When anyone with a cheap cell phone and a web browser can extract data and insights from a non-trivial fraction of the human knowledge base, behavior and culture are transformed. I would…

The Extreme Computing Group (XCG) at Microsoft was formed to develop radical new approaches to ultrascale and high-performance computing hardware and software. The group’s research activities include work in computer security, cryptography, operating system design, parallel programming models, cloud software, data center architectures, specialty hardware accelerators and quantum computing.

There is an old joke in the high-performance computing community that begins with a question, “How do you make a small fortune in high-performance computing?” There are several variations on the joke, but they all end with the same punch line, “Start with a large fortune and ship at least one generation of product. You…