Knowledge discovery in science and engineering has been driven by theory, experiments and more recently by large-scale simulations suing high-performance computers. Modern experiments and simulations involving satellites, telescopes, high-throughput instruments, imaging devices, sensor networks, accelerators, and supercomputers yield massive amounts of data. At the same time, the world, including social communities is creating massive amounts of data at an astonishing pace. Just consider Facebook, Google, Articles, Papers, Images, Videos and others. But, even more complex is the network that connects the creators of data. There is knowledge to be discovered in both. This represents a significant and interesting challenge for HPC and opens opportunities for accelerating knowledge discovery. Read more →

Programming languages have advanced tremendously over the years, but program debuggers have hardly changed. Sequential debuggers do little more than allow a user to control the flow of a program and examine its state. Parallel ones support the same operations on multiple processes, and are adequate with a small number of cores, but become unwieldy and ineffective on very large machines. Typical scientific codes have enormous multi-dimensional data structures and it is impractical to expect a user to view the data using traditional display techniques. Read more →

Exactly twenty years ago, we started our grid scheduling research in Delft with the design and implementation of the Condor flocking mechanism for load sharing across Condor pools. Over the last ten years we have designed and deployed the KOALA grid scheduler, which has served as our research vehicle for a large variety of research in grid scheduling. These are only two examples showing that in general, grids have been a present from heaven for researchers in resource management and scheduling in large-scale distributed systems. In this talk I will first look back: What have we learned from our past research in resource management and scheduling, and what is the value of this research in the first place? Read more →

The focus of vendors and service providers alike on wireless infrastructures to serve the masses with wireless high speed data trunks, converged infrastructure, more speed more bandwidth, more virtualization and the convergence of consumer and enterprise services have changed the business mode, and opened the doors to improve connectivity, commoditization of technology and helped to transform the SME into a service provider with a global reach: What does this mean to a typical SME? What does this mean to a service provider? And what would be the role of SME in the new eco system? Read more →

With more and more dynamic services provided by cloud, network faces a lot of challenges with capacities, physical interfaces, network virtualization architecture, dynamical networking services with virtualized network resources, ..., etc. Here is the data center network infrastructure of Huawei to solve the problems. Read more →