Performance Evaluation and Benchmarking

Published:
Editor(s):

Purchasing Options

Hardback
$139.95
Add to cart
ISBN 9780849336225
Cat# 3622
 

Features

  • Provides the fundamentals of performance evaluation along with the most recent techniques
  • Covers a wide variety of benchmarks in a single source
  • Integrates statistical, simulation, and analytical techniques into a single reference
  • Demonstrates how to use SimPoint, a widely used targeted sampling method
  • Explores hardware performance counters with case studies that illustrate their implementation in three different platforms
  • Summary

    Computer and microprocessor architectures are advancing at an astounding pace. However, increasing demands on performance coupled with a wide variety of specialized operating environments act to slow this pace by complicating the performance evaluation process. Carefully balancing efficiency and accuracy is key to avoid slowdowns, and such a balance can be achieved with an in-depth understanding of the available evaluation methodologies. Performance Evaluation and Benchmarking outlines a variety of evaluation methods and benchmark suites, considering their strengths, weaknesses, and when each is appropriate to use.

    Following a general overview of important performance analysis techniques, the book surveys contemporary benchmark suites for specific areas, such as Java, embedded systems, CPUs, and Web servers. Subsequent chapters explain how to choose appropriate averages for reporting metrics and provide a detailed treatment of statistical methods, including a summary of statistics, how to apply statistical sampling for simulation, how to apply SimPoint, and a comprehensive overview of statistical simulation. The discussion then turns to benchmark subsetting methodologies and the fundamentals of analytical modeling, including queuing models and Petri nets. Three chapters devoted to hardware performance counters conclude the book.

    Supplying abundant illustrations, examples, and case studies, Performance Evaluation and Benchmarking offers a firm foundation in evaluation methods along with up-to-date techniques that are necessary to develop next-generation architectures.

    Table of Contents

    INTRODUCTION AND OVERVIEW
    L.K. John and L. Eeckhout
    PERFORMANCE MODELING AND MEASUREMENT TECHNIQUES
    L.K. John
    BENCHMARKS
    L.K. John
    AGGREGATING PERFORMANCE METRICS OVER A BENCHMARK SUITE
    L.K. John
    STATISTICAL TECHNIQUES FOR COMPUTER PERFORMANCE ANALYSIS
    D.L. Lilja and J.J. Yi
    STATISTICAL SAMPLING FOR PROCESSOR AND CACHE SIMULATION
    T.M. Conte and P.D. Bryan
    SIMPOINT: PICKING REPRESENTATIVE SAMPLES TO GUIDE SIMULATION
    C. Calder, T. Sherwood, G. Hamerly, and E. Perelman
    STATISTICAL SIMULATION
    L. Eeckhout
    BENCHMARK SELECTION
    L. Eeckhout
    INTRODUCTION TO ANALYTICAL MODELS
    E.J. Kim, K.H. Yum, and C.R. Das
    PERFORMANCE MONITORING HARDWARE AND THE PENTIUM 4 PROCESSOR
    B. Sprunt
    PERFORMANCE MONITORING ON THE POWER5â„¢ MICROPROCESSOR
    A. Mericas
    PERFORMANCE MONITORING IN THE ITANIUM® PROCESSOR FAMILY
    R. Zahir, K. Menezes, and S. Fernando
    INDEX

    Related Titles