CSE567M: Computer Systems Analysis (Fall 2006)

Instructor:Prof. Raj Jain, jain@wustl.edu

Office:Bryan 405D

Office Hours: Mondays: 11:00AM-12:00PM
Wednesdays: 3:30PM-4:30PM

Graders :To be announced.

All question about the homeworks and mid-term exams 1 and 2 grading should be directed to graders.

Course Description (Revised):
Formerly CS 557M.
Comparing systems using measurement, simulation, and queueing models. Common mistakes and how to avoid them, selection of techniques and metrics, art of data presentation, summarizing measured data, comparing systems using sample data, introduction to experimental design, fractional factorial designs, introduction to simulation, common mistakes in simulations, analysis of simulation results, random number generation, random variate generation, commonly used distributions, introduction to queueing theory, single queues, and queueing networks. The techniques of the course can be used to analyze and compare any type of systems including algorithms, protocols, network, or database systems.

Prerequisites:CSE 131 or CSE 126 or their respective equivalents. CSE 280 is not required. If you have any questions about the prerequisites, please feel free to see the instructor or discuss in the first session.

Credits:3 Units.

Time:Monday-Wednesday 1:00PM-2:30PM

Text Book:Raj Jain, " The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling," Wiley-Interscience, New York, NY, April 1991, ISBN:0471503363

Tentative Schedule:

Class 1 Wednesday 8/30/2006 Course Introduction
Monday 9/4/2006 Memorial Day Holiday - No class
Class 2 Wednesday 9/6/2006 Common Mistakes Chapter 2
Class 3 Monday 9/11/2006 Selection of Techniques and Metrics Chapter 3
Types of Workloads Chapter 4
Workload Selection Chapter 5
Class 4 Wednesday 9/13/2006 Workload Characterization Chapter 6
Class 5 Monday 9/18/2006 Data Presentation Chapter 10
Ratio Games Chapter 11
Class 6 Wednesday 9/20/2006 Summarizing Measured Data Chapter 12
Class 7 Monday 9/25/2006 Comparing Systems Using Random Data Chapter 13
Class 8 Wednesday 9/27/2006 Comparing Systems Using Random Data (Continued) Chapter 13
Class 9 Monday 10/2/2006 Mid-Term Exam 1
Class 10 Wednesday 10/4/2006 Simple Linear Regression Models Chapter 14
Class 11 Monday 10/9/2006 Other Regression Models Chapter 15
Class 12 Wednesday 10/11/2006 Experimental Designs Chapter 16
2k Experimental Designs Chapter 17
Class 13 Monday 10/16/2006 Factorial Designs with Replication Chapter 18
Class 14 Wednesday 10/18/2006 Fractional Factorial Designs Chapter 19
Class 15 Monday 10/23/2006 One Factor Experiments Chapter 20
Two Factor Full Factorial Design w/o Replications Chapter 21
Class 16 Wednesday 10/25/2006 Two Factor Full Factorial Designs with Replications Chapter 22
General Full Factorial Designs Chapter 23
Class 17 Monday 10/30/2006 Introduction to Simulation Chapter 24
Class 18 Wednesday 11/1/2006 Introduction to Simulation (Continued) Chapter 24
Class 19 Monday 11/6/2006 Mid-Term Exam 2
Class 20 Wednesday 11/8/2006 Analysis of Simulation Results Chapter 25
Class 21 Monday 11/13/2006 Random Number Generation Chapter 26
Class 22 Wednesday 11/15/2006 Testing Random Number Generators Chapter 27
Random Variate Generation Chapter 28
Class 23 Monday 11/20/2006 Introduction to Queueing Theory Chapter 30
Analysis of Single Queue Chapter 31
Wednesday 11/22/2006 Thanksgiving Holiday - no class
Class 24 Monday 11/27/2006 Queueing Networks Chapter 32
Operational Laws Chapter 33
Class 25 Wednesday 11/29/2006 Operational Laws (Cont)
Class 26 Monday 12/4/2006 Mean-Value Analysis Chapter 34
Class 27 Wednesday 12/6/2006 Convolution Algorithm Chapter 35
Class 28 Monday 12/11/2006 Final Exam
Class 29 Thursday 12/21/2006 Class Meeting: Final Grades

Exams: 60%
Homeworks: 15%
Project: 20%
Class participation: 5%

Project: The students will be required to write a 10-15 page report on application of analysis techniques to systems of their interest, e.g., networks, database systems, web systems, etc or a survey of recent analysis techniques used in such systems.

Student Project Reports:
Performance Analysis of Data Encryption Algorithms
Case Study of the Performance of a Gamma-Ray Event Parameterization Application
Survey on Performance Analysis of MAC protocols
A Summary of Network Traffic Monitoring and Analysis Techniques
A Survey of Network Performance Monitoring Tools
Survey of Network Performance Monitoring Tools
SNMP and Beyond: A Survey of Network Performance Monitoring Tools
A Survey of Network Traffic Monitoring and Analysis Tools
Operating System and Process Monitoring Tools
A Survey of Performance Analysis Tools
Processor workloads
Case Study: Performance Analysis of a Diversified Router
Performance Analysis of Wireless Sensor Networks
An Overview of Software Performance Analysis Tools and Techniques: From GProf to DTrace
Survey of Software Monitoring and Profiling Tools
From Poisson Processes to Self-Similarity: a Survey of Network Traffic Models
A Historical View of Network Traffic Models
A Survey of Network Traffic Models
Verification and Validation of X-Sim: A Trace-Based Simulator
A Performance Model for a Thermally Adaptive Application Implemented in Reconfigurable HW

A list of Sample Projects, Project Guidelines, Paper Review Form

Complete List of Audio and Video Recording of Lectures by Raj Jain
Back to Raj Jain's Home Page