CS 704C-Parallel Programming |
Module I |
Introduction : Computational demands on modern science, advent of practical parallel processing, parallel processing
terminology.
PRAM algorithms : model of serial computation, PRAM model of parallel computation, PRAM algorithms, reducing
the number of processors.
|
Module II |
Processes and processors. Processor organizations, Processor arrays, Multiprocessors, Multicomputers, FLYNN’s
taxonomy, Shared memory. Fork. Join constructs. Basic parallel programming techniques- loop splitting, spin locks,
contention barriers and row conditions. |
Module III |
Variations in splitting, self and indirect scheduling. Data dependency-forward and backward block scheduling. Linear
recurrence relations. Backward dependency. Performance tuning overhead with number of processes, effective use of
cache.
|
Module IV |
Parallel programming examples: Average, mean squared deviation, curve fitting, numerical integration, Matrix
multiplication, sorting, travelling salesman problem, Gaussian elimination. Discrete event time simulation.
Parallel Programming Languages :Fortran 90, C*,Sequent C, OCCAM,C- Linda,
Parallel programming under Unix.
|
Text Books: |
1.Parallel Computing, Quinn,TMH
2.Introduction to Parallel Processing ,Sashi Kumar,PHI
3.Parallel Programming, Wilkinson, Pearson
4.Elements of Parallel Computing, Rajaraman,PHI
5.Fundamentals of Parallel Processing, Jordan, PHI
6. Advanced Computer Architecture, Hwang, TMH
|
|