Добавил:

korayakov Опубликованный материал нарушает ваши авторские права? Сообщите нам.

Вуз:

Национальный исследовательский университет «МИЭТ»

Предмет:

Операционные системы

Файл:

Введение в параллельное программирование

.pdf

Скачиваний:

Добавлен:

16.04.2013

Размер:

1.73 Mб

Скачать

☆

1 / 41 2 3 4 > Следующая >>>

AGentleIntroductiontoParallel

Programming

ParallelProgrammingTechniquesforSoftware

Developers

Dr. Tim Mattson

Principal Engineer

Applications Research Laboratory

Intel Corporation

Polling Question

Where are you located?

–North America

–Latin America

–Europe

–Asia

–Japan

–Africa or Middle East

Outline

Parallel programming, wetware, and software

Parallel programming APIs

–Thread Libraries

–Win32 API

–POSIX threads

–Compiler Directives

–OpenMP*

–Message Passing

–MPI

More complicated examples

Choosing which API is for you

*Other names and brands may be claimed as the property of others.

Parallel computers will be everywhere

Over the next few years, all computers will be parallel computers.

–Servers

–Laptops

–Cell phones

What about software?

–Software will no longer increase from one generation to

the next as hardware improves … unless it is parallel software

Applicationperformancewill becomea will a

competitivefeature for ISVs. feature for ISVs.

How to create a parallel application:

Decompose

into tasks

Original Problem

				o			.
				o			s
				t			t
				n			i
			o				n
			p			u
			p		n
		u			n
o				o
r				i
r				t
G			u
G			c
		e
	x
e

Tasks, shared and local data

Program SPMD_Emb_Par ()

{

Program SPMD_Emb_Par ()

TYPE{Program*tmp, *func();SPMD_Emb_Par ()

array D ta(TYPE);

Code with a

globalTYPE{Program*tmp, *func();SPMD_Emb_Par ()

globalglobalarrayarrayRes(TYPEData(TYPE);

TYPE{ *tmp, *func();

int

et num procs();

parallel

NglobalglobalarrayTYPEarrayRes(TYPE*tmp,Data(TYPE);*func();

int idint=Nglobalget= globalprocetarraynumid();arrayRes(TYPEprocs();Data(TYPE);

setup

programming

(id==0)int int=Nglobalget= getprocproblem(N,DATA);arraynumid();Resprocs();(TYPE

for

I= 0;

(intif(id==0)int intI<N;I=I+Num){setupget procproblem(N,DATA);getid();num procs();

environment

= fu

tmpfor (intif(id==0)intI=c(I);0; I<N;I=I+Num){setupget procproblem(N,DATA);id();

late( tmp);

);

Res.tmpaccumfor(intif= (id==0)func(II= 0;);I<N;I=I+Num){setup problem(N, Data

}

Res.tmpaccumfor(int=func(II=late(ID;);tmp);I<N;I=I+Num){

}

Res.tmpaccumulate(=func(I,tmp);Data);

}

Res.accumulate( tmp);

}

Units of execution + new shared data

for extracted dependencies

Corresponding source code

How to create a parallel application: “Wetware”

Decompose

into tasks

Original Problem

				o			.
				o			s
				t			t
				n			i
			o				n
			p			u
			p		n
		u			n
o				o
r				i
r				t
G			u
G			c
		e
	x
e

Tasks, shared and local data

Program SPMD_Emb_Par ()

{

Program SPMD_Emb_Par ()

TYPE{Program*tmp, *func();SPMD_Emb_Par ()

array D ta(TYPE);

Code with a

globalTYPE{Program*tmp, *func();SPMD_Emb_Par ()

globalglobalarrayarrayRes(TYPEData(TYPE);

TYPE{ *tmp, *func();

int

et num procs();

parallel

NglobalglobalarrayTYPEarrayRes(TYPE*tmp,Data(TYPE);*func();

int idint=Nglobalget= globalprocetarraynumid();arrayRes(TYPEprocs();Data(TYPE);

setup

programming

(id==0)int int=Nglobalget= getprocproblem(N,DATA);arraynumid();Resprocs();(TYPE

for

I= 0;

(intif(id==0)int intI<N;I=I+Num){setupget procproblem(N,DATA);getid();num procs();

environment

= fu

tmpfor (intif(id==0)intI=c(I);0; I<N;I=I+Num){setupget procproblem(N,DATA);id();

late( tmp);

);

Res.tmpaccumfor(intif= (id==0)func(II= 0;);I<N;I=I+Num){setup problem(N, Data

}

Res.tmpaccumfor(int=func(II=late(ID;);tmp);I<N;I=I+Num){

}

Res.tmpaccumulate(=func(I,tmp);Data);

}

Res.accumulate( tmp);

}

Units of execution + new shared data

Corresponding source code

for extracted dependencies

A systematic guide to wetware in parallel programming

A pattern language for parallel algorithm design with examples in MPI, OpenMP* and Java*.

This is our hypothesis for how programmers think about parallel programming.

See a recent webinar about these patterns at:

http://www3.intel.com/cd/ids/developer/asmo-na/eng/331571.htm

*Other names and brands may be claimed as the property of others.

The Major Parallel Algorithms

Start

Organize By Flow of Data		Organize By Tasks		Organize By Data

Regular?		Irregular?		Linear?		Recursive?		Linear?		Recursive?

Pipeline

Event Based

Task

Divide and

Geometric

Recursive

Pipeline

Event Based

Task

Divide and

Geometric

Recursive

Coordination

Parallelism

Conquer

Decomposition

Data

Coordination

Parallelism

Conquer

Decomposition

Data


Discrete			Gaming
Discrete	Ray	Molecular	Gaming
Time	Ray	Molecular	physics
Time	Tracing	dynamics	physics
simulation	Tracing	dynamics

	Examples

How to create a parallel application: software

Decompose

into tasks

Original Problem

				o			.
				o			s
				t			t
				n			i
			o				n
			p			u
			p		n
		u			n
o				o
r				i
r				t
G			u
G			c
		e
	x
e

Tasks, shared and local data

Program SPMD_Emb_Par ()

{

Program SPMD_Emb_Par ()

TYPE{Program*tmp, *func();SPMD_Emb_Par ()

array D ta(TYPE);

Code with a

globalTYPE{Program*tmp, *func();SPMD_Emb_Par ()

globalglobalarrayarrayRes(TYPEData(TYPE);

TYPE{ *tmp, *func();

int

et num procs();

parallel

NglobalglobalarrayTYPEarrayRes(TYPE*tmp,Data(TYPE);*func();

int idint=Nglobalget= globalprocetarraynumid();arrayRes(TYPEprocs();Data(TYPE);

setup

programming

(id==0)int int=Nglobalget= getprocproblem(N,DATA);arraynumid();Resprocs();(TYPE

for

I= 0;

(intif(id==0)int intI<N;I=I+Num){setupget procproblem(N,DATA);getid();num procs();

environment

= fu

tmpfor (intif(id==0)intI=c(I);0; I<N;I=I+Num){setupget procproblem(N,DATA);id();

late( tmp);

);

Res.tmpaccumfor(intif= (id==0)func(II= 0;);I<N;I=I+Num){setup problem(N, Data

}

Res.tmpaccumfor(int=func(II=late(ID;);tmp);I<N;I=I+Num){

}

Res.tmpaccumulate(=func(I,tmp);Data);

}

Res.accumulate( tmp);

}

Units of execution + new shared data

for extracted dependencies

Corresponding source code

parallel programming environments

Thread Libraries

–Win32 API

–POSIX threads

Compiler Directives

–OpenMP*

Message Passing

–MPI

POOP – Parallel Object Oriented Programming

*Other names and brands may be claimed as the property of others.

1 / 41 2 3 4 > Следующая >>>

Соседние файлы в папке Лекции_2007

#
16.04.20133.99 Mб71untitled.bmp
#
16.04.20131.73 Mб85Введение в параллельное программирование.pdf
#
16.04.2013100.86 Кб112Лекции 2 Концепция процесса.ppt
#
16.04.20133.2 Mб106Лекция 1 История ВТ.ppt
#
16.04.201381.92 Кб121Лекция 3 Прерывания и ядро ОС.ppt
#
16.04.2013172.03 Кб93Лекция 4 Асинхронные процессы.ppt
#
16.04.201373.22 Кб124Лекция 5 Семафоры.ppt