1 multithreaded programming using java threads rajkumar buyya grid computing and distributed systems...
TRANSCRIPT
![Page 1: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/1.jpg)
1
Multithreaded Programming using Java
Threads
Rajkumar BuyyaGrid Computing and Distributed Systems (GRIDS)
LaboratoryDept. of Computer Science and Software Engineering
University of Melbourne, Australiahttp://www.gridbus.org/~raj or http://www.buyya.com
![Page 2: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/2.jpg)
2
Agenda
Introduction Thread Applications Defining Threads Java Threads and States Examples
![Page 3: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/3.jpg)
3
A single threaded program
class ABC{….
public void main(..){…..}
}
begin
body
end
![Page 4: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/4.jpg)
4
A Multithreaded Program
Main Thread
Thread A Thread B Thread C
start startstart
Threads may switch or exchange data/results
![Page 5: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/5.jpg)
5
Single and Multithreaded Processes
Single-threaded Process
Single instruction stream Multiple instruction stream
Multiplethreaded ProcessThreads of
Execution
CommonAddress Space
threads are light-weight processes within a process
![Page 6: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/6.jpg)
6
ServerThreads
Server ProcessClient 1 Process
Client 2 Process
Multithreaded Server: For Serving Multiple Clients Concurrently
Internet
![Page 7: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/7.jpg)
7
Web/Internet Applications:Serving Many Users
Simultaneously
Internet Server
PC client
Local Area Network
PDA
![Page 8: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/8.jpg)
8
Printing ThreadPrinting Thread
Editing Thread
Editing Thread
Modern Applications need Threads (ex1):Editing and Printing documents in
background.
![Page 9: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/9.jpg)
9
Multithreaded/Parallel File Copy
reader()
{
- - - - - - - - - -
lock(buff[i]);
read(src,buff[i]);
unlock(buff[i]);
- - - - - - - - - -
}
reader()
{
- - - - - - - - - -
lock(buff[i]);
read(src,buff[i]);
unlock(buff[i]);
- - - - - - - - - -
}
writer()
{
- - - - - - - - - -
lock(buff[i]);
write(src,buff[i]);
unlock(buff[i]);
- - - - - - - - - -
}
writer()
{
- - - - - - - - - -
lock(buff[i]);
write(src,buff[i]);
unlock(buff[i]);
- - - - - - - - - -
}
buff[0]buff[0]
buff[1]buff[1]
Cooperative Parallel Synchronized Threads
Cooperative Parallel Synchronized Threads
![Page 10: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/10.jpg)
10
Code-GranularityCode ItemLarge grain(task level)Program
Medium grain(control level)Function (thread)
Fine grain(data level)Loop (Compiler)
Very fine grain(multiple issue)With hardware
Code-GranularityCode ItemLarge grain(task level)Program
Medium grain(control level)Function (thread)
Fine grain(data level)Loop (Compiler)
Very fine grain(multiple issue)With hardware
Task i-lTask i-l Task iTask i Task i+1Task i+1
func1 ( ){........}
func1 ( ){........}
func2 ( ){........}
func2 ( ){........}
func3 ( ){........}
func3 ( ){........}
a ( 0 ) =..b ( 0 ) =..
a ( 0 ) =..b ( 0 ) =..
a ( 1 )=..b ( 1 )=..
a ( 1 )=..b ( 1 )=..
a ( 2 )=..b ( 2 )=..
a ( 2 )=..b ( 2 )=..
++ xx LoadLoad
Sockets/PVM/MPI
Threads
Compilers
CPU
Levels of Parallelism
![Page 11: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/11.jpg)
11
What are Threads?
A piece of code that run in concurrent with other threads.
Each thread is a statically ordered sequence of instructions.
Threads are being extensively used express concurrency on both single and multiprocessors machines.
Programming a task having multiple threads of control – Multithreading or Multithreaded Programming.
![Page 12: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/12.jpg)
12
Java Threads
Java has built in thread support for Multithreading
Synchronization Thread Scheduling Inter-Thread Communication:
currentThread start setPriority yield run getPriority sleep stop suspend resume
Java Garbage Collector is a low-priority thread.
![Page 13: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/13.jpg)
13
Threading Mechanisms... Create a class that extends the Thread
class Create a class that implements the
Runnable interface
![Page 14: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/14.jpg)
14
1st method: Extending Thread class
Threads are implemented as objects that contains a method called run() class MyThread extends Thread {
public void run() { // thread body of execution } } Create a thread: MyThread thr1 = new MyThread(); Start Execution of threads: thr1.start(); Create and Execute: new MyThread().start();
![Page 15: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/15.jpg)
15
An example
class MyThread extends Thread { // the thread public void run() { System.out.println(" this thread is running ... "); }} // end class MyThread
class ThreadEx1 { // a program that utilizes the thread public static void main(String [] args ) {
MyThread t = new MyThread();// due to extending the Thread class (above)// I can call start(), and this will call// run(). start() is a method in class Thread.
t.start(); } // end main()} // end class ThreadEx1
![Page 16: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/16.jpg)
16
2nd method: Threads by implementing Runnable interfaceclass MyThread implements Runnable{ ..... public void run() { // thread body of execution }} Creating Object: MyThread myObject = new MyThread(); Creating Thread Object: Thread thr1 = new Thread( myObject ); Start Execution: thr1.start();
![Page 17: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/17.jpg)
17
An example
class MyThread implements Runnable { public void run() { System.out.println(" this thread is running ... "); }} // end class MyThread
class ThreadEx2 { public static void main(String [] args ) { Thread t = new Thread(new MyThread()); // due to implementing the Runnable
interface // I can call start(), and this will call run(). t.start(); } // end main()} // end class ThreadEx2
![Page 18: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/18.jpg)
18
Life Cycle of Thread
new
runnable non-runnable
dead
wait()sleep()suspend()blocked
notify()sleptresume()unblocked
start()
stop()
![Page 19: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/19.jpg)
19
A Program with Three Java Threads
Write a program that creates 3 threads
![Page 20: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/20.jpg)
20
Three threads example
class A extends Thread { public void run() { for(int i=1;i<=5;i++) { System.out.println("\t From ThreadA: i= "+i); } System.out.println("Exit from A"); } }
class B extends Thread { public void run() { for(int j=1;j<=5;j++) { System.out.println("\t From ThreadB: j= "+j); } System.out.println("Exit from B"); } }
![Page 21: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/21.jpg)
21
class C extends Thread { public void run() { for(int k=1;k<=5;k++) { System.out.println("\t From ThreadC: k= "+k); }
System.out.println("Exit from C"); } }
class ThreadTest { public static void main(String args[]) { new A().start(); new B().start(); new C().start(); } }
![Page 22: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/22.jpg)
22
Run 1
[raj@mundroo] threads [1:76] java ThreadTest From ThreadA: i= 1 From ThreadA: i= 2 From ThreadA: i= 3 From ThreadA: i= 4 From ThreadA: i= 5Exit from A From ThreadC: k= 1 From ThreadC: k= 2 From ThreadC: k= 3 From ThreadC: k= 4 From ThreadC: k= 5Exit from C From ThreadB: j= 1 From ThreadB: j= 2 From ThreadB: j= 3 From ThreadB: j= 4 From ThreadB: j= 5Exit from B
![Page 23: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/23.jpg)
23
Run2
[raj@mundroo] threads [1:77] java ThreadTest From ThreadA: i= 1 From ThreadA: i= 2 From ThreadA: i= 3 From ThreadA: i= 4 From ThreadA: i= 5 From ThreadC: k= 1 From ThreadC: k= 2 From ThreadC: k= 3 From ThreadC: k= 4 From ThreadC: k= 5Exit from C From ThreadB: j= 1 From ThreadB: j= 2 From ThreadB: j= 3 From ThreadB: j= 4 From ThreadB: j= 5Exit from BExit from A
![Page 24: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/24.jpg)
24
Process Parallelism
int add (int a, int b, int & result) // function stuff int sub(int a, int b, int & result) // function stuff
pthread t1, t2;
pthread-create(&t1, add, a,b, & r1);
pthread-create(&t2, sub, c,d, & r2);
pthread-par (2, t1, t2);
pthread t1, t2;
pthread-create(&t1, add, a,b, & r1);
pthread-create(&t2, sub, c,d, & r2);
pthread-par (2, t1, t2);
MISD and MIMD Processing
abr1cdr2
abr1cdr2
addadd
subsub
Processor
Data
IS1
IS2
Processor
![Page 25: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/25.jpg)
25
do““
dn/2
dn2/+1
““dn
SortSort
Data
IS
Data Parallelism
sort( int *array, int count) //...... //......
pthread-t, thread1, thread2;““pthread-create(& thread1, sort, array, N/2);pthread-create(& thread2, sort, array, N/2);pthread-par(2, thread1, thread2);
pthread-t, thread1, thread2;““pthread-create(& thread1, sort, array, N/2);pthread-create(& thread2, sort, array, N/2);pthread-par(2, thread1, thread2);
SIMD Processing
SortSort
Processor
Processor
![Page 26: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/26.jpg)
26
Next Class
Thread Priorities Thread Synchronisation
![Page 27: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/27.jpg)
27
Thread Priority
In Java, each thread is assigned priority, which affects the order in which it is scheduled for running. The threads so far had same default priority (NORM_PRIORITY) and they are served using FCFS policy. Java allows users to change priority:
ThreadName.setPriority(intNumber) MIN_PRIORITY = 1 NORM_PRIORITY=5 MAX_PRIORITY=10
![Page 28: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/28.jpg)
28
Thread Priority Example
class A extends Thread{ public void run() { System.out.println("Thread A started"); for(int i=1;i<=4;i++) { System.out.println("\t From ThreadA: i= "+i); } System.out.println("Exit from A"); }}class B extends Thread{ public void run() { System.out.println("Thread B started"); for(int j=1;j<=4;j++) { System.out.println("\t From ThreadB: j= "+j); } System.out.println("Exit from B"); }}
![Page 29: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/29.jpg)
29
Thread Priority Example
class C extends Thread{ public void run() { System.out.println("Thread C started"); for(int k=1;k<=4;k++) { System.out.println("\t From ThreadC: k= "+k); } System.out.println("Exit from C"); }}class ThreadPriority{ public static void main(String args[]) { A threadA=new A(); B threadB=new B(); C threadC=new C(); threadC.setPriority(Thread.MAX_PRIORITY); threadB.setPriority(threadA.getPriority()+1); threadA.setPriority(Thread.MIN_PRIORITY); System.out.println("Started Thread A"); threadA.start(); System.out.println("Started Thread B"); threadB.start(); System.out.println("Started Thread C"); threadC.start(); System.out.println("End of main thread"); }}
![Page 30: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/30.jpg)
30
Accessing Shared Resources
Applications Access to Shared Resources need to be coordinated. Printer (two person jobs cannot be printed at
the same time) Simultaneous operations on your bank
account. Can the following operations be done at the
same time on the same account? Deposit() Withdraw() Enquire()
![Page 31: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/31.jpg)
31
Online Bank: Serving Many Customers and Operations
Internet Bank Server
PC client
Local Area Network
PDABank
Database
![Page 32: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/32.jpg)
32
Shared Resources
If one thread tries to read the data and other thread tries to update the same date, it leads to inconsistent state.
This can be prevented by synchronising access to the data.
Use “Synchronized” method: public synchronized void update() {
… }
![Page 33: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/33.jpg)
33
the driver: 3rd Threads sharing the same object
class InternetBankingSystem { public static void main(String [] args ) { Account accountObject = new Account (); Thread t1 = new Thread(new MyThread(accountObject)); Thread t2 = new Thread(new YourThread(accountObject)); Thread t3 = new Thread(new HerThread(accountObject));
t1.start(); t2.start(); t3.start(); // DO some other operation } // end main()}
![Page 34: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/34.jpg)
34
Shared account object between 3 threads
class MyThread implements Runnable { Account account; public MyThread (Account s) { account = s;} public void run() { account.deposit(); }} // end class MyThread
class YourThread implements Runnable { Account account; public YourThread (Account s) { account = s;} public void run() { account.withdraw(); } } // end class YourThread
class HerThread implements Runnable { Account account; public HerThread (Account s) { account = s; } public void run() {account.enquire(); }} // end class HerThread
account(shared object)
![Page 35: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/35.jpg)
35
Monitor (shared object access): serializes operation on shared
objectclass Account { // the 'monitor' int balance;
// if 'synchronized' is removed, the outcome is unpredictable public synchronized void deposit( ) { // METHOD BODY : balance += deposit_amount; }
public synchronized void withdraw( ) { // METHOD BODY: balance -= deposit_amount;
} public synchronized void enquire( ) {
// METHOD BODY: display balance. }
}
![Page 36: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/36.jpg)
36
ServerThreads
Message PassingFacility
Server ProcessClient Process
Client Process
User Mode
Kernel Mode
Multithreaded ServerMultithreaded Server
![Page 37: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/37.jpg)
37
Assignment 1: Multithreaded MathServer – Demonstrate the use Sockets and
Threads
MultithreadedMathServer
(sin, cos, sqrt, etc.)
A Client ProgramWhat is sqrt(10)?
A Client ProgramWhat is sin(10)?
A Client Program in “C++”What is sin(10)?
A Client Program in “C”What is sin(10)?
“sqrt 4.0”
“2.0”
![Page 38: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/38.jpg)
38
Thread Programming models
Thread concurrency/operation models
The master/worker model The peer model A thread pipeline
![Page 39: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/39.jpg)
39
taskXtaskX
taskYtaskY
taskZtaskZ
main ( )main ( )
WorkersProgram
Files
Resources
Databases
Disks
SpecialDevices
Master
Input (Stream)
The master/worker model
![Page 40: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/40.jpg)
40
Example
main() /* the master */ { forever { get a request; switch( request ) case X: pthread_create(....,taskX); case Y: pthread_create(....,taskY); .... } } taskX() /* worker */ { perform the task, sync if accessing shared resources } taskY() /* worker */ { perform the task, sync if accessing shared resources } .... --Above runtime overhead of creating thread can be solved by thread pool * the master thread creates all worker thread at program initialization and each worker thread suspends itself immediately for a wakeup call from the master
![Page 41: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/41.jpg)
41
The peer model
taskXtaskX
taskYtaskY
WorkersProgram
Files
Resources
Databases
Disks
SpecialDevices
taskZtaskZ
InputInput
![Page 42: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/42.jpg)
42
Example
main() { pthread_create(....,thread1...taskX); pthread_create(....,thread2...taskY); .... signal all workers to start wait for all workers to finish do any cleanup } } taskX() /* worker */ { wait for start perform the task, sync if accessing shared resources } taskY() /* worker */ { wait for start perform the task, sync if accessing shared resources }
![Page 43: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/43.jpg)
43
A thread pipeline
Resources Files
Databases
Disks
Special Devices
Files
Databases
Disks
Special Devices
Files
Databases
Disks
Special Devices
Stage 1Stage 1 Stage 2Stage 2 Stage 3Stage 3
Program Filter Threads
Input (Stream)
A thread pipeline
![Page 44: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/44.jpg)
44
Examplemain()
{
pthread_create(....,stage1);
pthread_create(....,stage2);
....
wait for all pipeline threads to finish
do any cleanup
}
stage1() {
get next input for the program
do stage 1 processing of the input
pass result to next thread in pipeline
}
stage2(){
get input from previous thread in pipeline
do stage 2 processing of the input
pass result to next thread in pipeline
}
stageN()
{
get input from previous thread in pipeline
do stage N processing of the input
pass result to program output.
}
![Page 45: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/45.jpg)
45
Multithreading and Multiprocessing Deployment
issuesOn Shared and distributed
memory systems
![Page 46: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/46.jpg)
46
Process Parallelism Process Parallelism Process Parallelism Process Parallelism
P1P1
P2P2
P3P3
time
time
No of execution process more the number of CPUs
No of execution process more the number of CPUs
CPU
CPU
CPU
Multithreading - Multiprocessors
![Page 47: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/47.jpg)
47
Multithreading on Uni-processor
Concurrency Vs Parallelism Process ConcurrencyProcess Concurrency Process ConcurrencyProcess Concurrency
Number of Simultaneous execution units > number of CPUs
Number of Simultaneous execution units > number of CPUs
P1P1
P2P2
P3P3
time
time
CPU
![Page 48: 1 Multithreaded Programming using Java Threads Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software](https://reader036.vdocuments.site/reader036/viewer/2022062314/56649e995503460f94b9bc13/html5/thumbnails/48.jpg)
48
Application
Application Application
Application
CPU
Better Response Times in Multiple Application Environments
Higher Throughput for Parallelizeable Applications
CPU
CPU
CPU CPU CPU
Threaded Libraries, Multi-threaded I/OThreaded Libraries, Multi-threaded I/O
Multi-Processing (clusters & grids) and Multi-Threaded
Computing