Skip to content
Snippets Groups Projects
Commit 6e6fa64d authored by Chinthak Murali's avatar Chinthak Murali
Browse files

Update MPI Programming and Benchmarking

parent 17ba2c02
No related merge requests found
......@@ -521,6 +521,13 @@ Processes cannot run in true parallelism on a single-core system. On a single-co
Threads within the same process share the same memory space, which is more efficient for communication but requires careful synchronization to avoid race conditions.
Similar to processes, there are operating system-imposed limits on the number of threads per process and the total memory that can be allocated.
In python, no two threads from the same process can run simultaneously (parallelly) because of GIL(Global Interpreter Lock), but they can run concurrently by context switching.
However, if an I/O request is encountered, GIL is released, enabling multiple threads to execute simultaneously.
Threads are handled by the python interpreter while processes are handled by the OS. Threads are concurrent and non-parallel while processes are concurrent and parallel.
Parallelism:
Definition: Performing multiple operations simultaneously.
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment