Mpire: A Python package for easier and faster multiprocessing

MPIRE (MultiProcessing Is Really Easy) is a Python package for multiprocessing that offers several advantages over the default multiprocessing package. It is faster, has more features, and is more user-friendly. MPIRE combines the functionalities of multiprocessing.Pool and multiprocessing.Process, allowing for easy manipulation of worker state, insights, init and exit functions, timeouts, and progress bar functionality. It also offers features such as automatic task chunking, adjustable maximum number of active tasks, and the ability to utilize dill as a serialization backend. MPIRE has been tested on both Linux and Windows, although there are some minor known issues for Windows users.

https://github.com/sybrenjansen/mpire

To top