MParallel - Parallel Batch Processor

[deathcubek]

Download:
https://github.com/lordmulder/MParallel/releases

User Manual:
http://muldersoft.com/docs/mparallel_readme.html

MParallel is a batch processor with multi-threading support, i.e. it will run multiple tasks in parallel. This can be very useful, not only, to take full advantage of multi-processor (multi-core) machines.

This basic example uses MParallel to run multiple "ping" commands in parallel:

Code: Select all

MParallel.exe --count=3 ping.exe -n 16 fsf.org : ping.exe -n 16 gnu.org : ping.exe -n 16 w3c.org

A slightly more advanced example, using a command pattern to express the above command-line more elegantly:

Code: Select all

MParallel.exe --count=3 --pattern="ping.exe -n 16 {{0}}" fsf.org : gnu.org : w3c.org

It is also possible to read your commands (or the parameters for your command pattern) from a text file:

Code: Select all

MParallel.exe --count=3 --input=my_commands.txt

The content of the file "my_commands.txt" may look like this, for example:

Code: Select all

ping.exe -n 16 fsf.org
ping.exe -n 16 gnu.org
ping.exe -n 16 w3c.org

Convert all JPEG files in a directory to the PNG format, in parallel, using ImageMagick:

Code: Select all

dir /B *.jpg | MParallel.exe --stdin --no-split-lines --pattern="convert.exe \"{{0}}\" -resize 50%% \"{{0:N}}.png\""

Convert all AVI files in a directory to the MP4 format, in parallel, using FFmpeg/Libav:

Code: Select all

dir /B *.jpg | MParallel.exe --stdin --no-split-lines --pattern="ffmpeg.exe -i \"{{0}}\" -vf scale=iw*.5:ih*.5 \"{{0:N}}.mp4\""

[deathcubek]

MParallel v1.0.4:
https://github.com/lordmulder/MParallel ... /tag/1.0.4

v1.0.4 [2016-06-08]

• Added support for reading default options from a configuration file (MParallel.ini)
• Added new option --notify to play a sound as soon as all commands are completed
• Apply priority boost to MParallel "main" process by default (disabled by --no-boost)
• Documentation improvements

[webfork]

Great program, thanks for posting about it. I'm constantly amazed by how few programs have any kind of multi-threading or multi-processor capability, while so many work on 64-bit. Hopefully the open license will see this integrated with other programs.

MParallel v1.0.4:
https://github.com/lordmulder/MParallel ... /tag/1.0.4

v1.0.4 [2016-06-08]

• Added support for reading default options from a configuration file (MParallel.ini)
• Added new option --notify to play a sound as soon as all commands are completed
• Apply priority boost to MParallel "main" process by default (disabled by --no-boost)
• Documentation improvements

I'm looking at your post times and it looks like you did all that in 3 minutes.