MPJ Express Release 0.44

Dear MPJ Express Community, 

We are pleased to announce the next beta release (0.44) of the MPJ Express software. This release mainly introduces the Hadoop YARN runtime for MPJ Express programs. 
CHANGELOG 
   a. Port allocation has been moved to niodev.init
   b.  Build.xml is changed:
       "ant" command compiles the normal runtime
       "ant hadoop" command compiles the MPJ YARN runtime 
   c.  Unlike earlier versions, by passing the runtime and manually starting the
        processes is removed.
   d.  For running MPJ programs on Hadoop clusters, refer to "yarnguide.pdf"
        in $MPJ_HOME/doc folder 
You may download the new version of MPJ Express from

http://mpjexpress.org/

Feel free to contact us in case of any queries.

Best Regards,

MPJ Express Team

MPJ Express Release 0.43

Dear MPJ Express Community, 

We are pleased to announce the next beta release (0.43) of the MPJ Express software. This release mainly introduces optimized collective communication primitives added in MPJ Express to improve pure Java collective communication performance. Some minor bugs are also fixed. 

CHANGELOG 

1. This release mainly introduces optimized collective communication primitives added in MPJ Express to improve pure Java collective communication performance. Minimum Spanning Tree (MST) and Bucket or Cyclic Algorithms (BKT) are used to implement optimized collectives. Following collective communication primitives are updated: 

     a. Broadcast updated to Minimum Spanning Tree implementation. 

     b. Gather updated to Minimum Spanning Tree implementation for Small Data Size 0 - 16 KB and Flat Tree (old) implementation for Large Data Size > 16 KB. 

     c. Scatter updated to Minimum Spanning Tree implementation for Small Data Size 0 - 16 KB and Flat Tree (old) implementation for Large Data Size > 16 KB. 

     d. Allgather updated to Bucket Algorithm implementation. 

     e. Reduce updated to Minimum Spanning Tree implementation. 

     f.  Allreduce updated to MST_Reduce + MST_Bcast implementation. 

     g. Reduce_scatter updated to Bucket Algorithm implementation. 

2. In this release $MPJ_HOME/conf/wrapper.conf is modified to $MPJ_HOME/conf/mpjexpress.conf/. Unused configurations are removed and loglevel for core libraries is added. Switch for selection of Flat Tree (old) collective communication primitives is also added. 

3. Some minor bugs are fixed. 

You may download the new version of MPJ Express from

http://mpjexpress.org/


Feel free to contact us in case of any queries.

Best Regards,

MPJ Express Team

MPJ Express Release 0.42

Dear MPJ Express Community,

We are pleased to announce the next beta release (0.42) of the MPJ Express software. This release mainly introduces updated runtime system for MPJ Express to support parallel job execution by multiple users. This version of MPJ Express supports running of parallel Java application on non-shared file systems. Parallel launching of daemons have also been introduced in this release with new scripts for daemons.

CHANGELOG
1. This release mainly introduces updated runtime system for MPJ Express to support parallel job execution by multiple users. Following are major changes to support parallel job execution in MPJ Express.
     a. Addition of multi-threaded Job launcher in MPJ Daemon. Whenever a process request posted to MPJ Daemon it launches a new thread to execute it.
     b. Java NIO Sockets are replaced with Java I/O Sockets in both MPJ Daemon and MPJRun code.
     c. Separate channels are introduced for I/O messages delivery to each job executer.
     d. Optimized mechanism for port allocation to processes for inter-process communication while distributing job on cluster. Read/Write ports are now assigned dynamically.
     e. Dynamically allocated ports are now written in mpjdev.conf file and NIODevice reads both ports from mpjdev.conf
     f. XML based process ticket has been introduced to send processes information between MPJRun and MPJDaemon.

2. This release also introduces support for using MPJ Express on non-shared file system.

3. In this release dependency of "Java Service Wrapper Project" has been removed and a new mechanism to launch daemons has been introduced. To support this new mechanism, some useful scripts have also been added in MPJ Express such as mpjstatus, mpjclean and mpjinfo.

You may download the new version of MPJ Express from

http://mpjexpress.org/


Feel free to contact us in case of any queries.

Best Regards,

-MPJ Express Team

MPJ Express support added in TAU

Dear MPJ Express Community,

MPJ Express support has been added in Tuning and Analysis Utility (TAU). MPJ Express users can now perform Profiling and Tracing of MPJ Express applications using TAU. MPJ Express Profiler has been released with latest version (0.41) of MPJ Express. TAU version 2.23.1b or higher is required by MPJ Express for Profiling and Tracing.

You may download MPJ Express from http://www.mpjexpress.org 
and TAU from http://www.cs.uoregon.edu/research/tau/tau_releases

Best Regards,

-Team MPJ Express

MPJ Express Release 0.41

Dear MPJ Express Community,

We are pleased to announce the next beta release (0.41) of the MPJ Express software. This release introduces a new communication device called native device.The goal of the native communication device is to interface the MPJ Express software with native MPI libraries (MPICH, Open MPI or MS-MPI). In this setting the bulk of messaging logic is offloaded to the underlying MPI library. This is attractive because MPJ Express can exploit latest features, like support for new interconnects and e cient collective communication algorithms of the native MPI library.
This release also introduces support for MPJ Express Profiler. The Profiler generates profiles and traces of MPJ Express applications.

CHANGELOG
1. This release mainly introduces support for using a Native MPI Implementation from MPJ Express. We call this native device.
2. This release also introduces support for MPJ Express Profiler. The Profiler generates profiles and traces of MPJ Express applications. Currently the Profiler does not support native device.
3. Major changes: $MPJ_HOME/src/mpjdev is now abstract and provides two implementations i) javampjdev and ii) natmpjdev. Intracomm is now a wrapper class that either uses PureIntracomm (for pure Java devices) or NativeIntracomm (for native decive).
4. libnatmpjdev.so is a C JNI wrapper library to call native MPI library. The source code is placed in $MPJ_HOME/src/mpjdev/natmpjdev/lib
5. Some bug fixes in runtime.

- MPJ Express Team

MPJ Express Release 0.40

Dear MPJ Express Community,

We are pleased to announce the next beta release (0.40) of the MPJ Express software. This release adds support for Eclipse based MPJ Express Debugger plugin.

CHANGELOG

1. This release mainly introduces debugging support for MPJ Express Applications using MPJ Express Debugger. MPJ Express Debugger is an Eclipse based plugin. Current version (1.0.0) of MPJ Express Debugger supports Multicore Mode, Cluster Mode and Hybrid Mode. It is developed by Rizwan Hanif, Amjad Aziz and Aleem Akhtar.


You may download the software and plugin from:

http://mpjexpress.org/

Feel free to contact us in case of any queries.


Best Regards,

Aamir Shafi
Mohsan Jameel
Ansar Javed
Bibrak Qamar
Aleem Akhtar

MPJ Express Release 0.39

Dear MPJ Express Community,

We are pleased to announce the next beta release (0.39) of the MPJ Express software. This release adds support for hybrid parallelism on cluster of multicore machines.

CHANGELOG

1. This release mainly introduces a new MPJ Express device 'hybdev' that supports hybrid parallelism on cluster of multicore machines. The device, hybdev, transparently achieves hybrid parallelism. It does not require code rewriting effort for new and existing MPJ Express applications. It is developed by Ansar Javed and Mohsan Jameel.

You may download the software from:

http://mpjexpress.org/

Feel free to contact us in case of any queries.

Best Regards,

Aamir Shafi
Mohsan Jameel
Ansar Javed
Bibrak Qamar
Aleem Akhtar