The Darshan 2.0.0 release is now available for download. From a user’s perspective, the biggest difference is that you no longer have to run darshan-parser before darshan-job-summary.pl if you just want to see the summary report for a job. The darshan-job-summary.pl script operates directly on the binary .gz files now. We also introduced new characterization counters as well as some additional tables in the summary view. Here is the full change log:
Changelog:
- new output file format that is portable across architectures (NOTE: Darshan 1.x output files are incompatible with the tools in this release unless they were generated on a ppc32 architecture (Blue Gene))
- 8 new counters that record the rank of the fastest and slowest process that opened each shared file, along with the number of seconds and number of bytes consumed by those processes. It also reports the variance in both time and amount of data.
- new –with-jobid-env configure argument to support recording job identifiers from different schedulers
- job ID is now recorded within the Darshan log in addition to in the file name
- darshan-job-summary.pl:
- opens output files directly without using intermediate darshan-parser output
- table showing data usage per file system
- table showing I/O variance in shared files
- fixes for bugs reported by Noah Watkins:
- avoid name collision in hashing function
- divide by zero error in darshan-job-summary.pl
Darshan 2.0.0 is now available on the
download page.
The Darshan project now has a dedicated mailing list and Trac page. You can find more information in the “bug reports” tab at the top of the Darshan web site.
Changelog:
- bug fixes to darshan-gen-cc.pl and darshan-gen-cxx.pl
- basic testing of darshan-gen-cc.pl with mpich/pgi
- update autoconf so that –with-mpi argument overrides mpicc in path
- fix warnings on 64 bit machines
Darshan 1.1.15 is now available on the download page.
Changelog:
- fixed erroneous incompatibility warning when opening old logs in darshan-parser
Darshan 1.1.14 is now available on the download page.
Changelog:
- updated compiler scripts to fix link order in some cases with -lhdf5
Darshan 1.1.13 is now available on the download page.
Changelog:
- improved mapping of file records to mount points
- new page in darshan-job-summary.pl output showing timelines of file access
- bug fix to “fast” mpif90 script
- checkpoint/restart ability in parallel fsstats script
Darshan 1.1.12 is now available on the download page.
Changelog:
- Bug fix for lseek, pread, and pwrite when used in 32 applications without large file support
- Improved experimental darshan-gen-cc.pl script
- Added new experimental darshan-gen-cxx.pl script
Darshan 1.1.11 is now available on the download page.
Changelog:
- Bug fix for files that are accessed with stat() but never opened
- Work around zlib problems with 64 bit offsets on 32 bit architectures
Darshan 1.1.10 is now available on the download page.
Darshan has been successfully deployed on both the Surveyor and Intrepid BG/P systems at Argonne National Laboratory as of January 14, 2010! This means that all newly compiled applications are using Darshan by default on those systems.
Upcoming development work will be focused on how to mine the Darshan data to learn more about how users perform I/O at leadership scale.
Changelog:
- Added “fast” version of each BG/P compiler
- Added experimental scripts in test directory to run fsstats in parallel
- Kevin Harms: Added experimental utilities for loading darshan results into SQL
- Use exclusive flag when opening output file (to protect against file name collision)
- Rob Ross: updates to allow command line tools to build on Darwin
- Bug fix for pnetcdf configure problem reported by Rob Latham; darshan now always pulls in MPI_Wtime() symbol at link time
Darshan 1.1.9 is now available on the download page.