Skip to content

Commit

Permalink
Merge pull request #10938 from easybuilders/4.2.x
Browse files Browse the repository at this point in the history
release EasyBuild v4.2.2
  • Loading branch information
migueldiascosta authored Jul 8, 2020
2 parents 8047835 + 8e84d7c commit c31bf3b
Show file tree
Hide file tree
Showing 400 changed files with 13,923 additions and 385 deletions.
71 changes: 70 additions & 1 deletion RELEASE_NOTES
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,78 @@ For more detailed information, please see the git log.

These release notes can also be consulted at http://easybuild.readthedocs.org/en/latest/Release_notes.html.

The latest version of easybuild-easyconfig provides 9,894 easyconfig files, for 1,978 different software packages,
The latest version of easybuild-easyconfig provides 10,147 easyconfig files, for 2,013 different software packages,
incl. 31 different (compiler) toolchains.

v4.2.2 (July 8th 2020)
----------------------

update/bugfix release

- added easyconfigs for 2 new toolchains:
- golf/2020a (#10672)
- intel/2020.06, based on intel/2020a but with impi 2018 update 5 (#10864)
- added example easyconfig files for 36 new software packages:
- AmrPlusPlus (#9919), arrow (#10882), attrdict (#10827), Cartopy (#10685), dm-tree (#10775), dotNET-SDK (#10661),
FLAIR (#10860), fastqsplitter (#10706), GLFW (#10709), git-extras (#10440), hl7apy (#10728), hyperopt (#10735),
IgBLAST (#10889), IntelDAAL (#9848), ichorCNA (#10595), MARS (#10691), MITObim (#10897), MUST (#10849),
mhcnuggets (#9743), PAUP (#10830), Percolator (#10665), PyBerny (#10885), poetry (#10884), pycocotools (#10806),
python-hl7 (#10673), SHAPEIT4 (#10814), SYMPHONY (#10058), SunPy (#10676), sdsl-lite (#10691),
TEtranscripts (#10909, #10921), Tombo (#10646), tensorboardX (#10774), Unidecode (#10828), WHAM (#10736), XALT (#9792),
Xvfb (#10512)
- added additional easyconfigs for various supported software packages, including:
- Armadillo 9.900.1, astropy 4.0.1, BLAST+ 2.10.1, BioPerl 1.7.7, Blitz++ 1.0.2,
Bonito 0.2.0, bokeh 2.0.2, CFITSIO 3.48, CGAL 4.14.3, CLHEP 2.4.1.3, cutadapt 2.10,
dask 2.18.1, Elk 6.3.2, GATE 9.0, GLM 0.9.9.8, GRASS 7.8.3, Geant4 10.6,
geopandas 0.8.0, giflib 5.2.1, HDF5 1.12.0, HISAT2 2.2.0, Hadoop 2.10.0,
IPython 7.15.0, inferCNV 1.2.1, Julia 1.4.2, LibSoup 2.70.0, MATIO 1.5.17,
MRtrix 3.0.0, Mathematica 12.1.1 MultiQC 1.9, NGS 2.10.5, NiBabel 3.1.0,
Nipype 1.4.2, ncbi-vdb 20.10.7, numba 0.50.0, OpenBabel 3.1.1, OpenFOAM v2006,
PDT 3.25.1, PRSice 2.3.1, ParaView 5.8.0, ParmEd 3.2.0, PyQt5 5.13.2,
Pysam 0.16.0.1, parallel 20200522, plotly.py 4.8.1, pybedtools 0.8.1,
ROOT 6.20.04, ReFrame 3.0, Roary 3.13.0, rjags 4-10, rstudio 1.3.959,
SPAdes 3.14.1, SRA-Toolkit 2.10.8, Saxon-HE 9.9.1.7, Seaborn 0.10.1,
Seurat 3.1.5, SimPEG 0.14.1, Spark 2.4.5, StringTie 2.1.3, scikit-allel 1.2.1,
scikit-learn 0.23.1, snpEff 4.3t, Valgrind 3.16.1, VarScan 2.4.4,
vsc-mympirun 5.1.0, WebKitGTK+ 2.27.4, wxPython 4.0.7.post2, zarr 2.4.0
- minor enhancements, including:
- add extensions to R 4.0.0 easyconfig: drgee + stdReg (#10833), copCAR (#10911), ngspatial (#10913), drugCombo (#10914)
- add extensions to R-bundle-Bioconductor 3.11 easyconfig: BSgenome.Cfamiliaris.UCSC.canFam3 (#10840), SingleR (#10904)
- include extra extension and support for MPI in MAFFT v7.453 and v7.470 (#10853)
- add Array::Transpose to Perl (#10878)
- various bug fixes, including:
- fix dependencies and configuration of CoinUtils ecosystem (#10450)
- fix Togl configure patch so that it completely ignores TCL_SRC_DIR and TK_SRC_DIR (#10662)
- change Xerces-C++ to official CMakeMake build (fixes missing links to curl) (#10664)
- add -fPIC to toolchainopts in easyconfig for Lua 5.3.5 with system toolchain (#10671)
- remove hardcoded X86 target in LLVM easyconfigs (#10677)
- switch to https homepage and source_urls in libGLU easyconfigs (#10686)
- add patch for h5py 2.10.0 to avoid triggering MPI_Init at import (#10687)
- add alternative checksum for pkgmaker, doRNG, cobs extension in R 3.6.0 easyconfigs (#10692)
- update UDUNITS source_urls to https sources (#10693)
- add missing M4 to netCDF-Fortran easyconfigs using 2020a toolchain (#10695, #10697)
- add Rgraphviz patch to R-bundle-Bioconductor easyconfigs (#10710)
- add M4 builddependency to SuiteSparse 2019b easyconfigs (#10720)
- make sure WHAM is built with correct compiler (#10736)
- define MAX_JOBS in easyconfigs of PyTorch from v1.1.0 to v1.4.0 (#10772)
- add dm-tree and lz4 as dependencies to Ray v0.8.4 (#10775)
- fix source URL in recent ant easyconfigs (#10790)
- bump versions of GO.gb/org.Hs.eg.db/PFAM.db extensions in Bioconductor 3.11 bundle, since sources for old versions have disappeared (#10791)
- add patch to Armadillo easyconfigs using the foss toolchain to prevent it from picking up MKL if installed system-wide (#10812)
- add missing kerneltree extension in FLAIR easyconfig (#10860)
- fix source URLs in Eigen 3.2.* (#10872) and 3.3.* (#10869) easyconfigs
- refer to issue in GitHub repo in configparser patch, since Bitbucket repo is disappearing (#10873)
- switch to github.com source URL for MetaPhlAn (#10874)
- switch to GitHub sources for ScientificPython 2.9.4 (#10875)
- switch to GitHub source URL for HPDBSCAN (#10876)
- download x265 3.2/3.3 sources from bitbucket.org/multicoreware/x265_git (#10905)
- fix download URL for libatomic in gc 7.6.12 easyconfigs (#10915)
- fix sanity_check_paths in CFITSIO-3.48-GCCcore-9.3.0.eb easyconfig (#10917)
- add missing dependencies for geopandas 0.7.0 (#10923)
- other changes:
- rename OpenPyXL 2.6.4 easyconfig to openpyxl (#10916)


v4.2.1 (May 20th 2020)
----------------------

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
##
# This is a contribution from DeepThought HPC Service, Flinders University, Adelaide, Australia
# Homepage: https://staff.flinders.edu.au/research/deep-thought
#
# Authors:: Robert Qiao <[email protected]>
# Software License:: MIT
#
# Notes::
##

easyblock = 'CmdCp'

name = 'AmrPlusPlus'
version = '2.0-20200114'
local_commit = '8afc0af5234f8e322cc0f5e40cc553ecd5c932b8'

github_account = 'meglab-metagenomics'

homepage = 'https://megares.meglab.org/amrplusplus/latest/html/v2'
description = """AmrPlusPlus v2.0 can process the raw data from the sequencer,
identify the fragments of DNA, and count them. It also provides a count of the
polymorphisms that occur in each DNA fragment with respect to the reference database.
"""

toolchain = {'name': 'GCC', 'version': '8.3.0'}

source_urls = ['https://github.com/%(github_account)s/%(name)s_v%(version_major)s/archive']
sources = [{
'download_filename': '%s.zip' % local_commit,
'filename': SOURCE_ZIP,
}]
checksums = ['04af67517b752e15b5add27f4584f8c11293a0ed1353d3c1dd60c3c6e2dcb329']

dependencies = [
('Java', '11', '', True),
('BWA', '0.7.17'),
('Trimmomatic', '0.39', '-Java-%(javashortver)s', True),
('SAMtools', '1.10'),
('Nextflow', '19.12.0', '', True),
]

local_exe_files = [
'main_AmrPlusPlus_v2.nf',
'main_AmrPlusPlus_v2_withKraken.nf',
'main_AmrPlusPlus_v2_withRGI_Kraken.nf',
'main_AmrPlusPlus_v2_withRGI.nf',
'launch_mpi_slurm.sh',
'download_minikraken.sh',
'nextflow.config'
]

local_dir = ['bin', 'data', 'docs', 'config']

local_files = [
'main_AmrPlusPlus_v2.nf',
'bin/RGI_aro_hits.py',
'bin/RGI_long_combine.py',
'bin/samtools_idxstats.py',
'bin/kraken_long_to_wide.py',
'bin/trimmomatic_stats.py'
]

skipsteps = ['configure', 'build']

files_to_copy = [
(local_exe_files, '%(installdir)s'),
(local_dir, '%(installdir)s')
]

install_cmd = "chmod +x %(installdir)s/*.nf && "
install_cmd += "chmod +x %(installdir)s/*.sh"

modextravars = {
'JAVA': '${EBROOTJAVA}/bin/java',
'BWA': '${EBROOTBWA}/bin/bwa'
}

modloadmsg = """To execute AmrPlusPlus, run:\n nextflow run $EBROOTAMRPLUSPLUS/main_AmrPlusPlus_v2.nf [options]\n"""

sanity_check_paths = {
'files': ['%s' % x for x in local_files],
'dirs': ['config']
}

moduleclass = 'bio'
28 changes: 28 additions & 0 deletions easybuild/easyconfigs/a/Armadillo/Armadillo-9.600.5-foss-2018b.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
name = 'Armadillo'
version = '9.600.5'

homepage = 'https://arma.sourceforge.net/'
description = """Armadillo is an open-source C++ linear algebra library (matrix maths) aiming towards
a good balance between speed and ease of use. Integer, floating point and complex numbers are supported,
as well as a subset of trigonometric and statistics functions."""

toolchain = {'name': 'foss', 'version': '2018b'}

source_urls = ['https://sourceforge.net/projects/arma/files']
sources = [SOURCELOWER_TAR_XZ]
patches = [
'Armadillo-9.600.5_no_mkl.patch',
]
checksums = [
'dd9cd664282f2c3483af194ceedc2fba8559e0d20f8782c640fd6f3ac7cac2bf', # source
'8288e769ceaf06da9f6870f616272c354577b1dd6f07e923fed43b22bae131b6', # Armadillo-9.600.5_no_mkl.patch
]

dependencies = [
('Boost', '1.67.0'),
('arpack-ng', '3.5.0'),
]

builddependencies = [('CMake', '3.12.1')]

moduleclass = 'numlib'
11 changes: 11 additions & 0 deletions easybuild/easyconfigs/a/Armadillo/Armadillo-9.600.5_no_mkl.patch
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
--- CMakeLists.txt.orig 2016-06-16 18:20:05.000000000 +0200
+++ CMakeLists.txt 2019-10-22 10:44:59.764711121 +0200
@@ -173,7 +173,7 @@

set(ARMA_OS unix)

- include(ARMA_FindMKL)
+ set(MKL_FOUND false)
include(ARMA_FindACMLMP)
include(ARMA_FindACML)
include(ARMA_FindOpenBLAS)
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,13 @@ toolchain = {'name': 'foss', 'version': '2019a'}

source_urls = ['https://sourceforge.net/projects/arma/files']
sources = [SOURCELOWER_TAR_XZ]
checksums = ['923f2b48974f707c9da3176aab8d370e8003de23277c17ca0e49fdf97fac08bd']
patches = [
'Armadillo-9.600.5_no_mkl.patch',
]
checksums = [
'923f2b48974f707c9da3176aab8d370e8003de23277c17ca0e49fdf97fac08bd', # src
'8288e769ceaf06da9f6870f616272c354577b1dd6f07e923fed43b22bae131b6', # Armadillo-9.600.5_no_mkl.patch
]

dependencies = [
('Boost', '1.70.0'),
Expand Down
28 changes: 28 additions & 0 deletions easybuild/easyconfigs/a/Armadillo/Armadillo-9.880.1-foss-2020a.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
name = 'Armadillo'
version = "9.880.1"

homepage = 'https://arma.sourceforge.net/'
description = """Armadillo is an open-source C++ linear algebra library (matrix maths) aiming towards
a good balance between speed and ease of use. Integer, floating point and complex numbers are supported,
as well as a subset of trigonometric and statistics functions."""

toolchain = {'name': 'foss', 'version': '2020a'}

source_urls = ['https://sourceforge.net/projects/arma/files']
sources = [SOURCELOWER_TAR_XZ]
patches = [
'Armadillo-9.600.5_no_mkl.patch',
]
checksums = [
'900f3e8d35d8b722217bed979fa618faf6f3e4f56964c887a1fce44c3d4c4b9f', # src
'8288e769ceaf06da9f6870f616272c354577b1dd6f07e923fed43b22bae131b6', # Armadillo-9.600.5_no_mkl.patch
]

dependencies = [
('Boost', '1.72.0'),
('arpack-ng', '3.7.0'),
]

builddependencies = [('CMake', '3.16.4')]

moduleclass = 'numlib'
28 changes: 28 additions & 0 deletions easybuild/easyconfigs/a/Armadillo/Armadillo-9.900.1-foss-2019b.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
name = 'Armadillo'
version = "9.900.1"

homepage = 'https://arma.sourceforge.net/'
description = """Armadillo is an open-source C++ linear algebra library (matrix maths) aiming towards
a good balance between speed and ease of use. Integer, floating point and complex numbers are supported,
as well as a subset of trigonometric and statistics functions."""

toolchain = {'name': 'foss', 'version': '2019b'}

source_urls = ['https://sourceforge.net/projects/arma/files']
sources = [SOURCELOWER_TAR_XZ]
patches = [
'Armadillo-9.600.5_no_mkl.patch'
]
checksums = [
'53d7ad6124d06fdede8d839c091c649c794dae204666f1be0d30d7931737d635', # src
'8288e769ceaf06da9f6870f616272c354577b1dd6f07e923fed43b22bae131b6', # Armadillo-9.600.5_no_mkl.patch
]

dependencies = [
('Boost', '1.71.0'),
('arpack-ng', '3.7.0'),
]

builddependencies = [('CMake', '3.15.3')]

moduleclass = 'numlib'
28 changes: 28 additions & 0 deletions easybuild/easyconfigs/a/Armadillo/Armadillo-9.900.1-foss-2020a.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
name = 'Armadillo'
version = "9.900.1"

homepage = 'https://arma.sourceforge.net/'
description = """Armadillo is an open-source C++ linear algebra library (matrix maths) aiming towards
a good balance between speed and ease of use. Integer, floating point and complex numbers are supported,
as well as a subset of trigonometric and statistics functions."""

toolchain = {'name': 'foss', 'version': '2020a'}

source_urls = ['https://sourceforge.net/projects/arma/files']
sources = [SOURCELOWER_TAR_XZ]
patches = [
'Armadillo-9.600.5_no_mkl.patch'
]
checksums = [
'53d7ad6124d06fdede8d839c091c649c794dae204666f1be0d30d7931737d635', # src
'8288e769ceaf06da9f6870f616272c354577b1dd6f07e923fed43b22bae131b6', # Armadillo-9.600.5_no_mkl.patch
]

dependencies = [
('Boost', '1.72.0'),
('arpack-ng', '3.7.0'),
]

builddependencies = [('CMake', '3.16.4')]

moduleclass = 'numlib'
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
easyblock = 'CMakeMake'

name = 'Arrow'
version = '0.17.1'
versionsuffix = '-Python-%(pyver)s'

homepage = 'https://arrow.apache.org'
description = """Apache Arrow (incl. PyArrow Python bindings)), a cross-language development platform
for in-memory data."""

toolchain = {'name': 'foss', 'version': '2020a'}

source_urls = [
'http://apache.belnet.be/arrow/arrow-%(version)s/',
'https://www-eu.apache.org/dist/arrow/arrow-%(version)s/',
]
sources = ['apache-arrow-%(version)s.tar.gz']
patches = ['Arrow-0.16.0_fix-intel.patch']
checksums = [
'cbc51c343bca08b10f7f1b2ef15cb15057c30e5e9017cfcee18337b7e2da9ea2', # apache-arrow-0.17.1.tar.gz
'7c1569087f93959a0dfc163d80e5f542edb4d7ed0b9d71a2a05b4081211ad2b9', # Arrow-0.16.0_fix-intel.patch
]

builddependencies = [
('CMake', '3.16.4'),
('Autotools', '20180311'),
('flex', '2.6.4'),
('Bison', '3.5.3'),
('pkg-config', '0.29.2'),
]

# Arrow strongly prefers included jemalloc, so not including it as a dependency
dependencies = [
('Python', '3.8.2'),
('SciPy-bundle', '2020.03', versionsuffix), # for numpy
('Boost', '1.72.0'),
]

separate_build_dir = True
start_dir = 'cpp'

# see https://arrow.apache.org/docs/python/development.html
configopts = "-DCMAKE_BUILD_TYPE=Release -DARROW_PYTHON=on -DARROW_PARQUET=ON -DARROW_WITH_SNAPPY=ON "
configopts += "-DCMAKE_INSTALL_LIBDIR=lib"

# also install Python bindings
local_install_pyarrow_cmds = "export PKG_CONFIG_PATH=%(installdir)s/lib/pkgconfig:$PKG_CONFIG_PATH && "
local_install_pyarrow_cmds += "export PYTHONPATH=%(installdir)s/lib/python%(pyshortver)s/site-packages:$PYTHONPATH && "
local_install_pyarrow_cmds += "cd %(builddir)s/*arrow-%(version)s/python && export XDG_CACHE_HOME=$TMPDIR && "
local_install_pyarrow_cmds += "sed -i 's/numpy==[0-9.]*/numpy/g' pyproject.toml && "
local_install_pyarrow_cmds += "PYARROW_WITH_PARQUET=1 pip install --prefix %(installdir)s ."
postinstallcmds = [local_install_pyarrow_cmds]

modextrapaths = {'PYTHONPATH': 'lib/python%(pyshortver)s/site-packages'}

sanity_check_paths = {
'files': ['lib/libarrow.a', 'lib/libarrow.%s' % SHLIB_EXT,
'lib/libarrow_python.a', 'lib/libarrow_python.%s' % SHLIB_EXT],
'dirs': ['include/arrow', 'lib/cmake/arrow', 'lib/pkgconfig', 'lib/python%(pyshortver)s/site-packages'],
}

sanity_check_commands = [
"python -c 'import pyarrow'",
"python -c 'import pyarrow.parquet'",
]

moduleclass = 'data'
Loading

0 comments on commit c31bf3b

Please sign in to comment.