LSFCluster. This switches between
bsub < job_scriptand
bsub job_scriptto launch a
HTCondorCluster: support older
all cluster classes:
processesparameter default has changed. By default,
processes ~= sqrt(cores)so that the number of processes and the number of threads per process is roughly the same. Old default was to use one process and only threads, i.e.
0.7.0 / 2019-10-09¶
Base Dask-Jobqueue on top of the core
This is nearly complete reimplementation of the dask-jobqueue logic on top of more centralized logic. This improves standardization and adds new features, but does include the following breaking changes:
cluster.start_workersmethod has been removed. Use
cluster.stop_all_jobs()method has been removed. Please use
cancelled_jobshave been removed. These have been moved upstream to the
dask.distributed.SpecClusterclass instead as
worker_spec, as well as
nameattribute has been moved to
You can now specify jobs in
.adapt: for example
cluster.adapt(minimum_jobs=0, maximum_jobs=10). Specifying scaling in terms of jobs is generally more intuitive than in terms of Dask workers. This was part of GH#307.
Update interactive docs (GH#340)
Improve error message when cores or memory is not specified (GH#331)
Fix Python 3.5.0 support in setup.py (GH#317)
0.6.3 / 2019-08-18¶
0.6.1 / 2019-07-25¶
0.6.0 / 2019-07-06¶
0.5.0 / 2019-06-20¶
Keeping up to date with Dask and Distributed (GH#268)
Add HTCondor compatibility (GH#245)
Add the possibility to specify named configuration (:pr: 204)
Allow free configuration of Dask diagnostic_port (:pr: 192)
0.4.1 / 2018-10-18¶
Handle worker restart with clearer message (GH#138)
Better error handling on job submission failure (GH#146)
Fixed Python 2.7 error when starting workers (GH#155)
Better handling of extra scheduler options (GH#160)
Correct testing of Python 2.7 compatibility (GH#154)
Add ability to override python used to start workers (GH#167)
Internal improvements and edge cases handling (GH#97)
Possibility to specify a folder to store every job logs file (GH#145)
Require all cores on the same node for LSF (GH#177)
0.4.0 / 2018-09-06¶
Use number of worker processes as an argument to
scaleinstead of number of jobs.
Bind scheduler bokeh UI to every network interfaces by default.
Adds an OAR job queue system implementation.
Adds an LSF job queue system implementation.
Adds some convenient methods to JobQueueCluster objects: