BatchJobs: batchMapQuick – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

batchMapQuick

Combination of makeRegistry, batchMap and submitJobs.

Description

Combination of makeRegistry, batchMap and submitJobs for quick computations on the cluster. Should only be used by skilled users who know what they are doing. Creates the file.dir, maps function, potentially chunks jobs and submits them.

Usage

batchMapQuick(fun, ..., more.args = list(), file.dir = NULL,
  packages = character(0L), chunk.size, n.chunks,
  chunks.as.arrayjobs = FALSE, inds, resources = list())

Arguments

`fun`	[`function`] Function to map over `...`.
`...`	[any] Arguments to vectorize over (list or vector).
`more.args`	[`list`] A list of other arguments passed to `fun`. Default is empty list.
`file.dir`	[`character`] See `makeRegistry`. Default is `NULL`, which means that it is created in the current directory under the name “bmq_[random alphanumerics]”.
`packages`	[`character`] See `makeRegistry`.
`chunk.size`	[`integer(1)`] Preferred number of jobs in each chunk. Can not be used in combination with `n.chunks`. Note that the ids will get shuffled to balance out possible run time differences. Default is not to use chunking.
`n.chunks`	[`integer(1)`] Preferred number chunks. Can not be used in combination with `chunk.size`. Note that the ids will get shuffled to balance out possible run time differences. Default is not to use chunking.
`chunks.as.arrayjobs`	[`logical(1)`] Submit chunks as array jobs? Default is `FALSE`.
`inds`	[`integer`] Indices of ids / chunks to submit. Default is all. If ids get chunked, this subsets the list of shuffled ids.
`resources`	[`list`] Required resources for all batch jobs. Default is empty list.

Value

[Registry]

BatchJobs

Batch Computing with R

v1.8

BSD_2_clause + file LICENSE

Authors

Bernd Bischl <bernd_bischl@gmx.net>, Michel Lang <michellang@gmail.com>, Henrik Bengtsson <henrikb@braju.com>

Initial release