compute(self, collections, sync=False, optimize_graph=True, workers=None, allow_other_workers=False, resources=None, retries=0, priority=0, fifo_timeout='60s', actors=None, traverse=True, **kwargs)
Collections like dask.array or dataframe or dask.value objects
Returns Futures if False (default) or concrete values if True
Whether or not to optimize the underlying graphs
A set of worker hostnames on which computations may be performed. Leave empty to default to all workers (common case)
Used with :None:None:`workers`. Indicates whether or not the computations may be performed on workers that are not in the :None:None:`workers` set(s).
Number of allowed automatic retries if computing a result fails
Optional prioritization of task. Zero is default. Higher priorities take precedence
Allowed amount of time between calls to consider the same priority
By default dask traverses builtin python collections looking for dask objects passed to compute
. For large collections this can be expensive. If none of the arguments contain any dask objects, set traverse=False
to avoid doing this traversal.
Defines the :None:None:`resources` each instance of this mapped task requires on the worker; e.g. {'GPU': 2}
. See worker resources <resources>
for details on defining resources.
Whether these tasks should exist on the worker as stateful actors. Specified on a global (True/False) or per-task ( {'x': True,
'y': False}
) basis. See actors
for additional details.
Options to pass to the graph optimize calls
Compute dask collections on cluster
Client.get
Normal synchronous dask.get function
>>> from dask import delayedThis example is valid syntax, but we were not able to check execution
... from operator import add
... x = delayed(add)(1, 2)
... y = delayed(add)(x, x)
... xx, yy = client.compute([x, y]) # doctest: +SKIP
... xx # doctest: +SKIP <Future: status: finished, key: add-8f6e709446674bad78ea8aeecfee188e>
>>> xx.result() # doctest: +SKIP 3This example is valid syntax, but we were not able to check execution
>>> yy.result() # doctest: +SKIP 6
Also support single arguments
This example is valid syntax, but we were not able to check execution>>> xx = client.compute(x) # doctest: +SKIPSee :
The following pages refer to to this document either explicitly or contain code examples using this.
distributed.client.Client.get
distributed.client.Client.persist
Hover to see nodes names; edges to Self not shown, Caped at 50 nodes.
Using a canvas is more power efficient and can get hundred of nodes ; but does not allow hyperlinks; , arrows or text (beyond on hover)
SVG is more flexible but power hungry; and does not scale well to 50 + nodes.
All aboves nodes referred to, (or are referred from) current nodes; Edges from Self to other have been omitted (or all nodes would be connected to the central node "self" which is not useful). Nodes are colored by the library they belong to, and scaled with the number of references pointing them