Dask Tutorial: Dask Locks, Queues, Variables, & More
In this short Dask tutorial, Matt Rocklin gives a description of Dask's coordination primitives. You will also learn about Dask Locks, Queues, Variables, and Pub/Sub.
Notebook: https://gist.github.com/mrocklin/7f84...
Sometimes situations arise where tasks, workers, or clients need to coordinate with each other in ways beyond normal task scheduling with futures. In these cases Dask provides additional primitives to help in complex situations.
Dask provides distributed versions of coordination primitives like locks, events, queues, global variables, and pub-sub systems that, where appropriate, match their in-memory counterparts. These can be used to control access to external resources, track progress of ongoing computations, or share data in side-channels between many workers, clients, and tasks sensibly.
Additional documentation for this Dask tutorial here: https://docs.dask.org/en/latest/futur...
What is Dask?
Dask is a free and open-source library for parallel computing in Python. Dask is a community project maintained by developers and organizations.
Dask helps you scale your data science and machine learning workflows. Dask also makes it easy to work with Numpy, pandas, and Scikit-Learn.
Where is Dask used?
Dask is used in climate science, energy, hydrology, meteorology, and satellite imaging. Oceanographers produce massive simulated datasets of the earth's oceans. They couldn't even look at the outputs before Dask!
What do you think of this Dask tutorial?
Share your feedback with us in the comments and let us know:
Did you find the Dask tutorial helpful?
Have you used Dask before?
Interested in learning more about Dask?
You can find documentation and more at dask.org
If you're interested in more videos just like this one, you can also check out our playlist called "Getting Started with Dask" here:
• Getting Started with Dask
KEY MOMENTS
00:00:00 Dask Locks, Queues, Variables and Pub_Sub
00:00:48 Dask Coordination Primitives
00:01:30 Global Variable
00:02:03 Create a Queue
00:03:00 Locks
00:03:56 Pub/Sub
00:04:34 Coordination Primitives with Workers
00:05:29 Performance and Centralization
In questa pagina del sito puoi guardare il video online Dask Tutorial: Dask Locks, Queues, Variables, & More della durata di ore minuti seconda in buona qualità , che l'utente ha caricato Dask 13 novembre 2019, condividi il link con amici e conoscenti, su youtube questo video è già stato visto 3,092 volte e gli è piaciuto 48 spettatori. Buona visione!
