I want to share my experience of using Dask tasks and certain best practices/optimizations I implemented. Having some prior understanding about Dask is required to follow along. For implementing parallelism, I used Dask futures, one of the Dask collections. I referred Dask best practices on how to improve performance and incorporated some of them to my project. Hope you find […]
Optimize running large number of tasks using Dask
Visualize chess heatmap using Dask and Coiled
I used Dask and Coiled to make some Python code I had written run in parallel. In this blog, I have described the approach used for implementing parallelism using Dask running on a coiled cluster. I had developed a Python program to generate control heatmap images for chess games. A control heatmap (a term I made up!) shows how many […]
Adding a pre-commit hook to make sure the important data do not get leaked.
One of the biggest mistakes by a human being is to expose credentials/important data unknowingly. To avoid that we should be looking for some solution. So in this blog, I am going to share the solution to avoid such mistakes. we can commit other changes we want, without any issues. What is the solution? Pre-commit hook is the solution to […]