Optimize running large number of tasks using Dask

I want to share my experience of using Dask tasks and certain best practices/optimizations I implemented. Having some prior understanding about Dask is required to follow along. For implementing parallelism, I used Dask futures, one of the Dask collections. I referred Dask best practices on how to improve performance and incorporated some of them to my project. Hope you find […]

Skype sender as a web service

I used the fantastic Python module Skpy to setup a ‘Skype sender’ as a web service. I did this work because I wanted to make it as easy to programmatically post to a Skype channel as it is to programmatically post to a Slack channel. If you know your channel id and have an API key, then posting a message […]

Writing a Skype listener using skpy

I implemented a Skype listener service that listens to messages posted on our common Skype channels. The Skype listener is written using an excellent Python module skpy. This listener serves as a building block for a few AI-based internal applications. This post outlines the implementation details. I hope it helps companies that still use Skype as their instant messaging tool. […]

Returning repeatable data patterns from a HTTP endpoint

In this post, I outline a technique to create repeatable data patterns that I have used when testing algorithms that operate on streaming data. Imagine an API endpoint that returns the value of a real time metric. Examples of such metrics would be CPU load or stock price or the glucose levels of a patient. An application integrating with such […]

Replace logging with Loguru

We have a bunch of logging happening in our test popular automation framework and we were using standard Python logging module. We always wanted to make our debugging process simple and make logging look pleasant. Recently we came across the Python module Loguru which provides easier file logging with rotation / retention / compression and also provides good string formatting. […]