Machine learning models evolve. As a tester, how do we know the newer version of the model is better? How do we know that the model did not get worse in other areas? The most intuitive approach would be to design a ‘good’ labelled dataset and then calculate the evaluation score like the F1 score for the model under test. […]
Baseline Model Comparison for Performance Evaluation
Generate CPU load using Python
Problem: How do I spike up my CPU load? Recently at one of our client engagement, for one of our tests, we needed to spike up CPU usage in a controlled manner on some of our Unix servers. One way to do this was to generate a specific amount of load for a specific amount of time. This was a […]
Setting up Synthetic data in Neo4j
Qxf2 engineers are fans of using synthetic data for testing. We have used this technique for years now. But until recently, our experience was limited to SQL. We needed to work with neo4j in one of our projects. There was enough custom Python code and Cypher queries that we had to write as part of creating, backing up and restoring […]
GitHub Actions to execute tests against localhost
Do you want to setup a GitHub Actions to execute some tests against localhost at CI stage for every branch? Background In this post, we will discuss how we at Qxf2 have setup a GitHub Actions to execute selenium tests against localhost at the CI stage for every branch and the errors that we faced while setting up and how […]
XRAY server version Integration with Jira for behave BDD
Why this post XRAY is a Test management plugin for Jira. This plugin helps you automate your complete testing process. Also, it has easy integration with BDD which is something we have implemented at our client. There are server and cloud versions of XRAY. This article talks about simple methods which we implemented to get XRAY Server integration done with […]
Work Anniversary Image – Skype Bot using AWS Lambda
At Qxf2 services, we get to pick and work on any problem area (eg: Onboarding, Training, etc.) based on our interest. The one I take care of is ‘Employee Engagement. As a part of this initiative, I started congratulating employees on their work anniversary in the form of a Work Anniversary Image. Why Work Anniversary Image Skype Bot using AWS […]
Mocking date using Python freezegun library
Recently, I used freezegun library to mock date for writing unit test for microservices endpoint. This is a fairly new library and I could not find many examples online. So, I wanted to blog about my experience of using this library. Freezegun library allows our Python tests to travel through time by mocking the datetime module. Once the decorator or […]
Holiday Reminder Skype Bot
Qxf2 services provides testing services for startups, a majority of our client base is offshore so as to keep them informed about the days Qxf2 is going to be on PTO (public and optional holidays) we follow a practice of notifying them 3 to 7 days in advance. This helps in proper planning and estimating the work. Every year, Qxf2 […]
Optimize running large number of tasks using Dask
I want to share my experience of using Dask tasks and certain best practices/optimizations I implemented. Having some prior understanding about Dask is required to follow along. For implementing parallelism, I used Dask futures, one of the Dask collections. I referred Dask best practices on how to improve performance and incorporated some of them to my project. Hope you find […]
Extract message from AWS CloudWatch log record using log record pointer
This post shows you a short example of how to use the CloudWatch log record pointer to extract message from the AWS CloudWatch log record. Background Recently I have written end to end test for skype sender lambda. In the end to end test, I have compared message from AWS SQS queue with AWS CloudWatch logs. I have used log […]