TestRail – Get your tests organized

Problem: Many Start up companies don’t have their test cases organized

TestRail is comprehensive web-based test case management software to efficiently manage, track and organize your software testing efforts.


Why this post?

Many start ups use google docs or excel to document their test cases. Though the process may be easier and cheaper to maintain, they are not visual in nature and the problem arises as your testing team starts growing. Tracking, organizing and managing the test cases becomes challenging. That’s where a good test management tool would come in very handy. In this blog we will explore about “TestRail” a popular test management tool which can solve most of your problems related to test case management with ease.

TestRail_Collage


Overview

In this post we will cover the following:
1. TestRail Installation
2. Adding Projects
3. Test Cases and Test Suite
4. Milestone
5. Todos and Assign Test Cases
6. Test Run
7. Reports
8. Integration with Defect Tracking tool
9. TestRail API


1. TestRail Installation:
TestRail offers a 30 day free trial period using which you can checkout its rich features. You can either Download TestRail and install it on your own Server or Try the cloud/online edition of TestRail. Getting set up using the cloud edition is much easier and more popular.

Once you get the available web address along with credentials you are ready to go…


2. Adding Projects: Once you login to your TestRail account you are taken to the Dashboard page where you can see all your existing Projects and also add new Projects. As a general rule you create a new project for each of your project or actual product. You can create a new project by clicking on the Add Project link from the dashboard page and then entering the requested details on the resulting page.

Test Rail Add Project

The Project Overview page provides us lot of information like Project progress chart, Upcoming Milestones, Latest test runs, detailed history as well as the activity details

Project Overview Page


3. Test Cases and Test Suite:

In the Test Case page you can document all your Test cases. In case you have lot of test cases which need to be organized under different sections you can group related test cases under different Test suite. You can also add sub section in case you need to further organize larger test suites

Test Cases and Suites


4. Milestone:
You can use Milestone to manage your Project Milestones such as different releases, iterations etc using TestRail. Below screenshot shows a Milestone as Acceptance Test for one of our Project. You can also have Test Runs or Test Plans for Specific Milestones so that you can track the Milestone Progress

Add_Milestone

Milestone_Progress


5. Todos and Assign Test Cases:
You can assign tests to team members. You can either assign tests when a run is created or do it later from the run or test pages. Once the tests are assigned to a user it appears on the user’s todo list. Every user has their own todo list for the projects they are working on.

Testcase Assignment

Todos


6. Test Runs:
Test Run tab shows all the Test Runs that are currently active for the project. You can add a test run and by selecting all test cases for that project or select some specific tests required for that run as you wish. We can also have multiple test runs for the same test suite.

Active Test Run

Add Test Run

Test Run Status


7. Report:
Test Rail provides great reporting capabilities to share statistics with your clients or managers. You can create or schedule reports from a wide range of available templates like summary report, defect report, result report etc.
Please find below screenshot of a sample Summary report generated for one of our projects.

TestRail_Report1

TestRail_Report2

You can also email reports as links or attachments to your teams.

Email Reports


8. Integration with Defect Tracking tool: TestRail can be integrated with most of the bug tracking tools like Bugzilla, FogBugz, Gemini, Jira, Lighthouse etc. For this first you need to configure the web address of your bug tracker in TestRail. Then you can add, push or view defect details directly from TestRail.

TestRail Bug Tracker Integration

TestRail Push Defect


9. TestRail API: TestRail’s API can be used to integrate TestRail with various tools, frameworks and third-party applications. For example, many customers use the API to integrate their automated tests and submit test results to TestRail. You can refer to this link for a list of available bindings (libraries) for various programming languages.


That brings us to the end of this tutorial on TestRail. As always, we are happy to answer any questions you may have. Enjoy Testing…

Avinash Shetty
I am a software tester with over 10 years of experience in software testing. Currently I am working at Qxf2 Services Bangalore. As a student of the context-driven approach to software testing I feel there is a lot to learn out there which keeps me very excited. My work has helped me gain good experience in different areas of testing like CRM, Web, Mobile and Database testing. I have good knowledge of building test scripts using Automation tools like Selenium and Appium using Java and Python. Beside testing I am a “Sports Fanatic” and love watching and playing sports.

© 2013-2017, Avinash Shetty. All rights reserved.

5 Comments

  1. noor said:

    Hi Avinash,

    can u please help me how to create an automation testing integration with test rail.
    i have multple test cases which i need to automate these test with selenium ? \\many thanks noor

    May 29, 2016
    Reply
  2. noor said:

    hi Avinash. im new to test rail and cab u pls share to how to automate test cases with selenium web driver

    May 29, 2016
    Reply
    • Annapoorani Gurusamy Annapoorani Gurusamy said:

      Hi Noor,
      To automate test cases with selenium web driver, please refer these two links.
      i)https://qxf2.com/blog/selenium-tutorial-for-beginners/ -This link is for beginners
      ii)https://qxf2.com/blog/page-object-model-selenium-python/.
      Thank you.

      May 30, 2016
      Reply

Leave a Reply

Your email address will not be published.