Tomorrow’s Testing Today

As you've seen from my blogs, I am passionate about testing, and its future.  But, barriers can make a testing environment hard to navigate.

I've brought to light issues of multiple vendors and their proprietary scripts, lack of a single repository for test results and inadequate staffing. Next on my radar is accessibility.

I discussed the concept of a single repository that can house all test results for all equipment and all engineers.  But, what good is that repository if it is not easily accessible?  Often, the people who need this database are offsite, around the world, in a different time zone or maybe just caught up in meetings.

Another issue I've highlighted is the equipment. It typically lies idle or in static operation for about 16 hours a day, plus weekends and holidays.  Seems like a giant waste of resources.

But, the Internet has changed that. With just a web-enabled interface, you have access to the world!

In my earlier blog I said I want to put the spotlight on the future of testing.  As next gen products and services evolve, the lessons from legacy testing need to be incorporated. 

The next critical issue that I have run up against, in my years in the field of testing, is the data....not the just the high-level test status themselves (Passed/Failed), but the easy access and availability of those detailed test cases, test procedures and test results. 

Many test labs rely primarily on skilled test engineers to prepare and repeatedly run hundreds or even thousands of test cases for each major test cycle, manually gathering and interpreting the results, and consistently reporting problems and progress.  So, the

question arises, how does one take the results of many tests, from multiple vendors' test equipment, which are often in separate silos and locations, and consolidate them into a meaningful report combined with logs and other resulting details from all the devices in the test?

Test organizations must collect and manage important test information manually, typically using Microsoft Office tools or some form of internally developed and maintained test management tool. Manual methods can drastically limit collaboration and reuse, and certainly restrict knowledge base sharing. Unless a concerted, manual effort is made to coordinate and distribute updated and timely test information to everyone on the team, it can be difficult to track and manage valuable test information. Test information can be lost, requiring testers to recreate the test setup from scratch.

As my earlier blog said, we're here to get a discussion on the future of testing, and what it means to legacy testing as it melds with next generation products and services. 

I have been identifying some critical issues in the field of testing.  So, we need sensible ways to address the need to ensure product integrity and quality while meeting aggressive market deadlines and coping with dynamically changing test environments. 

Today I'm going to discuss the use of equipment in test labs. Test labs have a variety of equipment to do a variety of tests.  The equipment often is from multiple vendors, each requiring proprietary scripts. To be able to automate the multiple scripts from multiple machines into one program would be a test engineer's dream come true.

No one piece of test equipment does everything well, thus many labs utilize equipment from more than one vendor.

I'd like to thank TMC for the opportunity to share some thoughts with you on the subject of testing and test automation. It is a pleasure to have this space to talk about this important topic.

As the title of this blog implies, the focus will be on the future of testing, and in particular, how to incorporate the knowledge and results of legacy testing with next generation products and services and yield substantive results. We need sensible ways to address the growing demand for better ways to ensure product integrity and quality while meeting aggressive market deadlines and coping with dynamically changing test environments. 

In order to understand the future of testing, it is important to identify some the key problems and challenges that are facing many of today's telecommunications software testers and managers. We'll discuss these challenges in some detail, and then offer some practical and effective means to deal with many of them.

My team and I have many years of hands on involvement in development and testing of advanced telecommunications products and systems.