Development teams so often find themselves rushing to get a release out on time. When it comes time for testing, the software works fine in the lab. But, when it's released, customers report a bunch of bugs. How does this happen? Why weren't the flaws found in QA?
Welcome to defect fatigue, a common issue that occurs when testers execute the same repetitive automated and manual tests and as a result, skip over or miss defects. Testers need to get creative and investigative to find these well-hidden defects before they slip past QA and into the hands of customers.
Be an Investigator and Break Things
The purpose of exploratory testing is to find defects by breaking application functionality using manual and automated techniques without repetition. The "without repetition" piece is key, and the idea is that teams test to break, rather than confirm. Testers should manipulate connectivity, security, configuration settings, and different user navigation, among others. Other techniques include:
■ creating mind maps to find testing areas to investigate
■ forcing the application to function outside the known paths
■ triggering unexpected errors to discover missing error messaging paths
■ exercising back-end processing and third-party software integrations to see what can be interrupted or failed by unexpected user actions
If an application supports different user roles, testing should be done from these different perspectives and with their respective settings. Testers can also utilize existing browser development tools to find errors that are not always visible in the application UI, and to test and edit to see how the application responds.
Consider the People Element
Testers are also people that use applications every day. They should draw on their own personal experiences with typical application defects to try and break functionality. They should also consider the habits and behaviors of the members of the software development team.
As developers and product managers work more with an application over time, they start to develop habits that may influence how they interact with the software. For example, some developers may only develop code on a local machine while others may only do code reviews instead of pre-testing in a test environment. These are work habits that can lead to defects. On the product side, many product managers habitually create user stories and requirements in the same way, unintentionally leaving out a relevant workflow or configuration setting.
Finding hidden defects requires testing against the grain rather than verifying a function performs as expected. It also requires testing all possible paths that customers might take. Crowdtesting can supplement existing techniques by using real people to serve as proxies for customers. They can test for quality, user-experience and functionality outside the lab, and provide instant, useful feedback.
Testing repeatedly only to have bugs unearthed later by customers is a frustrating and potentially costly endeavor. When testers mix existing techniques with creativity and an understanding of human behavior, they will be able to dig deeper to find bugs and friction points that ultimately improve quality and customer experience before release.
The Latest
Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...
New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...
Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...
SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...
Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...
AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...
If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...
In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...
On average, only 48% of digital initiatives enterprise-wide meet or exceed their business outcome targets according to Gartner's annual global survey of CIOs and technology executives ...
Artificial intelligence (AI) is rapidly reshaping industries around the world. From optimizing business processes to unlocking new levels of innovation, AI is a critical driver of success for modern enterprises. As a result, business leaders — from DevOps engineers to CTOs — are under pressure to incorporate AI into their workflows to stay competitive. But the question isn't whether AI should be adopted — it's how ...