The Automated Testing Handbook
by Linda G. Hayes
The Automated Testing Handbook
The Automated Testing Handbook About the Author Introduction Why automate? When not to automate How not to automate Setting realistic expectations Getting and keeping management commitment Terminology Fundamentals of Test Automation Maintainability Optimization Independence Modularity Context Synchronization Documentation The Test Framework Common functions Standard tests Test templates Application Map Test Library Management Change Control Version Control Configuration Management 1 3 3 4 8 9 10 15 17 19 20 22 23 25 26 29 30 32 32 37 39 41 44 44 45 46
Selecting a Test Automation Approach Capture/Playback Structure Advantages Disadvantages Comparison Considerations Data Considerations Data-Driven Structure Advantages Disadvantages Data Considerations Table-Driven Structure Advantages Disadvantages The Test Automation Process The Test Team Test Automation Plan Planning the Test Cycle Test Suite Design Test Cycle Design Test Execution Test log Error log Analyzing Results Inaccurate results Defect tracking Test Metrics Management Reporting Historical trends
48 50 51 52 52 55 57 58 60 61 62 63 64 65 66 69 70 70 73 76 77 79 81 81 84 85 85 87 88 95 97
Page 2 The Automated Testing Handbook
About the Author
Linda G. Hayes is an accountant and tax lawyer who has founded three software companies, including AutoTester - developer of the first PC-based test automation tool, and Worksoft – developer of the next generation of test automation solutions. She is an award-winning author and popular speaker on software quality. She has been a columnist continuously since 1996 in publications including Computerworld , Datamation and StickyMinds and her work has been reprinted for universities and the Auerbach Systems Handbook. She co-edited Dare to be Excellent with Alka Jarvis on best practices and has published numerous articles on software development and testing. But most importantly she brings two decades of personal experience with thousands of people and hundreds of companies that is distilled into practical advice.
The risk of software failure has never been greater. The estimated annual economic impact ranges from $60 billion for poor testing to $100 billion in lost revenues and increased costs. Unfortunately, market pressure for the delivery of new functionality and applications has also never been stronger. This combination creates increasing pressure on software test organizations to improve test coverage while meeting ever-shorter deadlines with static or even declining resources. The only practical means to achieving quality goals within the constraints of schedules and budgets is to automate.
About the Author Page 3
Since software testing is a labor-intensive task, especially if done thoroughly, automation sounds instantly appealing. But, as with anything, there is a cost associated with getting the benefits. Automation isn’t always a good idea, and sometimes manual testing is out of the question. The key is to know what the benefits and costs really are, then to make an informed decision about what is best for your circumstances. The unfortunate fact is that many test automation projects fail, even after significant expenditures of time, money and resources. The goal of this book is to improve your chances of being among the successful.
The need for speed is practically the mantra of the information age. Because technology is now being used as a competitive weapon on the front lines of customer interaction, delivery schedules are subject to market pressures. Late products can lose revenue, customers, and market share. But economic pressures also demand resource and cost reductions as well, leading many companies to adopt automation to reduce time to market as well as cut testing budgets.
While it might be costly to be late to the market, it can be catastrophic to deliver a...
Please join StudyMode to read the full document