“Zero-touch” performance testing slashes release cycle time and cloud costs
Overview
The leading global provider of legal and business information/analytics needed to solve two parallel performance testing–related problems with one solution. First, they wanted to automate performance testing into their CI/CD pipelines. The company’s existing legacy tool (LoadRunner) was not only expensive; it also hindered their ability to become more agile, reduce test cycles, and promote collaboration between Dev and QA teams. Second, the cost of AWS resources dedicated to testing had to be driven down.
The company’s information network contains over three petabytes of legal and news data, with 128 billion documents from 60,000 sources. Each day the service processes more than 40 million documents and 77 million public records, with more than 1 trillion connections across all content types. With the ever-increasing volume of online research (both number of global users and amount of content) and the company’s innovative powerful data visualization and predictive analytical tools, the company knew they needed to move to the cloud.
他們的技術服務合作夥伴認識到，將公司的數據庫服務轉換為AWS雲體係結構並關閉其遺留的大型機和服務器。使用雲中托管的所有應用程序，它們利用AWS自動縮放，從而在更高級用戶活動期間自動增加彈性計算雲（EC2）實例的數量，然後在不需要時降低容量。
However, the company was concerned about how they were using AWS resources for their performance testing. Either there was no capacity for controllers and load generators when needed, or the company was paying for “idle” resources that were not being used optimally (especially during non-testing hours).
挑戰
- 需要雲就緒解決方案 - 所有應用程序已被遷移到AWS
- Lower costs of cloud testing resources
- Better ROI than existing performance testing solution (LoadRunner)
- 減少手動努力並加速測試周期
- 在CI / CD管道中自動化性能測試
- 與Git的集成,詹金斯,AWS CLI
Solution
認識推薦Tricentis NeoLoad以更快，更簡單的測試設計和維護，更高的自動化功能，與CI / CD工具的無縫集成以及能力有效地優化雲資源。
Cloud-resource costs brought under control
該公司利用NeoLoad的內置功能和本機集成來動態管理測試基礎架構，從始終如一地播放到必要的方法。
When a test is run through NeoLoad, controllers and load generators are dynamically spun up for the test duration and released once the test is finished. The AWS testing resources are automatically provisioned within minutes of executing a test on demand and shut down once the test is complete. With NeoLoad, nobody needs to write lengthy scripts to provision machines, manually connect dynamic testing resources to CI pipelines, or manually change the number of load generators used for a test.
NeoLoad also natively interacts with container orchestrators such as Kubernetes, OpenShift, Microsoft AKS, Amazon EKS, and Google GKE to provision and use load testing infrastructure automatically, on demand.
Further controlling costs, the NeoLoad license is used only when needed. When one team is finished with its test, another team can lease the license to execute its test.
該公司在NeoLoad上實現了SWS托管費用的80％。
Tricentis NeoLoad賦予世界領先的法律和商業研究公司，為其100％基於雲的應用環境進行性能測試的Devops方法。
“We realized an 80% savings on our AWS hosting costs with Tricentis NeoLoad.”
- 自動化測試領導，全球法律和商業研究公司
自動性能測試集成到CI / CD管道中
該公司實現了敏捷/換檔方法的好處 - 更容易，更快，更便宜地捕獲和解決問題，而不是以後的問題 - 通過將自動性能測試集成到CI / CD管道中。性能團隊開發了一個“零手動努力”解決方案集成Git，Jenkins和AWS與開箱即用的NeoLoad功能。
在構建部署,詹金斯工作上被觸發,automatically executing a performance test, with test results shared with stakeholders. No manual effort is required to clone the project to the Git repository or map the load generators to the test scenarios. All results are stored in NeoLoad and can be reviewed anytime during or after the test.
Additionally, again with built-in NeoLoad functionality, a second Jenkins job is triggered, creating a new controller in AWS dynamically. The latest NeoLoad project is cloned into the new controller from Git with new AWS load generators created based on the requirements. The test is executed in NeoLoad (with the license being leased based on the number of users and duration, and unleased automatically after test execution), the load generators and controller terminated post–test completion, and test reports are automatically generated to targeted stakeholders’ dashboards.
通過早期發現API性能問題，該公司能夠縮短新功能和架構的時間來解決。利用NeoLoad，他們現在可以根據每個版本或合並的SLA自動通過/失敗新功能。
“With Tricentis NeoLoad, we reduced testing cycles by 84%.”
- 自動化測試領導，全球法律和商業研究公司
Results
- Reduced AWS hosting costs by 80%
- 加速試驗周期84％
- Integrated “zero touch” automated performance testing into CI/CD pipelines
- 遷移了60個應用程序和超過100負載腳本到NeoLoad，沒有額外的努力
- Automated delivery of results analysis and reports
- Scaled multi-cloud approach increased productivity and saved costs
遺留工具的遷移不是技術挑戰
任何從LoadRunner切換到NeoLoad的組織（或他們多年來使用的任何遺留性能測試工具）都可以理解地考慮所涉及的努力水平。他們的性能工程師如何在當天沒有足夠的時間時致電時間來遷移數百個遺留腳本？這家公司采取了經過驗證的方法，抵製遷移的衝動，曾經首先隻關注最關鍵的應用程序，那麼在飛行中逐一地解決其餘的一個。他們發現的是：
- Developing a script in NeoLoad once is no more work than updating it once in LoadRunner.
- The time savings and reduced effort compound over time. Every subsequent script update in NeoLoad is significantly easier and faster.
- About 80% of legacy scripts were actually obsolete and could be discarded.
- 大多數情況（±70％）可以在幾周內遷移到NeoLoad。
該公司遷移了60個應用程序，開發/更新100個測試腳本（並丟棄約400個包含“死代碼”）的其他場景，以便在幾個月內到NeoLoad。
NeoLoad的易用性與低碼，快速測試設計以及自動腳本更新以及最佳CI / CD集成使QA和Dev團隊能夠以更大的頻率交叉合作。更快的測試腳本和自動維護導致自動化continuous performance testingat scale and speed.
底線：測試周期已減少84％