概述
Marvell Technology GroupLtd. provides data infrastructure technology that keeps the world running. They move, store, process, and secure the world’s data with semiconductor solutions designed for their customers’ current needs and future ambitions. Everything they do revolves around 4 key principles: reliable results, superior performance, nimble dexterity, and rigorous execution.
更快地釋放質量優異的軟件是一個key part of advancing these goals. That’s why Marvell made testing transformation a key element of their recently-launched DevOps initiative. Specifically, they recognized that maximizing the benefits of DevOps would require an enterprise-grade test management solution with asset sharing, approval processes, integration into the DevOps pipeline, and real-time reporting on test results and quality trends. Their existing process of using Excel files to plan tests and track test results, manually coordinating test execution, then manually compiling reports upon stakeholder request was not fast, efficient, or scalable enough for their new DevOps process.
Challenges
- Thousands of tests to run on hundreds of devices for many parallel projects
- Tests were created and stored in individual Excel files
- Test results were manually transferred into Excel files
- Reports were manually compiled by reviewing Excel files, consuming an hour per report per day
- TestLink測試管理工具被收購，但不是“企業級”，並沒有提供所需的Jenkins集成
- Multiple TCM tools across different teams ( HP QC, Excel, TestLink, SpiraTest…) that were not agile enough for the new DevOps process
- Different automation frameworks and integration tools were used across multiple business units
- Each business unit was expected to provide standardized reporting on key quality metrics—no matter whattest automation toolwas being used
- Opportunities to reduce testing time, effort, and cost could free resources for innovation
在看到解決辦法如何提高Devops管道中的測試規劃和共享，標準化測試執行以及簡化的報告後，瑪維爾的QTest采用在額外的業務單位中迅速擴展了額外的業務單位。
Solution
在探索多個解決方案之後，Marvell的SSD固件團隊選擇了Tricentis QTest。而不是將測試添加到各個測試儀係統上的各個Excel文件，而是在中央存儲庫中創建和可見所有測試，並與JIRA中的要求相關，他們的需求管理係統中的要求相關。這使得團隊成員可以在創建從頭開始的新資產之前已經存在任何可重用資產。可以一目了然地跟蹤和審查批準。qtest-jenkins集成在Devops管道內實現自動測試執行，結果報告回QTest和Jira。測試結果和Marvell的關鍵質量指標（例如，從版本到版本的故障率）在自定義儀表板中可視化，使利益相關者即時洞察測試狀態並釋放準備。
在看到解決辦法如何提高Devops管道中的測試規劃和共享，標準化測試執行以及簡化的報告後，瑪維爾的QTest采用在額外的業務單位中迅速擴展了額外的業務單位。
Challenges
- Custom dashboards provide on-demand access to key metrics and trends for stakeholder review and process improvement
- Reporting is standardized across different automation frameworks and integration tools
- Test automation (unit, API, etc.) is integrated into the DevOps pipeline with Jenkins and Gerrit
- 與JIRA實時集成提供需求可追溯性
- Over 300 users were onboarded in several “waves’ of adoption
- Teams modernized test management by migrating from tools like Excel, HP QC, and TestLink
- Reports that took an hour to create are now generated automatically
- Templates streamline test planning and management, reducing rework and increasing speed