The Testing subteam tests features and bug fixes during the first three weeks of a sprint. This is a cross-council subteam that includes members of the ArchivesSpace User Advisory and Technical Advisory Councils. The Testing subteam was created in January 2016 following a decision to split the former Features Prioritization and Testing team into two separate groups. The subteam coordinates work via email and only holds meetings when necessary. The preference for cross council teams is to have the lead and vice-lead be from different councilsFor details on how testing is conducted, see Testing Process - 2016.
Process
Testing occurs on an ad-hoc basis as JIRA issues become ready for testing or prior to any release. JIRA testing is targeted and tests only the specific issue(s) selected for testing. Full suite testing prior to a release involves testing the standard operations and workflows in ArchivesSpace.
JIRA Testing
Each issue is assigned randomly to two members of the testing team. The testers then review the issue to understand the feature request, change or fix and then test - typically in the sandbox at test.archivesspace.org. If the test is successful, then each tester will add a comment to the issue stating that the testing was successful. If the test is not successful, each tester will comment on the issue with details about how the test failed. They should include screenshots if applicable and as much information as needed so that the developers have a clear picture of the problem.
Full Suite Testing
Prior to a new release, each main section of the application is tested to ensure that any changes to ArchivesSpace do not break existing workflows. These main sections typically represent the top level areas of the application - Resources, Accessions, Archival Objects, Reports, User Management, etc. Again, each section is randomly assigned to two testers. A worksheet is provided to each tester so that they can track the results of their testing. Each tester completes the portions of the worksheet assigned to them and indicates whether the tests were successful or not. If a specific test is not successful, the tester should provide details (including screenshots if applicable) detailing how the test failed.
These worksheets can be useful for internal testing by an institution - either as a complete guide to testing or as a base for your own customized workflows.
Worksheets
- v3.1.0
- v3.0.0
- v3.0.0 Agents Module Update Information
- v3.0.0 Agents Module Lite Mode Testing
- v2.8.1
- v2.8.1 JIRA & GitHub Testing
- v2.8.0
- v2.7.0
- v2.6.0
Skills
Testing offers team members the opportunity to become very familiar with all sections of ArchivesSpace - even those that may not be part of the standard workflow at their home institution. This familiarity is essential for the full suite testing which tests the all sections of the application. JIRA testing offers a similar opportunity, though the JIRA issues are much more focused.
...