#opnfv-testperf: OPNFV Test WG

Meeting summary

1. 1. hongbo (hongbo1, 15:04:31)
   2. kubi (kubi001, 15:04:47)
   3. Bryan Sullivan (bryan_att, 15:04:53)
   4. Trevor Cooper (trevc, 15:05:23)
   5. Yujun Zhang (yujunz, 15:05:43)
   6. Jose Lausuch (jose_lausuch, 15:06:00)
   7. Helen Yao (HelenYao, 15:06:18)
   8. Morgan Richomme (morgan_orange, 15:06:18)
   9. Rex (Mingjiang5, 15:06:18)
   
   
2. Test community common goals (20') https://etherpad.opnfv.org/p/TestCommunityGoals (trevc, 15:06:25)
   1. Wenjing Chu (wenjing, 15:06:52)
   2. Jing Lu (JingLu_, 15:07:35)
   3. Discuss goals and priorities for D release (trevc, 15:08:18)
   4. Was difficult to describe exactly what was in Colorado (trevc, 15:08:33)
   5. Morgan proposed making a summary (1 pager) of what is in the release (trevc, 15:09:33)
   6. isn't this type of planning for Danube already too late per the release schedule? (bryan_att, 15:11:44)
   7. Several categories are described in https://etherpad.opnfv.org/p/TestCommunityGoals ... everybody is invited to comment and add items (trevc, 15:12:18)
   8. Need to be realistic as to what can get done. If not already tasks in Danube may not be possible but we should try and get started / experimental (trevc, 15:15:29)
   9. Bryan suggests organized as common goals and assign to releases (trevc, 15:17:31)
   10. Will continue to take input and discuss until end of November and plan to take recommendations to TSC (trevc, 15:28:24)
   
   
3. Dovetail (trevc, 15:31:39)
   1. Wenjing presents on Dovetail (trevc, 15:32:34)
   2. Dovetail building test suite based on Colorado (trevc, 15:33:09)
   3. First Dovetail test suite uses Functest and Yardstick test cases (trevc, 15:34:40)
   4. for putting tests into JIRA that we can track, see https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=147&projectKey=DOVETAIL ; we need to continue the transfer of tests from the wiki to JIRA if we intend to use JIRA as a test tracking tool. (bryan_att, 15:42:23)
   5. there are many tools available for documenting and managing test cases, such as Test Link, for example. (dmcbride, 15:46:43)
   6. the set of tests on the wiki https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases are a start on a set of assertions, that on an earlier Dovetail call we agreed to start migrating to JIRA. But since that initial concept demo (the JIRA link above) no further tests have been migrated as there (AFAICT) has not been explicit agreement that we should (bryan_att, 15:48:25)
   7. ... use JIRA in this way (bryan_att, 15:48:46)
   8. So I think dovetail needs to make a specific decision as to how it intends to manage the test assertion and case lists (they will be different, as cases will cover multiple assertions typically), and we need to know who specifically is signing up to do the work of populating the initial test assertion/case databases (if in JIRA or otherwise). (bryan_att, 15:51:08)
   9. so I'm getting that we do not intend to use JIRA for management of tests (bryan_att, 16:00:46)
   10. kindly reminding that we are running out of time (yujunz, 16:02:18)
   11. to me the topic is clear - where (in what tool) are we intending to manage the set of tests and what they claim to validate (test assertions) (bryan_att, 16:03:54)
   12. if the existing mongodb database has a way to do that, it should be clarified so we can start the process of populating it with test assertions in addition to the test cases (bryan_att, 16:05:16)
   13. having some tests, and having them generate some results, is inadequate. We need to know what those tests do specifically, and measure that against what we are expecting to be covered in testing. (bryan_att, 16:06:21)
   14. I'm happy to jump in and start populating the data with other's help, if we can just agree what tool we plan to use and how within that tool we will achieve the goals of managing test coverage (bryan_att, 16:08:33)

Action items

1. (none)

People present (lines said)

1. trevc (16)
2. bryan_att (13)
3. yujunz (5)
4. HelenYao (3)
5. collabot` (3)
6. Mingjiang5 (1)
7. hongbo1 (1)
8. morgan_orange (1)
9. wenjing (1)
10. JingLu_ (1)
11. kubi001 (1)
12. jose_lausuch (1)
13. dmcbride (1)