================================================== #opnfv-functest: Functest weekly meeting March 7th ================================================== Meeting started by morgan_orange1 at 08:00:27 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/opnfv-functest/2017/opnfv-functest.2017-03-07-08.00.log.html . Meeting summary --------------- * call role (morgan_orange1, 08:00:33) * morgan Richomme (morgan_orange1, 08:00:38) * Juha Kosonen (juhak, 08:00:55) * Hideyasu Hayashi (hideyasu, 08:01:11) * Linda Wang (LindaWang, 08:01:21) * agenda for today https://wiki.opnfv.org/display/functest/Functest+Meeting (morgan_orange1, 08:01:24) * Cristina Pauna (Enea) (CristinaPauna, 08:01:41) * action points follow up (morgan_orange1, 08:02:20) * AP1: ollivier add a wiki page about review best practices (morgan_orange1, 08:02:40) * not started (but not the priority regarding the release) (morgan_orange1, 08:03:00) * ACTION: ollivier add a wiki page about review best practices (morgan_orange1, 08:03:10) * AP2: jose_lausuch update documentation for: removed healthcheck, added tempest tests (morgan_orange1, 08:03:19) * done, patch submitted and structure agreed with other test projects (morgan_orange1, 08:03:26) * AP3: contact Refstack PTL to see why only 104 / 244 tests are run (morgan_orange1, 08:03:35) * done: seems negative tests are not executed (morgan_orange1, 08:03:41) * shuya(ool) (shuya_ool, 08:03:43) * work on using refstack client rather than starting tempest suite from Tempest/rally to be done (morgan_orange1, 08:03:47) * AP4: LindaWang troubleshoot securtiy_scan issue (morgan_orange1, 08:03:54) * done, see next topic discussion (morgan_orange1, 08:04:00) * AP5: morgan_orange create a patch to exclude Doctor temporarily + add Doctor team in review (morgan_orange1, 08:04:20) * done, patch will be abandonned - first Doctor run OK on fuel (morgan_orange1, 08:04:26) * AP6: re-enable promise on the dashboard (morgan_orange1, 08:04:34) * done (morgan_orange1, 08:04:42) * AP7: morgan_orange sync joid / Steve/ Narinder for SNAPS errors on joid scenarios (morgan_orange1, 08:04:50) * partially done, os-nosdn-nofeature scenario is now fine, still bug in odl and open questions on lxd scenarios / SNAPS (see next sections) (morgan_orange1, 08:04:55) * AP8: jose_lausuch ask for a pod for weekly loops (morgan_orange1, 08:05:02) * done....see next topic (morgan_orange1, 08:05:10) * Security scanning: testbase versus feature base for python based feature projects (morgan_orange1, 08:06:36) * LINK: https://gerrit.opnfv.org/gerrit/#/c/29703/ (morgan_orange1, 08:07:55) * security scanning patch will fix security scan problem on apex results. However it reintroduced a python => bash => python we tried to exclude (morgan_orange1, 08:11:25) * LINK: https://git.opnfv.org/functest/tree/functest/opnfv_tests/features/sdnvpn.py (morgan_orange1, 08:15:07) * LINK: https://git.opnfv.org/functest/tree/functest/opnfv_tests/features/odl_sfc.py (morgan_orange1, 08:15:18) * LINK: https://gerrit.opnfv.org/gerrit/#/c/29703/2/functest/opnfv_tests/features/security_scan.py (ollivier, 08:17:00) * ACTION: morgan_orange ollivier clarify python way for feature projects inhering feature based - see impact on sfc, sdnvpn (morgan_orange1, 08:20:00) * Weekly jobs (vrouter, orchestra_ims, cloudify_ims) (morgan_orange1, 08:20:19) * first weekly job created on fuel/os-nosdn-nofeature-ha scenario (morgan_orange1, 08:20:34) * it is now possible to launch manually a weekly job , mainly to test the VNF (morgan_orange1, 08:20:53) * LINK: https://build.opnfv.org/ci/job/functest-fuel-baremetal-weekly-master/ (morgan_orange1, 08:21:07) * first attempt => problem in cloudify_ims preventing vrouter and orchestra_ims to be run (morgan_orange1, 08:21:28) * orchestra torubleshooting done on virtual server, but it seems that issues may be due to resources shortage on virtual env, tests need to be done on baremetal to confirm (morgan_orange1, 08:23:38) * weekly runs can be triggered manually though jenkins interface (today one installer/1 scenario) (morgan_orange1, 08:25:33) * LINK: https://gerrit.opnfv.org/gerrit/#/c/28609/, jose do it in this patch (SerenaFeng, 08:25:48) * LINK: https://jira.opnfv.org/browse/FUNCTEST-750 (hideyasu, 08:26:23) * issue found on vrouter, patch will be submitted today (morgan_orange1, 08:26:38) * LINK: https://jira.opnfv.org/browse/FUNCTEST-750 (morgan_orange1, 08:26:45) * Troubleshooting status (morgan_orange1, 08:27:18) * mail sent yesterday (morgan_orange1, 08:27:29) * ACTION: morgan_orange => share the mail with scenario owners (any alias?) (morgan_orange1, 08:27:38) * bug fix provided for Doctor, successfully tested on fuel (morgan_orange1, 08:27:45) * status apex (morgan_orange1, 08:27:49) * LINK: http://testresults.opnfv.org/reporting/functest/release/master/index-status-apex.html (morgan_orange1, 08:27:54) * new run this morning (48h without CI run (morgan_orange1, 08:28:00) * Jun Li (MatthewLi, 08:28:26) * security scanning: we know how to solve but discussion to solve it properly ...(see previous topic that needs follwo up by mail) (morgan_orange1, 08:28:41) * considering Doctor/Security scanning OK => 1 scenario OK for Danube nosdn-nofeature-ha (morgan_orange1, 08:28:48) * main issues: Tempest_smoke (odl_l3, bgpvpn), SNAPS (gluon), vping_ssh (bgpvpn) (morgan_orange1, 08:28:56) * bgpvpn vping_ssh pb could be linked to last ODL version? (see Manuel's mail) (morgan_orange1, 08:29:17) * fds scenario in CI but failing SNAPS so not see in the reporting page (SNAPS patch provided to supported huge page) (morgan_orange1, 08:29:24) * ACTION: juhak : give feedback on tempest_smoke error for apex scenario (morgan_orange1, 08:29:43) * status compass (morgan_orange1, 08:29:53) * LINK: http://testresults.opnfv.org/reporting/functest/release/master/index-status-compass.html (morgan_orange1, 08:29:59) * 2 scenarios OK for release: nosdn-nofeature-ha and odl_l2-nofeature-ha (morgan_orange1, 08:30:05) * main issues: tempest_smoke & rally_sanity (odl_l3), ODL (odl_l3), vping_ssh (ocl) (morgan_orange1, 08:30:12) * ACTION: juhak have a look at tempest&rally issue on odl_l3 scenario (compass) (morgan_orange1, 08:30:28) * ACTION: ollivier see what is wrong on odl_l3 scenario (morgan_orange1, 08:30:36) * status fuel (morgan_orange1, 08:30:44) * LINK: http://testresults.opnfv.org/reporting/functest/release/master/index-status-fuel.html (morgan_orange1, 08:30:52) * 6 scenarios ~ OK for Release (Doctor exluded until we got the number of iterations): nosdn-ov__kvm_dpdk_noha, nosdn-ovs (ha and noha), nosdn_nofeature (ha and noha) (morgan_orange1, 08:31:07) * CI crash when launching barometer suite (morgan_orange1, 08:31:13) * issues vping_ssh (SFC), Tempest (odl_l3, odl_l2n bgpvpn), rally_sanity (kvm), SNAPS (kvm), bgpvpn (bgpvpn) (morgan_orange1, 08:31:19) * ACTION: juhak have a look at tempest&rally issues on odl & kvm scenarios (fuel) (morgan_orange1, 08:31:58) * status joid (morgan_orange1, 08:32:04) * LINK: http://testresults.opnfv.org/reporting/functest/release/master/index-status-joid.html (morgan_orange1, 08:32:10) * 2 scenarios OK (without considering Doctor now) for Danube nosdn-nofeature (ha and noha) (morgan_orange1, 08:32:16) * main issues: vping_ssh (odl), rally_sanity (lxd), SNAPS (lxd) (morgan_orange1, 08:32:22) * k8 scenarios no tested => rto be done in E (morgan_orange1, 08:32:28) * ACTION: juhak see rally_sanity issue on lxd scenario (joid) (morgan_orange1, 08:32:43) * ACTION: steve and morgan_orange, see if SNAPS smoke is compatible with lxd (probably not...) if not exclude it (morgan_orange1, 08:34:21) * please note that a new testcase has been introduced on os-nosdn-nofeature-ha scenario called tempest devcore, it corresponds to the work mentioned by Jose last year (working with Openstack on ref NFV suite) (morgan_orange1, 08:36:02) * Danube branching (morgan_orange1, 08:36:52) * ACTION: morgan_orange create Danube branch March 10th 2PM CET (morgan_orange1, 08:39:28) * ACTION: morgan_orange adapt reporting to include Danube version (morgan_orange1, 08:39:42) * Multisite (morgan_orange1, 08:41:00) * last run 27/2 (morgan_orange1, 08:41:26) * LINK: https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/1219/console (morgan_orange1, 08:41:28) * multisite case was failing (morgan_orange1, 08:41:44) * multisite tempest cases could be executed successfully manually (morgan_orange1, 08:43:08) * ACTION: juhak troubleshooting multisite (morgan_orange1, 08:43:26) * LINK: https://build.opnfv.org/ci/job/multisite-kingbird-virtual-daily-master/ (morgan_orange1, 08:44:09) * last attempt (morgan_orange1, 08:45:01) * LINK: https://build.opnfv.org/ci/job/functest-fuel-virtual-suite-master/271/console (morgan_orange1, 08:45:02) * JIRA (morgan_orange1, 08:48:34) * I started cleaning the JIRAs (morgan_orange1, 08:48:52) * ACTION: all close the JIRA that are fixed to clarify (morgan_orange1, 08:49:14) * if task cannot be done for Danube, move them to E (morgan_orange1, 08:49:30) * JIRA shall reflect some reality... (morgan_orange1, 08:49:52) * it includes the JIRAs we created for the internships (morgan_orange1, 08:50:48) * current status: 29 open issues + 62 in the backlogs that are still tagged Danube (morgan_orange1, 08:51:57) * ACTION: morgan_orange clean JIRA for Danube (morgan_orange1, 08:52:47) * AoB (morgan_orange1, 08:52:59) * ACTION: SerenaFeng check testapi fixed are included on testresults.opnfv.org, if not apply them and maybe enable automatic mechanism now.. (morgan_orange1, 09:00:01) * tomorrow Test weekly meeting (APAC slot): with a presentation of Kumar work on VNF catalogue. Feel free to join (morgan_orange1, 09:00:36) Meeting ended at 09:01:47 UTC. Action items, by person ----------------------- * juhak * juhak : give feedback on tempest_smoke error for apex scenario * juhak have a look at tempest&rally issue on odl_l3 scenario (compass) * juhak have a look at tempest&rally issues on odl & kvm scenarios (fuel) * juhak see rally_sanity issue on lxd scenario (joid) * juhak troubleshooting multisite * ollivier * ollivier add a wiki page about review best practices * morgan_orange ollivier clarify python way for feature projects inhering feature based - see impact on sfc, sdnvpn * ollivier see what is wrong on odl_l3 scenario * SerenaFeng * SerenaFeng check testapi fixed are included on testresults.opnfv.org, if not apply them and maybe enable automatic mechanism now.. * **UNASSIGNED** * morgan_orange => share the mail with scenario owners (any alias?) * steve and morgan_orange, see if SNAPS smoke is compatible with lxd (probably not...) if not exclude it * morgan_orange create Danube branch March 10th 2PM CET * morgan_orange adapt reporting to include Danube version * all close the JIRA that are fixed to clarify * morgan_orange clean JIRA for Danube People present (lines said) --------------------------- * morgan_orange1 (165) * joehuang__ (14) * ollivier (9) * LindaWang (8) * MatthewLi (6) * juhak (5) * SerenaFeng (4) * collabot` (4) * hideyasu (4) * shuya_ool (1) * CristinaPauna (1) Generated by `MeetBot`_ 0.1.4