GUI acceptance tests using environment deployed from packages.

Build: #2766 failed Child of ODSRV-OZP-1979

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

Test results

  • 853 tests in total
  • 5 tests failed
  • 1 test was fixed
  • 11 tests were quarantined / skipped
  • 1339 minutes taken in total.
Existing test failures 5
Status Test Failing since View job Duration
AssertionError: Processing speed is 6603.029411764706 bytes per second and is lower than expected 13500 per second.
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(37 more lines...)
RuntimeError: no  item found in modals
web_elem_root = <selenium.webdriver.chrome.webdriver.WebDriver (session="873ed49f831c10a519c2eb07f64d3777")>
css_sel = '.alert-global.modal.in .modal-dialog'
err_msg = 'no  item found in modals'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(277 more lines...)
RuntimeError: no  item found in modals
web_elem_root = <selenium.webdriver.chrome.webdriver.WebDriver (session="28775d79370209a291708a36b77fea61")>
css_sel = '.alert-global.modal.in .modal-dialog'
err_msg = 'no  item found in modals'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(281 more lines...)
RuntimeError: cannot click on button btn in Consumer caveat popup
request = <FixtureRequest for <Function 'test_user_successfully_creates_access_token_with_all_caveats[1oz_2op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(55 more lines...)
RuntimeError: no  item found in modals
web_elem_root = <selenium.webdriver.chrome.webdriver.WebDriver (session="4963d412d1378d47cfa75825d6e6e77e")>
css_sel = '.alert-global.modal.in .modal-dialog'
err_msg = 'no  item found in modals'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(281 more lines...)
Fixed tests 1
Status Test Failing since View job Duration
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_created_workflow_while_lane_had_preparing_status[1oz_1op_openfaas]
Failing since build #2765 (Child of ODSRV-OPRPM-2466) Atm workflows status 4 mins
Quarantined tests 11
Status Test Failing since Quarantined by View job Duration
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-mounted]
Not quarantined automation-examples workflows 9 mins
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 10 mins
Successful test_automation_examples_workflows_tests test_user_sees_desirable_exception_in_task_auditlog_after_changing_exceptionprobability_in_echo_lambda[1oz_1op_openfaas]
Not quarantined automation-examples workflows 4 mins
Successful test_automation_examples_workflows_tests test_user_sees_exception_after_execution_of_uploaded_downloadfiles_workflow_finishes_when_using_incorrect_fetch_file[1oz_1op_openfaas]
Not quarantined automation-examples workflows 3 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 4 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 36 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 39 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 1 min
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 1 min
Successful test_onezone_groups_multiuser test_user_fails_to_leave_group_from_space_because_of_lack_in_privileges[1oz_1op_deployed]
Not quarantined Onezone groups multiuser 38 secs