GUI acceptance tests using environment deployed from packages.

Build: #2844 failed Child of ODSRV-OPRPM-2518

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 860 tests in total
  • 5 tests failed
  • 5 failures are new
  • 2 tests were fixed
  • 15 tests were quarantined / skipped
  • 1167 minutes taken in total.
New test failures 5
Status Test View job Duration
Collapse Failed test_atm_stores_basic test_all_workflows_from_automationexamples_are_used_in_acceptance_tests[1oz_1op_openfaas]
Atm stores basic < 1 sec
AssertionError: there are workflows not included in tests: {'substitute-placeholders-example'}
request = <FixtureRequest for <Function 'test_all_workflows_from_automationexamples_are_used_in_acceptance_tests[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Collapse Failed test_atm_workflows_stores test_user_runs_workflow_with_debug_logging_level_and_can_see_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]
Atm workflows stores 2 mins
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pytest-of-bamboo/pytest-0/test_user_runs_workflow_with_d1/browser/download'
request = <FixtureRequest for <Function 'test_user_runs_workflow_with_debug_logging_level_and_can_see_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(33 more lines...)
Collapse Failed test_atm_workflows_stores test_user_runs_workflow_with_info_logging_level_and_cannot_see_any_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]
Atm workflows stores 2 mins
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pytest-of-bamboo/pytest-0/test_user_runs_workflow_with_i1/browser/download'
request = <FixtureRequest for <Function 'test_user_runs_workflow_with_info_logging_level_and_cannot_see_any_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(31 more lines...)
Collapse Failed test_onezone_automation test_each_lambda_dump_from_automationexamples_remains_the_same_after_uploading_and_downloading_it_from_automation_inventory[1oz_1op_deployed]
Onezone automations 9 mins
RuntimeError: no "1" found in Lambda in LambdasPage in AutomationPage in Onezone page
request = <FixtureRequest for <Function 'test_each_lambda_dump_from_automationexamples_remains_the_same_after_uploading_and_downloading_it_from_automation_inventory[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(45 more lines...)
Collapse Failed test_onezone_tokens test_user_successfully_creates_access_token_with_all_caveats[1oz_2op_elasticsearch]
Onezone tokens 3 mins
selenium.common.exceptions.StaleElementReferenceException: Message: stale element reference: element is not attached to the page document   (Session info: chrome=104.0.5112.79)
request = <FixtureRequest for <Function 'test_user_successfully_creates_access_token_with_all_caveats[1oz_2op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(184 more lines...)
Fixed tests 2
Status Test Failing since View job Duration
Successful test_automation_examples_workflows_tests test_user_sees_successful_execution_of_uploaded_initializeeureka3dproject[1oz_1op_openfaas]
Failing since build #2843 (Rebuilt by Łukasz Opioła) automation-examples workflows 4 mins
Successful test_automation_examples_workflows_tests test_user_sees_successful_execution_of_uploaded_initializeeureka3dproject_with_already_created_project_in_file_browser[1oz_1op_openfaas]
Failing since build #2843 (Rebuilt by Łukasz Opioła) automation-examples workflows 5 mins
Quarantined tests 15
Status Test Failing since Quarantined by View job Duration
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_created_workflow_while_lane_had_preparing_status[1oz_1op_openfaas]
Łukasz Opioła Łukasz Opioła
Atm workflows status 4 mins
Successful test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2841 (Child of ODSRV-OZP-2012) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 10 mins
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 9 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Collapse Failed test_oneprovider_archives test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_archive_browser[1oz_1op_deployed-["State", "Creator"]]
Failing since build #2826 (Child of ODSRV-OPRPM-2508) Not quarantined Oneprovider archives 1 min
AssertionError: there is different number of columns visible: 0 than expected: 2, in archive browser
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_archive_browser[1oz_1op_deployed-["State", "Creator"]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(34 more lines...)
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 26 secs
Collapse Failed test_oneprovider_data_tab test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_file_browser[1oz_1op_deployed-["Size", "Owner"]]
Failing since build #2826 (Child of ODSRV-OPRPM-2508) Not quarantined Oneprovider data tab 1 min
AssertionError: there is different number of columns visible: 0 than expected: 2, in file browser
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_file_browser[1oz_1op_deployed-["Size", "Owner"]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(34 more lines...)
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 30 secs
Collapse Failed test_oneprovider_datasets test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_dataset_browser[1oz_1op_deployed-["Archives"]]
Failing since build #2826 (Child of ODSRV-OPRPM-2508) Not quarantined Oneprovider datasets 1 min
AssertionError: there is different number of columns visible: 0 than expected: 1, in dataset browser
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_dataset_browser[1oz_1op_deployed-["Archives"]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(34 more lines...)
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 54 secs
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 51 secs
Successful test_onezone_harvesters_effective_privileges test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Wojciech Szmelich Wojciech Szmelich
Onezone harvesters effective privileges 3 mins
Successful test_onezone_spaces_memberships_privileges test_appropriate_tabs_are_disabled_after_removing_some_of_user_privileges[1oz_1op_deployed]
Failing since build #2829 (Child of ODSRV-OZP-2007) Not quarantined Onezone spaces memberships privileges 5 mins
Collapse Failed test_shares_basic test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-["Size", "Modified"]]
Failing since build #2826 (Child of ODSRV-OPRPM-2508) Not quarantined Shares basic 1 min
AssertionError: there is different number of columns visible: 0 than expected: 2, in file browser
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-["Size", "Modified"]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(34 more lines...)