GUI acceptance tests using environment deployed from packages.

Build: #2812 failed Child of ODSRV-OZP-2000

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 856 tests in total
  • 4 tests failed
  • 3 failures are new
  • 8 tests were quarantined / skipped
  • 1143 minutes taken in total.
New test failures 3
Status Test View job Duration
Collapse Failed test_atm_workflows_execution test_user_sees_that_different_checksums_are_well_counted_after_execution_of_uploaded_countingdifferentchecksums_workflow[1oz_1op_openfaas]
Atm workflow execution 4 mins
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pytest-of-bamboo/pytest-0/test_user_sees_that_different_1/browser/download/file2'
request = <FixtureRequest for <Function 'test_user_sees_that_different_checksums_are_well_counted_after_execution_of_uploaded_countingdifferentchecksums_workflow[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(27 more lines...)
Collapse Failed test_onezone_harvesters_effective_privileges test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Onezone harvesters effective privileges 1 min
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Collapse Failed test_onezone_harvesters_effective_privileges test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Onezone harvesters effective privileges 3 mins
AssertionError: Harvester management should be granted but is not
selenium = {'browser_admin': <selenium.webdriver.chrome.webdriver.WebDriver (session="9c0fba3800695dcabc5114d3d3561219")>, 'browser_user2': <selenium.webdriver.chrome.webdriver.WebDriver (session="4e205d5fc16d2d49b5cc66916d15a4f2")>}
browser_id = 'browser_admin', member_name = 'child_group_1'
member_type = 'groups', where = 'harvester'
config = 'Harvester management:\n  granted: True\nUser management:\n  granted: False\nGroup management:\n  granted: True\nSpace management:\n  granted: False'
onepanel = <class 'tests.gui.utils.onepanel.Onepanel'>
oz_page = <class 'tests.gui.utils.onezone.OZLoggedIn'>, option = 'effective '

(154 more lines...)
Existing test failures 1
Status Test Failing since View job Duration
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Quarantined tests 8
Status Test Failing since Quarantined by View job Duration
Collapse Failed test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2811 (Child of ODSRV-OPRPM-2496) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 22 mins
AssertionError: Processing speed is 5315.8 bytes per second and is lower than expected 13500 per second.
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(37 more lines...)
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 5 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 6 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 30 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 32 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 54 secs
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 50 secs