GUI acceptance tests using environment deployed from packages.

Build: #2808 failed Child of ODSRV-OZP-1998

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 856 tests in total
  • 17 tests failed
  • 12 failures are new
  • 12 tests were fixed
  • 8 tests were quarantined / skipped
  • 1113 minutes taken in total.
New test failures 12
Status Test View job Duration
Collapse Failed test_oneprovider_archives_audit_logs test_user_sees_logs_about_first_200_successfully_archived_files_and_3_directories_after_creating_archive[1oz_1op_deployed]
Oneprovider archives audit logs 3 mins
RuntimeError: no "Show audit log" found in Archive row menu
request = <FixtureRequest for <Function 'test_user_sees_logs_about_first_200_successfully_archived_files_and_3_directories_after_creating_archive[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(41 more lines...)
Collapse Failed test_onezone_basic test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Onezone basic 1 min
AssertionError: Group management should be granted but is not
selenium = {'browser_admin': <selenium.webdriver.chrome.webdriver.WebDriver (session="91c41204cb72c0453bb292a0f900d76e")>, 'browser_user2': <selenium.webdriver.chrome.webdriver.WebDriver (session="4378e8756a330b550cc12b7a51c0c1f3")>}
browser_id = 'browser_admin', member_name = 'child_group1'
member_type = 'groups', where = 'cluster'
config = 'Cluster management:\n  granted: True\nGroup management:\n  granted: True'
onepanel = <class 'tests.gui.utils.onepanel.Onepanel'>
oz_page = <class 'tests.gui.utils.onezone.OZLoggedIn'>, option = 'effective '

(154 more lines...)
Collapse Failed test_onezone_harvesters_basic test_user_successfully_leaves_harvester[1oz_1op_elasticsearch]
Onezone harvesters basic 1 min
RuntimeError: no "Leave" found in DiscoveryPage in Onezone page
request = <FixtureRequest for <Function 'test_user_successfully_leaves_harvester[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(39 more lines...)
Collapse Failed test_onezone_harvesters_basic test_user_successfully_checks_harvesting_progress[1oz_1op_elasticsearch]
Onezone harvesters basic 5 mins
RuntimeError: no "index1" found in IndicesPage in DiscoveryPage in Onezone page
request = <FixtureRequest for <Function 'test_user_successfully_checks_harvesting_progress[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(39 more lines...)
Collapse Failed test_onezone_spaces_memberships_privileges test_nonspaceowner_successfully_creates_share_if_he_got_manage_shares_privilege[1oz_1op_deployed]
Onezone spaces memberships privileges 1 min
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_nonspaceowner_successfully_creates_share_if_he_got_manage_shares_privilege[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(41 more lines...)
Collapse Failed test_shares_basic test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-[]]
Shares basic 1 min
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-[]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(49 more lines...)
Collapse Failed test_shares_basic test_user_creates_two_shares_of_one_directory_and_sees_them_in_shares_view[1oz_1op_deployed]
Shares basic 59 secs
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_creates_two_shares_of_one_directory_and_sees_them_in_shares_view[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(49 more lines...)
Collapse Failed test_shares_basic test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-["Size", "Modification"]]
Shares basic 58 secs
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_selects_desirable_columns_to_be_visible_and_can_see_only_them_in_files_table[1oz_1op_deployed-["Size", "Modification"]]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(49 more lines...)
Collapse Failed test_shares_basic test_user_cannot_enter_symlinked_directory_in_shared_directory_which_points_outside_share[1oz_1op_deployed]
Shares basic 48 secs
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_cannot_enter_symlinked_directory_in_shared_directory_which_points_outside_share[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(41 more lines...)
Collapse Failed test_shares_basic test_user_sees_shared_status_tag_for_directory_after_sharing_it[1oz_1op_deployed]
Shares basic 2 mins
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_sees_shared_status_tag_for_directory_after_sharing_it[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(41 more lines...)
Collapse Failed test_shares_basic test_user_shares_a_directory_and_opens_its_view_in_full_onezone_interface_from_modal[1oz_1op_deployed]
Shares basic 57 secs
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_shares_a_directory_and_opens_its_view_in_full_onezone_interface_from_modal[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(49 more lines...)
Collapse Failed test_shares_handle_service test_user_views_files_from_public_interface_of_share_shared_from_another_user_on_mock_handle_service[1oz_1op_handle_proxy_mock]
Shares handle service 3 mins
RuntimeError: no "Share / Publish" found in Data row menu
request = <FixtureRequest for <Function 'test_user_views_files_from_public_interface_of_share_shared_from_another_user_on_mock_handle_service[1oz_1op_handle_proxy_mock]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(49 more lines...)
Existing test failures 5
Status Test Failing since View job Duration
AssertionError: actual reason content for task: "bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-sha256.txt not found" is not as expected: "bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-md5.txt not found"
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...etch_txt.zip"-bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-md5.txt not found]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(50 more lines...)
AssertionError: There are 199 files in file browser when should be 200, file list:['file1.txt', 'file10.txt', 'file100.txt', 'file101.txt', 'file102.txt', 'file103.txt', 'file104.txt', 'file105.txt', 'file106.txt', 'file107.txt', 'file108.txt', 'file109.txt', 'file11.txt', 'file110.txt', 'file111.txt', 'file112.txt', 'file113.txt', 'file114.txt', 'file115.txt', 'file116.txt', 'file117.txt', 'file118.txt', 'file119.txt', 'file12.txt', 'file120.txt', 'file121.txt', 'file122.txt', 'file123.txt', 'file124.txt', 'file125.txt', 'file126.txt', 'file127.txt', 'file128.txt', 'file129.txt', 'file13.txt', 'file130.txt', 'file131.txt', 'file132.txt', 'file133.txt', 'file134.txt', 'file135.txt', 'file136.txt', 'file137.txt', 'file138.txt', 'file139.txt', 'file14.txt', 'file140.txt', 'file141.txt', 'file142.txt', 'file143.txt', 'file144.txt', 'file145.txt', 'file146.txt', 'file147.txt', 'file148.txt', 'file149.txt', 'file15.txt', 'file150.txt', 'file151.txt', 'file152.txt', 'file153.txt', 'file154.txt', 'file155.txt', 'file156.txt', 'file157.txt', 'file158.txt', 'file159.txt', 'file16.txt', 'file160.txt', 'file161.txt', 'file162.txt', 'file163.txt', 'file164.txt', 'file165.txt', 'file166.txt', 'file167.txt', 'file168.txt', 'file169.txt', 'file17.txt', 'file170.txt', 'file171.txt', 'file172.txt', 'file173.txt', 'file174.txt', 'file175.txt', 'file176.txt', 'file177.txt', 'file178.txt', 'file179.txt', 'file18.txt', 'file180.txt', 'file181.txt', 'file182.txt', 'file183.txt', 'file184.txt', 'file185.txt', 'file186.txt', 'file187.txt', 'file188.txt', 'file189.txt', 'file19.txt', 'file190.txt', 'file191.txt', 'file192.txt', 'file193.txt', 'file194.txt', 'file195.txt', 'file196.txt', 'file197.txt', 'file198.txt', 'file199.txt', 'file2.txt', 'file20.txt', 'file21.txt', 'file22.txt', 'file23.txt', 'file24.txt', 'file25.txt', 'file26.txt', 'file27.txt', 'file28.txt', 'file29.txt', 'file3.txt', 'file30.txt', 'file31.txt', 'file32.txt', 'file33.txt', 'file34.txt', 'file35.txt', 'file36.txt', 'file37.txt', 'file38.txt', 'file39.txt', 'file4.txt', 'file40.txt', 'file41.txt', 'file42.txt', 'file43.txt', 'file44.txt', 'file45.txt', 'file46.txt', 'file47.txt', 'file48.txt', 'file49.txt', 'file5.txt', 'file50.txt', 'file51.txt', 'file52.txt', 'file53.txt', 'file54.txt', 'file55.txt', 'file56.txt', 'file57.txt', 'file58.txt', 'file59.txt', 'file6.txt', 'file60.txt', 'file61.txt', 'file62.txt', 'file63.txt', 'file64.txt', 'file65.txt', 'file66.txt', 'file67.txt', 'file68.txt', 'file69.txt', 'file7.txt', 'file70.txt', 'file71.txt', 'file72.txt', 'file73.txt', 'file74.txt', 'file75.txt', 'file76.txt', 'file77.txt', 'file78.txt', 'file79.txt', 'file8.txt', 'file80.txt', 'file81.txt', 'file82.txt', 'file83.txt', 'file84.txt', 'file85.txt', 'file86.txt', 'file87.txt', 'file88.txt', 'file89.txt', 'file9.txt', 'file90.txt', 'file91.txt', 'file92.txt', 'file93.txt', 'file94.txt', 'file95.txt', 'file96.txt', 'file97.txt', 'file98.txt', 'file99.txt']
request = <FixtureRequest for <Function 'test_user_sees_100_files_from_200_uploaded_at_the_beginning_without_refresh_after_100_of_them_were_deleted_in_another_window[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(47 more lines...)
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
AssertionError: Harvester management should be granted but is not
selenium = {'browser_admin': <selenium.webdriver.chrome.webdriver.WebDriver (session="73ec7c1e958dffc9aceae06ded32b534")>, 'browser_user2': <selenium.webdriver.chrome.webdriver.WebDriver (session="d3571a5fd06f9bf42b3849e3297ac156")>}
browser_id = 'browser_admin', member_name = 'child_group_1'
member_type = 'groups', where = 'harvester'
config = 'Harvester management:\n  granted: True\nUser management:\n  granted: False\nGroup management:\n  granted: True\nSpace management:\n  granted: False'
onepanel = <class 'tests.gui.utils.onepanel.Onepanel'>
oz_page = <class 'tests.gui.utils.onezone.OZLoggedIn'>, option = 'effective '

(154 more lines...)
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Fixed tests 12
Status Test Failing since View job Duration
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_created_workflow_while_lane_had_preparing_status[1oz_1op_openfaas]
Failing since build #2807 (Child of ODSRV-OPRPM-2494) Atm workflows status 2 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"invalid_bagit_txt.tgz"-Invalid 'Tag-File-Character-Encoding' definition in 1st line in bagit.txt]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 3 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"unsupported_archive_type.7z"-Unsupported archive type: .7z]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_manifest_file.tgz"-No manifest file found]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_data_dir.tar"-Payload directory not found]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Successful test_automation_bagit test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"valid_with_xrootd.zip"]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 3 mins
Successful test_automation_bagit test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"bagit_archive_fetch_xrootd.zip"]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 3 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_payload.zip"-Files referenced by macaroon_bag1/manifest-md5.txt do not match with payload files.\\n Files in payload but not referenced: set()\\n Files referenced but not in payload: {'data/ark-file-meta.csv'}]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 7 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"unsupported_url.zip"-URL from line number 1 in fetch.txt is not supported]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"invalid_fetch_url.zip"-File path not within data/ directory (fetch.txt line 1)]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"wrong_tagmanifest_checksums.zip"-md5 checksum verification failed for macaroon_bag1/fetch.txt.\\nExpected: 5e8594d60bc90071ae12ad9b589166be, Calculated: ceb502eb82f571ea033f743f3c3c9123]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 3 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_bagit_txt.tar"-Bagit directory not found]
Failing since build #2806 (Child of ODSRV-OPRPM-2493) Atm BagIt 4 mins
Quarantined tests 8
Status Test Failing since Quarantined by View job Duration
Successful test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2804 (Child of ODSRV-OZP-1996) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 9 mins
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 6 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 27 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 29 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 51 secs
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 48 secs