GUI acceptance tests using environment deployed from packages.

Build: #2801 failed Child of ODSRV-OPRPM-2490

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 855 tests in total
  • 2 tests failed
  • 1 failure is new
  • 8 tests were fixed
  • 8 tests were quarantined / skipped
  • 1123 minutes taken in total.
New test failures 1
Status Test View job Duration
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"wrong_tagmanifest_checksums.zip"-md5 checksum verification failed for macaroon_bag1/fetch.txt.\\nExpected: 5e8594d60bc90071ae12ad9b589166be, Calculated: ceb502eb82f571ea033f743f3c3c9123]
Atm BagIt 4 mins
AssertionError: actual reason content for task: "sha256 checksum verification failed for macaroon_bag1/fetch.txt. Expected: a4127b2d0ced5571d738917292cb64ae686bea0c016d18a66029062b43dbd7eb, Calculated: 8db8b25444ca1130c2150fe622df8aac8e5604332cd0ec84e80adb9ce90240ab" is not as expected: "md5 checksum verification failed for macaroon_bag1/fetch.txt.\nexpected: 5e8594d60bc90071ae12ad9b589166be, calculated: ceb502eb82f571ea033f743f3c3c9123"
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...caroon_bag1/fetch.txt.\\\\nExpected: 5e8594d60bc90071ae12ad9b589166be, Calculated: ceb502eb82f571ea033f743f3c3c9123]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(51 more lines...)
Existing test failures 1
Status Test Failing since View job Duration
AssertionError: Harvester management should be granted but is not
request = <FixtureRequest for <Function 'test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(32 more lines...)
Fixed tests 8
Status Test Failing since View job Duration
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_created_workflow_while_lane_had_preparing_status[1oz_1op_openfaas]
Failing since build #2799 (Child of ODSRV-OZP-1995) Atm workflows status 2 mins
Successful test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_fetch_txt.zip"-bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-md5.txt not found]
Failing since build #2799 (Child of ODSRV-OZP-1995) Atm BagIt 4 mins
Successful test_storage_sync test_user_does_not_see_files_update_when_detect_modifications_is_disabled[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 3 mins
Successful test_storage_sync test_user_sees_imported_files_after_supporting_space_and_sees_difference_when_max_depth_has_changed[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 6 mins
Successful test_storage_sync test_user_does_not_see_files_and_directories_that_have_been_removed_in_storage_mount_point_when_detect_deletions_option_was_enabled[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 3 mins
Successful test_storage_sync test_user_sees_that_directory_is_not_synchronized_automatically_when_continuous_scan_is_disabled[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 3 mins
Successful test_storage_sync test_user_sees_files_update_when_detect_modifications_is_set[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 3 mins
Successful test_storage_sync test_user_sees_that_files_are_deleted_after_synchronization_when_detect_deletions_is_enabled_and_detect_modifications_is_disabled[1oz_1op_deployed]
Failing since build #2798 (Child of ODSRV-OPRPM-2488) Storage sync 3 mins
Quarantined tests 8
Status Test Failing since Quarantined by View job Duration
Collapse Failed test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2799 (Child of ODSRV-OZP-1995) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 18 mins
AssertionError: Processing speed is 6280.315789473684 bytes per second and is lower than expected 13500 per second.
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(37 more lines...)
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 5 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 9 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 30 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 34 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 1 min
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 59 secs