GUI acceptance tests using environment deployed from packages.

Build: #2806 failed Child of ODSRV-OPRPM-2493

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 855 tests in total
  • 21 tests failed
  • 15 failures are new
  • 1 test was fixed
  • 8 tests were quarantined / skipped
  • 1056 minutes taken in total.
New test failures 15
Status Test View job Duration
Collapse Failed test_automation_bagit test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"bagit_archive_fetch_xrootd.zip"]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"bagit_archive_fetch_xrootd.zip"]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"wrong_tagmanifest_checksums.zip"-md5 checksum verification failed for macaroon_bag1/fetch.txt.\\nExpected: 5e8594d60bc90071ae12ad9b589166be, Calculated: ceb502eb82f571ea033f743f3c3c9123]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...caroon_bag1/fetch.txt.\\\\nExpected: 5e8594d60bc90071ae12ad9b589166be, Calculated: ceb502eb82f571ea033f743f3c3c9123]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"invalid_bagit_txt.tgz"-Invalid 'Tag-File-Character-Encoding' definition in 1st line in bagit.txt]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...oz_1op_openfaas-"invalid_bagit_txt.tgz"-Invalid \'Tag-File-Character-Encoding\' definition in 1st line in bagit.txt]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_manifest_file.tgz"-No manifest file found]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_manifest_file.tgz"-No manifest file found]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_data_dir.tar"-Payload directory not found]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_data_dir.tar"-Payload directory not found]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"valid_with_xrootd.zip"]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_xrootd_file_in_file_browser_after_execution_of_uploaded_bagituploader_with_xrootd_archive[1oz_1op_openfaas-"valid_with_xrootd.zip"]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_fetch_txt.zip"-bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-md5.txt not found]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...etch_txt.zip"-bagit_missing_fetch_txt/fetch.txt referenced by bagit_missing_fetch_txt/tagmanifest-md5.txt not found]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_payload.zip"-Files referenced by macaroon_bag1/manifest-md5.txt do not match with payload files.\\n Files in payload but not referenced: set()\\n Files referenced but not in payload: {'data/ark-file-meta.csv'}]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...ch with payload files.\\\\n  Files in payload but not referenced: set()\\\\n  Files referenced but not in payload: ]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_bagit_txt.tar"-Bagit directory not found]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"missing_bagit_txt.tar"-Bagit directory not found]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"invalid_fetch_url.zip"-File path not within data/ directory (fetch.txt line 1)]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with...ive__input_archive[1oz_1op_openfaas-"invalid_fetch_url.zip"-File path not within data/ directory (fetch.txt line 1)]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"unsupported_url.zip"-URL from line number 1 in fetch.txt is not supported]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with..._archive__input_archive[1oz_1op_openfaas-"unsupported_url.zip"-URL from line number 1 in fetch.txt is not supported]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_automation_bagit test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"unsupported_archive_type.7z"-Unsupported archive type: .7z]
Atm BagIt 1 min
Exception: Files: ['dir1'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_audit_log_after_executing_bagituploader_with_invalid_archive__input_archive[1oz_1op_openfaas-"unsupported_archive_type.7z"-Unsupported archive type: .7z]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Collapse Failed test_onezone_data_discovery test_user_successfully_opens_space_of_harvested_file[1oz_1op_elasticsearch]
Onezone data discovery 2 mins
IndexError: list index out of range
request = <FixtureRequest for <Function 'test_user_successfully_opens_space_of_harvested_file[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Collapse Failed test_onezone_harvesters_basic test_user_successfully_leaves_harvester[1oz_1op_elasticsearch]
Onezone harvesters basic 1 min
RuntimeError: no "Leave" found in DiscoveryPage in Onezone page
request = <FixtureRequest for <Function 'test_user_successfully_leaves_harvester[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(39 more lines...)
Collapse Failed test_onezone_harvesters_basic test_user_successfully_renames_harvester[1oz_1op_elasticsearch]
Onezone harvesters basic 1 min
RuntimeError: no "Rename" found in DiscoveryPage in Onezone page
request = <FixtureRequest for <Function 'test_user_successfully_renames_harvester[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(39 more lines...)
Existing test failures 6
Status Test Failing since View job Duration
Exception: Files: ['example_image.jpg'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_information_in_file_metadata_after_execution_of_uploaded_detectfilemimeformats_workflow_and_input_file_example_file_name[1oz_1op_openfaas-"example_image.jpg"-image/jpeg]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Exception: Files: ['example_python_script'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_information_in_file_metadata_after_execution_of_uploaded_detec...xample_file_name[1oz_1op_openfaas-"example_python_script"-text/x-script.python-Python script, ASCII text executable]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Exception: Files: ['example_python_script.py'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_information_in_file_metadata_after_execution_of_uploaded_detectfilemimeformats_workflow_and_input_file_example_file_name[1oz_1op_openfaas-"example_python_script.py"-text/x-python]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Exception: Files: ['example_cpp_script'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_desirable_information_in_file_metadata_after_execution_of_uploaded_detec...s_workflow_and_input_file_example_file_name[1oz_1op_openfaas-"example_cpp_script"-text/x-c++-C++ source, ASCII text]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
ValueError: invalid literal for int() with base 10: '?'
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Fixed tests 1
Status Test Failing since View job Duration
Successful test_oneprovider_archives_audit_logs test_user_sees_logs_about_first_200_successfully_archived_files_and_3_directories_after_creating_archive[1oz_1op_deployed]
Failing since build #2805 (Child of ODSRV-OZP-1997) Oneprovider archives audit logs 4 mins
Quarantined tests 8
Status Test Failing since Quarantined by View job Duration
Collapse Failed test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2804 (Child of ODSRV-OZP-1996) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 1 min
Exception: Files: ['bagit_archive_unpack.tar'] as initial value for workflow was not selected
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(30 more lines...)
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 5 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 27 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 29 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 52 secs
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 51 secs