GUI acceptance tests using environment deployed from packages.

Build: #2788 failed Child of ODSRV-OPRPM-2481

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

Test results

  • 856 tests in total
  • 3 tests failed
  • 2 failures are new
  • 16 tests were fixed
  • 8 tests were quarantined / skipped
  • 1321 minutes taken in total.
New test failures 2
Status Test View job Duration
Collapse Failed test_multiprovider_basic test_user_sees_spaces_size_stats_per_provider_after_clicking_show_statistics_then_oneprovider2_is_stopped_and_user_sees_error_message[1oz_2op_deployed]
Multiprovider basic 3 mins
tests.utils.http_exceptions.HTTPInternalServerError: [500] Internal Server Error: {"error":{"id":"internalServerError","description":"The server has encountered an error while processing this request."}}
request = <FixtureRequest for <Function 'test_user_sees_spaces_size_stats_per_provider_after_clicking_show_statistics_then_oneprovider2_is_stopped_and_user_sees_error_message[1oz_2op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(25 more lines...)
Collapse Failed test_onezone_basic test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Onezone basic 2 mins
AssertionError: User management should not be granted but it is
request = <FixtureRequest for <Function 'test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(35 more lines...)
Existing test failures 1
Status Test Failing since View job Duration
RuntimeError: cannot click on button btn in Consumer caveat popup
request = <FixtureRequest for <Function 'test_user_successfully_creates_access_token_with_all_caveats[1oz_2op_elasticsearch]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(55 more lines...)
Fixed tests 16
Status Test Failing since View job Duration
Successful test_onezone_data_discovery test_user_successfully_opens_space_of_harvested_file[1oz_1op_elasticsearch]
Failing since build #2787 (Child of ODSRV-OZP-1990) Onezone data discovery 58 secs
Successful test_onezone_data_discovery_helpers test_user_can_filter_visible_properties_of_files_records[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery helpers 58 secs
Successful test_onezone_data_discovery_helpers test_user_sees_files_records_sorted_in_order_as_was_set[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery helpers 44 secs
Successful test_onezone_data_discovery_helpers test_files_records_are_paged_for_as_many_is_given[1oz_1op_elasticsearch]
Failing since build #2781 (Child of ODSRV-OPRPM-2477) Onezone data discovery helpers 2 mins
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_by_xattrs_metadata_values[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 50 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_by_any_property_property[1oz_1op_elasticsearch]
Failing since build #2787 (Child of ODSRV-OZP-1990) Onezone data discovery querying 57 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_using_not_with_space_attribute[1oz_1op_elasticsearch]
Failing since build #2786 (Child of ODSRV-OPRPM-2480) Onezone data discovery querying 55 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_with_complex_expression[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 1 min
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_using_and[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 57 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_by_json_metadata_values[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 50 secs
Successful test_onezone_data_discovery_querying test_metadata_keys_are_harvested_when_default_index_is_set_in_gui_plugin[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 2 mins
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_by_json_metadata_value_keyword[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 48 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_using_not_with_another_property[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 54 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_by_xattrs_metadata_value_keyword[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 49 secs
Successful test_onezone_data_discovery_querying test_user_sees_appropriate_files_after_searching_using_or[1oz_1op_elasticsearch]
Failing since build #2775 (Child of ODSRV-OPRPM-2473) Onezone data discovery querying 57 secs
Successful test_onezone_harvesters_basic test_user_successfully_checks_harvesting_progress[1oz_1op_elasticsearch]
Failing since build #2778 (Child of ODSRV-OPRPM-2475) Onezone harvesters basic 2 mins
Quarantined tests 8
Status Test Failing since Quarantined by View job Duration
Collapse Failed test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2787 (Child of ODSRV-OZP-1990) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 21 mins
AssertionError: Processing speed is 9162.42857142857 bytes per second and is lower than expected 13500 per second.
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(37 more lines...)
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 5 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 5 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 29 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 32 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 2 mins
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 1 min