GUI acceptance tests using environment deployed from packages.

Build: #2859 failed Child of ODSRV-OPRPM-2526

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 866 tests in total
  • 36 tests were fixed
  • 32 tests were quarantined / skipped
  • 1173 minutes taken in total.
Fixed tests 36
Status Test Failing since View job Duration
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Range-Number-List-Number-range-numbers-{'start': 1, 'end': 100,'step': 10}-[1, 11, 21, 31, 41, 51, 61, 71, 81, 91]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-List-Range-List-Range-ranges-ranges-[{'start': 5, 'end': 50,'step': 5}, {'start': 1, 'end': 100,'step': 10}]-[{'start': 5, 'end': 50,'step': 5},{'start': 1, 'end': 100,'step': 10}]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-List-Boolean-List-Boolean-booleans-booleans-[true, false, true, true]-[true, false, true, true]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-List-Number-List-Number-number-numbers-[1, 2, 3]-[1, 2, 3]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 4 mins
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Single Value-String-List-String-string-strings-Sample string-["Sample string"]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_file_attributes_in_result_store_after_modifying_lambda_and_executing_uploaded_echo_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 2 mins
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-List-Boolean-Single Value-Boolean-booleans-boolean-[true, true, true]-true]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-List-Range-List-Object-ranges-range_objects-[{'start': 5, 'end': 50,'step': 5}, {'start': 1, 'end': 100,'step': 10}]-[{'start': 5, 'end': 50,'step': 5},{'start': 1, 'end': 100,'step': 10}]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Single Value-Array (Number)-Single Value-Array (Number)-numbers-array-[11, 22, 33]-[11, 22, 33]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Range-Number-Single Value-Number-range-number-{'start': 5, 'end': 50,'step': 5}-45]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Single Value-Number-Single Value-Number-number-number-111-111]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Tree forest-File-List-File-files-files-dir1-[ /space1/dir1, /space1/dir1/file2, /space1/dir1/dir2, /space1/dir1/dir2/file3, /space1/dir1/dir2/file4]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Single Value-Range-Range-Range-range-range-{'start': 5, 'end': 50,'step': 5}-{'start': 5, 'end': 50,'step': 5}]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_stores_basic test_user_sees_output_store_type_of_output_type_in_result_store_after_modifying_input_store_and_lambda_data_type_and_executing_uploaded_echo_workflow[1oz_1op_openfaas-Single Value-String-Single Value-String-string-string-Sample string-Sample string]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm stores basic 1 min
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_status_in_lane1_after_stopping_execution_of_uploaded_workflowwithsleep_workflow_while_lane1_had_preparing_status[1oz_1op_openfaas-Cancelled-Cancel]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 1 min
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_cancelled_in_lane1_and_unscheduled_in_lane2_after_cancelling_execution_of_uploaded_workflowwithsleep_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 2 mins
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_status_in_lane2_after_stopping_execution_of_uploaded_workflowwithsleep_workflow[1oz_1op_openfaas-Cancelled-Cancel]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 2 mins
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_status_in_lane1_after_stopping_execution_of_uploaded_workflowwithsleep_workflow_while_lane1_had_preparing_status[1oz_1op_openfaas-Paused-Pause]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 1 min
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_status_in_lane2_after_stopping_execution_of_uploaded_workflowwithsleep_workflow[1oz_1op_openfaas-Paused-Pause]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 2 mins
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_that_tasks_are_cancelled_after_cancelling_workflow_while_task_was_pausing[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 2 mins
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_that_workflow_is_cancelled_after_cancelling_workflow_that_is_paused[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 1 min
Successful test_atm_workflows_pausing_and_cancelling test_user_sees_status_paused_in_lane1_and_unscheduled_in_lane2_after_pausing_execution_of_created_workflowwithsleep_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows pausing and cancelling 4 mins
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_uploaded_workflow_while_first_task_had_active_status[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 2 mins
Successful test_atm_workflows_status test_user_can_not_remove_uploaded_workflowwithsleep_workflow_while_it_is_still_running[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 42 secs
Successful test_atm_workflows_status test_user_sees_lane_run_indicators_and_statuses_after_rerunning_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 1 min
Successful test_atm_workflows_status test_user_does_not_see_workflow_on_list_after_removing_uploaded_inout_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 1 min
Successful test_atm_workflows_status test_user_sees_that_workflow_task_lane_statuses_are_finished_after_execution_of_uploaded_workflow1_workflow_finishes[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 2 mins
Successful test_atm_workflows_status test_user_sees_that_lane_task_and_workflow_statuses_are_preparing_pending_and_active_in_turn_during_execution_of_uploaded_workflowwithsleeponelane_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows status 2 mins
Successful test_atm_workflows_stores test_user_runs_workflow_with_debug_logging_level_and_can_see_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]
Failing since build #2856 (Child of ODSRV-OPRPM-2525) Atm workflows stores 57 secs
Successful test_atm_workflows_stores test_user_sees_expected_results_in_result_store_after_modifying_input_store_type_to_storage_type_and_executing_uploaded_counting_checksums_workflow[1oz_1op_openfaas-Single value-file1-1-file1]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 1 min
Successful test_atm_workflows_stores test_user_sees_file_in_result_store_after_modifying_input_store_and_lambda_data_type_to_file_and_executing_uploaded_echo_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 1 min
Successful test_atm_workflows_stores test_user_sees_results_for_task_workflow_and_in_result_store_after_modifying_task_by_adding_result_mapping_in_uploaded_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 5 mins
Successful test_atm_workflows_stores test_user_runs_workflow_with_info_logging_level_and_cannot_see_any_entry_with_severity_debug_in_audit_log[1oz_1op_openfaas]
Failing since build #2856 (Child of ODSRV-OPRPM-2525) Atm workflows stores 56 secs
Successful test_atm_workflows_stores test_user_sees_expected_results_in_result_store_after_modifying_input_store_type_to_storage_type_and_executing_uploaded_counting_checksums_workflow[1oz_1op_openfaas-List-[file1, dir1, dir1/file2, dir1/dir2/file3]-4-[file1, dir1, dir1/file2, dir1/dir2/file3]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 2 mins
Successful test_atm_workflows_stores test_user_sees_list_of_datasets_in_result_store_after_modifying_input_store_data_type_to_dataset_and_executing_uploaded_echo_workflow[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 1 min
Successful test_atm_workflows_stores test_user_sees_expected_results_in_result_store_after_modifying_input_store_type_to_storage_type_and_executing_uploaded_counting_checksums_workflow[1oz_1op_openfaas-Tree forest-dir1-5-[dir1, dir1/file2, dir1/dir2, dir1/dir2/file3, dir1/dir2/file4]]
Failing since build #2857 (Child of ODSRV-OZP-2018) Atm workflows stores 2 mins
Quarantined tests 13
Status Test Failing since Quarantined by View job Duration
Successful test_atm_stores_basic test_all_workflows_from_automationexamples_are_used_in_acceptance_tests[1oz_1op_openfaas]
Not quarantined Atm stores basic < 1 sec
Successful test_atm_workflows_status test_user_resume_workflow_execution_after_pausing_execution_of_created_workflow_while_lane_had_preparing_status[1oz_1op_openfaas]
Failing since build #2857 (Child of ODSRV-OZP-2018) Łukasz Opioła Łukasz Opioła
Atm workflows status 2 mins
Collapse Failed test_automation_bagit test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]
Failing since build #2856 (Child of ODSRV-OPRPM-2525) Wojciech Szmelich Wojciech Szmelich
Atm BagIt 19 mins
AssertionError: Processing speed is 8387.407407407407 bytes per second and is lower than expected 13500 per second.
request = <FixtureRequest for <Function 'test_user_sees_successful_execution_of_uploaded_bagituploader_workflow_and_input_file_bagit_archive_unpacktar[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(37 more lines...)
Successful test_automation_examples_workflows_tests test_user_checks_time_series_charts_and_results_store_content_after_execution_of_uploaded_workflow_name_workflow[1oz_1op_openfaas-calculate-checksums-rest]
Katarzyna Such Katarzyna Such
automation-examples workflows 5 mins
Successful test_multiprovider_basic test_user_sees_file_is_not_visible_after_its_upload_has_been_canceled[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Multiprovider basic 3 mins
Successful test_oneprovider_archives_recall test_user_sees_that_recall_has_been_cancelled_after_cancelling_it[1oz_2op_slow_file_operations]
Katarzyna Such Katarzyna Such
Oneprovider archives recall 2 mins
Successful test_oneprovider_data_tab test_user_jumps_to_the_end_of_the_list_after_writing_zzz_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 24 secs
Successful test_oneprovider_data_tab test_user_successfully_jumps_to_a_previously_nonvisible_file_after_writing_its_name_prefix_to_jump_input[1oz_1op_deployed]
Łukasz Opioła Łukasz Opioła
Oneprovider data tab 26 secs
Successful test_oneprovider_transfers_files test_user_tries_to_migrate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 57 secs
Successful test_oneprovider_transfers_files test_user_tries_to_replicate_file_to_too_small_space_on_remote_provider[1oz_2op_deployed]
Agnieszka Warchol Agnieszka Warchol
Transfers files 51 secs
Collapse Failed test_onezone_automation test_each_lambda_dump_from_automationexamples_remains_the_same_after_uploading_and_downloading_it_from_automation_inventory[1oz_1op_deployed]
Failing since build #2844 (Child of ODSRV-OPRPM-2518) Not quarantined Onezone automations 5 mins
RuntimeError: no "1" found in Lambda in LambdasPage in AutomationPage in Onezone page
request = <FixtureRequest for <Function 'test_each_lambda_dump_from_automationexamples_remains_the_same_after_uploading_and_downloading_it_from_automation_inventory[1oz_1op_deployed]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(45 more lines...)
Successful test_onezone_harvesters_effective_privileges test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_elasticsearch]
Wojciech Szmelich Wojciech Szmelich
Onezone harvesters effective privileges 2 mins
Successful test_onezone_harvesters_memberships_privileges test_user_successfully_renames_harvester_with_modify_harvester_privilege[1oz_1op_elasticsearch]
Wojciech Szmelich Wojciech Szmelich
Onezone harvesters memberships privileges 1 min
Skipped tests 19
Status Test Failing since View job
Skipped test_onezone_automation_members_and_privileges test_user_successfully_manages_lambda_with_manage_lambda_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_generates_invitation_token_for_user_with_add_user_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_removes_inventory_with_remove_inventory_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_sets_privileges_with_set_privileges_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_can_see_owned_group_in_select_groups_modal_when_executing_workflow_without_view_space_privilege[1oz_1op_deployed]
Failing since build #2857 (Child of ODSRV-OZP-2018) Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parent_direct_privileges_and_its_direct_privileges[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_generates_invitation_token_for_group_to_join_inventory_with_add_group_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_manages_workflow_with_manage_workflows_schema_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_invites_group_to_inventory_using_token[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_joins_an_inventory_with_group_invitation_token_and_sees_renamed_inventory[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_fails_to_join_to_the_inventory_because_the_inventory_was_deleted[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_removes_user_from_inventory_with_remove_user_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_views_privileges_with_view_privileges_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_sees_that_group_effective_privileges_are_the_sum_of_its_direct_parents_direct_privileges[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_renames_inventory_with_modify_inventory_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_successfully_removes_group_from_inventory_with_remove_group_privilege[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_sees_that_user_effective_privileges_are_the_sum_of_its_direct_parents_direct_privileges[1oz_1op_deployed]
Onezone automations members and privileges
Skipped test_onezone_automation_members_and_privileges test_user_fails_to_see_inventory_without_view_inventory_privilege[1oz_1op_deployed]
Onezone automations members and privileges