GUI acceptance tests using environment deployed from packages.

Build: #2875 failed

Job: automation-examples workflows failed

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Test results

  • 24 tests in total
  • 3 tests failed
  • 1 test was quarantined / skipped
  • 52 minutes taken in total.

Build 2,875 has the following 3 errors:There were no new test failures since the previous build.

Existing test failures 3
Status Test Failing since Duration
AssertionError: logs in file: {'timestamp': 1722287137241, 'severity': 'info', 'index': '1', 'content': {'referencedElements': {'tasks': ['fac7bf6f24848039edfa1410483cc21cch58b4']}, 'description': '[Lane: 1, Run: 1, PBox: 1, Task: 1] Started.'}} and visible {'index': '0', 'timestamp': 1722287131137, 'severity': 'notice', 'content': {'details': {'scheduledLaneRunSelector': {'laneIndex': 1, 'RunNumber': 1}}, 'description': 'Scheduled execution.'}}are different
request = <FixtureRequest for <Function 'test_user_downloads_audit_log_of_executed_workflow_and_sees_that_log_entries_in_the_downloaded_file_correspond_to_those_visible_in_gui[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(48 more lines...)
AssertionError: Actual "echo" status: "Failed" does not match expected: "Finished"
request = <FixtureRequest for <Function 'test_user_sees_desirable_active_workflow_status_before_10s_pass_in_task_auditlog_after_changing_sleepdurationsec_in_echo_lambda[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(24 more lines...)
AssertionError: description "Failed to process batch of items." in audit log for "echo" task is not "Lambda exception occurred during item processing." as expected
request = <FixtureRequest for <Function 'test_user_sees_desirable_exception_in_task_auditlog_after_changing_exceptionprobability_in_echo_lambda[1oz_1op_openfaas]'>>

    @pytest.mark.usefixtures(*function_args)
    def scenario_wrapper(request):
>       _execute_scenario(feature, scenario, request, encoding)

/usr/local/lib/python3.8/dist-packages/pytest_bdd/scenario.py:227: 
(27 more lines...)