Build: #14 failed Child of ODSRV-OZP314-6

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build result summary

Details

Completed
Queue duration
1 second
Duration
1129 minutes
Labels
None
Revision
96320bdb0f2c88136b673bd0f9815cd436ed0054
Total tests
878
Failing since
#8 (Manual run by Darin Nikolow)

Responsible

This build has been failing since #8
No one has taken responsibility

Tests

New test failures 2
Status Test View job Duration
Collapse Failed test_atm_workflows_status test_user_sees_lane_run_indicators_and_statuses_after_rerunning_workflow[1oz_1op_openfaas]
Atm workflows status 6 mins
AssertionError: After awaiting for workflow "checksum-counting-different-lambdas" its status is not Finished as expected
fixturefunc = <function await_for_lane_workflow_status at 0x7ff4c577ac00>
request = <FixtureRequest for <Function test_user_sees_lane_run_indicators_and_statuses_after_rerunning_workflow[1oz_1op_openfaas]>>
kwargs = {'browser_id': 'browser', 'expected_status': 'Finished', 'name': 'checksum-counting-different-lambdas', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(51 more lines...)
Collapse Failed test_onepanel_basic test_user_deregisters_provider_registers_it_again_and_sees_that_provider_is_working[1oz_1op_deployed]
Onepanel basic 1 min
tests.utils.http_exceptions.HTTPServiceUnavailable: [503] Service Unavailable: {"error":{"id":"unregisteredOneprovider","description":"This Oneprovider is not registered."}}
zone_hostname = 'dev-onezone.default.svc.cluster.local'
onepanel_credentials = <tests.utils.user_utils.AdminUser object at 0x7fdbdcfc2bd0>
owner_credentials = <tests.utils.user_utils.User object at 0x7fdbdbd61f10>
space_id = '1149e618d5cff943ef66c0e079190ac5chdad8'
storages_db = {'dev-oneprovider-krakow': {}}
hosts = {'oneprovider-1': {'container-id': 'b6fe6b4de01360fa171d153454783f2f3531467fd93db5a8038e2dd0c6a702cb', 'hostname': 'de...8c1acee803ef', 'hostname': 'dev-onezone.default.svc.cluster.local', 'ip': '10.244.46.221', 'name': 'dev-onezone', ...}}
providers = [{'oneprovider-1': {'size': 1000000, 'storage': 'posix'}}]
(266 more lines...)
Existing test failures 30
Status Test Failing since View job Duration
AssertionError: logical size is 0 B instead of 15 B!
fixturefunc = <function check_size_stats_for_archive at 0x7f7489a79580>
request = <FixtureRequest for <Function test_user_sees_that_archives_data_is_placed_on_the_provider_creating_the_archive_via_size_statistics[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'config': 'logical size: 15 B\ntotal physical size: 15 B\ncontain counter: 1 file, 1 directo...t_user_sees_that_archives_data_is_placed_on_the_provider_creating_the_archive_via_size_statistics[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='10.244.57.154', port=443): Read timed out.
self = <urllib3.response.HTTPResponse object at 0x7fdfeee98490>

    @contextmanager
    def _error_catcher(self) -> typing.Generator[None, None, None]:
        """
        Catch low-level python exceptions, instead re-raising urllib3
        variants, so that low-level exceptions are not leaked in the
(152 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7efe0c3b9da0>
request = <FixtureRequest for <Function test_user_uses_autocleaning[1oz_2op_deployed]>>
kwargs = {'browser_id': 'space_owner_browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'...p_deployed]>>, 'space_owner_browser': <tests.conftest.ChromeWithAllLogs (session="2ff6e8a93440afd98261d93c775b302c")>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7efe0c3b9da0>
request = <FixtureRequest for <Function test_user_uses_autocleaning_with_upper_size_limit_which_skips_too_big_files[1oz_2op_deployed]>>
kwargs = {'browser_id': 'space_owner_browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'...p_deployed]>>, 'space_owner_browser': <tests.conftest.ChromeWithAllLogs (session="bf76e4bdb9a75415b0619208363842dd")>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
RuntimeError: file 20B-0.txt has not been downloaded
fixturefunc = <function has_downloaded_file_content at 0x7efe0c46d300>
request = <FixtureRequest for <Function test_user_uploads_file_on_one_provider_sees_its_distribution_downloads_on_other_provider_and_again_sees_its_distribution[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser1', 'content': '00000000000000000000', 'file_name': '20B-0.txt', 'tmpdir': local('/tmp/pytest-of-bamboo/pytest-0/test_user_uploads_file_on_one_1')}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(50 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7efe0c3b9da0>
request = <FixtureRequest for <Function test_user_uses_autocleaning_with_lower_size_limit_which_skips_too_small_files[1oz_2op_deployed]>>
kwargs = {'browser_id': 'space_owner_browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'...p_deployed]>>, 'space_owner_browser': <tests.conftest.ChromeWithAllLogs (session="25f0f6a44045acd7fec31be2f49d31a1")>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
RuntimeError: cannot click on button btn in AutoCleaning in Space in SpacesContentPage in content in Oneprovider Panel 21.02.7
fixturefunc = <function click_start_cleaning_now at 0x7f7746d47c40>
request = <FixtureRequest for <Function test_autocleaning_respects_qos_replicas_count_requirement_beside_autocleaning_quota[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser_emergency', 'onepanel': <class 'tests.gui.utils.onepanel.Onepanel'>, 'selenium': {'browser_eme...for <Function test_autocleaning_respects_qos_replicas_count_requirement_beside_autocleaning_quota[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(59 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="4e36b5ea24e10864acc1dd42ab097703", element="8CF89A9F53919CFC456ADBE989405776_element_556")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
AssertionError: distribution for dev-oneprovider-paris is not entirely filled
fixturefunc = <function wt_assert_file_chunks at 0x7f2aafca5f80>
request = <FixtureRequest for <Function test_file_is_replicated_after_migration_from_one_storage_with_qos_requirement[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser_unified', 'desc': 'oneprovider-1: entirely filled\noneprovider-2: entirely filled', 'file_name...9655aff', 'hostname': 'dev-onezone.default.svc.cluster.local', 'ip': '10.244.36.34', 'name': 'dev-onezone', ...}}, ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(60 more lines...)
AssertionError: Transfer status is failed instead of completed in ended
fixturefunc = <function assert_ended_transfer at 0x7f7e5e21a7a0>
request = <FixtureRequest for <Function test_user_reruns_directory_transfer_to_remote_provider_after_canceling_it[1oz_2op_slow_deployed]>>
kwargs = {'browser_id': 'browser', 'desc': 'name: "0"\nreplicated: <= 9.3 GB\ntype: replication\nstatus: completed', 'hosts': {...'dev-onezone.default.svc.cluster.local', 'ip': '10.244.61.144', 'name': 'dev-onezone', ...}}, 'item_type': 'file', ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(75 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7fc27124fa60>
request = <FixtureRequest for <Function test_user_sees_actual_file_replication_rate_for_a_directory_distributed_between_providers[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...unction test_user_sees_actual_file_replication_rate_for_a_directory_distributed_between_providers[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: physical_size is 0 B instead of 60 B for provider dev-oneprovider-paris!
fixturefunc = <function check_size_stats_for_provider at 0x7fc271662de0>
request = <FixtureRequest for <Function test_user_sees_spaces_size_stats_per_provider_after_clicking_show_statistics_button_and_replicating_directories_from_oneprovider1_to_oneprovider2[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'elem_type': 'physical_size', 'expected': '60 B', 'hosts': {'oneprovider-1': {'container-id'...79b646f', 'hostname': 'dev-onezone.default.svc.cluster.local', 'ip': '10.244.53.93', 'name': 'dev-onezone', ...}}, ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(56 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7fc27124fa60>
request = <FixtureRequest for <Function test_user_sees_actual_file_replication_rate_that_is_lower_than_1[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...Request 'selenium' for <Function test_user_sees_actual_file_replication_rate_that_is_lower_than_1[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7fc27124fa60>
request = <FixtureRequest for <Function test_user_sees_actual_file_replication_rate_for_a_file_replicated_to_another_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...r <Function test_user_sees_actual_file_replication_rate_for_a_file_replicated_to_another_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7fc27124fa60>
request = <FixtureRequest for <Function test_user_replicates_directory_to_remote_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...'request': <SubRequest 'selenium' for <Function test_user_replicates_directory_to_remote_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7fc27124fa60>
request = <FixtureRequest for <Function test_user_migrates_directory_to_remote_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t..., 'request': <SubRequest 'selenium' for <Function test_user_migrates_directory_to_remote_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Data distribution at 0% instead of 33% for provider dev-oneprovider-paris!
fixturefunc = <function check_data_distribution_percentage_for_provider at 0x7fc271661c60>
request = <FixtureRequest for <Function test_user_checks_directorys_data_distribution_change_for_oneprovider2_after_file_replication[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'hosts': {'oneprovider-1': {'container-id': '2f80ea805d189f13106451281cc456ce96af64c51dd8b27....93', 'name': 'dev-onezone', ...}}, 'modals': <class 'tests.gui.utils.common.modals.Modals'>, 'percentage': '33%', ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(53 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7f57e789b9c0>
request = <FixtureRequest for <Function test_user_replicates_file_to_remote_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...")>, 'request': <SubRequest 'selenium' for <Function test_user_replicates_file_to_remote_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: distribution for dev-oneprovider-paris is not entirely filled
fixturefunc = <function wt_assert_file_chunks at 0x7f57e79198a0>
request = <FixtureRequest for <Function test_user_sees_that_there_are_no_file_blocks_on_provider_from_which_file_was_downloaded_and_then_evicted[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'desc': 'oneprovider-1: entirely filled\noneprovider-2: entirely filled', 'file_name': '20B-...fe277b3', 'hostname': 'dev-onezone.default.svc.cluster.local', 'ip': '10.244.26.84', 'name': 'dev-onezone', ...}}, ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(60 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7f57e789b9c0>
request = <FixtureRequest for <Function test_user_migrates_file_to_remote_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser': <t...7d")>, 'request': <SubRequest 'selenium' for <Function test_user_migrates_file_to_remote_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: distribution for dev-oneprovider-paris is not entirely filled
fixturefunc = <function wt_assert_file_chunks at 0x7f453ae61b20>
request = <FixtureRequest for <Function test_nonspaceowner_successfully_schedules_eviction_if_he_got_transfer_management_privileges[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser_user1', 'desc': 'oneprovider-1: entirely filled\noneprovider-2: entirely filled', 'file_name':...17c4f5', 'hostname': 'dev-onezone.default.svc.cluster.local', 'ip': '10.244.24.134', 'name': 'dev-onezone', ...}}, ...}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(60 more lines...)
AssertionError: Ongoing transfers did not finish
fixturefunc = <function wait_for_ongoing_tranfers_to_finish at 0x7f453ae20180>
request = <FixtureRequest for <Function test_user_migrates_directory_with_2_files_on_different_providers_to_current_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser1', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser1': ...or <Function test_user_migrates_directory_with_2_files_on_different_providers_to_current_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7f453addfc40>
request = <FixtureRequest for <Function test_user_replicates_file_from_remote_provider_to_current_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser1', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser1': ...quest 'selenium' for <Function test_user_replicates_file_from_remote_provider_to_current_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Waiting transfers did not start
fixturefunc = <function wait_for_waiting_transfer_to_start at 0x7f453addfc40>
request = <FixtureRequest for <Function test_user_migrates_file_from_remote_provider_to_current_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser1', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser1': ...Request 'selenium' for <Function test_user_migrates_file_from_remote_provider_to_current_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
AssertionError: Ongoing transfers did not finish
fixturefunc = <function wait_for_ongoing_tranfers_to_finish at 0x7f453ae20180>
request = <FixtureRequest for <Function test_user_replicates_directory_with_2_files_on_different_providers_to_current_provider[1oz_2op_deployed]>>
kwargs = {'browser_id': 'browser1', 'op_container': <class 'tests.gui.utils.oneprovider.OPLoggedIn'>, 'selenium': {'browser1': ... <Function test_user_replicates_directory_with_2_files_on_different_providers_to_current_provider[1oz_2op_deployed]>>}}

    def call_fixture_func(
        fixturefunc: "_FixtureFunc[FixtureValue]", request: FixtureRequest, kwargs
    ) -> FixtureValue:
(42 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="fb3400c1c1ed3eb9f2153dcf2de718d1", element="D77144F911C6FD032638E28F23CE02EF_element_595")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="0704dc4e5fc750207e15cb2cef040cd4", element="45CA448E428954A91929A10BF307D7A9_element_668")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="db78aa54a2941675ec7fa813e1cca9f7", element="D94FDFCE572BF4D35E849C3839333496_element_653")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="14993291115b06fa47ad66111b1f6d0e", element="122EF01F9A6E676B5BDE1EDC5B3B9DC5_element_664")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
RuntimeError: no  item found in Requirement in QoS tab
web_elem_root = <selenium.webdriver.remote.webelement.WebElement (session="879e8316380586e5a8965858558a31cf", element="858B12E930B3FAC257E5095D2EB8BD1F_element_595")>
css_sel = '.qos-status-fulfilled'
err_msg = 'no  item found in Requirement in QoS tab'

    def find_web_elem(web_elem_root, css_sel, err_msg):
        try:
            _scroll_to_css_sel(web_elem_root, css_sel)
(187 more lines...)
Fixed tests 3
Status Test Failing since View job Duration
Successful test_atm_workflows_execution test_user_checks_pods_activity_events_after_checksumcountingdifferentlambdas_workflow_execution[1oz_1op_openfaas]
Failing since build #12 (Child of ODSRV-OZP314-5) Atm workflow execution 8 mins
Successful test_multiprovider_qos test_user_sees_qos_requirement_met_after_a_new_support_is_added[1oz_2op_deployed]
Failing since build #11 (Child of ODSRV-OPRPM599-16) Multiprovider QoS 3 mins
Successful test_onezone_invite_tokens_with_consumer_caveats test_user_successfully_consumes_group_to_space_invite_token_with_consumer_caveat_set_for_them[1oz_2op_elasticsearch]
Failing since build #13 (Child of ODSRV-OPRPM599-17) Onezone invite tokens with consumer caveats 10 mins