oneclient acceptance tests using environment deployed from packages

Build: #3372 was successful

Job: multiprovider replication directio symlinks was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,387 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
30-Nov-2024 00:26:16 Adding user `space_owner' ...
30-Nov-2024 00:26:16 Adding new group `space_owner' (24849) ...
30-Nov-2024 00:26:16 Adding new user `space_owner' (24849) with group `space_owner' ...
30-Nov-2024 00:26:16 Creating home directory `/home/space_owner' ...
30-Nov-2024 00:26:16 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
30-Nov-2024 00:26:16 Adding user `user1' ...
30-Nov-2024 00:26:16 Adding new group `user1' (25687) ...
30-Nov-2024 00:26:16 Adding new user `user1' (25687) with group `user1' ...
30-Nov-2024 00:26:16 Creating home directory `/home/user1' ...
30-Nov-2024 00:26:16 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
30-Nov-2024 00:26:16 Adding user `user2' ...
30-Nov-2024 00:26:16 Adding new group `user2' (30628) ...
30-Nov-2024 00:26:16 Adding new user `user2' (30628) with group `user2' ...
30-Nov-2024 00:26:16 Creating home directory `/home/user2' ...
30-Nov-2024 00:26:16 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
30-Nov-2024 00:26:16 Adding user `space_owner' ...
30-Nov-2024 00:26:16 Adding new group `space_owner' (24849) ...
30-Nov-2024 00:26:16 Adding new user `space_owner' (24849) with group `space_owner' ...
30-Nov-2024 00:26:16 Creating home directory `/home/space_owner' ...
30-Nov-2024 00:26:16 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
30-Nov-2024 00:26:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
30-Nov-2024 00:26:17 id: ‘user2’: no such user
30-Nov-2024 00:26:17 command terminated with exit code 1
30-Nov-2024 00:26:18 command terminated with exit code 1
30-Nov-2024 00:26:21 command terminated with exit code 1
30-Nov-2024 00:26:23 command terminated with exit code 1
30-Nov-2024 00:26:58 Adding user `user1' ...
30-Nov-2024 00:26:58 Adding new group `user1' (25687) ...
30-Nov-2024 00:26:58 Adding new user `user1' (25687) with group `user1' ...
30-Nov-2024 00:26:58 Creating home directory `/home/user1' ...
30-Nov-2024 00:26:58 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
30-Nov-2024 00:26:58 Adding user `user2' ...
30-Nov-2024 00:26:58 Adding new group `user2' (30628) ...
30-Nov-2024 00:26:58 Adding new user `user2' (30628) with group `user2' ...
30-Nov-2024 00:26:58 Creating home directory `/home/user2' ...
30-Nov-2024 00:26:58 Copying files from `/etc/skel' ...
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:26:58 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 =================================================================
30-Nov-2024 00:26:58 - Executing scenario 'Create files on one provider and see them on the other provider'
30-Nov-2024 00:26:58 - from feature 'Multiprovider_replication'
30-Nov-2024 00:26:58 -----------------------------------------------------------------
30-Nov-2024 00:26:58 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:26:58 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:26:58 using [token, token] by [user1, user2]"'
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:26:58 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/y4v2c208wzl66xji
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/y4v2c208wzl66xji --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/y4v2c208wzl66xji
30-Nov-2024 00:26:58 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '11786435772974524309'...
30-Nov-2024 00:26:58 Getting configuration...
30-Nov-2024 00:26:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/y4v2c208wzl66xji'.
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:26:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:26:58 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/cmch2tkqb0d9mitr
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/cmch2tkqb0d9mitr --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/cmch2tkqb0d9mitr
30-Nov-2024 00:26:58 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3234030169276335073'...
30-Nov-2024 00:26:58 Getting configuration...
30-Nov-2024 00:26:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/cmch2tkqb0d9mitr'.
30-Nov-2024 00:26:58
30-Nov-2024 00:26:58 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
30-Nov-2024 00:26:58 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
30-Nov-2024 00:26:58 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
30-Nov-2024 00:26:58 =================================================================
30-Nov-2024 00:26:58
30-Nov-2024 00:26:59 PASSED
30-Nov-2024 00:26:59 Unmounting client from /tmp/onedata/mnt/y4v2c208wzl66xji
30-Nov-2024 00:26:59
30-Nov-2024 00:26:59
30-Nov-2024 00:26:59 Unmounting client from /tmp/onedata/mnt/cmch2tkqb0d9mitr
30-Nov-2024 00:26:59
30-Nov-2024 00:26:59
30-Nov-2024 00:27:34 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:27:34 =================================================================
30-Nov-2024 00:27:34 - Executing scenario 'Create empty file on one provider and read it on the other provider'
30-Nov-2024 00:27:34 - from feature 'Multiprovider_replication'
30-Nov-2024 00:27:34 -----------------------------------------------------------------
30-Nov-2024 00:27:34 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:27:34 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:27:34 using [token, token] by [user1, user2]"'
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:27:34 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/u4btaf545sn0jua8
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/u4btaf545sn0jua8 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/u4btaf545sn0jua8
30-Nov-2024 00:27:34 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '15660581948690519270'...
30-Nov-2024 00:27:34 Getting configuration...
30-Nov-2024 00:27:34 Oneclient has been successfully mounted in '/tmp/onedata/mnt/u4btaf545sn0jua8'.
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:27:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:27:34 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/wxmzmvj7367kmizs
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/wxmzmvj7367kmizs --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/wxmzmvj7367kmizs
30-Nov-2024 00:27:34 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '4510658717197760558'...
30-Nov-2024 00:27:34 Getting configuration...
30-Nov-2024 00:27:34 Oneclient has been successfully mounted in '/tmp/onedata/mnt/wxmzmvj7367kmizs'.
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
30-Nov-2024 00:27:34 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
30-Nov-2024 00:27:34 =================================================================
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 PASSED
30-Nov-2024 00:27:34 Unmounting client from /tmp/onedata/mnt/u4btaf545sn0jua8
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34 Unmounting client from /tmp/onedata/mnt/wxmzmvj7367kmizs
30-Nov-2024 00:27:34
30-Nov-2024 00:27:34
30-Nov-2024 00:28:09 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:28:09 =================================================================
30-Nov-2024 00:28:09 - Executing scenario 'Write to file on one provider and check size on the other provider'
30-Nov-2024 00:28:09 - from feature 'Multiprovider_replication'
30-Nov-2024 00:28:09 -----------------------------------------------------------------
30-Nov-2024 00:28:09 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:28:09 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:28:09 using [token, token] by [user1, user2]"'
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:28:09 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/i2h0tri4d7x558ce
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/i2h0tri4d7x558ce --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/i2h0tri4d7x558ce
30-Nov-2024 00:28:09 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10378648905463147634'...
30-Nov-2024 00:28:09 Getting configuration...
30-Nov-2024 00:28:09 Oneclient has been successfully mounted in '/tmp/onedata/mnt/i2h0tri4d7x558ce'.
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:28:09 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:28:09 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/gpawnc0rq1y2yxd0
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/gpawnc0rq1y2yxd0 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/gpawnc0rq1y2yxd0
30-Nov-2024 00:28:09 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '18257855057788442035'...
30-Nov-2024 00:28:09 Getting configuration...
30-Nov-2024 00:28:09 Oneclient has been successfully mounted in '/tmp/onedata/mnt/gpawnc0rq1y2yxd0'.
30-Nov-2024 00:28:09
30-Nov-2024 00:28:09 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
30-Nov-2024 00:28:09 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
30-Nov-2024 00:28:09 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
30-Nov-2024 00:28:09 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
30-Nov-2024 00:28:09 =================================================================
30-Nov-2024 00:28:09
30-Nov-2024 00:28:10 PASSED
30-Nov-2024 00:28:10 Unmounting client from /tmp/onedata/mnt/i2h0tri4d7x558ce
30-Nov-2024 00:28:10
30-Nov-2024 00:28:10
30-Nov-2024 00:28:10 Unmounting client from /tmp/onedata/mnt/gpawnc0rq1y2yxd0
30-Nov-2024 00:28:10
30-Nov-2024 00:28:10
30-Nov-2024 00:28:54 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:28:54 =================================================================
30-Nov-2024 00:28:54 - Executing scenario 'Write to file on one provider and read on the other provider'
30-Nov-2024 00:28:54 - from feature 'Multiprovider_replication'
30-Nov-2024 00:28:54 -----------------------------------------------------------------
30-Nov-2024 00:28:54 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:28:54 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:28:54 using [token, token] by [user1, user2]"'
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:28:54 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/qoy5nqpqlmqgihmw
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/qoy5nqpqlmqgihmw --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/qoy5nqpqlmqgihmw
30-Nov-2024 00:28:54 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10762341518628879716'...
30-Nov-2024 00:28:54 Getting configuration...
30-Nov-2024 00:28:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/qoy5nqpqlmqgihmw'.
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:28:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:28:54 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/aeq7d85tsggp1r9k
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/aeq7d85tsggp1r9k --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/aeq7d85tsggp1r9k
30-Nov-2024 00:28:54 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1553999541090378276'...
30-Nov-2024 00:28:54 Getting configuration...
30-Nov-2024 00:28:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/aeq7d85tsggp1r9k'.
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:28:54 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
30-Nov-2024 00:28:54 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
30-Nov-2024 00:28:54 =================================================================
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 PASSED
30-Nov-2024 00:28:54 Unmounting client from /tmp/onedata/mnt/qoy5nqpqlmqgihmw
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54 Unmounting client from /tmp/onedata/mnt/aeq7d85tsggp1r9k
30-Nov-2024 00:28:54
30-Nov-2024 00:28:54
30-Nov-2024 00:29:28 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:29:28 =================================================================
30-Nov-2024 00:29:28 - Executing scenario 'Big file transfer with MD5 check'
30-Nov-2024 00:29:28 - from feature 'Multiprovider_replication'
30-Nov-2024 00:29:28 -----------------------------------------------------------------
30-Nov-2024 00:29:28 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:29:28 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:29:28 using [token, token] by [user1, user2]"'
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:29:28 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/n69drnzpwboll8p1
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/n69drnzpwboll8p1 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/n69drnzpwboll8p1
30-Nov-2024 00:29:28 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '6027119675487355235'...
30-Nov-2024 00:29:28 Getting configuration...
30-Nov-2024 00:29:28 Oneclient has been successfully mounted in '/tmp/onedata/mnt/n69drnzpwboll8p1'.
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:29:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:29:28 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/aayt7oyr0timp5rw
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/aayt7oyr0timp5rw --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/aayt7oyr0timp5rw
30-Nov-2024 00:29:28 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '509930951235062339'...
30-Nov-2024 00:29:28 Getting configuration...
30-Nov-2024 00:29:28 Oneclient has been successfully mounted in '/tmp/onedata/mnt/aayt7oyr0timp5rw'.
30-Nov-2024 00:29:28
30-Nov-2024 00:29:28 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:29:28 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
30-Nov-2024 00:29:28 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
30-Nov-2024 00:29:28 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
30-Nov-2024 00:29:28 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
30-Nov-2024 00:29:28 =================================================================
30-Nov-2024 00:29:28
30-Nov-2024 00:29:29 PASSED
30-Nov-2024 00:29:29 Unmounting client from /tmp/onedata/mnt/n69drnzpwboll8p1
30-Nov-2024 00:29:29
30-Nov-2024 00:29:29
30-Nov-2024 00:29:29 Unmounting client from /tmp/onedata/mnt/aayt7oyr0timp5rw
30-Nov-2024 00:29:29
30-Nov-2024 00:29:29
30-Nov-2024 00:30:22 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:30:22 =================================================================
30-Nov-2024 00:30:22 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
30-Nov-2024 00:30:22 - from feature 'Multiprovider_replication'
30-Nov-2024 00:30:22 -----------------------------------------------------------------
30-Nov-2024 00:30:22 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:30:22 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:30:22 using [token, token] by [user1, user2]"'
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:30:22 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/c3diq9u90zuourp0
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/c3diq9u90zuourp0 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/c3diq9u90zuourp0
30-Nov-2024 00:30:22 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '13005669246672870031'...
30-Nov-2024 00:30:22 Getting configuration...
30-Nov-2024 00:30:22 Oneclient has been successfully mounted in '/tmp/onedata/mnt/c3diq9u90zuourp0'.
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:30:22 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:30:22 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/5z9zkeudm0r3l8cw
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/5z9zkeudm0r3l8cw --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/5z9zkeudm0r3l8cw
30-Nov-2024 00:30:22 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '10032701114599220719'...
30-Nov-2024 00:30:22 Getting configuration...
30-Nov-2024 00:30:22 Oneclient has been successfully mounted in '/tmp/onedata/mnt/5z9zkeudm0r3l8cw'.
30-Nov-2024 00:30:22
30-Nov-2024 00:30:22 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 00:30:22 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
30-Nov-2024 00:30:22 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
30-Nov-2024 00:30:22 =================================================================
30-Nov-2024 00:30:22
30-Nov-2024 00:30:23 PASSED
30-Nov-2024 00:30:23 Unmounting client from /tmp/onedata/mnt/c3diq9u90zuourp0
30-Nov-2024 00:30:23
30-Nov-2024 00:30:23
30-Nov-2024 00:30:23 Unmounting client from /tmp/onedata/mnt/5z9zkeudm0r3l8cw
30-Nov-2024 00:30:23
30-Nov-2024 00:30:23
30-Nov-2024 00:31:03 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:31:03 =================================================================
30-Nov-2024 00:31:03 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
30-Nov-2024 00:31:03 - from feature 'Multiprovider_replication'
30-Nov-2024 00:31:03 -----------------------------------------------------------------
30-Nov-2024 00:31:03 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:31:03 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:31:03 using [token, token] by [user1, user2]"'
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:31:03 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/lrvtormnvhd1tpgx
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/lrvtormnvhd1tpgx --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/lrvtormnvhd1tpgx
30-Nov-2024 00:31:03 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '5053006005235319307'...
30-Nov-2024 00:31:03 Getting configuration...
30-Nov-2024 00:31:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/lrvtormnvhd1tpgx'.
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:31:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:31:03 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/9kwptoce7m6990nf
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/9kwptoce7m6990nf --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/9kwptoce7m6990nf
30-Nov-2024 00:31:03 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1521405606000418767'...
30-Nov-2024 00:31:03 Getting configuration...
30-Nov-2024 00:31:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/9kwptoce7m6990nf'.
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:31:03 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 00:31:03 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
30-Nov-2024 00:31:03 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
30-Nov-2024 00:31:03 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
30-Nov-2024 00:31:03 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
30-Nov-2024 00:31:03 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
30-Nov-2024 00:31:03 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
30-Nov-2024 00:31:03 =================================================================
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 PASSED
30-Nov-2024 00:31:03 Unmounting client from /tmp/onedata/mnt/lrvtormnvhd1tpgx
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03 Unmounting client from /tmp/onedata/mnt/9kwptoce7m6990nf
30-Nov-2024 00:31:03
30-Nov-2024 00:31:03
30-Nov-2024 00:32:02 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:32:02 =================================================================
30-Nov-2024 00:32:02 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
30-Nov-2024 00:32:02 - from feature 'Multiprovider_replication'
30-Nov-2024 00:32:02 -----------------------------------------------------------------
30-Nov-2024 00:32:02 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:32:02 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:32:02 using [token, token] by [user1, user2]"'
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:32:02 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/bhhuabiev5c3twh5
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/bhhuabiev5c3twh5 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/bhhuabiev5c3twh5
30-Nov-2024 00:32:02 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '8926535429558647708'...
30-Nov-2024 00:32:02 Getting configuration...
30-Nov-2024 00:32:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/bhhuabiev5c3twh5'.
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:32:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:32:02 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/zh6zfa1thmnwqh6f
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/zh6zfa1thmnwqh6f --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/zh6zfa1thmnwqh6f
30-Nov-2024 00:32:02 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '15199171176013419369'...
30-Nov-2024 00:32:02 Getting configuration...
30-Nov-2024 00:32:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/zh6zfa1thmnwqh6f'.
30-Nov-2024 00:32:02
30-Nov-2024 00:32:02 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
30-Nov-2024 00:32:02 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
30-Nov-2024 00:32:02 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
30-Nov-2024 00:32:02 =================================================================
30-Nov-2024 00:32:02
30-Nov-2024 00:32:03 PASSED
30-Nov-2024 00:32:03 Unmounting client from /tmp/onedata/mnt/bhhuabiev5c3twh5
30-Nov-2024 00:32:03
30-Nov-2024 00:32:03
30-Nov-2024 00:32:03 Unmounting client from /tmp/onedata/mnt/zh6zfa1thmnwqh6f
30-Nov-2024 00:32:03
30-Nov-2024 00:32:03
30-Nov-2024 00:32:49 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:32:49 =================================================================
30-Nov-2024 00:32:49 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
30-Nov-2024 00:32:49 - from feature 'Multiprovider_replication'
30-Nov-2024 00:32:49 -----------------------------------------------------------------
30-Nov-2024 00:32:49 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:32:49 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:32:49 using [token, token] by [user1, user2]"'
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-xz96b', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b'
30-Nov-2024 00:32:49 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-xz96b' successfully started
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/rg0ut9brfezn20x3
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/rg0ut9brfezn20x3 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/rg0ut9brfezn20x3
30-Nov-2024 00:32:49 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '15175751470234269914'...
30-Nov-2024 00:32:49 Getting configuration...
30-Nov-2024 00:32:49 Oneclient has been successfully mounted in '/tmp/onedata/mnt/rg0ut9brfezn20x3'.
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:32:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-b489l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l'
30-Nov-2024 00:32:49 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-b489l' successfully started
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/2aw5qlvbg43nmqb2
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/2aw5qlvbg43nmqb2 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/2aw5qlvbg43nmqb2
30-Nov-2024 00:32:49 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3404141937308126578'...
30-Nov-2024 00:32:49 Getting configuration...
30-Nov-2024 00:32:49 Oneclient has been successfully mounted in '/tmp/onedata/mnt/2aw5qlvbg43nmqb2'.
30-Nov-2024 00:32:49
30-Nov-2024 00:32:49 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 00:32:49 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 00:32:49 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 00:32:49 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 00:32:49 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
30-Nov-2024 00:32:49 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
30-Nov-2024 00:32:49 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
30-Nov-2024 00:32:49 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
30-Nov-2024 00:32:49 =================================================================
30-Nov-2024 00:32:49
30-Nov-2024 00:33:00 PASSED
30-Nov-2024 00:33:00 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
30-Nov-2024 00:33:00 Unmounting client from /tmp/onedata/mnt/rg0ut9brfezn20x3
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 Unmounting client from /tmp/onedata/mnt/2aw5qlvbg43nmqb2
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1732926769.9794958', '-c', '/tmp/logs']
30-Nov-2024 00:33:00 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-f9j88. See /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-cross-support-job-3p-users-f9j88/entrypoint.log for more details
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-xz96b: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneclient-krakow-7d9476b8bc-xz96b/oneclient_logs
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=64/79)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          84,139   3%   26.75MB/s    0:00:00 (xfr#1, to-chk=63/79)
30-Nov-2024 00:33:00          84,139   3%   26.75MB/s    0:00:00 (xfr#1, to-chk=57/79)
30-Nov-2024 00:33:00          84,697   3%   26.92MB/s    0:00:00 (xfr#2, to-chk=59/79)
30-Nov-2024 00:33:00         383,563  18%   15.24MB/s    0:00:00 (xfr#3, to-chk=58/79)
30-Nov-2024 00:33:00         384,121  18%   15.26MB/s    0:00:00 (xfr#4, to-chk=57/79)
30-Nov-2024 00:33:00         447,658  21%   14.72MB/s    0:00:00 (xfr#5, to-chk=56/79)
30-Nov-2024 00:33:00         448,216  21%   14.74MB/s    0:00:00 (xfr#6, to-chk=52/79)
30-Nov-2024 00:33:00         667,245  31%   14.80MB/s    0:00:00 (xfr#7, to-chk=51/79)
30-Nov-2024 00:33:00         667,803  31%   14.81MB/s    0:00:00 (xfr#8, to-chk=50/79)
30-Nov-2024 00:33:00         704,846  33%   15.63MB/s    0:00:00 (xfr#9, to-chk=49/79)
30-Nov-2024 00:33:00         705,500  33%   15.65MB/s    0:00:00 (xfr#10, to-chk=45/79)
30-Nov-2024 00:33:00         817,777  38%   16.59MB/s    0:00:00 (xfr#11, to-chk=44/79)
30-Nov-2024 00:33:00         818,431  38%   16.61MB/s    0:00:00 (xfr#12, to-chk=43/79)
30-Nov-2024 00:33:00         853,949  40%   16.62MB/s    0:00:00 (xfr#13, to-chk=42/79)
30-Nov-2024 00:33:00         854,219  40%   16.63MB/s    0:00:00 (xfr#14, to-chk=38/79)
30-Nov-2024 00:33:00         965,983  45%   17.72MB/s    0:00:00 (xfr#15, to-chk=37/79)
30-Nov-2024 00:33:00         966,253  45%   17.72MB/s    0:00:00 (xfr#16, to-chk=36/79)
30-Nov-2024 00:33:00       1,012,571  47%   18.57MB/s    0:00:00 (xfr#17, to-chk=35/79)
30-Nov-2024 00:33:00       1,013,129  47%   18.23MB/s    0:00:00 (xfr#18, to-chk=31/79)
30-Nov-2024 00:33:00       1,343,928  63%   19.42MB/s    0:00:00 (xfr#19, to-chk=30/79)
30-Nov-2024 00:33:00       1,344,486  63%   19.43MB/s    0:00:00 (xfr#20, to-chk=29/79)
30-Nov-2024 00:33:00       1,382,790  65%   19.68MB/s    0:00:00 (xfr#21, to-chk=28/79)
30-Nov-2024 00:33:00       1,383,348  65%   19.69MB/s    0:00:00 (xfr#22, to-chk=24/79)
30-Nov-2024 00:33:00       1,502,180  70%   19.90MB/s    0:00:00 (xfr#23, to-chk=23/79)
30-Nov-2024 00:33:00       1,502,738  70%   19.90MB/s    0:00:00 (xfr#24, to-chk=22/79)
30-Nov-2024 00:33:00       1,573,693  74%   20.28MB/s    0:00:00 (xfr#25, to-chk=21/79)
30-Nov-2024 00:33:00       1,574,443  74%   20.29MB/s    0:00:00 (xfr#26, to-chk=17/79)
30-Nov-2024 00:33:00       1,829,567  86%   15.44MB/s    0:00:00 (xfr#27, to-chk=16/79)
30-Nov-2024 00:33:00       1,830,317  86%   15.45MB/s    0:00:00 (xfr#28, to-chk=15/79)
30-Nov-2024 00:33:00       1,856,514  87%   15.53MB/s    0:00:00 (xfr#29, to-chk=14/79)
30-Nov-2024 00:33:00       1,857,168  87%   15.54MB/s    0:00:00 (xfr#30, to-chk=10/79)
30-Nov-2024 00:33:00       1,941,538  91%   15.96MB/s    0:00:00 (xfr#31, to-chk=9/79)
30-Nov-2024 00:33:00       1,942,192  91%   15.97MB/s    0:00:00 (xfr#32, to-chk=8/79)
30-Nov-2024 00:33:00       1,978,977  93%   16.13MB/s    0:00:00 (xfr#33, to-chk=7/79)
30-Nov-2024 00:33:00       1,979,343  93%   16.13MB/s    0:00:00 (xfr#34, to-chk=3/79)
30-Nov-2024 00:33:00       2,111,556  99%   16.92MB/s    0:00:00 (xfr#35, to-chk=2/79)
30-Nov-2024 00:33:00       2,111,922  99%   16.93MB/s    0:00:00 (xfr#36, to-chk=1/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   17.03MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   15.71MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   15.71MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   15.71MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00       2,124,818  99%   15.71MB/s    0:00:00 (xfr#37, to-chk=0/79)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-b489l: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneclient-paris-5cc45c8cb7-b489l/oneclient_logs
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=68/83)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          45,625   1%   43.51MB/s    0:00:00 (xfr#1, to-chk=67/83)
30-Nov-2024 00:33:00          45,625   1%   43.51MB/s    0:00:00 (xfr#1, to-chk=61/83)
30-Nov-2024 00:33:00          46,279   1%   44.14MB/s    0:00:00 (xfr#2, to-chk=63/83)
30-Nov-2024 00:33:00         252,250   9%  240.56MB/s    0:00:00 (xfr#3, to-chk=62/83)
30-Nov-2024 00:33:00         252,904   9%  120.59MB/s    0:00:00 (xfr#4, to-chk=61/83)
30-Nov-2024 00:33:00         316,516  12%  150.93MB/s    0:00:00 (xfr#5, to-chk=60/83)
30-Nov-2024 00:33:00         317,074  12%  151.19MB/s    0:00:00 (xfr#6, to-chk=56/83)
30-Nov-2024 00:33:00         592,228  23%  112.96MB/s    0:00:00 (xfr#7, to-chk=55/83)
30-Nov-2024 00:33:00         592,786  23%  113.06MB/s    0:00:00 (xfr#8, to-chk=54/83)
30-Nov-2024 00:33:00         593,414  23%  113.18MB/s    0:00:00 (xfr#9, to-chk=53/83)
30-Nov-2024 00:33:00         622,069  24%  118.65MB/s    0:00:00 (xfr#10, to-chk=52/83)
30-Nov-2024 00:33:00         622,627  24%   98.96MB/s    0:00:00 (xfr#11, to-chk=48/83)
30-Nov-2024 00:33:00         773,444  30%  122.94MB/s    0:00:00 (xfr#12, to-chk=47/83)
30-Nov-2024 00:33:00         774,002  30%  123.02MB/s    0:00:00 (xfr#13, to-chk=46/83)
30-Nov-2024 00:33:00         774,630  30%  105.53MB/s    0:00:00 (xfr#14, to-chk=45/83)
30-Nov-2024 00:33:00         836,692  32%  113.99MB/s    0:00:00 (xfr#15, to-chk=44/83)
30-Nov-2024 00:33:00         837,154  32%  114.05MB/s    0:00:00 (xfr#16, to-chk=40/83)
30-Nov-2024 00:33:00       1,089,214  42%  103.88MB/s    0:00:00 (xfr#17, to-chk=39/83)
30-Nov-2024 00:33:00       1,089,676  42%  103.92MB/s    0:00:00 (xfr#18, to-chk=38/83)
30-Nov-2024 00:33:00       1,166,993  45%  101.18MB/s    0:00:00 (xfr#19, to-chk=37/83)
30-Nov-2024 00:33:00       1,167,743  45%  101.24MB/s    0:00:00 (xfr#20, to-chk=33/83)
30-Nov-2024 00:33:00       1,445,522  56%   81.09MB/s    0:00:00 (xfr#21, to-chk=32/83)
30-Nov-2024 00:33:00       1,446,272  56%   81.13MB/s    0:00:00 (xfr#22, to-chk=31/83)
30-Nov-2024 00:33:00       1,446,900  56%   81.17MB/s    0:00:00 (xfr#23, to-chk=30/83)
30-Nov-2024 00:33:00       1,486,909  58%   78.78MB/s    0:00:00 (xfr#24, to-chk=29/83)
30-Nov-2024 00:33:00       1,487,563  58%   78.81MB/s    0:00:00 (xfr#25, to-chk=25/83)
30-Nov-2024 00:33:00       1,631,530  63%   81.89MB/s    0:00:00 (xfr#26, to-chk=24/83)
30-Nov-2024 00:33:00       1,632,184  63%   81.92MB/s    0:00:00 (xfr#27, to-chk=23/83)
30-Nov-2024 00:33:00       1,661,894  65%   83.42MB/s    0:00:00 (xfr#28, to-chk=22/83)
30-Nov-2024 00:33:00       1,662,356  65%   79.27MB/s    0:00:00 (xfr#29, to-chk=18/83)
30-Nov-2024 00:33:00       1,773,414  69%   67.65MB/s    0:00:00 (xfr#30, to-chk=17/83)
30-Nov-2024 00:33:00       1,773,876  69%   67.67MB/s    0:00:00 (xfr#31, to-chk=16/83)
30-Nov-2024 00:33:00       1,806,938  70%   68.93MB/s    0:00:00 (xfr#32, to-chk=15/83)
30-Nov-2024 00:33:00       1,807,592  70%   68.95MB/s    0:00:00 (xfr#33, to-chk=11/83)
30-Nov-2024 00:33:00       1,910,580  74%   50.61MB/s    0:00:00 (xfr#34, to-chk=10/83)
30-Nov-2024 00:33:00       1,911,234  74%   50.63MB/s    0:00:00 (xfr#35, to-chk=9/83)
30-Nov-2024 00:33:00       1,911,862  74%   50.65MB/s    0:00:00 (xfr#36, to-chk=8/83)
30-Nov-2024 00:33:00       2,038,581  79%   49.85MB/s    0:00:00 (xfr#37, to-chk=7/83)
30-Nov-2024 00:33:00       2,039,235  79%   49.87MB/s    0:00:00 (xfr#38, to-chk=3/83)
30-Nov-2024 00:33:00       2,528,268  98%   44.65MB/s    0:00:00 (xfr#39, to-chk=2/83)
30-Nov-2024 00:33:00       2,528,922  98%   44.66MB/s    0:00:00 (xfr#40, to-chk=1/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   44.30MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   38.68MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00       2,555,125  99%   38.68MB/s    0:00:00 (xfr#41, to-chk=0/83)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-krakow-0/op-worker
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          31,198  10%   29.75MB/s    0:00:00 (xfr#2, to-chk=67/72)
30-Nov-2024 00:33:00          49,624  16%   47.33MB/s    0:00:00 (xfr#3, to-chk=65/72)
30-Nov-2024 00:33:00          50,208  16%   47.88MB/s    0:00:00 (xfr#4, to-chk=63/72)
30-Nov-2024 00:33:00          50,208  16%   47.88MB/s    0:00:00 (xfr#5, to-chk=61/72)
30-Nov-2024 00:33:00          67,496  22%   64.37MB/s    0:00:00 (xfr#6, to-chk=59/72)
30-Nov-2024 00:33:00          67,646  22%   64.51MB/s    0:00:00 (xfr#7, to-chk=57/72)
30-Nov-2024 00:33:00          67,943  22%   64.80MB/s    0:00:00 (xfr#8, to-chk=51/72)
30-Nov-2024 00:33:00         122,469  40%   58.40MB/s    0:00:00 (xfr#9, to-chk=49/72)
30-Nov-2024 00:33:00         122,791  40%   58.55MB/s    0:00:00 (xfr#10, to-chk=39/72)
30-Nov-2024 00:33:00         123,107  40%   58.70MB/s    0:00:00 (xfr#11, to-chk=38/72)
30-Nov-2024 00:33:00         124,071  40%   59.16MB/s    0:00:00 (xfr#12, to-chk=37/72)
30-Nov-2024 00:33:00         124,540  41%   59.39MB/s    0:00:00 (xfr#13, to-chk=36/72)
30-Nov-2024 00:33:00         124,856  41%   59.54MB/s    0:00:00 (xfr#14, to-chk=35/72)
30-Nov-2024 00:33:00         125,511  41%   39.90MB/s    0:00:00 (xfr#15, to-chk=34/72)
30-Nov-2024 00:33:00         126,478  41%   40.21MB/s    0:00:00 (xfr#16, to-chk=33/72)
30-Nov-2024 00:33:00         127,610  42%   40.57MB/s    0:00:00 (xfr#17, to-chk=32/72)
30-Nov-2024 00:33:00         127,926  42%   40.67MB/s    0:00:00 (xfr#18, to-chk=31/72)
30-Nov-2024 00:33:00         128,922  42%   40.98MB/s    0:00:00 (xfr#19, to-chk=30/72)
30-Nov-2024 00:33:00         129,238  42%   41.08MB/s    0:00:00 (xfr#20, to-chk=29/72)
30-Nov-2024 00:33:00         130,022  42%   41.33MB/s    0:00:00 (xfr#21, to-chk=28/72)
30-Nov-2024 00:33:00         130,341  42%   41.43MB/s    0:00:00 (xfr#22, to-chk=27/72)
30-Nov-2024 00:33:00         131,455  43%   41.79MB/s    0:00:00 (xfr#23, to-chk=26/72)
30-Nov-2024 00:33:00         132,080  43%   41.99MB/s    0:00:00 (xfr#24, to-chk=25/72)
30-Nov-2024 00:33:00         132,242  43%   42.04MB/s    0:00:00 (xfr#25, to-chk=24/72)
30-Nov-2024 00:33:00         132,558  43%   42.14MB/s    0:00:00 (xfr#26, to-chk=23/72)
30-Nov-2024 00:33:00         133,188  43%   42.34MB/s    0:00:00 (xfr#27, to-chk=22/72)
30-Nov-2024 00:33:00         136,362  44%   32.51MB/s    0:00:00 (xfr#28, to-chk=21/72)
30-Nov-2024 00:33:00         136,909  45%   32.64MB/s    0:00:00 (xfr#29, to-chk=20/72)
30-Nov-2024 00:33:00         138,502  45%   33.02MB/s    0:00:00 (xfr#30, to-chk=19/72)
30-Nov-2024 00:33:00         142,886  47%   34.07MB/s    0:00:00 (xfr#31, to-chk=18/72)
30-Nov-2024 00:33:00         144,573  47%   34.47MB/s    0:00:00 (xfr#32, to-chk=17/72)
30-Nov-2024 00:33:00         147,192  48%   35.09MB/s    0:00:00 (xfr#33, to-chk=16/72)
30-Nov-2024 00:33:00         150,324  49%   35.84MB/s    0:00:00 (xfr#34, to-chk=15/72)
30-Nov-2024 00:33:00         150,777  49%   35.95MB/s    0:00:00 (xfr#35, to-chk=14/72)
30-Nov-2024 00:33:00         154,350  50%   36.80MB/s    0:00:00 (xfr#36, to-chk=13/72)
30-Nov-2024 00:33:00         156,664  51%   37.35MB/s    0:00:00 (xfr#37, to-chk=12/72)
30-Nov-2024 00:33:00         159,325  52%   37.99MB/s    0:00:00 (xfr#38, to-chk=11/72)
30-Nov-2024 00:33:00         160,556  52%   38.28MB/s    0:00:00 (xfr#39, to-chk=10/72)
30-Nov-2024 00:33:00         164,979  54%   31.47MB/s    0:00:00 (xfr#40, to-chk=9/72)
30-Nov-2024 00:33:00         166,116  54%   31.68MB/s    0:00:00 (xfr#41, to-chk=8/72)
30-Nov-2024 00:33:00         170,046  56%   32.43MB/s    0:00:00 (xfr#42, to-chk=7/72)
30-Nov-2024 00:33:00         174,013  57%   33.19MB/s    0:00:00 (xfr#43, to-chk=6/72)
30-Nov-2024 00:33:00         176,270  58%   33.62MB/s    0:00:00 (xfr#44, to-chk=5/72)
30-Nov-2024 00:33:00         179,801  59%   34.29MB/s    0:00:00 (xfr#45, to-chk=4/72)
30-Nov-2024 00:33:00         180,087  59%   34.35MB/s    0:00:00 (xfr#46, to-chk=1/72)
30-Nov-2024 00:33:00         180,373  59%   34.40MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         180,373  59%   34.40MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         180,373  59%   28.67MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         180,373  59%   24.57MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         180,373  59%   24.57MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         180,373  59%   24.57MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-krakow-0/cluster-manager
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00           6,857  50%    1.31MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-krakow-0/op-panel
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          16,593  16%   15.82MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00          34,108  33%   32.53MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00          34,108  33%   32.53MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00          50,498  49%   16.05MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00          50,789  50%   16.15MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00          50,789  50%   12.11MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-paris-0/op-worker
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          42,593  13%   40.62MB/s    0:00:00 (xfr#2, to-chk=67/72)
30-Nov-2024 00:33:00          60,373  18%   57.58MB/s    0:00:00 (xfr#3, to-chk=65/72)
30-Nov-2024 00:33:00          60,373  18%   57.58MB/s    0:00:00 (xfr#4, to-chk=63/72)
30-Nov-2024 00:33:00          60,373  18%   57.58MB/s    0:00:00 (xfr#5, to-chk=61/72)
30-Nov-2024 00:33:00          77,030  23%   73.46MB/s    0:00:00 (xfr#6, to-chk=59/72)
30-Nov-2024 00:33:00          77,180  23%   73.60MB/s    0:00:00 (xfr#7, to-chk=57/72)
30-Nov-2024 00:33:00          77,477  23%   73.89MB/s    0:00:00 (xfr#8, to-chk=51/72)
30-Nov-2024 00:33:00         132,784  40%   63.32MB/s    0:00:00 (xfr#9, to-chk=49/72)
30-Nov-2024 00:33:00         133,065  41%   63.45MB/s    0:00:00 (xfr#10, to-chk=39/72)
30-Nov-2024 00:33:00         133,347  41%   63.58MB/s    0:00:00 (xfr#11, to-chk=38/72)
30-Nov-2024 00:33:00         134,332  41%   64.05MB/s    0:00:00 (xfr#12, to-chk=37/72)
30-Nov-2024 00:33:00         135,080  41%   64.41MB/s    0:00:00 (xfr#13, to-chk=36/72)
30-Nov-2024 00:33:00         135,360  41%   64.54MB/s    0:00:00 (xfr#14, to-chk=35/72)
30-Nov-2024 00:33:00         136,204  42%   43.30MB/s    0:00:00 (xfr#15, to-chk=34/72)
30-Nov-2024 00:33:00         137,207  42%   43.62MB/s    0:00:00 (xfr#16, to-chk=33/72)
30-Nov-2024 00:33:00         138,537  42%   44.04MB/s    0:00:00 (xfr#17, to-chk=32/72)
30-Nov-2024 00:33:00         138,818  42%   44.13MB/s    0:00:00 (xfr#18, to-chk=31/72)
30-Nov-2024 00:33:00         140,026  43%   44.51MB/s    0:00:00 (xfr#19, to-chk=30/72)
30-Nov-2024 00:33:00         140,310  43%   44.60MB/s    0:00:00 (xfr#20, to-chk=29/72)
30-Nov-2024 00:33:00         140,904  43%   44.79MB/s    0:00:00 (xfr#21, to-chk=28/72)
30-Nov-2024 00:33:00         141,184  43%   33.66MB/s    0:00:00 (xfr#22, to-chk=27/72)
30-Nov-2024 00:33:00         142,667  44%   34.01MB/s    0:00:00 (xfr#23, to-chk=26/72)
30-Nov-2024 00:33:00         143,508  44%   34.21MB/s    0:00:00 (xfr#24, to-chk=25/72)
30-Nov-2024 00:33:00         143,790  44%   34.28MB/s    0:00:00 (xfr#25, to-chk=24/72)
30-Nov-2024 00:33:00         144,070  44%   34.35MB/s    0:00:00 (xfr#26, to-chk=23/72)
30-Nov-2024 00:33:00         144,929  44%   34.55MB/s    0:00:00 (xfr#27, to-chk=22/72)
30-Nov-2024 00:33:00         148,006  45%   35.29MB/s    0:00:00 (xfr#28, to-chk=21/72)
30-Nov-2024 00:33:00         148,394  45%   35.38MB/s    0:00:00 (xfr#29, to-chk=20/72)
30-Nov-2024 00:33:00         149,987  46%   28.61MB/s    0:00:00 (xfr#30, to-chk=19/72)
30-Nov-2024 00:33:00         154,373  47%   29.44MB/s    0:00:00 (xfr#31, to-chk=18/72)
30-Nov-2024 00:33:00         155,903  48%   29.74MB/s    0:00:00 (xfr#32, to-chk=17/72)
30-Nov-2024 00:33:00         158,522  48%   30.24MB/s    0:00:00 (xfr#33, to-chk=16/72)
30-Nov-2024 00:33:00         161,654  49%   30.83MB/s    0:00:00 (xfr#34, to-chk=15/72)
30-Nov-2024 00:33:00         162,107  49%   30.92MB/s    0:00:00 (xfr#35, to-chk=14/72)
30-Nov-2024 00:33:00         165,575  51%   31.58MB/s    0:00:00 (xfr#36, to-chk=13/72)
30-Nov-2024 00:33:00         167,797  51%   26.67MB/s    0:00:00 (xfr#37, to-chk=12/72)
30-Nov-2024 00:33:00         170,353  52%   27.08MB/s    0:00:00 (xfr#38, to-chk=11/72)
30-Nov-2024 00:33:00         171,427  52%   27.25MB/s    0:00:00 (xfr#39, to-chk=10/72)
30-Nov-2024 00:33:00         175,748  54%   27.93MB/s    0:00:00 (xfr#40, to-chk=9/72)
30-Nov-2024 00:33:00         176,885  54%   28.12MB/s    0:00:00 (xfr#41, to-chk=8/72)
30-Nov-2024 00:33:00         180,815  55%   28.74MB/s    0:00:00 (xfr#42, to-chk=7/72)
30-Nov-2024 00:33:00         184,690  56%   29.36MB/s    0:00:00 (xfr#43, to-chk=6/72)
30-Nov-2024 00:33:00         186,847  57%   25.46MB/s    0:00:00 (xfr#44, to-chk=5/72)
30-Nov-2024 00:33:00         190,380  58%   25.94MB/s    0:00:00 (xfr#45, to-chk=4/72)
30-Nov-2024 00:33:00         190,665  58%   25.98MB/s    0:00:00 (xfr#46, to-chk=1/72)
30-Nov-2024 00:33:00         190,950  58%   26.01MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         190,950  58%   22.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         190,950  58%   22.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         190,950  58%   22.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         190,950  58%   22.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00         190,950  58%   22.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-paris-0/cluster-manager
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-oneprovider-paris-0/op-panel
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00          33,565  33%   32.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00          33,565  33%   32.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00          49,687  49%   47.39MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00          49,978  50%   47.66MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00          49,978  50%    2.98MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-onezone-0/oz-worker
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          13,209   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
30-Nov-2024 00:33:00          27,013  13%   25.76MB/s    0:00:00 (xfr#3, to-chk=11/18)
30-Nov-2024 00:33:00          27,013  13%   25.76MB/s    0:00:00 (xfr#4, to-chk=9/18)
30-Nov-2024 00:33:00          39,742  20%   37.90MB/s    0:00:00 (xfr#5, to-chk=7/18)
30-Nov-2024 00:33:00          39,833  20%   37.99MB/s    0:00:00 (xfr#6, to-chk=5/18)
30-Nov-2024 00:33:00          40,130  20%   38.27MB/s    0:00:00 (xfr#7, to-chk=3/18)
30-Nov-2024 00:33:00          96,952  50%   92.46MB/s    0:00:00 (xfr#8, to-chk=1/18)
30-Nov-2024 00:33:00          96,952  50%   92.46MB/s    0:00:00 (xfr#8, to-chk=0/18)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-onezone-0/cluster-manager
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.24.07/pod-logs/dev-onezone-0/oz-panel
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 00:33:00               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 00:33:00          22,479  13%   21.44MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 00:33:00          45,967  27%   43.84MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 00:33:00          61,159  36%   58.33MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 00:33:00          83,435  49%   79.57MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 00:33:00          83,726  50%   79.85MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 00:33:00          83,726  50%   39.92MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 00:33:00 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1732926769.9794958 exists, exporting anyway.
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 =============================== warnings summary ===============================
30-Nov-2024 00:33:00 tests/utils/rest_utils.py:97
30-Nov-2024 00:33:00   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
30-Nov-2024 00:33:00     print("""
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 tests/utils/path_utils.py:112
30-Nov-2024 00:33:00   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
30-Nov-2024 00:33:00     return path.replace("'", "\\'").replace(' ', '\ ')
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 tests/utils/acceptance_utils.py:55
30-Nov-2024 00:33:00   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
30-Nov-2024 00:33:00     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 tests/utils/acceptance_utils.py:57
30-Nov-2024 00:33:00   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
30-Nov-2024 00:33:00     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
30-Nov-2024 00:33:00
30-Nov-2024 00:33:00 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
30-Nov-2024 00:33:00 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance/test-reports/results.xml -
30-Nov-2024 00:33:00 ================== 9 passed, 4 warnings in 537.03s (0:08:57) ===================
30-Nov-2024 00:33:04 release "dev" uninstalled
30-Nov-2024 00:33:05 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
30-Nov-2024 00:33:05 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
30-Nov-2024 00:33:13 No resources found
30-Nov-2024 00:33:14 Sidecar injection has been disabled
30-Nov-2024 00:33:14 Cleaning helm release "dev"...
30-Nov-2024 00:33:14 Deleted 1 helm deployments
30-Nov-2024 00:33:14 Deleted 0 k8s deployments
30-Nov-2024 00:33:14 Deleted 0 k8s services
30-Nov-2024 00:33:14 Deleted 0 persistent volumes
30-Nov-2024 00:33:14 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 00:33:14 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
30-Nov-2024 00:33:14 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 00:33:14 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
30-Nov-2024 00:33:14 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
30-Nov-2024 00:33:14 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 00:33:14 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
30-Nov-2024 00:33:14 Finished task 'Run acceptance oneclient tests' with result: Success
30-Nov-2024 00:33:14 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
30-Nov-2024 00:33:14 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS...
30-Nov-2024 00:33:14 Finished task 'Parse test results' with result: Success
30-Nov-2024 00:33:14 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoHostname} with S3
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoPort} with 10161
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.planRepository.branchName} with develop
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoHostname} with S3
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoPort} with 10161
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.planRepository.branchName} with develop
30-Nov-2024 00:33:14
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
30-Nov-2024 00:33:14 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 00:33:14
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio symlinks #3372 (ODSRV-OAP-MRDS-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDS-3372-ScriptBuildTask-7701679804842886668.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance
30-Nov-2024 00:33:14 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_directio_symlinks.tar.gz
30-Nov-2024 00:33:14 Uploading artifact
30-Nov-2024 00:33:14     source path: surefire_multiprovider_replication_directio_symlinks.tar.gz
30-Nov-2024 00:33:14     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_directio_symlinks.tar.gz
30-Nov-2024 00:33:14 Finished task 'Pack and push surefire artifact' with result: Success
30-Nov-2024 00:33:14 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 00:33:14 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 00:33:14
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio symlinks #3372 (ODSRV-OAP-MRDS-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDS-3372-ScriptBuildTask-2351163657689930479.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS
30-Nov-2024 00:33:14 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
30-Nov-2024 00:33:15 Finished task 'Pack logs' with result: Success
30-Nov-2024 00:33:15 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 00:33:15
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
30-Nov-2024 00:33:15 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 00:33:15
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio symlinks #3372 (ODSRV-OAP-MRDS-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDS-3372-ScriptBuildTask-12179366670730362317.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS/onedata-acceptance
30-Nov-2024 00:33:15   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
30-Nov-2024 00:33:15                                  Dload  Upload   Total   Spent    Left  Speed
30-Nov-2024 00:33:15
30-Nov-2024 00:33:15   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
30-Nov-2024 00:33:15 100  4822  100  4822    0     0  62623      0 --:--:-- --:--:-- --:--:-- 62623
30-Nov-2024 00:33:15 Clearing /tmp/onedata and /home/bamboo/.one-env
30-Nov-2024 00:33:16 Cleaning helm deployments
30-Nov-2024 00:33:16 Cleanining pods
30-Nov-2024 00:33:16 Cleaning kube persistant volumes
30-Nov-2024 00:33:16 Cleaning dockswift container
30-Nov-2024 00:33:16 Cleaning docker containers
30-Nov-2024 00:33:19 Stalled docker containers to remove:
30-Nov-2024 00:33:19 0116653b8bc6 d31e83e4b9cb 73fac9ec9e4c fbd279f49e5a 9a722794ea3b 3d2ee04e670b 4d3ac138cc3c 8a8e8eb48575 92e67e000c01 0fe0f3f82c1f b1fc1336e401 64b4f3820483 f84f0d97e62a 8758a60dc2b0 35448e05b30b bc3946341212 74f95236cf62 53f2d782cb8f 93faa5327ba9 4bbdbceaa313
30-Nov-2024 00:33:19 Removing stalled docker containers
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 0116653b8bc6: Container 0116653b8bc6f332baccd4a0054f9007ddae655b92b3a886eb14289e90d07a03 is not running
30-Nov-2024 00:33:19 0116653b8bc6
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: d31e83e4b9cb: Container d31e83e4b9cb9fb6d308070e68363501f118842c3fc9e8dda01b17590729f6ab is not running
30-Nov-2024 00:33:19 d31e83e4b9cb
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 73fac9ec9e4c: Container 73fac9ec9e4c2c61ee341502cc4c26f3fc1ffedf2b442f71852f287713060148 is not running
30-Nov-2024 00:33:19 73fac9ec9e4c
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: fbd279f49e5a: Container fbd279f49e5a5f9e02033ae6a74eb73c519c63b362979617ba8b824dea7b58ae is not running
30-Nov-2024 00:33:19 fbd279f49e5a
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 9a722794ea3b: Container 9a722794ea3bfd7282e705a756ea36227c4c9e9340548e2b9a59b2acc9e2483f is not running
30-Nov-2024 00:33:19 9a722794ea3b
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 3d2ee04e670b: Container 3d2ee04e670b850e1d7042edd50e352eab16ab6b9d1cc46a34989a6d41a8acdd is not running
30-Nov-2024 00:33:19 3d2ee04e670b
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 4d3ac138cc3c: Container 4d3ac138cc3c149b35db8606c3f86ac7391694bc13e62e5f00041642223172be is not running
30-Nov-2024 00:33:19 4d3ac138cc3c
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 8a8e8eb48575: Container 8a8e8eb485759f9d9209a407cd4364ab6e90d337004f4f8b6601b20c41c73724 is not running
30-Nov-2024 00:33:19 8a8e8eb48575
30-Nov-2024 00:33:19 Error response from daemon: Cannot kill container: 92e67e000c01: Container 92e67e000c013e84b27b491ae04eafb0052744be48cc0b40cd6dae27a472966e is not running
30-Nov-2024 00:33:19 92e67e000c01
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 0fe0f3f82c1f: Container 0fe0f3f82c1f79bec870b04f940ad2d69ad77db5117448192316085cc7d50f29 is not running
30-Nov-2024 00:33:20 0fe0f3f82c1f
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: b1fc1336e401: Container b1fc1336e401cd9acbcecff64de091b8b770bde6ee1ce8a8fabe8aae9571e935 is not running
30-Nov-2024 00:33:20 b1fc1336e401
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 64b4f3820483: Container 64b4f38204833513eca356752f422e4e6e171bf03a61403a3bd55301c63e240f is not running
30-Nov-2024 00:33:20 64b4f3820483
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: f84f0d97e62a: Container f84f0d97e62a6c378ff01c7cf8852482884bf3f9b9851f16f01deba5cfc0fa18 is not running
30-Nov-2024 00:33:20 f84f0d97e62a
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 8758a60dc2b0: Container 8758a60dc2b0a7fd44ce1ccaaa93e8d4a078cbe302820f03834e5a5d3ac7fed7 is not running
30-Nov-2024 00:33:20 8758a60dc2b0
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 35448e05b30b: Container 35448e05b30b68e6acb22ac790db2bb1e2717d3b9349b115f0696f872040abf9 is not running
30-Nov-2024 00:33:20 35448e05b30b
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: bc3946341212: Container bc39463412123d102b13ad0e79c53da65e904b8e14dee103dd6c0aeac9b696ae is not running
30-Nov-2024 00:33:20 bc3946341212
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 74f95236cf62: Container 74f95236cf6282ae32503925d9128a145d43096c8b19e9bd721bfb34e1c909cc is not running
30-Nov-2024 00:33:20 74f95236cf62
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 53f2d782cb8f: Container 53f2d782cb8f2e229c05ae266ee18ccb1dd8c6e9a5cd5e912ae5624d6b947afd is not running
30-Nov-2024 00:33:20 53f2d782cb8f
30-Nov-2024 00:33:20 Error response from daemon: Cannot kill container: 93faa5327ba9: Container 93faa5327ba9c08e2c226893d4a9a734451d2a33b89f2f69b03517bb5f52ab70 is not running
30-Nov-2024 00:33:20 93faa5327ba9
30-Nov-2024 00:33:21 4bbdbceaa313
30-Nov-2024 00:33:21 4bbdbceaa313
30-Nov-2024 00:33:21 Stalled docker volumes to remove:
30-Nov-2024 00:33:21
30-Nov-2024 00:33:21 Removing stalled docker volumes
30-Nov-2024 00:33:21 Removing stalled loopdevices
30-Nov-2024 00:33:22 Done
30-Nov-2024 00:33:22 Finished task 'Clear env and working dir' with result: Success
30-Nov-2024 00:33:22 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
30-Nov-2024 00:33:22 Running post build plugin 'Docker Container Cleanup'
30-Nov-2024 00:33:22 Running post build plugin 'NCover Results Collector'
30-Nov-2024 00:33:22 Running post build plugin 'Build Results Label Collector'
30-Nov-2024 00:33:22 Running post build plugin 'Clover Results Collector'
30-Nov-2024 00:33:22 Running post build plugin 'npm Cache Cleanup'
30-Nov-2024 00:33:22 Running post build plugin 'Artifact Copier'
30-Nov-2024 00:33:22 Publishing an artifact: test_logs.tar.gz
30-Nov-2024 00:33:22 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 87.41 ms
30-Nov-2024 00:33:23 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDS'
30-Nov-2024 00:33:23 Finalising the build...
30-Nov-2024 00:33:23 Stopping timer.
30-Nov-2024 00:33:23 Build ODSRV-OAP-MRDS-3372 completed.
30-Nov-2024 00:33:23 Running on server: post build plugin 'Build Hanging Detection Configuration'
30-Nov-2024 00:33:23 Running on server: post build plugin 'NCover Results Collector'
30-Nov-2024 00:33:23 Running on server: post build plugin 'Build Labeller'
30-Nov-2024 00:33:23 Running on server: post build plugin 'Clover Delta Calculator'
30-Nov-2024 00:33:23 Running on server: post build plugin 'Maven Dependencies Postprocessor'
30-Nov-2024 00:33:23 All post build plugins have finished
30-Nov-2024 00:33:23 Generating build results summary...
30-Nov-2024 00:33:23 Saving build results to disk...
30-Nov-2024 00:33:23 Store variable context...
30-Nov-2024 00:33:23 Finished building ODSRV-OAP-MRDS-3372.