oneclient acceptance tests using environment deployed from packages

Build: #3366 failed

Job: multiprovider replication proxyio symlinks was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,389 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'groupadd', '-g', '55062', 'space2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'usermod', '-a', '-G', 'space2', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'usermod', '-a', '-G', 'space2', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'grep', '-q', 'fuse', '/etc/group']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'groupadd', '-g', '46411', 'fuse']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
19-Nov-2024 22:34:17 Adding user `space_owner' ...
19-Nov-2024 22:34:17 Adding new group `space_owner' (24849) ...
19-Nov-2024 22:34:17 Adding new user `space_owner' (24849) with group `space_owner' ...
19-Nov-2024 22:34:17 Creating home directory `/home/space_owner' ...
19-Nov-2024 22:34:17 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
19-Nov-2024 22:34:17 Adding user `user1' ...
19-Nov-2024 22:34:17 Adding new group `user1' (25687) ...
19-Nov-2024 22:34:17 Adding new user `user1' (25687) with group `user1' ...
19-Nov-2024 22:34:17 Creating home directory `/home/user1' ...
19-Nov-2024 22:34:17 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
19-Nov-2024 22:34:17 Adding user `user2' ...
19-Nov-2024 22:34:17 Adding new group `user2' (30628) ...
19-Nov-2024 22:34:17 Adding new user `user2' (30628) with group `user2' ...
19-Nov-2024 22:34:17 Creating home directory `/home/user2' ...
19-Nov-2024 22:34:17 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
19-Nov-2024 22:34:17 Adding user `space_owner' ...
19-Nov-2024 22:34:17 Adding new group `space_owner' (24849) ...
19-Nov-2024 22:34:17 Adding new user `space_owner' (24849) with group `space_owner' ...
19-Nov-2024 22:34:17 Creating home directory `/home/space_owner' ...
19-Nov-2024 22:34:17 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:17 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
19-Nov-2024 22:34:17 id: ‘user2’: no such user
19-Nov-2024 22:34:17 command terminated with exit code 1
19-Nov-2024 22:34:18 command terminated with exit code 1
19-Nov-2024 22:34:20 command terminated with exit code 1
19-Nov-2024 22:34:21 command terminated with exit code 1
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
19-Nov-2024 22:34:56 Adding user `user1' ...
19-Nov-2024 22:34:56 Adding new group `user1' (25687) ...
19-Nov-2024 22:34:56 Adding new user `user1' (25687) with group `user1' ...
19-Nov-2024 22:34:56 Creating home directory `/home/user1' ...
19-Nov-2024 22:34:56 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
19-Nov-2024 22:34:56 Adding user `user2' ...
19-Nov-2024 22:34:56 Adding new group `user2' (30628) ...
19-Nov-2024 22:34:56 Adding new user `user2' (30628) with group `user2' ...
19-Nov-2024 22:34:56 Creating home directory `/home/user2' ...
19-Nov-2024 22:34:56 Copying files from `/etc/skel' ...
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
19-Nov-2024 22:34:56 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 =================================================================
19-Nov-2024 22:34:56 - Executing scenario 'Create files on one provider and see them on the other provider'
19-Nov-2024 22:34:56 - from feature 'Multiprovider_replication'
19-Nov-2024 22:34:56 -----------------------------------------------------------------
19-Nov-2024 22:34:56 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:34:56 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:34:56 using [token, token] by [user1, user2]"'
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:34:56 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/pjexcdox783nno5s
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/pjexcdox783nno5s --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/pjexcdox783nno5s
19-Nov-2024 22:34:56 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '4587848799905200706'...
19-Nov-2024 22:34:56 Getting configuration...
19-Nov-2024 22:34:56 Oneclient has been successfully mounted in '/tmp/onedata/mnt/pjexcdox783nno5s'.
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:34:56 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:34:56 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/10ao4u3nauofq6wl
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/10ao4u3nauofq6wl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/10ao4u3nauofq6wl
19-Nov-2024 22:34:56 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '45539415716506777'...
19-Nov-2024 22:34:56 Getting configuration...
19-Nov-2024 22:34:56 Oneclient has been successfully mounted in '/tmp/onedata/mnt/10ao4u3nauofq6wl'.
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
19-Nov-2024 22:34:56 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
19-Nov-2024 22:34:56 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
19-Nov-2024 22:34:56 =================================================================
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 PASSED
19-Nov-2024 22:34:56 Unmounting client from /tmp/onedata/mnt/pjexcdox783nno5s
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56 Unmounting client from /tmp/onedata/mnt/10ao4u3nauofq6wl
19-Nov-2024 22:34:56
19-Nov-2024 22:34:56
19-Nov-2024 22:35:30 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:35:30 =================================================================
19-Nov-2024 22:35:30 - Executing scenario 'Create empty file on one provider and read it on the other provider'
19-Nov-2024 22:35:30 - from feature 'Multiprovider_replication'
19-Nov-2024 22:35:30 -----------------------------------------------------------------
19-Nov-2024 22:35:30 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:35:30 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:35:30 using [token, token] by [user1, user2]"'
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:35:30 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/qqdq8fwb1e97wr9s
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/qqdq8fwb1e97wr9s --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/qqdq8fwb1e97wr9s
19-Nov-2024 22:35:30 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '7483008313305917287'...
19-Nov-2024 22:35:30 Getting configuration...
19-Nov-2024 22:35:30 Oneclient has been successfully mounted in '/tmp/onedata/mnt/qqdq8fwb1e97wr9s'.
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:35:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:35:30 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/c8lgwjwhjzxtswfk
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/c8lgwjwhjzxtswfk --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/c8lgwjwhjzxtswfk
19-Nov-2024 22:35:30 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '18264815368752090451'...
19-Nov-2024 22:35:30 Getting configuration...
19-Nov-2024 22:35:30 Oneclient has been successfully mounted in '/tmp/onedata/mnt/c8lgwjwhjzxtswfk'.
19-Nov-2024 22:35:30
19-Nov-2024 22:35:30 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
19-Nov-2024 22:35:30 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
19-Nov-2024 22:35:30 =================================================================
19-Nov-2024 22:35:30
19-Nov-2024 22:35:31 PASSED
19-Nov-2024 22:35:31 Unmounting client from /tmp/onedata/mnt/qqdq8fwb1e97wr9s
19-Nov-2024 22:35:31
19-Nov-2024 22:35:31
19-Nov-2024 22:35:31 Unmounting client from /tmp/onedata/mnt/c8lgwjwhjzxtswfk
19-Nov-2024 22:35:31
19-Nov-2024 22:35:31
19-Nov-2024 22:36:03 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:36:03 =================================================================
19-Nov-2024 22:36:03 - Executing scenario 'Write to file on one provider and check size on the other provider'
19-Nov-2024 22:36:03 - from feature 'Multiprovider_replication'
19-Nov-2024 22:36:03 -----------------------------------------------------------------
19-Nov-2024 22:36:03 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:36:03 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:36:03 using [token, token] by [user1, user2]"'
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:36:03 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/zm0jo22fcdif7wdz
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/zm0jo22fcdif7wdz --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/zm0jo22fcdif7wdz
19-Nov-2024 22:36:03 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2095054358127698591'...
19-Nov-2024 22:36:03 Getting configuration...
19-Nov-2024 22:36:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/zm0jo22fcdif7wdz'.
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:36:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:36:03 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/xvrcod057visndbl
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/xvrcod057visndbl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/xvrcod057visndbl
19-Nov-2024 22:36:03 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3233250697479360604'...
19-Nov-2024 22:36:03 Getting configuration...
19-Nov-2024 22:36:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/xvrcod057visndbl'.
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
19-Nov-2024 22:36:03 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
19-Nov-2024 22:36:03 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
19-Nov-2024 22:36:03 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
19-Nov-2024 22:36:03 =================================================================
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 PASSED
19-Nov-2024 22:36:03 Unmounting client from /tmp/onedata/mnt/zm0jo22fcdif7wdz
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03 Unmounting client from /tmp/onedata/mnt/xvrcod057visndbl
19-Nov-2024 22:36:03
19-Nov-2024 22:36:03
19-Nov-2024 22:36:48 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:36:48 =================================================================
19-Nov-2024 22:36:48 - Executing scenario 'Write to file on one provider and read on the other provider'
19-Nov-2024 22:36:48 - from feature 'Multiprovider_replication'
19-Nov-2024 22:36:48 -----------------------------------------------------------------
19-Nov-2024 22:36:48 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:36:48 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:36:48 using [token, token] by [user1, user2]"'
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:36:48 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/jkdqkrluejo70war
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/jkdqkrluejo70war --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/jkdqkrluejo70war
19-Nov-2024 22:36:48 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2538919197397515808'...
19-Nov-2024 22:36:48 Getting configuration...
19-Nov-2024 22:36:48 Oneclient has been successfully mounted in '/tmp/onedata/mnt/jkdqkrluejo70war'.
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:36:48 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:36:48 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/bkqhmj7zrc90mnce
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/bkqhmj7zrc90mnce --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/bkqhmj7zrc90mnce
19-Nov-2024 22:36:48 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11318655741588504694'...
19-Nov-2024 22:36:48 Getting configuration...
19-Nov-2024 22:36:48 Oneclient has been successfully mounted in '/tmp/onedata/mnt/bkqhmj7zrc90mnce'.
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:36:48 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
19-Nov-2024 22:36:48 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
19-Nov-2024 22:36:48 =================================================================
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 PASSED
19-Nov-2024 22:36:48 Unmounting client from /tmp/onedata/mnt/jkdqkrluejo70war
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48 Unmounting client from /tmp/onedata/mnt/bkqhmj7zrc90mnce
19-Nov-2024 22:36:48
19-Nov-2024 22:36:48
19-Nov-2024 22:37:24 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:37:24 =================================================================
19-Nov-2024 22:37:24 - Executing scenario 'Big file transfer with MD5 check'
19-Nov-2024 22:37:24 - from feature 'Multiprovider_replication'
19-Nov-2024 22:37:24 -----------------------------------------------------------------
19-Nov-2024 22:37:24 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:37:24 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:37:24 using [token, token] by [user1, user2]"'
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:37:24 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/6w6furzczira3yqa
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/6w6furzczira3yqa --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/6w6furzczira3yqa
19-Nov-2024 22:37:24 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '14064362157846490424'...
19-Nov-2024 22:37:24 Getting configuration...
19-Nov-2024 22:37:24 Oneclient has been successfully mounted in '/tmp/onedata/mnt/6w6furzczira3yqa'.
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:37:24 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:37:24 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/hg7y7wro1llqink0
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/hg7y7wro1llqink0 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/hg7y7wro1llqink0
19-Nov-2024 22:37:24 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '10645204257414928521'...
19-Nov-2024 22:37:24 Getting configuration...
19-Nov-2024 22:37:24 Oneclient has been successfully mounted in '/tmp/onedata/mnt/hg7y7wro1llqink0'.
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:37:24 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
19-Nov-2024 22:37:24 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
19-Nov-2024 22:37:24 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
19-Nov-2024 22:37:24 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
19-Nov-2024 22:37:24 =================================================================
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 PASSED
19-Nov-2024 22:37:24 Unmounting client from /tmp/onedata/mnt/6w6furzczira3yqa
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24 Unmounting client from /tmp/onedata/mnt/hg7y7wro1llqink0
19-Nov-2024 22:37:24
19-Nov-2024 22:37:24
19-Nov-2024 22:38:34 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:38:34 =================================================================
19-Nov-2024 22:38:34 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
19-Nov-2024 22:38:34 - from feature 'Multiprovider_replication'
19-Nov-2024 22:38:34 -----------------------------------------------------------------
19-Nov-2024 22:38:34 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:38:34 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:38:34 using [token, token] by [user1, user2]"'
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:38:34 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/13fdkdlyelfsd6na
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/13fdkdlyelfsd6na --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/13fdkdlyelfsd6na
19-Nov-2024 22:38:34 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '14393717000841727424'...
19-Nov-2024 22:38:34 Getting configuration...
19-Nov-2024 22:38:34 Oneclient has been successfully mounted in '/tmp/onedata/mnt/13fdkdlyelfsd6na'.
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:38:34 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:38:34 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/bkpgucez588w83yf
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/bkpgucez588w83yf --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/bkpgucez588w83yf
19-Nov-2024 22:38:34 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '7294841924844522370'...
19-Nov-2024 22:38:34 Getting configuration...
19-Nov-2024 22:38:34 Oneclient has been successfully mounted in '/tmp/onedata/mnt/bkpgucez588w83yf'.
19-Nov-2024 22:38:34
19-Nov-2024 22:38:34 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
19-Nov-2024 22:38:34 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
19-Nov-2024 22:38:34 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
19-Nov-2024 22:38:34 =================================================================
19-Nov-2024 22:38:34
19-Nov-2024 22:38:35 PASSED
19-Nov-2024 22:38:35 Unmounting client from /tmp/onedata/mnt/13fdkdlyelfsd6na
19-Nov-2024 22:38:35
19-Nov-2024 22:38:35
19-Nov-2024 22:38:35 Unmounting client from /tmp/onedata/mnt/bkpgucez588w83yf
19-Nov-2024 22:38:35
19-Nov-2024 22:38:35
19-Nov-2024 22:39:15 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:39:15 =================================================================
19-Nov-2024 22:39:15 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
19-Nov-2024 22:39:15 - from feature 'Multiprovider_replication'
19-Nov-2024 22:39:15 -----------------------------------------------------------------
19-Nov-2024 22:39:15 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:39:15 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:39:15 using [token, token] by [user1, user2]"'
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:39:15 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/rmj53hbsr9r1doww
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/rmj53hbsr9r1doww --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/rmj53hbsr9r1doww
19-Nov-2024 22:39:15 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '453411881101803042'...
19-Nov-2024 22:39:15 Getting configuration...
19-Nov-2024 22:39:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/rmj53hbsr9r1doww'.
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:39:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:39:15 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/slztvwwhoiv2g8t4
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/slztvwwhoiv2g8t4 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/slztvwwhoiv2g8t4
19-Nov-2024 22:39:15 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '16221618477901550178'...
19-Nov-2024 22:39:15 Getting configuration...
19-Nov-2024 22:39:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/slztvwwhoiv2g8t4'.
19-Nov-2024 22:39:15
19-Nov-2024 22:39:15 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:39:15 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
19-Nov-2024 22:39:15 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
19-Nov-2024 22:39:15 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
19-Nov-2024 22:39:15 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
19-Nov-2024 22:39:15 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
19-Nov-2024 22:39:15 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
19-Nov-2024 22:39:15 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
19-Nov-2024 22:39:15 =================================================================
19-Nov-2024 22:39:15
19-Nov-2024 22:39:16 PASSED
19-Nov-2024 22:39:16 Unmounting client from /tmp/onedata/mnt/rmj53hbsr9r1doww
19-Nov-2024 22:39:16
19-Nov-2024 22:39:16
19-Nov-2024 22:39:16 Unmounting client from /tmp/onedata/mnt/slztvwwhoiv2g8t4
19-Nov-2024 22:39:16
19-Nov-2024 22:39:16
19-Nov-2024 22:40:26 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:40:26 =================================================================
19-Nov-2024 22:40:26 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
19-Nov-2024 22:40:26 - from feature 'Multiprovider_replication'
19-Nov-2024 22:40:26 -----------------------------------------------------------------
19-Nov-2024 22:40:26 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:40:26 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:40:26 using [token, token] by [user1, user2]"'
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:40:26 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/zf86l5xq9qui4hbe
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/zf86l5xq9qui4hbe --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/zf86l5xq9qui4hbe
19-Nov-2024 22:40:26 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '6060834779761384661'...
19-Nov-2024 22:40:26 Getting configuration...
19-Nov-2024 22:40:26 Oneclient has been successfully mounted in '/tmp/onedata/mnt/zf86l5xq9qui4hbe'.
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:40:26 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:40:26 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/x0lkyp724c4sn5hf
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/x0lkyp724c4sn5hf --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/x0lkyp724c4sn5hf
19-Nov-2024 22:40:26 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '6438637434844318905'...
19-Nov-2024 22:40:26 Getting configuration...
19-Nov-2024 22:40:26 Oneclient has been successfully mounted in '/tmp/onedata/mnt/x0lkyp724c4sn5hf'.
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
19-Nov-2024 22:40:26 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
19-Nov-2024 22:40:26 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
19-Nov-2024 22:40:26 =================================================================
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 PASSED
19-Nov-2024 22:40:26 Unmounting client from /tmp/onedata/mnt/zf86l5xq9qui4hbe
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26 Unmounting client from /tmp/onedata/mnt/x0lkyp724c4sn5hf
19-Nov-2024 22:40:26
19-Nov-2024 22:40:26
19-Nov-2024 22:41:11 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
19-Nov-2024 22:41:11 =================================================================
19-Nov-2024 22:41:11 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
19-Nov-2024 22:41:11 - from feature 'Multiprovider_replication'
19-Nov-2024 22:41:11 -----------------------------------------------------------------
19-Nov-2024 22:41:11 -- Executing step: 'Given "oneclients [client11, client21]
19-Nov-2024 22:41:11 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
19-Nov-2024 22:41:11 using [token, token] by [user1, user2]"'
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-w9xxf', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf'
19-Nov-2024 22:41:11 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-w9xxf' successfully started
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/jr1ym79olnum6h6s
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/jr1ym79olnum6h6s --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/jr1ym79olnum6h6s
19-Nov-2024 22:41:11 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10765849572289097250'...
19-Nov-2024 22:41:11 Getting configuration...
19-Nov-2024 22:41:11 Oneclient has been successfully mounted in '/tmp/onedata/mnt/jr1ym79olnum6h6s'.
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
19-Nov-2024 22:41:11 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-vxkvw', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw'
19-Nov-2024 22:41:11 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-vxkvw' successfully started
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/1k02zwvqv2vys6ug
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/1k02zwvqv2vys6ug --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/1k02zwvqv2vys6ug
19-Nov-2024 22:41:11 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '16110967681676276143'...
19-Nov-2024 22:41:11 Getting configuration...
19-Nov-2024 22:41:11 Oneclient has been successfully mounted in '/tmp/onedata/mnt/1k02zwvqv2vys6ug'.
19-Nov-2024 22:41:11
19-Nov-2024 22:41:11 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
19-Nov-2024 22:41:11 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
19-Nov-2024 22:41:11 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
19-Nov-2024 22:41:11 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
19-Nov-2024 22:41:11 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
19-Nov-2024 22:41:11 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
19-Nov-2024 22:41:11 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
19-Nov-2024 22:41:11 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
19-Nov-2024 22:41:11 =================================================================
19-Nov-2024 22:41:11
19-Nov-2024 22:41:23 PASSED
19-Nov-2024 22:41:23 Unmounting client from /tmp/onedata/mnt/jr1ym79olnum6h6s
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 Unmounting client from /tmp/onedata/mnt/1k02zwvqv2vys6ug
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1732056072.3175385', '-c', '/tmp/logs']
19-Nov-2024 22:41:23 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-8pjmx. See /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-cross-support-job-3p-users-8pjmx/entrypoint.log for more details
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-w9xxf: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneclient-krakow-7d9476b8bc-w9xxf/oneclient_logs
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23         123,759   4%  118.03MB/s    0:00:00 (xfr#1, to-chk=64/80)
19-Nov-2024 22:41:23         123,759   4%  118.03MB/s    0:00:00 (xfr#1, to-chk=58/80)
19-Nov-2024 22:41:23         124,221   4%  118.47MB/s    0:00:00 (xfr#2, to-chk=60/80)
19-Nov-2024 22:41:23         558,598  20%   20.49MB/s    0:00:00 (xfr#3, to-chk=59/80)
19-Nov-2024 22:41:23         559,060  20%   20.51MB/s    0:00:00 (xfr#4, to-chk=58/80)
19-Nov-2024 22:41:23         690,694  25%   17.80MB/s    0:00:00 (xfr#5, to-chk=57/80)
19-Nov-2024 22:41:23         691,060  25%   17.81MB/s    0:00:00 (xfr#6, to-chk=53/80)
19-Nov-2024 22:41:23       1,015,146  37%   21.51MB/s    0:00:00 (xfr#7, to-chk=52/80)
19-Nov-2024 22:41:23       1,015,512  37%   21.52MB/s    0:00:00 (xfr#8, to-chk=51/80)
19-Nov-2024 22:41:23       1,052,984  39%   21.83MB/s    0:00:00 (xfr#9, to-chk=50/80)
19-Nov-2024 22:41:23       1,053,350  39%   21.84MB/s    0:00:00 (xfr#10, to-chk=46/80)
19-Nov-2024 22:41:23       1,167,693  43%   23.20MB/s    0:00:00 (xfr#11, to-chk=45/80)
19-Nov-2024 22:41:23       1,168,059  43%   23.21MB/s    0:00:00 (xfr#12, to-chk=44/80)
19-Nov-2024 22:41:23       1,240,681  46%   23.66MB/s    0:00:00 (xfr#13, to-chk=43/80)
19-Nov-2024 22:41:23       1,241,143  46%   23.67MB/s    0:00:00 (xfr#14, to-chk=39/80)
19-Nov-2024 22:41:23       1,488,075  55%   26.78MB/s    0:00:00 (xfr#15, to-chk=38/80)
19-Nov-2024 22:41:23       1,488,537  55%   26.29MB/s    0:00:00 (xfr#16, to-chk=37/80)
19-Nov-2024 22:41:23       1,527,058  56%   26.97MB/s    0:00:00 (xfr#17, to-chk=36/80)
19-Nov-2024 22:41:23       1,527,616  56%   26.98MB/s    0:00:00 (xfr#18, to-chk=32/80)
19-Nov-2024 22:41:23       1,663,381  62%   28.84MB/s    0:00:00 (xfr#19, to-chk=31/80)
19-Nov-2024 22:41:23       1,663,939  62%   28.85MB/s    0:00:00 (xfr#20, to-chk=30/80)
19-Nov-2024 22:41:23       1,664,567  62%   28.86MB/s    0:00:00 (xfr#21, to-chk=29/80)
19-Nov-2024 22:41:23       1,690,746  63%   28.79MB/s    0:00:00 (xfr#22, to-chk=28/80)
19-Nov-2024 22:41:23       1,691,208  63%   28.80MB/s    0:00:00 (xfr#23, to-chk=24/80)
19-Nov-2024 22:41:23       1,777,588  66%   28.73MB/s    0:00:00 (xfr#24, to-chk=23/80)
19-Nov-2024 22:41:23       1,778,050  66%   28.74MB/s    0:00:00 (xfr#25, to-chk=22/80)
19-Nov-2024 22:41:23       1,814,388  67%   28.84MB/s    0:00:00 (xfr#26, to-chk=21/80)
19-Nov-2024 22:41:23       1,814,946  67%   28.85MB/s    0:00:00 (xfr#27, to-chk=17/80)
19-Nov-2024 22:41:23       1,938,684  72%   28.89MB/s    0:00:00 (xfr#28, to-chk=16/80)
19-Nov-2024 22:41:23       1,939,242  72%   28.90MB/s    0:00:00 (xfr#29, to-chk=15/80)
19-Nov-2024 22:41:23       2,067,546  77%   27.77MB/s    0:00:00 (xfr#30, to-chk=14/80)
19-Nov-2024 22:41:23       2,068,200  77%   27.78MB/s    0:00:00 (xfr#31, to-chk=10/80)
19-Nov-2024 22:41:23       2,517,929  93%   27.60MB/s    0:00:00 (xfr#32, to-chk=9/80)
19-Nov-2024 22:41:23 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
19-Nov-2024 22:41:23 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
19-Nov-2024 22:41:23       2,518,583  93%   27.61MB/s    0:00:00 (xfr#33, to-chk=8/80)
19-Nov-2024 22:41:23       2,555,072  95%   27.69MB/s    0:00:00 (xfr#34, to-chk=7/80)
19-Nov-2024 22:41:23       2,555,630  95%   27.70MB/s    0:00:00 (xfr#35, to-chk=3/80)
19-Nov-2024 22:41:23       2,665,504  99%   28.56MB/s    0:00:00 (xfr#36, to-chk=2/80)
19-Nov-2024 22:41:23       2,666,062  99%   28.57MB/s    0:00:00 (xfr#37, to-chk=1/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   28.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   24.57MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   24.57MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23       2,678,911  99%   24.57MB/s    0:00:00 (xfr#38, to-chk=0/80)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-vxkvw: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneclient-paris-5cc45c8cb7-vxkvw/oneclient_logs
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=66/81)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          42,254   1%   40.30MB/s    0:00:00 (xfr#1, to-chk=65/81)
19-Nov-2024 22:41:23          42,254   1%   40.30MB/s    0:00:00 (xfr#1, to-chk=59/81)
19-Nov-2024 22:41:23          42,812   1%   40.83MB/s    0:00:00 (xfr#2, to-chk=61/81)
19-Nov-2024 22:41:23         199,516   7%   27.18MB/s    0:00:00 (xfr#3, to-chk=60/81)
19-Nov-2024 22:41:23         200,074   7%   23.85MB/s    0:00:00 (xfr#4, to-chk=59/81)
19-Nov-2024 22:41:23         200,702   7%   23.93MB/s    0:00:00 (xfr#5, to-chk=58/81)
19-Nov-2024 22:41:23         246,072   8%   26.07MB/s    0:00:00 (xfr#6, to-chk=57/81)
19-Nov-2024 22:41:23         246,534   8%   23.51MB/s    0:00:00 (xfr#7, to-chk=53/81)
19-Nov-2024 22:41:23         455,203  16%   33.39MB/s    0:00:00 (xfr#8, to-chk=52/81)
19-Nov-2024 22:41:23         455,665  16%   33.43MB/s    0:00:00 (xfr#9, to-chk=51/81)
19-Nov-2024 22:41:23         555,098  20%   33.09MB/s    0:00:00 (xfr#10, to-chk=50/81)
19-Nov-2024 22:41:23         555,656  20%   33.12MB/s    0:00:00 (xfr#11, to-chk=46/81)
19-Nov-2024 22:41:23         991,180  36%   36.36MB/s    0:00:00 (xfr#12, to-chk=45/81)
19-Nov-2024 22:41:23         991,738  36%   36.38MB/s    0:00:00 (xfr#13, to-chk=44/81)
19-Nov-2024 22:41:23       1,066,007  38%   35.06MB/s    0:00:00 (xfr#14, to-chk=43/81)
19-Nov-2024 22:41:23       1,066,661  38%   35.08MB/s    0:00:00 (xfr#15, to-chk=39/81)
19-Nov-2024 22:41:23       1,339,328  48%   37.57MB/s    0:00:00 (xfr#16, to-chk=38/81)
19-Nov-2024 22:41:23       1,339,982  48%   37.59MB/s    0:00:00 (xfr#17, to-chk=37/81)
19-Nov-2024 22:41:23       1,373,934  50%   37.44MB/s    0:00:00 (xfr#18, to-chk=36/81)
19-Nov-2024 22:41:23       1,374,204  50%   37.44MB/s    0:00:00 (xfr#19, to-chk=32/81)
19-Nov-2024 22:41:23       1,473,679  53%   39.04MB/s    0:00:00 (xfr#20, to-chk=31/81)
19-Nov-2024 22:41:23       1,473,949  53%   39.05MB/s    0:00:00 (xfr#21, to-chk=30/81)
19-Nov-2024 22:41:23       1,584,681  57%   38.75MB/s    0:00:00 (xfr#22, to-chk=29/81)
19-Nov-2024 22:41:23       1,585,239  57%   38.76MB/s    0:00:00 (xfr#23, to-chk=25/81)
19-Nov-2024 22:41:23       1,822,795  66%   40.43MB/s    0:00:00 (xfr#24, to-chk=24/81)
19-Nov-2024 22:41:23       1,823,353  66%   39.52MB/s    0:00:00 (xfr#25, to-chk=23/81)
19-Nov-2024 22:41:23       1,850,322  67%   40.10MB/s    0:00:00 (xfr#26, to-chk=22/81)
19-Nov-2024 22:41:23       1,850,880  67%   40.12MB/s    0:00:00 (xfr#27, to-chk=18/81)
19-Nov-2024 22:41:23       1,995,594  72%   41.37MB/s    0:00:00 (xfr#28, to-chk=17/81)
19-Nov-2024 22:41:23       1,996,152  72%   41.38MB/s    0:00:00 (xfr#29, to-chk=16/81)
19-Nov-2024 22:41:23       2,124,053  77%   42.20MB/s    0:00:00 (xfr#30, to-chk=15/81)
19-Nov-2024 22:41:23       2,124,515  77%   41.35MB/s    0:00:00 (xfr#31, to-chk=11/81)
19-Nov-2024 22:41:23       2,597,855  94%   45.05MB/s    0:00:00 (xfr#32, to-chk=10/81)
19-Nov-2024 22:41:23       2,598,317  94%   45.05MB/s    0:00:00 (xfr#33, to-chk=9/81)
19-Nov-2024 22:41:23       2,598,945  94%   45.06MB/s    0:00:00 (xfr#34, to-chk=8/81)
19-Nov-2024 22:41:23       2,624,815  95%   45.51MB/s    0:00:00 (xfr#35, to-chk=7/81)
19-Nov-2024 22:41:23       2,625,277  95%   44.71MB/s    0:00:00 (xfr#36, to-chk=3/81)
19-Nov-2024 22:41:23       2,718,407  98%   44.70MB/s    0:00:00 (xfr#37, to-chk=2/81)
19-Nov-2024 22:41:23       2,718,869  98%   44.71MB/s    0:00:00 (xfr#38, to-chk=1/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   45.15MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   43.65MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23       2,745,941  99%   43.65MB/s    0:00:00 (xfr#39, to-chk=0/81)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-krakow-0/cluster-manager
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-krakow-0/op-worker
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          30,933   9%   29.50MB/s    0:00:00 (xfr#2, to-chk=67/72)
19-Nov-2024 22:41:23          49,093  15%   46.82MB/s    0:00:00 (xfr#3, to-chk=65/72)
19-Nov-2024 22:41:23          49,093  15%   46.82MB/s    0:00:00 (xfr#4, to-chk=63/72)
19-Nov-2024 22:41:23          49,093  15%   46.82MB/s    0:00:00 (xfr#5, to-chk=61/72)
19-Nov-2024 22:41:23          66,120  21%   15.76MB/s    0:00:00 (xfr#6, to-chk=59/72)
19-Nov-2024 22:41:23          66,270  21%   15.80MB/s    0:00:00 (xfr#7, to-chk=57/72)
19-Nov-2024 22:41:23          66,567  21%   15.87MB/s    0:00:00 (xfr#8, to-chk=51/72)
19-Nov-2024 22:41:23         123,637  39%   16.84MB/s    0:00:00 (xfr#9, to-chk=49/72)
19-Nov-2024 22:41:23         124,607  40%   16.98MB/s    0:00:00 (xfr#10, to-chk=39/72)
19-Nov-2024 22:41:23         124,923  40%   14.89MB/s    0:00:00 (xfr#11, to-chk=38/72)
19-Nov-2024 22:41:23         125,902  40%   15.01MB/s    0:00:00 (xfr#12, to-chk=37/72)
19-Nov-2024 22:41:23         126,218  40%   15.05MB/s    0:00:00 (xfr#13, to-chk=36/72)
19-Nov-2024 22:41:23         126,690  40%   15.10MB/s    0:00:00 (xfr#14, to-chk=35/72)
19-Nov-2024 22:41:23         127,378  40%   15.18MB/s    0:00:00 (xfr#15, to-chk=34/72)
19-Nov-2024 22:41:23         128,339  41%   15.30MB/s    0:00:00 (xfr#16, to-chk=33/72)
19-Nov-2024 22:41:23         129,130  41%   15.39MB/s    0:00:00 (xfr#17, to-chk=32/72)
19-Nov-2024 22:41:23         129,782  41%   15.47MB/s    0:00:00 (xfr#18, to-chk=31/72)
19-Nov-2024 22:41:23         129,942  41%   15.49MB/s    0:00:00 (xfr#19, to-chk=30/72)
19-Nov-2024 22:41:23         131,300  42%   15.65MB/s    0:00:00 (xfr#20, to-chk=29/72)
19-Nov-2024 22:41:23         131,616  42%   15.69MB/s    0:00:00 (xfr#21, to-chk=28/72)
19-Nov-2024 22:41:23         132,088  42%   14.00MB/s    0:00:00 (xfr#22, to-chk=27/72)
19-Nov-2024 22:41:23         132,404  42%   14.03MB/s    0:00:00 (xfr#23, to-chk=26/72)
19-Nov-2024 22:41:23         132,881  42%   14.08MB/s    0:00:00 (xfr#24, to-chk=25/72)
19-Nov-2024 22:41:23         134,655  43%   14.27MB/s    0:00:00 (xfr#25, to-chk=24/72)
19-Nov-2024 22:41:23         134,971  43%   14.30MB/s    0:00:00 (xfr#26, to-chk=23/72)
19-Nov-2024 22:41:23         135,596  43%   14.37MB/s    0:00:00 (xfr#27, to-chk=22/72)
19-Nov-2024 22:41:23         139,070  44%   14.74MB/s    0:00:00 (xfr#28, to-chk=21/72)
19-Nov-2024 22:41:23         143,379  46%   15.19MB/s    0:00:00 (xfr#29, to-chk=20/72)
19-Nov-2024 22:41:23         143,832  46%   15.24MB/s    0:00:00 (xfr#30, to-chk=19/72)
19-Nov-2024 22:41:23         145,633  46%   15.43MB/s    0:00:00 (xfr#31, to-chk=18/72)
19-Nov-2024 22:41:23         149,848  48%   14.29MB/s    0:00:00 (xfr#32, to-chk=17/72)
19-Nov-2024 22:41:23         154,519  49%   14.74MB/s    0:00:00 (xfr#33, to-chk=16/72)
19-Nov-2024 22:41:23         156,283  50%   13.55MB/s    0:00:00 (xfr#34, to-chk=15/72)
19-Nov-2024 22:41:23         158,882  51%   12.63MB/s    0:00:00 (xfr#35, to-chk=14/72)
19-Nov-2024 22:41:23         161,843  51%   12.86MB/s    0:00:00 (xfr#36, to-chk=13/72)
19-Nov-2024 22:41:23         165,753  53%   13.17MB/s    0:00:00 (xfr#37, to-chk=12/72)
19-Nov-2024 22:41:23         167,100  53%   13.28MB/s    0:00:00 (xfr#38, to-chk=11/72)
19-Nov-2024 22:41:23         168,445  54%   12.36MB/s    0:00:00 (xfr#39, to-chk=10/72)
19-Nov-2024 22:41:23         171,956  55%   12.61MB/s    0:00:00 (xfr#40, to-chk=9/72)
19-Nov-2024 22:41:23         174,954  56%   12.83MB/s    0:00:00 (xfr#41, to-chk=8/72)
19-Nov-2024 22:41:23         175,506  56%   12.88MB/s    0:00:00 (xfr#42, to-chk=7/72)
19-Nov-2024 22:41:23         178,068  57%   13.06MB/s    0:00:00 (xfr#43, to-chk=6/72)
19-Nov-2024 22:41:23         182,776  58%   12.45MB/s    0:00:00 (xfr#44, to-chk=5/72)
19-Nov-2024 22:41:23         186,649  59%   12.71MB/s    0:00:00 (xfr#45, to-chk=4/72)
19-Nov-2024 22:41:23         186,935  60%   12.73MB/s    0:00:00 (xfr#46, to-chk=1/72)
19-Nov-2024 22:41:23         187,221  60%   12.75MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         187,221  60%    7.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         187,221  60%    7.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         187,221  60%    6.61MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         187,221  60%    6.61MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         187,221  60%    6.61MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-krakow-0/op-panel
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          16,360  16%   15.60MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23          33,637  33%   32.08MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23          33,637  33%   32.08MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23          49,794  49%   47.49MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23          50,085  50%   47.76MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23          50,085  50%   15.92MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-paris-0/cluster-manager
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23           6,843  50%    3.26MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-paris-0/op-worker
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          43,309  12%   41.30MB/s    0:00:00 (xfr#2, to-chk=67/72)
19-Nov-2024 22:41:23          61,839  18%   58.97MB/s    0:00:00 (xfr#3, to-chk=65/72)
19-Nov-2024 22:41:23          61,839  18%   58.97MB/s    0:00:00 (xfr#4, to-chk=63/72)
19-Nov-2024 22:41:23          61,839  18%   58.97MB/s    0:00:00 (xfr#5, to-chk=61/72)
19-Nov-2024 22:41:23          79,235  23%   37.78MB/s    0:00:00 (xfr#6, to-chk=59/72)
19-Nov-2024 22:41:23          79,385  23%   37.85MB/s    0:00:00 (xfr#7, to-chk=57/72)
19-Nov-2024 22:41:23          79,682  23%   38.00MB/s    0:00:00 (xfr#8, to-chk=51/72)
19-Nov-2024 22:41:23         136,955  40%   32.65MB/s    0:00:00 (xfr#9, to-chk=49/72)
19-Nov-2024 22:41:23         137,955  40%   26.31MB/s    0:00:00 (xfr#10, to-chk=39/72)
19-Nov-2024 22:41:23         138,235  40%   26.37MB/s    0:00:00 (xfr#11, to-chk=38/72)
19-Nov-2024 22:41:23         139,479  41%   26.60MB/s    0:00:00 (xfr#12, to-chk=37/72)
19-Nov-2024 22:41:23         139,761  41%   26.66MB/s    0:00:00 (xfr#13, to-chk=36/72)
19-Nov-2024 22:41:23         140,602  41%   26.82MB/s    0:00:00 (xfr#14, to-chk=35/72)
19-Nov-2024 22:41:23         141,506  41%   26.99MB/s    0:00:00 (xfr#15, to-chk=34/72)
19-Nov-2024 22:41:23         142,491  42%   27.18MB/s    0:00:00 (xfr#16, to-chk=33/72)
19-Nov-2024 22:41:23         143,239  42%   22.77MB/s    0:00:00 (xfr#17, to-chk=32/72)
19-Nov-2024 22:41:23         143,897  42%   19.60MB/s    0:00:00 (xfr#18, to-chk=31/72)
19-Nov-2024 22:41:23         144,179  42%   19.64MB/s    0:00:00 (xfr#19, to-chk=30/72)
19-Nov-2024 22:41:23         145,453  43%   19.82MB/s    0:00:00 (xfr#20, to-chk=29/72)
19-Nov-2024 22:41:23         145,731  43%   19.85MB/s    0:00:00 (xfr#21, to-chk=28/72)
19-Nov-2024 22:41:23         146,165  43%   19.91MB/s    0:00:00 (xfr#22, to-chk=27/72)
19-Nov-2024 22:41:23         146,443  43%   17.46MB/s    0:00:00 (xfr#23, to-chk=26/72)
19-Nov-2024 22:41:23         147,040  43%   17.53MB/s    0:00:00 (xfr#24, to-chk=25/72)
19-Nov-2024 22:41:23         148,648  44%   17.72MB/s    0:00:00 (xfr#25, to-chk=24/72)
19-Nov-2024 22:41:23         148,926  44%   17.75MB/s    0:00:00 (xfr#26, to-chk=23/72)
19-Nov-2024 22:41:23         149,590  44%   15.85MB/s    0:00:00 (xfr#27, to-chk=22/72)
19-Nov-2024 22:41:23         153,064  45%   16.22MB/s    0:00:00 (xfr#28, to-chk=21/72)
19-Nov-2024 22:41:23         157,216  46%   14.99MB/s    0:00:00 (xfr#29, to-chk=20/72)
19-Nov-2024 22:41:23         157,726  46%   15.04MB/s    0:00:00 (xfr#30, to-chk=19/72)
19-Nov-2024 22:41:23         159,427  47%   15.20MB/s    0:00:00 (xfr#31, to-chk=18/72)
19-Nov-2024 22:41:23         163,642  48%   15.61MB/s    0:00:00 (xfr#32, to-chk=17/72)
19-Nov-2024 22:41:23         168,313  49%   16.05MB/s    0:00:00 (xfr#33, to-chk=16/72)
19-Nov-2024 22:41:23         170,077  50%   14.75MB/s    0:00:00 (xfr#34, to-chk=15/72)
19-Nov-2024 22:41:23         172,584  51%   14.96MB/s    0:00:00 (xfr#35, to-chk=14/72)
19-Nov-2024 22:41:23         175,545  51%   15.22MB/s    0:00:00 (xfr#36, to-chk=13/72)
19-Nov-2024 22:41:23         179,353  53%   15.55MB/s    0:00:00 (xfr#37, to-chk=12/72)
19-Nov-2024 22:41:23         180,653  53%   14.36MB/s    0:00:00 (xfr#38, to-chk=11/72)
19-Nov-2024 22:41:23         181,841  53%   14.45MB/s    0:00:00 (xfr#39, to-chk=10/72)
19-Nov-2024 22:41:23         185,252  54%   14.72MB/s    0:00:00 (xfr#40, to-chk=9/72)
19-Nov-2024 22:41:23         188,150  55%   14.95MB/s    0:00:00 (xfr#41, to-chk=8/72)
19-Nov-2024 22:41:23         188,605  55%   14.99MB/s    0:00:00 (xfr#42, to-chk=7/72)
19-Nov-2024 22:41:23         191,167  56%   15.19MB/s    0:00:00 (xfr#43, to-chk=6/72)
19-Nov-2024 22:41:23         195,775  57%   14.36MB/s    0:00:00 (xfr#44, to-chk=5/72)
19-Nov-2024 22:41:23         199,648  59%   14.65MB/s    0:00:00 (xfr#45, to-chk=4/72)
19-Nov-2024 22:41:23         199,933  59%   14.67MB/s    0:00:00 (xfr#46, to-chk=1/72)
19-Nov-2024 22:41:23         200,218  59%   14.69MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         200,218  59%   14.69MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         200,218  59%   13.64MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         200,218  59%   12.73MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         200,218  59%   12.73MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23         200,218  59%   12.73MB/s    0:00:00 (xfr#47, to-chk=0/72)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-oneprovider-paris-0/op-panel
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23          33,565  33%   32.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23          33,565  33%   32.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23          49,687  49%   47.39MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23          49,978  50%   47.66MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23          49,978  50%   15.89MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-onezone-0/oz-panel
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          21,546  13%   20.55MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23          44,089  27%   42.05MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23          59,281  36%   56.53MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23          80,624  49%   76.89MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23          80,915  50%   77.17MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23          80,915  50%   38.58MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-onezone-0/oz-worker
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23          13,212   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
19-Nov-2024 22:41:23          27,019  13%   25.77MB/s    0:00:00 (xfr#3, to-chk=11/18)
19-Nov-2024 22:41:23          27,019  13%   25.77MB/s    0:00:00 (xfr#4, to-chk=9/18)
19-Nov-2024 22:41:23          39,751  20%   37.91MB/s    0:00:00 (xfr#5, to-chk=7/18)
19-Nov-2024 22:41:23          39,842  20%   38.00MB/s    0:00:00 (xfr#6, to-chk=5/18)
19-Nov-2024 22:41:23          40,139  20%   38.28MB/s    0:00:00 (xfr#7, to-chk=3/18)
19-Nov-2024 22:41:23          99,199  50%   94.60MB/s    0:00:00 (xfr#8, to-chk=1/18)
19-Nov-2024 22:41:23          99,199  50%   23.65MB/s    0:00:00 (xfr#8, to-chk=0/18)
19-Nov-2024 22:41:23 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.19-22.32.11/pod-logs/dev-onezone-0/cluster-manager
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
19-Nov-2024 22:41:23               0   0%    0.00kB/s    0:00:00 
19-Nov-2024 22:41:23           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
19-Nov-2024 22:41:23           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
19-Nov-2024 22:41:23           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
19-Nov-2024 22:41:23           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
19-Nov-2024 22:41:23           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
19-Nov-2024 22:41:23           6,700  50%    1.60MB/s    0:00:00 (xfr#6, to-chk=0/14)
19-Nov-2024 22:41:23 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1732056072.3175385 exists, exporting anyway.
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 =============================== warnings summary ===============================
19-Nov-2024 22:41:23 tests/utils/rest_utils.py:98
19-Nov-2024 22:41:23   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/utils/rest_utils.py:98: SyntaxWarning: invalid escape sequence '\ '
19-Nov-2024 22:41:23     print("""
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 tests/utils/path_utils.py:112
19-Nov-2024 22:41:23   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
19-Nov-2024 22:41:23     return path.replace("'", "\\'").replace(' ', '\ ')
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 tests/utils/acceptance_utils.py:55
19-Nov-2024 22:41:23   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
19-Nov-2024 22:41:23     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 tests/utils/acceptance_utils.py:57
19-Nov-2024 22:41:23   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
19-Nov-2024 22:41:23     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
19-Nov-2024 22:41:23
19-Nov-2024 22:41:23 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
19-Nov-2024 22:41:23 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance/test-reports/results.xml -
19-Nov-2024 22:41:23 ================== 9 passed, 4 warnings in 555.23s (0:09:15) ===================
19-Nov-2024 22:41:28 release "dev" uninstalled
19-Nov-2024 22:41:28 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
19-Nov-2024 22:41:28 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
19-Nov-2024 22:41:32 No resources found
19-Nov-2024 22:41:33 Sidecar injection has been disabled
19-Nov-2024 22:41:33 Cleaning helm release "dev"...
19-Nov-2024 22:41:33 Deleted 1 helm deployments
19-Nov-2024 22:41:33 Deleted 0 k8s deployments
19-Nov-2024 22:41:33 Deleted 0 k8s services
19-Nov-2024 22:41:33 Deleted 0 persistent volumes
19-Nov-2024 22:41:34 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
19-Nov-2024 22:41:34 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
19-Nov-2024 22:41:34 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
19-Nov-2024 22:41:34 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
19-Nov-2024 22:41:34 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
19-Nov-2024 22:41:34 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
19-Nov-2024 22:41:34 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
19-Nov-2024 22:41:34 Finished task 'Run acceptance oneclient tests' with result: Success
19-Nov-2024 22:41:34 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
19-Nov-2024 22:41:34 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS...
19-Nov-2024 22:41:34 Finished task 'Parse test results' with result: Success
19-Nov-2024 22:41:34 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoHostname} with S3
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoPort} with 10161
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.planRepository.branchName} with develop
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoHostname} with S3
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoPort} with 10161
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.planRepository.branchName} with develop
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
19-Nov-2024 22:41:34 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
19-Nov-2024 22:41:34
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio symlinks #3366 (ODSRV-OAP-MRPS-3366)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPS-3366-ScriptBuildTask-8190347296382485178.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance
19-Nov-2024 22:41:34 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_proxyio_symlinks.tar.gz
19-Nov-2024 22:41:34 Uploading artifact
19-Nov-2024 22:41:34     source path: surefire_multiprovider_replication_proxyio_symlinks.tar.gz
19-Nov-2024 22:41:34     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_proxyio_symlinks.tar.gz
19-Nov-2024 22:41:34 Finished task 'Pack and push surefire artifact' with result: Success
19-Nov-2024 22:41:34 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
19-Nov-2024 22:41:34 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
19-Nov-2024 22:41:34
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio symlinks #3366 (ODSRV-OAP-MRPS-3366)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPS-3366-ScriptBuildTask-3524597361506836894.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS
19-Nov-2024 22:41:34 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
19-Nov-2024 22:41:34 Finished task 'Pack logs' with result: Success
19-Nov-2024 22:41:34 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
19-Nov-2024 22:41:34
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
19-Nov-2024 22:41:34 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
19-Nov-2024 22:41:34
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio symlinks #3366 (ODSRV-OAP-MRPS-3366)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPS-3366-ScriptBuildTask-770477274668371651.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS/onedata-acceptance
19-Nov-2024 22:41:34   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
19-Nov-2024 22:41:34                                  Dload  Upload   Total   Spent    Left  Speed
19-Nov-2024 22:41:34
19-Nov-2024 22:41:34   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
19-Nov-2024 22:41:35   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
19-Nov-2024 22:41:35 100  4822  100  4822    0     0  20695      0 --:--:-- --:--:-- --:--:-- 20606
19-Nov-2024 22:41:35 Clearing /tmp/onedata and /home/bamboo/.one-env
19-Nov-2024 22:41:36 Cleaning helm deployments
19-Nov-2024 22:41:36 Cleanining pods
19-Nov-2024 22:41:36 Cleaning kube persistant volumes
19-Nov-2024 22:41:36 Cleaning dockswift container
19-Nov-2024 22:41:36 Cleaning docker containers
19-Nov-2024 22:41:39 Stalled docker containers to remove:
19-Nov-2024 22:41:39 bb8ad00495d5 9758d01b2aea afdeb3195871 b2faffe87f20 feea18a10fd5 006ec3d9a8f9 373aa7eded52 e3b9bcfae713 e7dab2d2f9be 764a21d75aaa 1372b5826665 b8ec01305baf c8f127d02995 3f419f18d9e8 ee1b55c291d0 bdb5a26fca65 9b1221028d6c 31510795f397 58b90fbb8694 1cb47c4d4deb
19-Nov-2024 22:41:39 Removing stalled docker containers
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: bb8ad00495d5: Container bb8ad00495d51ff95fc508dfa49461d5de39ee73dfca454440b7fd0da6cca4d9 is not running
19-Nov-2024 22:41:39 bb8ad00495d5
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: 9758d01b2aea: Container 9758d01b2aea70104e36f890a8bbee1dcf5718e9946bbbe6d3f3b36184a2d7ed is not running
19-Nov-2024 22:41:39 9758d01b2aea
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: afdeb3195871: Container afdeb31958710edb3b2a28b3fb1160779a0422a999b5ffde959e030813577064 is not running
19-Nov-2024 22:41:39 afdeb3195871
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: b2faffe87f20: Container b2faffe87f207710fbfb35bea239ae07b4a948b16c9b581a44c5d39a47d7acee is not running
19-Nov-2024 22:41:39 b2faffe87f20
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: feea18a10fd5: Container feea18a10fd537313ec7cb785385959bda2d28c22dfd9deca9d01d3300709d5d is not running
19-Nov-2024 22:41:39 feea18a10fd5
19-Nov-2024 22:41:39 Error response from daemon: Cannot kill container: 006ec3d9a8f9: Container 006ec3d9a8f928e8eaff8d8bdac54af3734200b5f0321237185502a6ad43ed55 is not running
19-Nov-2024 22:41:40 006ec3d9a8f9
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 373aa7eded52: Container 373aa7eded52902b86fa2b60b987d8d5f332de185dcdadff4882d99f29518693 is not running
19-Nov-2024 22:41:40 373aa7eded52
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: e3b9bcfae713: Container e3b9bcfae713a956b3ec31e8475291309319dc51d8a011b7181b36829247dbc5 is not running
19-Nov-2024 22:41:40 e3b9bcfae713
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: e7dab2d2f9be: Container e7dab2d2f9becf4b3eb89e5c64682a72a3876a63d6735c308af2d7bcb4f2750c is not running
19-Nov-2024 22:41:40 e7dab2d2f9be
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 764a21d75aaa: Container 764a21d75aaae764807b5bca8617f084dcdb32e64cd805600a7867c181b6bfe2 is not running
19-Nov-2024 22:41:40 764a21d75aaa
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 1372b5826665: Container 1372b582666547cac4b2b2b874ef9a111dfc82e6c0e2cf59ee5abb04d4c88eef is not running
19-Nov-2024 22:41:40 1372b5826665
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: b8ec01305baf: Container b8ec01305bafd692f95bd7b720871df2ea5d05cea7863097fe92603d3df8957d is not running
19-Nov-2024 22:41:40 b8ec01305baf
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: c8f127d02995: Container c8f127d02995a98f9850074443eb2e4284aed049de3fb668f700665c223d11c7 is not running
19-Nov-2024 22:41:40 c8f127d02995
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 3f419f18d9e8: Container 3f419f18d9e8943b6dc1ee6b1b33dcf207d573742e7f3165771b69af965e1dc4 is not running
19-Nov-2024 22:41:40 3f419f18d9e8
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: ee1b55c291d0: Container ee1b55c291d0d8d2a0b6d7288dbfe5b0d6e7ca4d947a81df92f4481c2786c13b is not running
19-Nov-2024 22:41:40 ee1b55c291d0
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: bdb5a26fca65: Container bdb5a26fca652852c61de791ee98488a86c05c0c99ba92c86e8070c33b2354b6 is not running
19-Nov-2024 22:41:40 bdb5a26fca65
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 9b1221028d6c: Container 9b1221028d6cfdb5b31ab358b94af66ccdceeddc53da847f96c2fc33e429562d is not running
19-Nov-2024 22:41:40 9b1221028d6c
19-Nov-2024 22:41:40 Error response from daemon: Cannot kill container: 31510795f397: Container 31510795f397e644096f485ba53147fda961a1226efaf5f860caaae65e8fa6e9 is not running
19-Nov-2024 22:41:40 31510795f397
19-Nov-2024 22:41:41 Error response from daemon: Cannot kill container: 58b90fbb8694: Container 58b90fbb8694a817f0b535312e58f7b9aad7a2316507d63282f58ec5e3530b07 is not running
19-Nov-2024 22:41:41 58b90fbb8694
19-Nov-2024 22:41:41 1cb47c4d4deb
19-Nov-2024 22:41:41 1cb47c4d4deb
19-Nov-2024 22:41:41 Stalled docker volumes to remove:
19-Nov-2024 22:41:41
19-Nov-2024 22:41:41 Removing stalled docker volumes
19-Nov-2024 22:41:41 Removing stalled loopdevices
19-Nov-2024 22:41:41 Done
19-Nov-2024 22:41:41 Finished task 'Clear env and working dir' with result: Success
19-Nov-2024 22:41:41 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
19-Nov-2024 22:41:41 Running post build plugin 'Docker Container Cleanup'
19-Nov-2024 22:41:41 Running post build plugin 'NCover Results Collector'
19-Nov-2024 22:41:41 Running post build plugin 'Build Results Label Collector'
19-Nov-2024 22:41:41 Running post build plugin 'Clover Results Collector'
19-Nov-2024 22:41:41 Running post build plugin 'npm Cache Cleanup'
19-Nov-2024 22:41:41 Running post build plugin 'Artifact Copier'
19-Nov-2024 22:41:41 Publishing an artifact: test_logs.tar.gz
19-Nov-2024 22:41:42 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 91.51 ms
19-Nov-2024 22:41:42 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPS'
19-Nov-2024 22:41:42 Finalising the build...
19-Nov-2024 22:41:42 Stopping timer.
19-Nov-2024 22:41:42 Build ODSRV-OAP-MRPS-3366 completed.
19-Nov-2024 22:41:42 Running on server: post build plugin 'Build Hanging Detection Configuration'
19-Nov-2024 22:41:42 Running on server: post build plugin 'NCover Results Collector'
19-Nov-2024 22:41:42 Running on server: post build plugin 'Build Labeller'
19-Nov-2024 22:41:42 Running on server: post build plugin 'Clover Delta Calculator'
19-Nov-2024 22:41:42 Running on server: post build plugin 'Maven Dependencies Postprocessor'
19-Nov-2024 22:41:42 All post build plugins have finished
19-Nov-2024 22:41:42 Generating build results summary...
19-Nov-2024 22:41:42 Saving build results to disk...
19-Nov-2024 22:41:42 Store variable context...
19-Nov-2024 22:41:42 Finished building ODSRV-OAP-MRPS-3366.