oneclient acceptance tests using environment deployed from packages

Build: #3374 failed

Job: multiprovider replication proxyio hardlinks was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,388 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:48:26 Adding user `space_owner' ...
03-Dec-2024 18:48:26 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:48:26 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:48:26 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:48:26 Copying files from `/etc/skel' ...
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:48:26 Adding user `user1' ...
03-Dec-2024 18:48:26 Adding new group `user1' (25687) ...
03-Dec-2024 18:48:26 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:48:26 Creating home directory `/home/user1' ...
03-Dec-2024 18:48:26 Copying files from `/etc/skel' ...
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:48:26 Adding user `user2' ...
03-Dec-2024 18:48:26 Adding new group `user2' (30628) ...
03-Dec-2024 18:48:26 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:48:26 Creating home directory `/home/user2' ...
03-Dec-2024 18:48:26 Copying files from `/etc/skel' ...
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:48:26 Adding user `space_owner' ...
03-Dec-2024 18:48:26 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:48:26 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:48:26 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:48:26 Copying files from `/etc/skel' ...
03-Dec-2024 18:48:26 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:48:27 id: ‘user2’: no such user
03-Dec-2024 18:48:27 command terminated with exit code 1
03-Dec-2024 18:48:28 command terminated with exit code 1
03-Dec-2024 18:48:31 command terminated with exit code 1
03-Dec-2024 18:48:34 command terminated with exit code 1
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:49:16 Adding user `user1' ...
03-Dec-2024 18:49:16 Adding new group `user1' (25687) ...
03-Dec-2024 18:49:16 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:49:16 Creating home directory `/home/user1' ...
03-Dec-2024 18:49:16 Copying files from `/etc/skel' ...
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:49:16 Adding user `user2' ...
03-Dec-2024 18:49:16 Adding new group `user2' (30628) ...
03-Dec-2024 18:49:16 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:49:16 Creating home directory `/home/user2' ...
03-Dec-2024 18:49:16 Copying files from `/etc/skel' ...
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:49:16 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 =================================================================
03-Dec-2024 18:49:16 - Executing scenario 'Create files on one provider and see them on the other provider'
03-Dec-2024 18:49:16 - from feature 'Multiprovider_replication'
03-Dec-2024 18:49:16 -----------------------------------------------------------------
03-Dec-2024 18:49:16 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:49:16 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:49:16 using [token, token] by [user1, user2]"'
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:49:16 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/uion8w3k4elw86by
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/uion8w3k4elw86by --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/uion8w3k4elw86by
03-Dec-2024 18:49:16 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '1535715805984927941'...
03-Dec-2024 18:49:16 Getting configuration...
03-Dec-2024 18:49:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/uion8w3k4elw86by'.
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:49:16 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/pqt5dxq8m36g3iyk
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/pqt5dxq8m36g3iyk --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/pqt5dxq8m36g3iyk
03-Dec-2024 18:49:16 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '50713901810847258'...
03-Dec-2024 18:49:16 Getting configuration...
03-Dec-2024 18:49:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/pqt5dxq8m36g3iyk'.
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:49:16 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:49:16 =================================================================
03-Dec-2024 18:49:16
03-Dec-2024 18:49:17 PASSED
03-Dec-2024 18:49:17 Unmounting client from /tmp/onedata/mnt/uion8w3k4elw86by
03-Dec-2024 18:49:17
03-Dec-2024 18:49:17
03-Dec-2024 18:49:17 Unmounting client from /tmp/onedata/mnt/pqt5dxq8m36g3iyk
03-Dec-2024 18:49:17
03-Dec-2024 18:49:17
03-Dec-2024 18:49:58 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:49:58 =================================================================
03-Dec-2024 18:49:58 - Executing scenario 'Create empty file on one provider and read it on the other provider'
03-Dec-2024 18:49:58 - from feature 'Multiprovider_replication'
03-Dec-2024 18:49:58 -----------------------------------------------------------------
03-Dec-2024 18:49:58 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:49:58 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:49:58 using [token, token] by [user1, user2]"'
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:49:58 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/h1hbidpgkg567t0a
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/h1hbidpgkg567t0a --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/h1hbidpgkg567t0a
03-Dec-2024 18:49:58 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2139816297075151736'...
03-Dec-2024 18:49:58 Getting configuration...
03-Dec-2024 18:49:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/h1hbidpgkg567t0a'.
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:49:58 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/vtkblwx2c13hwiew
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/vtkblwx2c13hwiew --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/vtkblwx2c13hwiew
03-Dec-2024 18:49:58 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '17636618696354985871'...
03-Dec-2024 18:49:58 Getting configuration...
03-Dec-2024 18:49:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/vtkblwx2c13hwiew'.
03-Dec-2024 18:49:58
03-Dec-2024 18:49:58 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:49:58 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
03-Dec-2024 18:49:58 =================================================================
03-Dec-2024 18:49:58
03-Dec-2024 18:49:59 PASSED
03-Dec-2024 18:49:59 Unmounting client from /tmp/onedata/mnt/h1hbidpgkg567t0a
03-Dec-2024 18:49:59
03-Dec-2024 18:49:59
03-Dec-2024 18:49:59 Unmounting client from /tmp/onedata/mnt/vtkblwx2c13hwiew
03-Dec-2024 18:49:59
03-Dec-2024 18:49:59
03-Dec-2024 18:50:32 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:50:32 =================================================================
03-Dec-2024 18:50:32 - Executing scenario 'Write to file on one provider and check size on the other provider'
03-Dec-2024 18:50:32 - from feature 'Multiprovider_replication'
03-Dec-2024 18:50:32 -----------------------------------------------------------------
03-Dec-2024 18:50:32 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:50:32 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:50:32 using [token, token] by [user1, user2]"'
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:50:32 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/n7jqbnthx9nnx534
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/n7jqbnthx9nnx534 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/n7jqbnthx9nnx534
03-Dec-2024 18:50:32 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '14717435567835195829'...
03-Dec-2024 18:50:32 Getting configuration...
03-Dec-2024 18:50:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/n7jqbnthx9nnx534'.
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:50:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:50:32 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/ofo77vdybhuec3td
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ofo77vdybhuec3td --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ofo77vdybhuec3td
03-Dec-2024 18:50:32 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '8467552676728872639'...
03-Dec-2024 18:50:32 Getting configuration...
03-Dec-2024 18:50:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ofo77vdybhuec3td'.
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:50:32 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:50:32 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
03-Dec-2024 18:50:32 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
03-Dec-2024 18:50:32 =================================================================
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 PASSED
03-Dec-2024 18:50:32 Unmounting client from /tmp/onedata/mnt/n7jqbnthx9nnx534
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32 Unmounting client from /tmp/onedata/mnt/ofo77vdybhuec3td
03-Dec-2024 18:50:32
03-Dec-2024 18:50:32
03-Dec-2024 18:51:18 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:51:18 =================================================================
03-Dec-2024 18:51:18 - Executing scenario 'Write to file on one provider and read on the other provider'
03-Dec-2024 18:51:18 - from feature 'Multiprovider_replication'
03-Dec-2024 18:51:18 -----------------------------------------------------------------
03-Dec-2024 18:51:18 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:51:18 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:51:18 using [token, token] by [user1, user2]"'
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:51:18 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/rxvff49b9uhcik4x
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/rxvff49b9uhcik4x --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/rxvff49b9uhcik4x
03-Dec-2024 18:51:18 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '17070446585167821030'...
03-Dec-2024 18:51:18 Getting configuration...
03-Dec-2024 18:51:18 Oneclient has been successfully mounted in '/tmp/onedata/mnt/rxvff49b9uhcik4x'.
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:51:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:51:18 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/t19ql8y9ls3tyobl
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/t19ql8y9ls3tyobl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/t19ql8y9ls3tyobl
03-Dec-2024 18:51:18 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1461322348692600969'...
03-Dec-2024 18:51:18 Getting configuration...
03-Dec-2024 18:51:18 Oneclient has been successfully mounted in '/tmp/onedata/mnt/t19ql8y9ls3tyobl'.
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:51:18 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:51:18 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
03-Dec-2024 18:51:18 =================================================================
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 PASSED
03-Dec-2024 18:51:18 Unmounting client from /tmp/onedata/mnt/rxvff49b9uhcik4x
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18 Unmounting client from /tmp/onedata/mnt/t19ql8y9ls3tyobl
03-Dec-2024 18:51:18
03-Dec-2024 18:51:18
03-Dec-2024 18:51:54 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:51:54 =================================================================
03-Dec-2024 18:51:54 - Executing scenario 'Big file transfer with MD5 check'
03-Dec-2024 18:51:54 - from feature 'Multiprovider_replication'
03-Dec-2024 18:51:54 -----------------------------------------------------------------
03-Dec-2024 18:51:54 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:51:54 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:51:54 using [token, token] by [user1, user2]"'
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:51:54 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/k5tb5lxelvt43dmc
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/k5tb5lxelvt43dmc --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/k5tb5lxelvt43dmc
03-Dec-2024 18:51:54 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '14594025638187699954'...
03-Dec-2024 18:51:54 Getting configuration...
03-Dec-2024 18:51:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/k5tb5lxelvt43dmc'.
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:51:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:51:54 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/5xewtqdxpvx1ydea
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/5xewtqdxpvx1ydea --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/5xewtqdxpvx1ydea
03-Dec-2024 18:51:54 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '9178750306064533027'...
03-Dec-2024 18:51:54 Getting configuration...
03-Dec-2024 18:51:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/5xewtqdxpvx1ydea'.
03-Dec-2024 18:51:54
03-Dec-2024 18:51:54 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:51:54 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:51:54 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:51:54 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:51:54 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:51:54 =================================================================
03-Dec-2024 18:51:54
03-Dec-2024 18:51:55 PASSED
03-Dec-2024 18:51:55 Unmounting client from /tmp/onedata/mnt/k5tb5lxelvt43dmc
03-Dec-2024 18:51:55
03-Dec-2024 18:51:55
03-Dec-2024 18:51:55 Unmounting client from /tmp/onedata/mnt/5xewtqdxpvx1ydea
03-Dec-2024 18:51:55
03-Dec-2024 18:51:55
03-Dec-2024 18:52:46 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:52:46 =================================================================
03-Dec-2024 18:52:46 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
03-Dec-2024 18:52:46 - from feature 'Multiprovider_replication'
03-Dec-2024 18:52:46 -----------------------------------------------------------------
03-Dec-2024 18:52:46 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:52:46 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:52:46 using [token, token] by [user1, user2]"'
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:52:46 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/gi0nb1pqzi7y7acn
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/gi0nb1pqzi7y7acn --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/gi0nb1pqzi7y7acn
03-Dec-2024 18:52:46 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10811454542604432305'...
03-Dec-2024 18:52:46 Getting configuration...
03-Dec-2024 18:52:46 Oneclient has been successfully mounted in '/tmp/onedata/mnt/gi0nb1pqzi7y7acn'.
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:52:46 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:52:46 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/cvrgwf5wsf46sd66
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/cvrgwf5wsf46sd66 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/cvrgwf5wsf46sd66
03-Dec-2024 18:52:46 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '13045620683672779377'...
03-Dec-2024 18:52:46 Getting configuration...
03-Dec-2024 18:52:46 Oneclient has been successfully mounted in '/tmp/onedata/mnt/cvrgwf5wsf46sd66'.
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:52:46 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
03-Dec-2024 18:52:46 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
03-Dec-2024 18:52:46 =================================================================
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 PASSED
03-Dec-2024 18:52:46 Unmounting client from /tmp/onedata/mnt/gi0nb1pqzi7y7acn
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46 Unmounting client from /tmp/onedata/mnt/cvrgwf5wsf46sd66
03-Dec-2024 18:52:46
03-Dec-2024 18:52:46
03-Dec-2024 18:53:32 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:53:32 =================================================================
03-Dec-2024 18:53:32 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
03-Dec-2024 18:53:32 - from feature 'Multiprovider_replication'
03-Dec-2024 18:53:32 -----------------------------------------------------------------
03-Dec-2024 18:53:32 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:53:32 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:53:32 using [token, token] by [user1, user2]"'
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:53:32 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/mv9vtd0mibd13eo4
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/mv9vtd0mibd13eo4 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/mv9vtd0mibd13eo4
03-Dec-2024 18:53:32 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '5623385288855226250'...
03-Dec-2024 18:53:32 Getting configuration...
03-Dec-2024 18:53:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/mv9vtd0mibd13eo4'.
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:53:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:53:32 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/t9svzb4203ggg8rl
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/t9svzb4203ggg8rl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/t9svzb4203ggg8rl
03-Dec-2024 18:53:32 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '8266668560801490175'...
03-Dec-2024 18:53:32 Getting configuration...
03-Dec-2024 18:53:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/t9svzb4203ggg8rl'.
03-Dec-2024 18:53:32
03-Dec-2024 18:53:32 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:53:32 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:53:32 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:53:32 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
03-Dec-2024 18:53:32 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
03-Dec-2024 18:53:32 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
03-Dec-2024 18:53:32 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
03-Dec-2024 18:53:32 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
03-Dec-2024 18:53:32 =================================================================
03-Dec-2024 18:53:32
03-Dec-2024 18:53:33 PASSED
03-Dec-2024 18:53:33 Unmounting client from /tmp/onedata/mnt/mv9vtd0mibd13eo4
03-Dec-2024 18:53:33
03-Dec-2024 18:53:33
03-Dec-2024 18:53:33 Unmounting client from /tmp/onedata/mnt/t9svzb4203ggg8rl
03-Dec-2024 18:53:33
03-Dec-2024 18:53:33
03-Dec-2024 18:54:21 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:54:21 =================================================================
03-Dec-2024 18:54:21 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
03-Dec-2024 18:54:21 - from feature 'Multiprovider_replication'
03-Dec-2024 18:54:21 -----------------------------------------------------------------
03-Dec-2024 18:54:21 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:54:21 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:54:21 using [token, token] by [user1, user2]"'
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:54:21 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/glyggm1d2r42m9pw
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/glyggm1d2r42m9pw --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/glyggm1d2r42m9pw
03-Dec-2024 18:54:21 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '7527306407187991991'...
03-Dec-2024 18:54:21 Getting configuration...
03-Dec-2024 18:54:21 Oneclient has been successfully mounted in '/tmp/onedata/mnt/glyggm1d2r42m9pw'.
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:54:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:54:21 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/4pautw3xfl0f62a9
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/4pautw3xfl0f62a9 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/4pautw3xfl0f62a9
03-Dec-2024 18:54:21 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '5271002553685990098'...
03-Dec-2024 18:54:21 Getting configuration...
03-Dec-2024 18:54:21 Oneclient has been successfully mounted in '/tmp/onedata/mnt/4pautw3xfl0f62a9'.
03-Dec-2024 18:54:21
03-Dec-2024 18:54:21 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
03-Dec-2024 18:54:21 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
03-Dec-2024 18:54:21 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
03-Dec-2024 18:54:21 =================================================================
03-Dec-2024 18:54:21
03-Dec-2024 18:54:22 PASSED
03-Dec-2024 18:54:22 Unmounting client from /tmp/onedata/mnt/glyggm1d2r42m9pw
03-Dec-2024 18:54:22
03-Dec-2024 18:54:22
03-Dec-2024 18:54:22 Unmounting client from /tmp/onedata/mnt/4pautw3xfl0f62a9
03-Dec-2024 18:54:22
03-Dec-2024 18:54:22
03-Dec-2024 18:55:18 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:55:18 =================================================================
03-Dec-2024 18:55:18 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
03-Dec-2024 18:55:18 - from feature 'Multiprovider_replication'
03-Dec-2024 18:55:18 -----------------------------------------------------------------
03-Dec-2024 18:55:18 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:55:18 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:55:18 using [token, token] by [user1, user2]"'
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-smh9l', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l'
03-Dec-2024 18:55:18 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-smh9l' successfully started
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/mlklmvmgr9fkgd5w
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/mlklmvmgr9fkgd5w --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/mlklmvmgr9fkgd5w
03-Dec-2024 18:55:18 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2092514062661690013'...
03-Dec-2024 18:55:18 Getting configuration...
03-Dec-2024 18:55:18 Oneclient has been successfully mounted in '/tmp/onedata/mnt/mlklmvmgr9fkgd5w'.
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:55:18 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-zzfkm', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm'
03-Dec-2024 18:55:18 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-zzfkm' successfully started
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/9wh3cjnzk8fi8juz
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/9wh3cjnzk8fi8juz --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/9wh3cjnzk8fi8juz
03-Dec-2024 18:55:18 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '14537142867377686965'...
03-Dec-2024 18:55:18 Getting configuration...
03-Dec-2024 18:55:18 Oneclient has been successfully mounted in '/tmp/onedata/mnt/9wh3cjnzk8fi8juz'.
03-Dec-2024 18:55:18
03-Dec-2024 18:55:18 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:55:18 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:55:18 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:55:18 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:55:18 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
03-Dec-2024 18:55:18 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
03-Dec-2024 18:55:18 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
03-Dec-2024 18:55:18 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
03-Dec-2024 18:55:18 =================================================================
03-Dec-2024 18:55:18
03-Dec-2024 18:55:29 PASSED
03-Dec-2024 18:55:29 Unmounting client from /tmp/onedata/mnt/mlklmvmgr9fkgd5w
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 Unmounting client from /tmp/onedata/mnt/9wh3cjnzk8fi8juz
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1733252119.3979948', '-c', '/tmp/logs']
03-Dec-2024 18:55:29 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-pbjkh. See /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-cross-support-job-3p-users-pbjkh/entrypoint.log for more details
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-smh9l: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneclient-krakow-7d9476b8bc-smh9l/oneclient_logs
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          74,279   3%   70.84MB/s    0:00:00 (xfr#1, to-chk=64/80)
03-Dec-2024 18:55:29          74,279   3%   70.84MB/s    0:00:00 (xfr#1, to-chk=58/80)
03-Dec-2024 18:55:29          75,125   3%   71.64MB/s    0:00:00 (xfr#2, to-chk=60/80)
03-Dec-2024 18:55:29         316,233  13%   75.40MB/s    0:00:00 (xfr#3, to-chk=59/80)
03-Dec-2024 18:55:29         317,079  13%   75.60MB/s    0:00:00 (xfr#4, to-chk=58/80)
03-Dec-2024 18:55:29         406,093  17%   64.55MB/s    0:00:00 (xfr#5, to-chk=57/80)
03-Dec-2024 18:55:29         406,747  17%   64.65MB/s    0:00:00 (xfr#6, to-chk=53/80)
03-Dec-2024 18:55:29         410,887  17%   65.31MB/s    0:00:00 (xfr#7, to-chk=52/80)
03-Dec-2024 18:55:29         693,238  30%   66.11MB/s    0:00:00 (xfr#8, to-chk=51/80)
03-Dec-2024 18:55:29         693,892  30%   66.17MB/s    0:00:00 (xfr#9, to-chk=50/80)
03-Dec-2024 18:55:29         721,334  31%   62.54MB/s    0:00:00 (xfr#10, to-chk=49/80)
03-Dec-2024 18:55:29         721,988  31%   57.38MB/s    0:00:00 (xfr#11, to-chk=45/80)
03-Dec-2024 18:55:29         810,925  35%   64.45MB/s    0:00:00 (xfr#12, to-chk=44/80)
03-Dec-2024 18:55:29         811,579  35%   64.50MB/s    0:00:00 (xfr#13, to-chk=43/80)
03-Dec-2024 18:55:29         945,606  41%   56.36MB/s    0:00:00 (xfr#14, to-chk=42/80)
03-Dec-2024 18:55:29         946,068  41%   56.39MB/s    0:00:00 (xfr#15, to-chk=38/80)
03-Dec-2024 18:55:29       1,283,795  56%   45.35MB/s    0:00:00 (xfr#16, to-chk=37/80)
03-Dec-2024 18:55:29       1,284,257  56%   45.36MB/s    0:00:00 (xfr#17, to-chk=36/80)
03-Dec-2024 18:55:29       1,362,460  59%   43.31MB/s    0:00:00 (xfr#18, to-chk=35/80)
03-Dec-2024 18:55:29       1,362,922  59%   43.33MB/s    0:00:00 (xfr#19, to-chk=31/80)
03-Dec-2024 18:55:29       1,610,162  70%   35.71MB/s    0:00:00 (xfr#20, to-chk=30/80)
03-Dec-2024 18:55:29       1,610,624  70%   35.72MB/s    0:00:00 (xfr#21, to-chk=29/80)
03-Dec-2024 18:55:29       1,647,768  72%   36.54MB/s    0:00:00 (xfr#22, to-chk=28/80)
03-Dec-2024 18:55:29       1,648,038  72%   36.55MB/s    0:00:00 (xfr#23, to-chk=24/80)
03-Dec-2024 18:55:29       1,763,897  77%   31.74MB/s    0:00:00 (xfr#24, to-chk=23/80)
03-Dec-2024 18:55:29       1,764,167  77%   31.74MB/s    0:00:00 (xfr#25, to-chk=22/80)
03-Dec-2024 18:55:29       1,800,652  78%   32.40MB/s    0:00:00 (xfr#26, to-chk=21/80)
03-Dec-2024 18:55:29       1,801,402  78%   32.41MB/s    0:00:00 (xfr#27, to-chk=17/80)
03-Dec-2024 18:55:29       1,917,909  83%   33.87MB/s    0:00:00 (xfr#28, to-chk=16/80)
03-Dec-2024 18:55:29       1,918,659  83%   33.88MB/s    0:00:00 (xfr#29, to-chk=15/80)
03-Dec-2024 18:55:29       1,955,837  85%   33.91MB/s    0:00:00 (xfr#30, to-chk=14/80)
03-Dec-2024 18:55:29       1,956,395  85%   33.92MB/s    0:00:00 (xfr#31, to-chk=10/80)
03-Dec-2024 18:55:29       2,076,865  90%   36.01MB/s    0:00:00 (xfr#32, to-chk=9/80)
03-Dec-2024 18:55:29 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)build        03-Dec-2024 18:55:29              2,077,423  90%   35.38MB/s    0:00:00 (xfr#33, to-chk=8/80)
01-Jan-1970 00:00:00
03-Dec-2024 18:55:29       2,116,986  92%   36.05MB/s    0:00:00 (xfr#34, to-chk=7/80)
03-Dec-2024 18:55:29       2,117,256  92%   36.06MB/s    0:00:00 (xfr#35, to-chk=3/80)
03-Dec-2024 18:55:29       2,273,345  99%   31.88MB/s    0:00:00 (xfr#36, to-chk=2/80)
03-Dec-2024 18:55:29       2,273,615  99%   31.89MB/s    0:00:00 (xfr#37, to-chk=1/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   31.60MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,286,511  99%   30.29MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:55:29       2,286,511  99%   30.29MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-zzfkm: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneclient-paris-5cc45c8cb7-zzfkm/oneclient_logs
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          82,642   3%   19.70MB/s    0:00:00 (xfr#1, to-chk=64/80)
03-Dec-2024 18:55:29          82,642   3%   19.70MB/s    0:00:00 (xfr#1, to-chk=58/80)
03-Dec-2024 18:55:29          83,104   3%   19.81MB/s    0:00:00 (xfr#2, to-chk=60/80)
03-Dec-2024 18:55:29         355,450  16%   16.14MB/s    0:00:00 (xfr#3, to-chk=59/80)
03-Dec-2024 18:55:29         355,912  16%   15.43MB/s    0:00:00 (xfr#4, to-chk=58/80)
03-Dec-2024 18:55:29         468,651  21%   17.88MB/s    0:00:00 (xfr#5, to-chk=57/80)
03-Dec-2024 18:55:29         469,113  21%   17.21MB/s    0:00:00 (xfr#6, to-chk=53/80)
03-Dec-2024 18:55:29         714,846  32%   25.25MB/s    0:00:00 (xfr#7, to-chk=52/80)
03-Dec-2024 18:55:29         715,308  32%   25.27MB/s    0:00:00 (xfr#8, to-chk=51/80)
03-Dec-2024 18:55:29         755,871  34%   25.74MB/s    0:00:00 (xfr#9, to-chk=50/80)
03-Dec-2024 18:55:29         756,141  34%   25.75MB/s    0:00:00 (xfr#10, to-chk=46/80)
03-Dec-2024 18:55:29         945,727  43%   32.21MB/s    0:00:00 (xfr#11, to-chk=45/80)
03-Dec-2024 18:55:29         945,997  43%   31.11MB/s    0:00:00 (xfr#12, to-chk=44/80)
03-Dec-2024 18:55:29       1,000,120  46%   32.89MB/s    0:00:00 (xfr#13, to-chk=43/80)
03-Dec-2024 18:55:29       1,000,678  46%   32.91MB/s    0:00:00 (xfr#14, to-chk=39/80)
03-Dec-2024 18:55:29       1,226,463  56%   30.78MB/s    0:00:00 (xfr#15, to-chk=38/80)
03-Dec-2024 18:55:29       1,227,021  56%   30.79MB/s    0:00:00 (xfr#16, to-chk=37/80)
03-Dec-2024 18:55:29       1,252,877  57%   31.44MB/s    0:00:00 (xfr#17, to-chk=36/80)
03-Dec-2024 18:55:29       1,253,435  57%   30.65MB/s    0:00:00 (xfr#18, to-chk=32/80)
03-Dec-2024 18:55:29       1,351,161  62%   32.21MB/s    0:00:00 (xfr#19, to-chk=31/80)
03-Dec-2024 18:55:29       1,351,719  62%   32.23MB/s    0:00:00 (xfr#20, to-chk=30/80)
03-Dec-2024 18:55:29       1,352,347  62%   32.24MB/s    0:00:00 (xfr#21, to-chk=29/80)
03-Dec-2024 18:55:29       1,386,418  63%   24.49MB/s    0:00:00 (xfr#22, to-chk=28/80)
03-Dec-2024 18:55:29       1,386,976  63%   24.49MB/s    0:00:00 (xfr#23, to-chk=24/80)
03-Dec-2024 18:55:29       1,524,275  70%   25.96MB/s    0:00:00 (xfr#24, to-chk=23/80)
03-Dec-2024 18:55:29       1,524,833  70%   25.97MB/s    0:00:00 (xfr#25, to-chk=22/80)
03-Dec-2024 18:55:29       1,593,630  73%   26.66MB/s    0:00:00 (xfr#26, to-chk=21/80)
03-Dec-2024 18:55:29       1,593,996  73%   26.67MB/s    0:00:00 (xfr#27, to-chk=17/80)
03-Dec-2024 18:55:29       1,826,802  84%   28.10MB/s    0:00:00 (xfr#28, to-chk=16/80)
03-Dec-2024 18:55:29       1,827,168  84%   28.11MB/s    0:00:00 (xfr#29, to-chk=15/80)
03-Dec-2024 18:55:29       1,850,869  85%   28.47MB/s    0:00:00 (xfr#30, to-chk=14/80)
03-Dec-2024 18:55:29       1,851,331  85%   28.48MB/s    0:00:00 (xfr#31, to-chk=10/80)
03-Dec-2024 18:55:29       1,992,974  91%   28.37MB/s    0:00:00 (xfr#32, to-chk=9/80)
03-Dec-2024 18:55:29       1,993,436  91%   27.96MB/s    0:00:00 (xfr#33, to-chk=8/80)
03-Dec-2024 18:55:29       2,025,029  93%   28.40MB/s    0:00:00 (xfr#34, to-chk=7/80)
03-Dec-2024 18:55:29       2,025,587  93%   28.41MB/s    0:00:00 (xfr#35, to-chk=3/80)
03-Dec-2024 18:55:29       2,138,994  98%   29.14MB/s    0:00:00 (xfr#36, to-chk=2/80)
03-Dec-2024 18:55:29       2,139,552  98%   29.15MB/s    0:00:00 (xfr#37, to-chk=1/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   29.10MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   23.75MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29       2,166,670  99%   23.48MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-krakow-0/cluster-manager
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-krakow-0/op-panel
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          16,360  16%   15.60MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29          33,637  33%   32.08MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29          33,637  33%   32.08MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29          49,794  49%   47.49MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29          50,085  50%   47.76MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29          50,085  50%   47.76MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-krakow-0/op-worker
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          31,711  10%   30.24MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:55:29          49,834  15%   47.53MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:55:29          49,834  15%   47.53MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:55:29          49,834  15%   47.53MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:55:29          66,825  21%   63.73MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:55:29          66,974  21%   63.87MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:55:29          67,271  21%   64.15MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:55:29         126,481  40%  120.62MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:55:29         126,953  40%   40.36MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:55:29         127,584  40%   40.56MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:55:29         127,900  40%   40.66MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:55:29         129,329  41%   41.11MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:55:29         129,957  41%   41.31MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:55:29         130,117  41%   41.36MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:55:29         131,405  41%   31.33MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:55:29         131,877  41%   31.44MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:55:29         132,349  42%   31.55MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:55:29         133,001  42%   31.71MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:55:29         133,962  42%   31.94MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:55:29         134,929  42%   32.17MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:55:29         135,089  42%   32.21MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:55:29         136,068  43%   25.95MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:55:29         136,384  43%   26.01MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:55:29         136,700  43%   26.07MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:55:29         137,325  43%   26.19MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:55:29         138,603  44%   26.44MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:55:29         143,254  45%   22.77MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:55:29         143,915  45%   22.87MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:55:29         147,996  47%   23.52MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:55:29         148,563  47%   23.61MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:55:29         152,607  48%   24.26MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:55:29         156,232  49%   21.28MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:55:29         157,371  50%   21.44MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:55:29         158,602  50%   21.61MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:55:29         160,916  51%   21.92MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:55:29         163,592  52%   22.29MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:55:29         166,781  53%   19.88MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:55:29         168,488  53%   20.09MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:55:29         171,258  54%   20.42MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:55:29         175,815  55%   20.96MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:55:29         179,098  56%   21.35MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:55:29         180,847  57%   19.16MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:55:29         184,435  58%   19.54MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:55:29         186,712  59%   19.78MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:55:29         186,998  59%   19.82MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:55:29         187,284  59%   19.85MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         187,284  59%   17.86MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         187,284  59%   17.86MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         187,284  59%   16.24MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         187,284  59%   16.24MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         187,284  59%   16.24MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-paris-0/cluster-manager
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29           6,843  50%    3.26MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-paris-0/op-panel
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29          33,565  33%   32.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29          33,565  33%   32.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29          49,687  49%   47.39MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29          49,978  50%   47.66MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29          49,978  50%   23.83MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-oneprovider-paris-0/op-worker
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          44,503  13%   42.44MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:55:29          62,374  18%   59.48MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:55:29          62,374  18%   59.48MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:55:29          62,374  18%   59.48MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:55:29          79,120  23%   37.73MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:55:29          79,269  23%   37.80MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:55:29          79,566  23%   37.94MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:55:29         138,298  40%   43.96MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:55:29         138,738  41%   44.10MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:55:29         139,334  41%   44.29MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:55:29         139,770  41%   44.43MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:55:29         141,155  41%   33.65MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:55:29         142,146  42%   33.89MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:55:29         142,426  42%   33.96MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:55:29         143,663  42%   34.25MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:55:29         144,101  42%   34.36MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:55:29         144,693  42%   34.50MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:55:29         145,507  43%   34.69MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:55:29         146,498  43%   34.93MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:55:29         147,633  43%   28.16MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:55:29         147,913  43%   28.21MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:55:29         148,952  44%   28.41MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:55:29         149,388  44%   28.49MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:55:29         149,671  44%   28.55MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:55:29         150,524  44%   28.71MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:55:29         151,567  44%   28.91MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:55:29         156,061  46%   24.81MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:55:29         156,565  46%   24.89MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:55:29         160,546  47%   25.52MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:55:29         161,170  47%   25.62MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:55:29         165,214  48%   26.26MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:55:29         168,739  49%   26.82MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:55:29         169,933  50%   27.01MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:55:29         171,064  50%   23.31MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:55:29         173,278  51%   23.61MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:55:29         175,954  52%   23.97MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:55:29         179,143  52%   24.41MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:55:29         180,850  53%   24.64MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:55:29         183,461  54%   21.87MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:55:29         188,018  55%   22.41MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:55:29         191,144  56%   22.79MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:55:29         192,788  57%   22.98MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:55:29         196,376  58%   23.41MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:55:29         198,655  58%   23.68MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:55:29         198,940  58%   21.08MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:55:29         199,225  58%   21.11MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         199,225  58%   21.11MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         199,225  58%   21.11MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         199,225  58%   19.00MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         199,225  58%   19.00MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29         199,225  58%   19.00MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-onezone-0/cluster-manager
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-onezone-0/oz-panel
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          22,482  13%   21.44MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:55:29          45,973  27%   43.84MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:55:29          61,165  36%   58.33MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:55:29          83,444  49%   79.58MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:55:29          83,735  50%   79.86MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:55:29          83,735  50%   39.93MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:55:29 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.45.59/pod-logs/dev-onezone-0/oz-worker
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
03-Dec-2024 18:55:29               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:55:29          13,395   6%   12.77MB/s    0:00:00 (xfr#2, to-chk=13/18)
03-Dec-2024 18:55:29          27,389  13%   26.12MB/s    0:00:00 (xfr#3, to-chk=11/18)
03-Dec-2024 18:55:29          27,389  13%   26.12MB/s    0:00:00 (xfr#4, to-chk=9/18)
03-Dec-2024 18:55:29          40,304  19%   38.44MB/s    0:00:00 (xfr#5, to-chk=7/18)
03-Dec-2024 18:55:29          40,394  19%   38.52MB/s    0:00:00 (xfr#6, to-chk=5/18)
03-Dec-2024 18:55:29          40,691  20%   38.81MB/s    0:00:00 (xfr#7, to-chk=3/18)
03-Dec-2024 18:55:29         101,195  50%   96.51MB/s    0:00:00 (xfr#8, to-chk=1/18)
03-Dec-2024 18:55:29         101,195  50%   16.08MB/s    0:00:00 (xfr#8, to-chk=0/18)
03-Dec-2024 18:55:29 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1733252119.3979948 exists, exporting anyway.
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 =============================== warnings summary ===============================
03-Dec-2024 18:55:29 tests/utils/rest_utils.py:97
03-Dec-2024 18:55:29   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:55:29     print("""
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 tests/utils/path_utils.py:112
03-Dec-2024 18:55:29   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:55:29     return path.replace("'", "\\'").replace(' ', '\ ')
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 tests/utils/acceptance_utils.py:55
03-Dec-2024 18:55:29   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:55:29     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 tests/utils/acceptance_utils.py:57
03-Dec-2024 18:55:29   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:55:29     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:55:29
03-Dec-2024 18:55:29 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
03-Dec-2024 18:55:29 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance/test-reports/results.xml -
03-Dec-2024 18:55:29 ================== 9 passed, 4 warnings in 573.50s (0:09:33) ===================
03-Dec-2024 18:55:34 release "dev" uninstalled
03-Dec-2024 18:55:35 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
03-Dec-2024 18:55:35 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
03-Dec-2024 18:55:37 No resources found
03-Dec-2024 18:55:38 Sidecar injection has been disabled
03-Dec-2024 18:55:38 Cleaning helm release "dev"...
03-Dec-2024 18:55:38 Deleted 1 helm deployments
03-Dec-2024 18:55:38 Deleted 0 k8s deployments
03-Dec-2024 18:55:38 Deleted 0 k8s services
03-Dec-2024 18:55:38 Deleted 0 persistent volumes
03-Dec-2024 18:55:38 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:55:38 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
03-Dec-2024 18:55:38 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:55:38 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
03-Dec-2024 18:55:38 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
03-Dec-2024 18:55:38 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:55:38 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
03-Dec-2024 18:55:38 Finished task 'Run acceptance oneclient tests' with result: Success
03-Dec-2024 18:55:38 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
03-Dec-2024 18:55:38 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH...
03-Dec-2024 18:55:38 Finished task 'Parse test results' with result: Success
03-Dec-2024 18:55:38 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:55:38
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:55:38 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:55:38
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio hardlinks #3374 (ODSRV-OAP-MRPH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPH-3374-ScriptBuildTask-8383990428155010495.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance
03-Dec-2024 18:55:38 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_proxyio_hardlinks.tar.gz
03-Dec-2024 18:55:39 Uploading artifact
03-Dec-2024 18:55:39     source path: surefire_multiprovider_replication_proxyio_hardlinks.tar.gz
03-Dec-2024 18:55:39     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_proxyio_hardlinks.tar.gz
03-Dec-2024 18:55:39 Finished task 'Pack and push surefire artifact' with result: Success
03-Dec-2024 18:55:39 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:55:39 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:55:39
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio hardlinks #3374 (ODSRV-OAP-MRPH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPH-3374-ScriptBuildTask-7250358594566020889.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH
03-Dec-2024 18:55:39 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
03-Dec-2024 18:55:39 Finished task 'Pack logs' with result: Success
03-Dec-2024 18:55:39 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:55:39
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
03-Dec-2024 18:55:39 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:55:39
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio hardlinks #3374 (ODSRV-OAP-MRPH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRPH-3374-ScriptBuildTask-18375516356373707220.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH/onedata-acceptance
03-Dec-2024 18:55:39   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
03-Dec-2024 18:55:39                                  Dload  Upload   Total   Spent    Left  Speed
03-Dec-2024 18:55:39
03-Dec-2024 18:55:39   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
03-Dec-2024 18:55:39 100  4822  100  4822    0     0  56729      0 --:--:-- --:--:-- --:--:-- 56729
03-Dec-2024 18:55:39 Clearing /tmp/onedata and /home/bamboo/.one-env
03-Dec-2024 18:55:40 Cleaning helm deployments
03-Dec-2024 18:55:40 Cleanining pods
03-Dec-2024 18:55:40 Cleaning kube persistant volumes
03-Dec-2024 18:55:40 Cleaning dockswift container
03-Dec-2024 18:55:40 Cleaning docker containers
03-Dec-2024 18:55:43 Stalled docker containers to remove:
03-Dec-2024 18:55:43 61fc8c8cc42c e7a4e457ce58 9a86cf5d6f2e 76760f59aeff 342fe24488e8 a54c8ca0bb9b 2f711f502c8e 1609411e9291 cd8d5889a0c6 dc83875f5e62 639b651864f9 8ab6f44a1c24 4d5346bf189c 178f30c408fc 8a3677a63d9c f518f9408d7d f7f8aa344f2e 9ef4a6d1e9e5 d233a053fe3f b9f58c780360
03-Dec-2024 18:55:43 Removing stalled docker containers
03-Dec-2024 18:55:43 Error response from daemon: Cannot kill container: 61fc8c8cc42c: Container 61fc8c8cc42ceb4930320d91ddd87f4c1b0ba6d3d6fe079392c8a6bb4eb4fad4 is not running
03-Dec-2024 18:55:43 61fc8c8cc42c
03-Dec-2024 18:55:43 Error response from daemon: Cannot kill container: e7a4e457ce58: Container e7a4e457ce5866adab30fd8501c1b32aec37b8dc277b8ba9864df562db147397 is not running
03-Dec-2024 18:55:43 e7a4e457ce58
03-Dec-2024 18:55:43 Error response from daemon: Cannot kill container: 9a86cf5d6f2e: Container 9a86cf5d6f2ee9058edd0394af0aaff9bb92e63a2ac8b7bef63996ffdb96ca3e is not running
03-Dec-2024 18:55:43 9a86cf5d6f2e
03-Dec-2024 18:55:43 Error response from daemon: Cannot kill container: 76760f59aeff: Container 76760f59aeffccb5c41058adfe2500c136869caea5eda103b0bb9358913b48f1 is not running
03-Dec-2024 18:55:43 76760f59aeff
03-Dec-2024 18:55:43 Error response from daemon: Cannot kill container: 342fe24488e8: Container 342fe24488e816df0849dc29addb5d051e95cd3e03e035782020be0cb724275d is not running
03-Dec-2024 18:55:44 342fe24488e8
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: a54c8ca0bb9b: Container a54c8ca0bb9b353600fff9f010d46fa5ab3028dabc57e0ac792d7271a44525c3 is not running
03-Dec-2024 18:55:44 a54c8ca0bb9b
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 2f711f502c8e: Container 2f711f502c8e21acf200e79e4e4ce631c6b2825a5b3535a158032c20b8f35c49 is not running
03-Dec-2024 18:55:44 2f711f502c8e
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 1609411e9291: Container 1609411e9291cf6d7bbcf9d8fe75614876f8dab9e5c8e9d6b73a74155b7d982a is not running
03-Dec-2024 18:55:44 1609411e9291
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: cd8d5889a0c6: Container cd8d5889a0c6ab76914d1841760318e262e767f2654c61dced48bfccea05b98c is not running
03-Dec-2024 18:55:44 cd8d5889a0c6
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: dc83875f5e62: Container dc83875f5e62185ebad988becd1f7b1e2e6362c5797344faed853cee53888506 is not running
03-Dec-2024 18:55:44 dc83875f5e62
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 639b651864f9: Container 639b651864f98e0de8994f692a9a502580706c904f6e49648af5ad428482e95d is not running
03-Dec-2024 18:55:44 639b651864f9
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 8ab6f44a1c24: Container 8ab6f44a1c24b294d716da3ec1ae43b83c2b6cd3ba752af92e01308a9a62f298 is not running
03-Dec-2024 18:55:44 8ab6f44a1c24
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 4d5346bf189c: Container 4d5346bf189cea27b92a63e3df2293a4043ebe5f50d02fbe3e4a5ccc25944ab9 is not running
03-Dec-2024 18:55:44 4d5346bf189c
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 178f30c408fc: Container 178f30c408fc7cdd3db303a00cc015644d4f628a1fc836770c9e4f476ae89112 is not running
03-Dec-2024 18:55:44 178f30c408fc
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: 8a3677a63d9c: Container 8a3677a63d9c474e447445c34041f76acabf3c238f50dc1dc2f1742de04f7b87 is not running
03-Dec-2024 18:55:44 8a3677a63d9c
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: f518f9408d7d: Container f518f9408d7d056c7eea435825dc5015f94024e9597dde59d189e5bd5c10eafe is not running
03-Dec-2024 18:55:44 f518f9408d7d
03-Dec-2024 18:55:44 Error response from daemon: Cannot kill container: f7f8aa344f2e: Container f7f8aa344f2e567d649ee9835e6e70f22983abb4c9ce5f1baf6943676179da90 is not running
03-Dec-2024 18:55:44 f7f8aa344f2e
03-Dec-2024 18:55:45 Error response from daemon: Cannot kill container: 9ef4a6d1e9e5: Container 9ef4a6d1e9e539bf670e7705be983dcd3c5152490ef0e9181c6b128fb4c76f0d is not running
03-Dec-2024 18:55:45 9ef4a6d1e9e5
03-Dec-2024 18:55:45 Error response from daemon: Cannot kill container: d233a053fe3f: Container d233a053fe3f38110883dfbebb9665c2330946bd21334741e3e602d6fed27ea8 is not running
03-Dec-2024 18:55:45 d233a053fe3f
03-Dec-2024 18:55:45 b9f58c780360
03-Dec-2024 18:55:45 b9f58c780360
03-Dec-2024 18:55:45 Stalled docker volumes to remove:
03-Dec-2024 18:55:45
03-Dec-2024 18:55:45 Removing stalled docker volumes
03-Dec-2024 18:55:45 Removing stalled loopdevices
03-Dec-2024 18:55:46 Done
03-Dec-2024 18:55:46 Finished task 'Clear env and working dir' with result: Success
03-Dec-2024 18:55:46 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
03-Dec-2024 18:55:46 Running post build plugin 'Docker Container Cleanup'
03-Dec-2024 18:55:46 Running post build plugin 'NCover Results Collector'
03-Dec-2024 18:55:46 Running post build plugin 'Build Results Label Collector'
03-Dec-2024 18:55:46 Running post build plugin 'Clover Results Collector'
03-Dec-2024 18:55:46 Running post build plugin 'npm Cache Cleanup'
03-Dec-2024 18:55:46 Running post build plugin 'Artifact Copier'
03-Dec-2024 18:55:46 Publishing an artifact: test_logs.tar.gz
03-Dec-2024 18:55:46 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 53.93 ms
03-Dec-2024 18:55:46 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRPH'
03-Dec-2024 18:55:46 Finalising the build...
03-Dec-2024 18:55:46 Stopping timer.
03-Dec-2024 18:55:46 Build ODSRV-OAP-MRPH-3374 completed.
03-Dec-2024 18:55:46 Running on server: post build plugin 'Build Hanging Detection Configuration'
03-Dec-2024 18:55:46 Running on server: post build plugin 'NCover Results Collector'
03-Dec-2024 18:55:46 Running on server: post build plugin 'Build Labeller'
03-Dec-2024 18:55:46 Running on server: post build plugin 'Clover Delta Calculator'
03-Dec-2024 18:55:46 Running on server: post build plugin 'Maven Dependencies Postprocessor'
03-Dec-2024 18:55:46 All post build plugins have finished
03-Dec-2024 18:55:46 Generating build results summary...
03-Dec-2024 18:55:46 Saving build results to disk...
03-Dec-2024 18:55:46 Store variable context...
03-Dec-2024 18:55:46 Finished building ODSRV-OAP-MRPH-3374.