oneclient acceptance tests using environment deployed from packages

Build: #3374 failed

Job: multiprovider replication directio hardlinks was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,886 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:23:42 Adding user `space_owner' ...
03-Dec-2024 18:23:42 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:23:42 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:23:42 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:23:42 Copying files from `/etc/skel' ...
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:23:42 Adding user `user1' ...
03-Dec-2024 18:23:42 Adding new group `user1' (25687) ...
03-Dec-2024 18:23:42 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:23:42 Creating home directory `/home/user1' ...
03-Dec-2024 18:23:42 Copying files from `/etc/skel' ...
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:23:42 Adding user `user2' ...
03-Dec-2024 18:23:42 Adding new group `user2' (30628) ...
03-Dec-2024 18:23:42 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:23:42 Creating home directory `/home/user2' ...
03-Dec-2024 18:23:42 Copying files from `/etc/skel' ...
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:23:42 Adding user `space_owner' ...
03-Dec-2024 18:23:42 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:23:42 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:23:42 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:23:42 Copying files from `/etc/skel' ...
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:23:42 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:23:42 id: ‘user2’: no such user
03-Dec-2024 18:23:42 command terminated with exit code 1
03-Dec-2024 18:23:43 command terminated with exit code 1
03-Dec-2024 18:23:44 command terminated with exit code 1
03-Dec-2024 18:23:46 command terminated with exit code 1
03-Dec-2024 18:24:21 Adding user `user1' ...
03-Dec-2024 18:24:21 Adding new group `user1' (25687) ...
03-Dec-2024 18:24:21 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:24:21 Creating home directory `/home/user1' ...
03-Dec-2024 18:24:21 Copying files from `/etc/skel' ...
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:24:21 Adding user `user2' ...
03-Dec-2024 18:24:21 Adding new group `user2' (30628) ...
03-Dec-2024 18:24:21 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:24:21 Creating home directory `/home/user2' ...
03-Dec-2024 18:24:21 Copying files from `/etc/skel' ...
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:24:21 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 =================================================================
03-Dec-2024 18:24:21 - Executing scenario 'Create files on one provider and see them on the other provider'
03-Dec-2024 18:24:21 - from feature 'Multiprovider_replication'
03-Dec-2024 18:24:21 -----------------------------------------------------------------
03-Dec-2024 18:24:21 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:24:21 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:24:21 using [token, token] by [user1, user2]"'
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:24:21 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/1mynbdp1icdy2u3d
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/1mynbdp1icdy2u3d --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/1mynbdp1icdy2u3d
03-Dec-2024 18:24:21 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '789625849134344004'...
03-Dec-2024 18:24:21 Getting configuration...
03-Dec-2024 18:24:21 Oneclient has been successfully mounted in '/tmp/onedata/mnt/1mynbdp1icdy2u3d'.
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:24:21 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:24:21 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/sr08pswnkndhx2ja
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/sr08pswnkndhx2ja --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/sr08pswnkndhx2ja
03-Dec-2024 18:24:21 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '13514016515108748066'...
03-Dec-2024 18:24:21 Getting configuration...
03-Dec-2024 18:24:21 Oneclient has been successfully mounted in '/tmp/onedata/mnt/sr08pswnkndhx2ja'.
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
03-Dec-2024 18:24:21 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:24:21 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:24:21 =================================================================
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 PASSED
03-Dec-2024 18:24:21 Unmounting client from /tmp/onedata/mnt/1mynbdp1icdy2u3d
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21 Unmounting client from /tmp/onedata/mnt/sr08pswnkndhx2ja
03-Dec-2024 18:24:21
03-Dec-2024 18:24:21
03-Dec-2024 18:24:54 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:24:54 =================================================================
03-Dec-2024 18:24:54 - Executing scenario 'Create empty file on one provider and read it on the other provider'
03-Dec-2024 18:24:54 - from feature 'Multiprovider_replication'
03-Dec-2024 18:24:54 -----------------------------------------------------------------
03-Dec-2024 18:24:54 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:24:54 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:24:54 using [token, token] by [user1, user2]"'
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:24:54 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/iaqfcf2nx8dgz234
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/iaqfcf2nx8dgz234 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/iaqfcf2nx8dgz234
03-Dec-2024 18:24:54 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '13638903139082859785'...
03-Dec-2024 18:24:54 Getting configuration...
03-Dec-2024 18:24:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/iaqfcf2nx8dgz234'.
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:24:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:24:54 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/4o9yoeuvwzg65yn3
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/4o9yoeuvwzg65yn3 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/4o9yoeuvwzg65yn3
03-Dec-2024 18:24:54 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11926686386143001791'...
03-Dec-2024 18:24:54 Getting configuration...
03-Dec-2024 18:24:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/4o9yoeuvwzg65yn3'.
03-Dec-2024 18:24:54
03-Dec-2024 18:24:54 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:24:54 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
03-Dec-2024 18:24:54 =================================================================
03-Dec-2024 18:24:54
03-Dec-2024 18:24:55 PASSED
03-Dec-2024 18:24:55 Unmounting client from /tmp/onedata/mnt/iaqfcf2nx8dgz234
03-Dec-2024 18:24:55
03-Dec-2024 18:24:55
03-Dec-2024 18:24:55 Unmounting client from /tmp/onedata/mnt/4o9yoeuvwzg65yn3
03-Dec-2024 18:24:55
03-Dec-2024 18:24:55
03-Dec-2024 18:25:28 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:25:28 =================================================================
03-Dec-2024 18:25:28 - Executing scenario 'Write to file on one provider and check size on the other provider'
03-Dec-2024 18:25:28 - from feature 'Multiprovider_replication'
03-Dec-2024 18:25:28 -----------------------------------------------------------------
03-Dec-2024 18:25:28 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:25:28 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:25:28 using [token, token] by [user1, user2]"'
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:25:28 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/hyykkg5aaqkzhynk
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/hyykkg5aaqkzhynk --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/hyykkg5aaqkzhynk
03-Dec-2024 18:25:28 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '8911850553022569559'...
03-Dec-2024 18:25:28 Getting configuration...
03-Dec-2024 18:25:28 Oneclient has been successfully mounted in '/tmp/onedata/mnt/hyykkg5aaqkzhynk'.
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:25:28 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:25:28 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/kri2o1mep6661l5s
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/kri2o1mep6661l5s --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/kri2o1mep6661l5s
03-Dec-2024 18:25:28 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '7827630009755029954'...
03-Dec-2024 18:25:28 Getting configuration...
03-Dec-2024 18:25:28 Oneclient has been successfully mounted in '/tmp/onedata/mnt/kri2o1mep6661l5s'.
03-Dec-2024 18:25:28
03-Dec-2024 18:25:28 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:25:28 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:25:28 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
03-Dec-2024 18:25:28 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
03-Dec-2024 18:25:28 =================================================================
03-Dec-2024 18:25:28
03-Dec-2024 18:25:29 PASSED
03-Dec-2024 18:25:29 Unmounting client from /tmp/onedata/mnt/hyykkg5aaqkzhynk
03-Dec-2024 18:25:29
03-Dec-2024 18:25:29
03-Dec-2024 18:25:29 Unmounting client from /tmp/onedata/mnt/kri2o1mep6661l5s
03-Dec-2024 18:25:29
03-Dec-2024 18:25:29
03-Dec-2024 18:26:03 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:26:03 =================================================================
03-Dec-2024 18:26:03 - Executing scenario 'Write to file on one provider and read on the other provider'
03-Dec-2024 18:26:03 - from feature 'Multiprovider_replication'
03-Dec-2024 18:26:03 -----------------------------------------------------------------
03-Dec-2024 18:26:03 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:26:03 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:26:03 using [token, token] by [user1, user2]"'
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:26:03 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/mqcwvohvays7iknn
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/mqcwvohvays7iknn --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/mqcwvohvays7iknn
03-Dec-2024 18:26:03 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '8667727756726638581'...
03-Dec-2024 18:26:03 Getting configuration...
03-Dec-2024 18:26:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/mqcwvohvays7iknn'.
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:26:03 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:26:03 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/ia140m53rfey2uym
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ia140m53rfey2uym --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ia140m53rfey2uym
03-Dec-2024 18:26:03 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '15064204047472291642'...
03-Dec-2024 18:26:03 Getting configuration...
03-Dec-2024 18:26:03 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ia140m53rfey2uym'.
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:26:03 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:26:03 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
03-Dec-2024 18:26:03 =================================================================
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 PASSED
03-Dec-2024 18:26:03 Unmounting client from /tmp/onedata/mnt/mqcwvohvays7iknn
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03 Unmounting client from /tmp/onedata/mnt/ia140m53rfey2uym
03-Dec-2024 18:26:03
03-Dec-2024 18:26:03
03-Dec-2024 18:26:37 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:26:37 =================================================================
03-Dec-2024 18:26:37 - Executing scenario 'Big file transfer with MD5 check'
03-Dec-2024 18:26:37 - from feature 'Multiprovider_replication'
03-Dec-2024 18:26:37 -----------------------------------------------------------------
03-Dec-2024 18:26:37 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:26:37 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:26:37 using [token, token] by [user1, user2]"'
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:26:37 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/j6z7ra3ov4nlftx6
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/j6z7ra3ov4nlftx6 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/j6z7ra3ov4nlftx6
03-Dec-2024 18:26:37 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '15541266074036870563'...
03-Dec-2024 18:26:37 Getting configuration...
03-Dec-2024 18:26:37 Oneclient has been successfully mounted in '/tmp/onedata/mnt/j6z7ra3ov4nlftx6'.
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:26:37 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:26:37 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/s8b3ae0rwm6mkeqx
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/s8b3ae0rwm6mkeqx --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/s8b3ae0rwm6mkeqx
03-Dec-2024 18:26:37 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1180046420157211261'...
03-Dec-2024 18:26:37 Getting configuration...
03-Dec-2024 18:26:37 Oneclient has been successfully mounted in '/tmp/onedata/mnt/s8b3ae0rwm6mkeqx'.
03-Dec-2024 18:26:37
03-Dec-2024 18:26:37 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:26:37 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:26:37 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:26:37 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:26:37 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:26:37 =================================================================
03-Dec-2024 18:26:37
03-Dec-2024 18:26:38 PASSED
03-Dec-2024 18:26:38 Unmounting client from /tmp/onedata/mnt/j6z7ra3ov4nlftx6
03-Dec-2024 18:26:38
03-Dec-2024 18:26:38
03-Dec-2024 18:26:38 Unmounting client from /tmp/onedata/mnt/s8b3ae0rwm6mkeqx
03-Dec-2024 18:26:38
03-Dec-2024 18:26:38
03-Dec-2024 18:27:43 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:27:43 =================================================================
03-Dec-2024 18:27:43 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
03-Dec-2024 18:27:43 - from feature 'Multiprovider_replication'
03-Dec-2024 18:27:43 -----------------------------------------------------------------
03-Dec-2024 18:27:43 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:27:43 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:27:43 using [token, token] by [user1, user2]"'
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:27:43 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/ttlmmg0schfdxxqc
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ttlmmg0schfdxxqc --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ttlmmg0schfdxxqc
03-Dec-2024 18:27:43 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '8548779845538142771'...
03-Dec-2024 18:27:43 Getting configuration...
03-Dec-2024 18:27:43 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ttlmmg0schfdxxqc'.
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:27:43 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:27:43 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/t8x636zzxz01v61a
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/t8x636zzxz01v61a --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/t8x636zzxz01v61a
03-Dec-2024 18:27:43 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '9695548068241020616'...
03-Dec-2024 18:27:43 Getting configuration...
03-Dec-2024 18:27:43 Oneclient has been successfully mounted in '/tmp/onedata/mnt/t8x636zzxz01v61a'.
03-Dec-2024 18:27:43
03-Dec-2024 18:27:43 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:27:43 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
03-Dec-2024 18:27:43 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
03-Dec-2024 18:27:43 =================================================================
03-Dec-2024 18:27:43
03-Dec-2024 18:27:44 PASSED
03-Dec-2024 18:27:44 Unmounting client from /tmp/onedata/mnt/ttlmmg0schfdxxqc
03-Dec-2024 18:27:44
03-Dec-2024 18:27:44
03-Dec-2024 18:27:44 Unmounting client from /tmp/onedata/mnt/t8x636zzxz01v61a
03-Dec-2024 18:27:44
03-Dec-2024 18:27:44
03-Dec-2024 18:28:29 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:28:29 =================================================================
03-Dec-2024 18:28:29 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
03-Dec-2024 18:28:29 - from feature 'Multiprovider_replication'
03-Dec-2024 18:28:29 -----------------------------------------------------------------
03-Dec-2024 18:28:29 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:28:29 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:28:29 using [token, token] by [user1, user2]"'
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:28:29 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/vb6c2wxmpnairwej
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/vb6c2wxmpnairwej --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/vb6c2wxmpnairwej
03-Dec-2024 18:28:29 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '11983317482784892286'...
03-Dec-2024 18:28:29 Getting configuration...
03-Dec-2024 18:28:29 Oneclient has been successfully mounted in '/tmp/onedata/mnt/vb6c2wxmpnairwej'.
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:28:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:28:29 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/vfipva6o9ahu0hnu
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/vfipva6o9ahu0hnu --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/vfipva6o9ahu0hnu
03-Dec-2024 18:28:29 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11579345726485175046'...
03-Dec-2024 18:28:29 Getting configuration...
03-Dec-2024 18:28:29 Oneclient has been successfully mounted in '/tmp/onedata/mnt/vfipva6o9ahu0hnu'.
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:28:29 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:28:29 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:28:29 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
03-Dec-2024 18:28:29 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
03-Dec-2024 18:28:29 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
03-Dec-2024 18:28:29 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
03-Dec-2024 18:28:29 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
03-Dec-2024 18:28:29 =================================================================
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 PASSED
03-Dec-2024 18:28:29 Unmounting client from /tmp/onedata/mnt/vb6c2wxmpnairwej
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29 Unmounting client from /tmp/onedata/mnt/vfipva6o9ahu0hnu
03-Dec-2024 18:28:29
03-Dec-2024 18:28:29
03-Dec-2024 18:29:49 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:29:49 =================================================================
03-Dec-2024 18:29:49 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
03-Dec-2024 18:29:49 - from feature 'Multiprovider_replication'
03-Dec-2024 18:29:49 -----------------------------------------------------------------
03-Dec-2024 18:29:49 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:29:49 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:29:49 using [token, token] by [user1, user2]"'
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:29:49 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/n5sdlmhnmez80kid
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/n5sdlmhnmez80kid --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/n5sdlmhnmez80kid
03-Dec-2024 18:29:49 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '1647857828672366465'...
03-Dec-2024 18:29:49 Getting configuration...
03-Dec-2024 18:29:49 Oneclient has been successfully mounted in '/tmp/onedata/mnt/n5sdlmhnmez80kid'.
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:29:49 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:29:49 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/lst6s9n2xaiwzcxa
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/lst6s9n2xaiwzcxa --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/lst6s9n2xaiwzcxa
03-Dec-2024 18:29:49 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '10702889714501812909'...
03-Dec-2024 18:29:49 Getting configuration...
03-Dec-2024 18:29:49 Oneclient has been successfully mounted in '/tmp/onedata/mnt/lst6s9n2xaiwzcxa'.
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
03-Dec-2024 18:29:49 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
03-Dec-2024 18:29:49 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
03-Dec-2024 18:29:49 =================================================================
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 PASSED
03-Dec-2024 18:29:49 Unmounting client from /tmp/onedata/mnt/n5sdlmhnmez80kid
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49 Unmounting client from /tmp/onedata/mnt/lst6s9n2xaiwzcxa
03-Dec-2024 18:29:49
03-Dec-2024 18:29:49
03-Dec-2024 18:30:35 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:30:35 =================================================================
03-Dec-2024 18:30:35 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
03-Dec-2024 18:30:35 - from feature 'Multiprovider_replication'
03-Dec-2024 18:30:35 -----------------------------------------------------------------
03-Dec-2024 18:30:35 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:30:35 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:30:35 using [token, token] by [user1, user2]"'
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-bchrs', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs'
03-Dec-2024 18:30:35 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-bchrs' successfully started
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/pbtiwj40hck9s35t
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/pbtiwj40hck9s35t --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/pbtiwj40hck9s35t
03-Dec-2024 18:30:35 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '9343409078668234482'...
03-Dec-2024 18:30:35 Getting configuration...
03-Dec-2024 18:30:35 Oneclient has been successfully mounted in '/tmp/onedata/mnt/pbtiwj40hck9s35t'.
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:30:35 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-xpp7x', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x'
03-Dec-2024 18:30:35 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-xpp7x' successfully started
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/txlypjr1ilkaz3m6
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/txlypjr1ilkaz3m6 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/txlypjr1ilkaz3m6
03-Dec-2024 18:30:35 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3219217963143397648'...
03-Dec-2024 18:30:35 Getting configuration...
03-Dec-2024 18:30:35 Oneclient has been successfully mounted in '/tmp/onedata/mnt/txlypjr1ilkaz3m6'.
03-Dec-2024 18:30:35
03-Dec-2024 18:30:35 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:30:35 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:30:35 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:30:35 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:30:35 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
03-Dec-2024 18:30:35 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
03-Dec-2024 18:30:35 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
03-Dec-2024 18:30:35 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
03-Dec-2024 18:30:35 =================================================================
03-Dec-2024 18:30:35
03-Dec-2024 18:30:46 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:30:46 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:30:46 PASSED
03-Dec-2024 18:30:46 Unmounting client from /tmp/onedata/mnt/pbtiwj40hck9s35t
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 Unmounting client from /tmp/onedata/mnt/txlypjr1ilkaz3m6
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1733250635.491928', '-c', '/tmp/logs']
03-Dec-2024 18:30:46 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-w55sz. See /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-cross-support-job-3p-users-w55sz/entrypoint.log for more details
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-bchrs: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneclient-krakow-7d9476b8bc-bchrs/oneclient_logs
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          39,877   1%   38.03MB/s    0:00:00 (xfr#1, to-chk=64/80)
03-Dec-2024 18:30:46          39,877   1%   38.03MB/s    0:00:00 (xfr#1, to-chk=58/80)
03-Dec-2024 18:30:46          40,435   1%   38.56MB/s    0:00:00 (xfr#2, to-chk=60/80)
03-Dec-2024 18:30:46         194,694   7%   92.84MB/s    0:00:00 (xfr#3, to-chk=59/80)
03-Dec-2024 18:30:46         195,252   7%   93.10MB/s    0:00:00 (xfr#4, to-chk=58/80)
03-Dec-2024 18:30:46         232,492   8%   73.91MB/s    0:00:00 (xfr#5, to-chk=57/80)
03-Dec-2024 18:30:46         233,050   8%   74.08MB/s    0:00:00 (xfr#6, to-chk=53/80)
03-Dec-2024 18:30:46         348,712  13%   66.51MB/s    0:00:00 (xfr#7, to-chk=52/80)
03-Dec-2024 18:30:46         349,270  13%   66.62MB/s    0:00:00 (xfr#8, to-chk=51/80)
03-Dec-2024 18:30:46         376,480  14%   71.81MB/s    0:00:00 (xfr#9, to-chk=50/80)
03-Dec-2024 18:30:46         376,942  14%   71.90MB/s    0:00:00 (xfr#10, to-chk=46/80)
03-Dec-2024 18:30:46         467,030  17%   74.23MB/s    0:00:00 (xfr#11, to-chk=45/80)
03-Dec-2024 18:30:46         467,492  17%   74.31MB/s    0:00:00 (xfr#12, to-chk=44/80)
03-Dec-2024 18:30:46         514,512  19%   49.07MB/s    0:00:00 (xfr#13, to-chk=43/80)
03-Dec-2024 18:30:46         515,358  19%   49.15MB/s    0:00:00 (xfr#14, to-chk=39/80)
03-Dec-2024 18:30:46         856,594  32%   45.38MB/s    0:00:00 (xfr#15, to-chk=38/80)
03-Dec-2024 18:30:46         857,440  32%   45.43MB/s    0:00:00 (xfr#16, to-chk=37/80)
03-Dec-2024 18:30:46         895,998  34%   25.89MB/s    0:00:00 (xfr#17, to-chk=36/80)
03-Dec-2024 18:30:46         896,556  34%   25.91MB/s    0:00:00 (xfr#18, to-chk=32/80)
03-Dec-2024 18:30:46       1,015,272  38%   25.48MB/s    0:00:00 (xfr#19, to-chk=31/80)
03-Dec-2024 18:30:46       1,015,830  38%   25.49MB/s    0:00:00 (xfr#20, to-chk=30/80)
03-Dec-2024 18:30:46       1,140,272  43%   27.88MB/s    0:00:00 (xfr#21, to-chk=29/80)
03-Dec-2024 18:30:46       1,140,542  43%   27.89MB/s    0:00:00 (xfr#22, to-chk=25/80)
03-Dec-2024 18:30:46       1,585,295  60%   24.00MB/s    0:00:00 (xfr#23, to-chk=24/80)
03-Dec-2024 18:30:46       1,585,565  60%   24.00MB/s    0:00:00 (xfr#24, to-chk=23/80)
03-Dec-2024 18:30:46       1,586,193  60%   24.01MB/s    0:00:00 (xfr#25, to-chk=22/80)
03-Dec-2024 18:30:46       1,657,173  63%   24.69MB/s    0:00:00 (xfr#26, to-chk=21/80)
03-Dec-2024 18:30:46       1,657,827  63%   24.70MB/s    0:00:00 (xfr#27, to-chk=17/80)
03-Dec-2024 18:30:46       1,904,747  72%   26.71MB/s    0:00:00 (xfr#28, to-chk=16/80)
03-Dec-2024 18:30:46       1,905,401  72%   26.72MB/s    0:00:00 (xfr#29, to-chk=15/80)
03-Dec-2024 18:30:46       2,020,347  76%   27.92MB/s    0:00:00 (xfr#30, to-chk=14/80)
03-Dec-2024 18:30:46       2,021,097  76%   27.93MB/s    0:00:00 (xfr#31, to-chk=10/80)
03-Dec-2024 18:30:46       2,436,538  92%   31.40MB/s    0:00:00 (xfr#32, to-chk=9/80)
03-Dec-2024 18:30:46       2,437,288  92%   31.41MB/s    0:00:00 (xfr#33, to-chk=8/80)
03-Dec-2024 18:30:46       2,476,970  94%   31.92MB/s    0:00:00 (xfr#34, to-chk=7/80)
03-Dec-2024 18:30:46       2,477,816  94%   31.51MB/s    0:00:00 (xfr#35, to-chk=3/80)
03-Dec-2024 18:30:46       2,612,277  99%   33.22MB/s    0:00:00 (xfr#36, to-chk=2/80)
03-Dec-2024 18:30:46       2,613,123  99%   33.23MB/s    0:00:00 (xfr#37, to-chk=1/80)
03-Dec-2024 18:30:46       2,625,972  99%   33.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   33.39MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   32.95MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   32.95MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   32.95MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   32.95MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   32.95MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   30.54MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   30.54MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   30.17MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46       2,625,972  99%   30.17MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-xpp7x: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneclient-paris-5cc45c8cb7-xpp7x/oneclient_logs
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=64/79)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          31,865   1%   30.39MB/s    0:00:00 (xfr#1, to-chk=63/79)
03-Dec-2024 18:30:46          31,865   1%   30.39MB/s    0:00:00 (xfr#1, to-chk=57/79)
03-Dec-2024 18:30:46          32,423   1%   30.92MB/s    0:00:00 (xfr#2, to-chk=59/79)
03-Dec-2024 18:30:46         140,163   5%  133.67MB/s    0:00:00 (xfr#3, to-chk=58/79)
03-Dec-2024 18:30:46         140,721   5%  134.20MB/s    0:00:00 (xfr#4, to-chk=57/79)
03-Dec-2024 18:30:46         180,843   7%   86.23MB/s    0:00:00 (xfr#5, to-chk=56/79)
03-Dec-2024 18:30:46         181,401   7%   86.50MB/s    0:00:00 (xfr#6, to-chk=52/79)
03-Dec-2024 18:30:46         302,730  12%   57.74MB/s    0:00:00 (xfr#7, to-chk=51/79)
03-Dec-2024 18:30:46         303,288  12%   57.85MB/s    0:00:00 (xfr#8, to-chk=50/79)
03-Dec-2024 18:30:46         330,416  13%   52.52MB/s    0:00:00 (xfr#9, to-chk=49/79)
03-Dec-2024 18:30:46         330,782  13%   52.58MB/s    0:00:00 (xfr#10, to-chk=45/79)
03-Dec-2024 18:30:46         433,965  18%   51.73MB/s    0:00:00 (xfr#11, to-chk=44/79)
03-Dec-2024 18:30:46         434,331  18%   51.78MB/s    0:00:00 (xfr#12, to-chk=43/79)
03-Dec-2024 18:30:46         592,275  24%   51.35MB/s    0:00:00 (xfr#13, to-chk=42/79)
03-Dec-2024 18:30:46         592,737  24%   51.39MB/s    0:00:00 (xfr#14, to-chk=38/79)
03-Dec-2024 18:30:46       1,172,953  48%   24.32MB/s    0:00:00 (xfr#15, to-chk=37/79)
03-Dec-2024 18:30:46       1,173,415  48%   24.33MB/s    0:00:00 (xfr#16, to-chk=36/79)
03-Dec-2024 18:30:46       1,231,721  51%   25.54MB/s    0:00:00 (xfr#17, to-chk=35/79)
03-Dec-2024 18:30:46       1,232,183  51%   25.55MB/s    0:00:00 (xfr#18, to-chk=31/79)
03-Dec-2024 18:30:46       1,479,592  61%   28.80MB/s    0:00:00 (xfr#19, to-chk=30/79)
03-Dec-2024 18:30:46       1,480,054  61%   28.23MB/s    0:00:00 (xfr#20, to-chk=29/79)
03-Dec-2024 18:30:46       1,514,830  63%   28.33MB/s    0:00:00 (xfr#21, to-chk=28/79)
03-Dec-2024 18:30:46       1,515,292  63%   28.34MB/s    0:00:00 (xfr#22, to-chk=24/79)
03-Dec-2024 18:30:46       1,682,727  70%   30.86MB/s    0:00:00 (xfr#23, to-chk=23/79)
03-Dec-2024 18:30:46       1,683,189  70%   30.87MB/s    0:00:00 (xfr#24, to-chk=22/79)
03-Dec-2024 18:30:46       1,743,726  72%   31.38MB/s    0:00:00 (xfr#25, to-chk=21/79)
03-Dec-2024 18:30:46       1,744,188  72%   31.38MB/s    0:00:00 (xfr#26, to-chk=17/79)
03-Dec-2024 18:30:46       1,982,979  82%   28.65MB/s    0:00:00 (xfr#27, to-chk=16/79)
03-Dec-2024 18:30:46       1,983,441  82%   28.66MB/s    0:00:00 (xfr#28, to-chk=15/79)
03-Dec-2024 18:30:46       2,023,274  84%   28.80MB/s    0:00:00 (xfr#29, to-chk=14/79)
03-Dec-2024 18:30:46       2,024,120  84%   28.81MB/s    0:00:00 (xfr#30, to-chk=10/79)
03-Dec-2024 18:30:46       2,198,690  91%   29.12MB/s    0:00:00 (xfr#31, to-chk=9/79)
03-Dec-2024 18:30:46       2,199,536  91%   29.13MB/s    0:00:00 (xfr#32, to-chk=8/79)
03-Dec-2024 18:30:46       2,223,489  92%   29.45MB/s    0:00:00 (xfr#33, to-chk=7/79)
03-Dec-2024 18:30:46       2,224,047  92%   29.46MB/s    0:00:00 (xfr#34, to-chk=3/79)
03-Dec-2024 18:30:46       2,369,207  98%   30.95MB/s    0:00:00 (xfr#35, to-chk=2/79)
03-Dec-2024 18:30:46       2,369,765  98%   30.96MB/s    0:00:00 (xfr#36, to-chk=1/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.92MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.51MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46       2,399,591  99%   30.51MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-krakow-0/op-worker
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          31,528  10%   30.07MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:30:46          49,460  15%   47.17MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:30:46          49,460  15%   47.17MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:30:46          49,460  15%   47.17MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:30:46          66,264  21%   15.80MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:30:46          66,413  21%   15.83MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:30:46          66,710  21%   15.90MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:30:46         123,239  39%   23.51MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:30:46         123,867  39%   23.63MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:30:46         124,183  39%   23.69MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:30:46         124,985  40%   23.84MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:30:46         125,457  40%   23.93MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:30:46         126,111  40%   24.05MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:30:46         127,228  40%   20.22MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:30:46         127,700  40%   20.30MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:30:46         127,860  41%   20.32MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:30:46         128,644  41%   20.45MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:30:46         129,121  41%   20.52MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:30:46         130,788  41%   20.79MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:30:46         131,104  42%   20.84MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:30:46         132,044  42%   20.99MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:30:46         132,204  42%   21.01MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:30:46         133,318  42%   18.16MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:30:46         135,285  43%   18.43MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:30:46         135,601  43%   18.47MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:30:46         135,761  43%   18.50MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:30:46         140,375  45%   19.12MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:30:46         140,922  45%   19.20MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:30:46         143,940  46%   19.61MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:30:46         148,155  47%   20.18MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:30:46         151,572  48%   18.07MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:30:46         153,450  49%   18.29MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:30:46         155,422  49%   18.53MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:30:46         158,933  50%   18.95MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:30:46         161,646  51%   19.27MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:30:46         165,464  53%   17.53MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:30:46         168,142  53%   17.82MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:30:46         172,850  55%   18.32MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:30:46         174,309  55%   18.47MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:30:46         178,162  57%   18.88MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:30:46         178,615  57%   18.93MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:30:46         179,980  57%   19.07MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:30:46         183,097  58%   17.46MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:30:46         187,349  60%   17.87MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:30:46         187,635  60%   17.89MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:30:46         187,921  60%   17.92MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         187,921  60%   10.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         187,921  60%   10.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         187,921  60%   10.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         187,921  60%   10.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         187,921  60%   10.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-krakow-0/op-panel
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          16,535  16%   15.77MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46          33,989  33%   32.41MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46          33,989  33%   32.41MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46          50,321  49%   47.99MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46          50,612  50%   48.27MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46          50,612  50%   48.27MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-krakow-0/cluster-manager
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46           6,857  50%    3.27MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-paris-0/op-worker
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          44,302  13%   42.25MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:30:46          61,980  18%   59.11MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:30:46          61,980  18%   59.11MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:30:46          61,980  18%   59.11MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:30:46          78,537  23%   74.90MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:30:46          78,686  23%   75.04MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:30:46          78,983  23%   75.32MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:30:46         135,476  40%  129.20MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:30:46         136,359  40%  130.04MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:30:46         136,797  40%  130.46MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:30:46         137,635  40%  131.26MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:30:46         138,470  41%  132.06MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:30:46         139,308  41%  132.85MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:30:46         140,461  41%  133.95MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:30:46         140,899  41%  134.37MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:30:46         141,181  41%  134.64MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:30:46         141,929  42%   67.68MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:30:46         142,787  42%   68.09MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:30:46         144,385  42%   68.85MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:30:46         144,667  43%   68.98MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:30:46         145,569  43%   69.41MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:30:46         145,847  43%   69.55MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:30:46         147,009  43%   70.10MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:30:46         148,859  44%   70.98MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:30:46         149,146  44%   47.41MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:30:46         149,428  44%   47.50MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:30:46         154,099  45%   48.99MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:30:46         154,489  45%   49.11MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:30:46         157,507  46%   50.07MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:30:46         161,722  48%   51.41MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:30:46         165,141  49%   39.37MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:30:46         167,019  49%   39.82MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:30:46         168,834  50%   40.25MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:30:46         172,188  51%   41.05MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:30:46         174,744  51%   41.66MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:30:46         178,562  53%   42.57MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:30:46         181,240  53%   43.21MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:30:46         185,848  55%   35.45MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:30:46         187,207  55%   35.71MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:30:46         190,958  56%   36.42MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:30:46         191,411  56%   36.51MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:30:46         192,776  57%   36.77MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:30:46         195,731  58%   37.33MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:30:46         199,881  59%   31.77MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:30:46         200,166  59%   31.82MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:30:46         200,451  59%   31.86MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         200,451  59%   27.31MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         200,451  59%   27.31MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         200,451  59%   27.31MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         200,451  59%   27.31MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46         200,451  59%   27.31MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-paris-0/op-panel
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46          33,565  33%   32.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46          33,565  33%   32.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46          49,687  49%   47.39MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46          49,978  50%   47.66MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46          49,978  50%   11.92MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-oneprovider-paris-0/cluster-manager
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46           6,843  50%    3.26MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-onezone-0/oz-panel
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          22,479  13%   21.44MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46          45,967  27%   43.84MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46          61,159  36%   58.33MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46          83,435  49%   79.57MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46          83,726  50%   79.85MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46          83,726  50%   19.96MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-onezone-0/cluster-manager
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:30:46           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:30:46           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:30:46           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:30:46           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:30:46           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:30:46 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.21.39/pod-logs/dev-onezone-0/oz-worker
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
03-Dec-2024 18:30:46               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:30:46          13,211   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
03-Dec-2024 18:30:46          27,017  13%   25.77MB/s    0:00:00 (xfr#3, to-chk=11/18)
03-Dec-2024 18:30:46          27,017  13%   25.77MB/s    0:00:00 (xfr#4, to-chk=9/18)
03-Dec-2024 18:30:46          39,748  20%   37.91MB/s    0:00:00 (xfr#5, to-chk=7/18)
03-Dec-2024 18:30:46          39,838  20%   37.99MB/s    0:00:00 (xfr#6, to-chk=5/18)
03-Dec-2024 18:30:46          40,135  20%   38.28MB/s    0:00:00 (xfr#7, to-chk=3/18)
03-Dec-2024 18:30:46          97,962  50%   93.42MB/s    0:00:00 (xfr#8, to-chk=1/18)
03-Dec-2024 18:30:46          97,962  50%   31.14MB/s    0:00:00 (xfr#8, to-chk=0/18)
03-Dec-2024 18:30:46 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1733250635.491928 exists, exporting anyway.
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 =============================== warnings summary ===============================
03-Dec-2024 18:30:46 tests/utils/rest_utils.py:97
03-Dec-2024 18:30:46   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:30:46     print("""
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 tests/utils/path_utils.py:112
03-Dec-2024 18:30:46   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:30:46     return path.replace("'", "\\'").replace(' ', '\ ')
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 tests/utils/acceptance_utils.py:55
03-Dec-2024 18:30:46   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:30:46     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 tests/utils/acceptance_utils.py:57
03-Dec-2024 18:30:46   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:30:46     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:30:46
03-Dec-2024 18:30:46 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
03-Dec-2024 18:30:46 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/test-reports/results.xml -
03-Dec-2024 18:30:46 ================== 9 passed, 4 warnings in 549.06s (0:09:09) ===================
03-Dec-2024 18:30:51 release "dev" uninstalled
03-Dec-2024 18:30:51 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
03-Dec-2024 18:30:51 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
03-Dec-2024 18:30:53 No resources found
03-Dec-2024 18:30:54 Sidecar injection has been disabled
03-Dec-2024 18:30:54 Cleaning helm release "dev"...
03-Dec-2024 18:30:54 Deleted 1 helm deployments
03-Dec-2024 18:30:54 Deleted 0 k8s deployments
03-Dec-2024 18:30:54 Deleted 0 k8s services
03-Dec-2024 18:30:54 Deleted 0 persistent volumes
03-Dec-2024 18:30:55 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:30:55 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
03-Dec-2024 18:30:55 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:30:55 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
03-Dec-2024 18:30:55 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
03-Dec-2024 18:30:55 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:30:55 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
03-Dec-2024 18:30:55 Finished task 'Run acceptance oneclient tests' with result: Success
03-Dec-2024 18:30:55 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
03-Dec-2024 18:30:55 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH...
03-Dec-2024 18:30:55 Finished task 'Parse test results' with result: Success
03-Dec-2024 18:30:55 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:30:55
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:30:55 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:30:55
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3374 (ODSRV-OAP-MRDH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3374-ScriptBuildTask-139588138352243612.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance
03-Dec-2024 18:30:55 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_directio_hardlinks.tar.gz
03-Dec-2024 18:30:56 Uploading artifact
03-Dec-2024 18:30:56     source path: surefire_multiprovider_replication_directio_hardlinks.tar.gz
03-Dec-2024 18:30:56     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_directio_hardlinks.tar.gz
03-Dec-2024 18:30:56 Finished task 'Pack and push surefire artifact' with result: Success
03-Dec-2024 18:30:56 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:30:56 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:30:56
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3374 (ODSRV-OAP-MRDH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3374-ScriptBuildTask-1403428361438644500.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH
03-Dec-2024 18:30:56 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
03-Dec-2024 18:30:56 Finished task 'Pack logs' with result: Success
03-Dec-2024 18:30:56 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:30:56
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
03-Dec-2024 18:30:56 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:30:56
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3374 (ODSRV-OAP-MRDH-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3374-ScriptBuildTask-5973591822965329105.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance
03-Dec-2024 18:30:56   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
03-Dec-2024 18:30:56                                  Dload  Upload   Total   Spent    Left  Speed
03-Dec-2024 18:30:56
03-Dec-2024 18:30:56   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
03-Dec-2024 18:30:56 100  4822  100  4822    0     0  56729      0 --:--:-- --:--:-- --:--:-- 56729
03-Dec-2024 18:30:56 Clearing /tmp/onedata and /home/bamboo/.one-env
03-Dec-2024 18:30:57 Cleaning helm deployments
03-Dec-2024 18:30:57 Cleanining pods
03-Dec-2024 18:30:57 Cleaning kube persistant volumes
03-Dec-2024 18:30:58 Cleaning dockswift container
03-Dec-2024 18:30:58 Cleaning docker containers
03-Dec-2024 18:31:00 Stalled docker containers to remove:
03-Dec-2024 18:31:00 1e9afcdbdbc3 737f651b5397 919c2e232adf c61d386b7c55 f359eb7e3d1d b651f5be1632 c2afe414227d 0814e87538a4 e8a3f3c61932 a3ea4d3fbe33 b643b5a7b505 dbf5396b7991 50ad2b9a8657 5e20cb500edc ea4425a207b5 15d5c49db314 edeec4d6f51a 3a4bfa8cfd8f 7082f51faad9 7aa45f529827
03-Dec-2024 18:31:00 Removing stalled docker containers
03-Dec-2024 18:31:00 Error response from daemon: Cannot kill container: 1e9afcdbdbc3: Container 1e9afcdbdbc362bfb6d3128112e59edc79da6264e67e66714a9293b499e6e45f is not running
03-Dec-2024 18:31:00 1e9afcdbdbc3
03-Dec-2024 18:31:00 Error response from daemon: Cannot kill container: 737f651b5397: Container 737f651b539729b3488af3afa3b611793b62ee07f72f76413c4bff09df13bb71 is not running
03-Dec-2024 18:31:00 737f651b5397
03-Dec-2024 18:31:00 Error response from daemon: Cannot kill container: 919c2e232adf: Container 919c2e232adff705eab0799b4499dca7caafe472e4d393d56cef28491705d6ec is not running
03-Dec-2024 18:31:00 919c2e232adf
03-Dec-2024 18:31:00 Error response from daemon: Cannot kill container: c61d386b7c55: Container c61d386b7c55aea2c635eea56c02928c2b4ecb18743be86a1c289ce744d360aa is not running
03-Dec-2024 18:31:01 c61d386b7c55
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: f359eb7e3d1d: Container f359eb7e3d1dced746a8e4388cf41c396c9b6d6b6ae0afaeae4e694ec02d412e is not running
03-Dec-2024 18:31:01 f359eb7e3d1d
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: b651f5be1632: Container b651f5be163212e6bfc10087257bf97cd8894e951c5f1312241ba1c151304ade is not running
03-Dec-2024 18:31:01 b651f5be1632
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: c2afe414227d: Container c2afe414227df67b25bb943cd85b96e3cbfae40597cedb2e7868a4aa66e3a542 is not running
03-Dec-2024 18:31:01 c2afe414227d
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: 0814e87538a4: Container 0814e87538a4339f76313a8f1faecfd83d54f74b7ac4947ba05e4395a15585e4 is not running
03-Dec-2024 18:31:01 0814e87538a4
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: e8a3f3c61932: Container e8a3f3c619326b1dfae2197201abcf4141d9611482b40758518c90e41c16b09a is not running
03-Dec-2024 18:31:01 e8a3f3c61932
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: a3ea4d3fbe33: Container a3ea4d3fbe33aa0e7c676afef0954ee610f8013feeea45ece371879266446529 is not running
03-Dec-2024 18:31:01 a3ea4d3fbe33
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: b643b5a7b505: Container b643b5a7b505bfb6257ad7aa9879b2ef5b1c735f6d00c4588e1b5e8d20f0ff1a is not running
03-Dec-2024 18:31:01 b643b5a7b505
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: dbf5396b7991: Container dbf5396b7991e1bca66b1a6c51a857f4c7003949a17e6b1973db30e0a3e28eae is not running
03-Dec-2024 18:31:01 dbf5396b7991
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: 50ad2b9a8657: Container 50ad2b9a86579edbd0995cafda4d4920b107cf84b3103abb670cbad4eefd7fd8 is not running
03-Dec-2024 18:31:01 50ad2b9a8657
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: 5e20cb500edc: Container 5e20cb500edcd7af6615b083b27926082737b003ad8909c937a8f2cfed8c2f4e is not running
03-Dec-2024 18:31:01 5e20cb500edc
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: ea4425a207b5: Container ea4425a207b58eb9d8c6f269918cbdc0596e89a35feec3e39590926e5653e0de is not running
03-Dec-2024 18:31:01 ea4425a207b5
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: 15d5c49db314: Container 15d5c49db314bfe1a6e3d928070b014208360d34b8ea55802f84c53cc5e9da2e is not running
03-Dec-2024 18:31:01 15d5c49db314
03-Dec-2024 18:31:01 Error response from daemon: Cannot kill container: edeec4d6f51a: Container edeec4d6f51ad07228a0e4d0fd036245f465ef31aa4a9eabec479ff3a9a4179d is not running
03-Dec-2024 18:31:02 edeec4d6f51a
03-Dec-2024 18:31:02 Error response from daemon: Cannot kill container: 3a4bfa8cfd8f: Container 3a4bfa8cfd8f2e60b6c40e827785d4c114c7608533012a3db677121a8f50a51c is not running
03-Dec-2024 18:31:02 3a4bfa8cfd8f
03-Dec-2024 18:31:02 Error response from daemon: Cannot kill container: 7082f51faad9: Container 7082f51faad9e220d30259f9dfa2354241529b70d3f3f3ede8f348e25b4554cf is not running
03-Dec-2024 18:31:02 7082f51faad9
03-Dec-2024 18:31:02 7aa45f529827
03-Dec-2024 18:31:02 7aa45f529827
03-Dec-2024 18:31:02 Stalled docker volumes to remove:
03-Dec-2024 18:31:02
03-Dec-2024 18:31:02 Removing stalled docker volumes
03-Dec-2024 18:31:02 Removing stalled loopdevices
03-Dec-2024 18:31:03 Done
03-Dec-2024 18:31:03 Finished task 'Clear env and working dir' with result: Success
03-Dec-2024 18:31:03 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
03-Dec-2024 18:31:03 Running post build plugin 'Docker Container Cleanup'
03-Dec-2024 18:31:03 Running post build plugin 'NCover Results Collector'
03-Dec-2024 18:31:03 Running post build plugin 'Build Results Label Collector'
03-Dec-2024 18:31:03 Running post build plugin 'Clover Results Collector'
03-Dec-2024 18:31:03 Running post build plugin 'npm Cache Cleanup'
03-Dec-2024 18:31:03 Running post build plugin 'Artifact Copier'
03-Dec-2024 18:31:03 Publishing an artifact: test_logs.tar.gz
03-Dec-2024 18:31:03 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 63.43 ms
03-Dec-2024 18:31:03 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH'
03-Dec-2024 18:31:03 Finalising the build...
03-Dec-2024 18:31:03 Stopping timer.
03-Dec-2024 18:31:03 Build ODSRV-OAP-MRDH-3374 completed.
03-Dec-2024 18:31:03 Running on server: post build plugin 'Build Hanging Detection Configuration'
03-Dec-2024 18:31:03 Running on server: post build plugin 'NCover Results Collector'
03-Dec-2024 18:31:03 Running on server: post build plugin 'Build Labeller'
03-Dec-2024 18:31:03 Running on server: post build plugin 'Clover Delta Calculator'
03-Dec-2024 18:31:03 Running on server: post build plugin 'Maven Dependencies Postprocessor'
03-Dec-2024 18:31:03 All post build plugins have finished
03-Dec-2024 18:31:03 Generating build results summary...
03-Dec-2024 18:31:03 Saving build results to disk...
03-Dec-2024 18:31:03 Store variable context...
03-Dec-2024 18:31:03 Finished building ODSRV-OAP-MRDH-3374.