oneclient acceptance tests using environment deployed from packages

Build: #3360 failed

Job: multiprovider replication directio hardlinks was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,357 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'grep', '-q', 'fuse', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'groupadd', '-g', '46411', 'fuse']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'id', '-u', 'space_owner']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
07-Nov-2024 23:21:11 Adding user `space_owner' ...
07-Nov-2024 23:21:11 Adding new group `space_owner' (24849) ...
07-Nov-2024 23:21:11 Adding new user `space_owner' (24849) with group `space_owner' ...
07-Nov-2024 23:21:11 Creating home directory `/home/space_owner' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'id', '-u', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
07-Nov-2024 23:21:11 Adding user `user1' ...
07-Nov-2024 23:21:11 Adding new group `user1' (25687) ...
07-Nov-2024 23:21:11 Adding new user `user1' (25687) with group `user1' ...
07-Nov-2024 23:21:11 Creating home directory `/home/user1' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'id', '-u', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
07-Nov-2024 23:21:11 Adding user `user2' ...
07-Nov-2024 23:21:11 Adding new group `user2' (30628) ...
07-Nov-2024 23:21:11 Adding new user `user2' (30628) with group `user2' ...
07-Nov-2024 23:21:11 Creating home directory `/home/user2' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'grep', '-q', 'space1', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'groupadd', '-g', '54356', 'space1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'space1', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'space1', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'grep', '-q', 'space2', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'groupadd', '-g', '55062', 'space2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'space2', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'space2', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'grep', '-q', 'fuse', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'groupadd', '-g', '46411', 'fuse']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
07-Nov-2024 23:21:11 Adding user `space_owner' ...
07-Nov-2024 23:21:11 Adding new group `space_owner' (24849) ...
07-Nov-2024 23:21:11 Adding new user `space_owner' (24849) with group `space_owner' ...
07-Nov-2024 23:21:11 Creating home directory `/home/space_owner' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
07-Nov-2024 23:21:11 Adding user `user1' ...
07-Nov-2024 23:21:11 Adding new group `user1' (25687) ...
07-Nov-2024 23:21:11 Adding new user `user1' (25687) with group `user1' ...
07-Nov-2024 23:21:11 Creating home directory `/home/user1' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
07-Nov-2024 23:21:11 Adding user `user2' ...
07-Nov-2024 23:21:11 Adding new group `user2' (30628) ...
07-Nov-2024 23:21:11 Adding new user `user2' (30628) with group `user2' ...
07-Nov-2024 23:21:11 Creating home directory `/home/user2' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
07-Nov-2024 23:21:11 Adding user `space_owner' ...
07-Nov-2024 23:21:11 Adding new group `space_owner' (24849) ...
07-Nov-2024 23:21:11 Adding new user `space_owner' (24849) with group `space_owner' ...
07-Nov-2024 23:21:11 Creating home directory `/home/space_owner' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
07-Nov-2024 23:21:11 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
07-Nov-2024 23:21:11 Adding user `user1' ...
07-Nov-2024 23:21:11 Adding new group `user1' (25687) ...
07-Nov-2024 23:21:11 Adding new user `user1' (25687) with group `user1' ...
07-Nov-2024 23:21:11 Creating home directory `/home/user1' ...
07-Nov-2024 23:21:11 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:11 id: ‘user2’: no such user
07-Nov-2024 23:21:11 command terminated with exit code 1
07-Nov-2024 23:21:13 command terminated with exit code 1
07-Nov-2024 23:21:15 command terminated with exit code 1
07-Nov-2024 23:21:17 command terminated with exit code 1
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
07-Nov-2024 23:21:54 Adding user `user2' ...
07-Nov-2024 23:21:54 Adding new group `user2' (30628) ...
07-Nov-2024 23:21:54 Adding new user `user2' (30628) with group `user2' ...
07-Nov-2024 23:21:54 Creating home directory `/home/user2' ...
07-Nov-2024 23:21:54 Copying files from `/etc/skel' ...
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
07-Nov-2024 23:21:54 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 =================================================================
07-Nov-2024 23:21:54 - Executing scenario 'Create files on one provider and see them on the other provider'
07-Nov-2024 23:21:54 - from feature 'Multiprovider_replication'
07-Nov-2024 23:21:54 -----------------------------------------------------------------
07-Nov-2024 23:21:54 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:21:54 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:21:54 using [token, token] by [user1, user2]"'
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:21:54 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/dojd5b0jakd2dr5z
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/dojd5b0jakd2dr5z --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/dojd5b0jakd2dr5z
07-Nov-2024 23:21:54 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '17083392795944522318'...
07-Nov-2024 23:21:54 Getting configuration...
07-Nov-2024 23:21:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/dojd5b0jakd2dr5z'.
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:21:54 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:21:54 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/irzfsnibk27xcmg4
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/irzfsnibk27xcmg4 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/irzfsnibk27xcmg4
07-Nov-2024 23:21:54 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '4459807300195405445'...
07-Nov-2024 23:21:54 Getting configuration...
07-Nov-2024 23:21:54 Oneclient has been successfully mounted in '/tmp/onedata/mnt/irzfsnibk27xcmg4'.
07-Nov-2024 23:21:54
07-Nov-2024 23:21:54 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
07-Nov-2024 23:21:54 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
07-Nov-2024 23:21:54 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
07-Nov-2024 23:21:54 =================================================================
07-Nov-2024 23:21:54
07-Nov-2024 23:21:55 PASSED
07-Nov-2024 23:21:55 Unmounting client from /tmp/onedata/mnt/dojd5b0jakd2dr5z
07-Nov-2024 23:21:55
07-Nov-2024 23:21:55
07-Nov-2024 23:21:55 Unmounting client from /tmp/onedata/mnt/irzfsnibk27xcmg4
07-Nov-2024 23:21:55
07-Nov-2024 23:21:55
07-Nov-2024 23:22:29 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:22:29 =================================================================
07-Nov-2024 23:22:29 - Executing scenario 'Create empty file on one provider and read it on the other provider'
07-Nov-2024 23:22:29 - from feature 'Multiprovider_replication'
07-Nov-2024 23:22:29 -----------------------------------------------------------------
07-Nov-2024 23:22:29 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:22:29 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:22:29 using [token, token] by [user1, user2]"'
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:22:29 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/a6276l0n9frfn0lw
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/a6276l0n9frfn0lw --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/a6276l0n9frfn0lw
07-Nov-2024 23:22:29 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '12276588685273839481'...
07-Nov-2024 23:22:29 Getting configuration...
07-Nov-2024 23:22:29 Oneclient has been successfully mounted in '/tmp/onedata/mnt/a6276l0n9frfn0lw'.
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:22:29 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:22:29 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/qyc03r462dw7two7
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/qyc03r462dw7two7 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/qyc03r462dw7two7
07-Nov-2024 23:22:29 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3664096403299594012'...
07-Nov-2024 23:22:29 Getting configuration...
07-Nov-2024 23:22:29 Oneclient has been successfully mounted in '/tmp/onedata/mnt/qyc03r462dw7two7'.
07-Nov-2024 23:22:29
07-Nov-2024 23:22:29 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
07-Nov-2024 23:22:29 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
07-Nov-2024 23:22:29 =================================================================
07-Nov-2024 23:22:29
07-Nov-2024 23:22:30 PASSED
07-Nov-2024 23:22:30 Unmounting client from /tmp/onedata/mnt/a6276l0n9frfn0lw
07-Nov-2024 23:22:30
07-Nov-2024 23:22:30
07-Nov-2024 23:22:30 Unmounting client from /tmp/onedata/mnt/qyc03r462dw7two7
07-Nov-2024 23:22:30
07-Nov-2024 23:22:30
07-Nov-2024 23:23:04 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:23:04 =================================================================
07-Nov-2024 23:23:04 - Executing scenario 'Write to file on one provider and check size on the other provider'
07-Nov-2024 23:23:04 - from feature 'Multiprovider_replication'
07-Nov-2024 23:23:04 -----------------------------------------------------------------
07-Nov-2024 23:23:04 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:23:04 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:23:04 using [token, token] by [user1, user2]"'
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:23:04 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/kfcvmxmxi74ua989
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/kfcvmxmxi74ua989 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/kfcvmxmxi74ua989
07-Nov-2024 23:23:04 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '7576618476538048597'...
07-Nov-2024 23:23:04 Getting configuration...
07-Nov-2024 23:23:04 Oneclient has been successfully mounted in '/tmp/onedata/mnt/kfcvmxmxi74ua989'.
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:23:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:23:04 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/ws9dj99owuc2hksc
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ws9dj99owuc2hksc --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ws9dj99owuc2hksc
07-Nov-2024 23:23:04 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1114283801546019523'...
07-Nov-2024 23:23:04 Getting configuration...
07-Nov-2024 23:23:04 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ws9dj99owuc2hksc'.
07-Nov-2024 23:23:04
07-Nov-2024 23:23:04 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
07-Nov-2024 23:23:04 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
07-Nov-2024 23:23:04 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
07-Nov-2024 23:23:04 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
07-Nov-2024 23:23:04 =================================================================
07-Nov-2024 23:23:04
07-Nov-2024 23:23:05 PASSED
07-Nov-2024 23:23:05 Unmounting client from /tmp/onedata/mnt/kfcvmxmxi74ua989
07-Nov-2024 23:23:05
07-Nov-2024 23:23:05
07-Nov-2024 23:23:05 Unmounting client from /tmp/onedata/mnt/ws9dj99owuc2hksc
07-Nov-2024 23:23:05
07-Nov-2024 23:23:05
07-Nov-2024 23:23:38 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:23:38 =================================================================
07-Nov-2024 23:23:38 - Executing scenario 'Write to file on one provider and read on the other provider'
07-Nov-2024 23:23:38 - from feature 'Multiprovider_replication'
07-Nov-2024 23:23:38 -----------------------------------------------------------------
07-Nov-2024 23:23:38 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:23:38 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:23:38 using [token, token] by [user1, user2]"'
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:23:38 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/6no7gnsnvglyiggz
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/6no7gnsnvglyiggz --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/6no7gnsnvglyiggz
07-Nov-2024 23:23:38 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '16632821095862020198'...
07-Nov-2024 23:23:38 Getting configuration...
07-Nov-2024 23:23:38 Oneclient has been successfully mounted in '/tmp/onedata/mnt/6no7gnsnvglyiggz'.
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:23:38 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:23:38 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/6ou9duy1m0zyvio4
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/6ou9duy1m0zyvio4 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/6ou9duy1m0zyvio4
07-Nov-2024 23:23:38 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '9451492250336735061'...
07-Nov-2024 23:23:38 Getting configuration...
07-Nov-2024 23:23:38 Oneclient has been successfully mounted in '/tmp/onedata/mnt/6ou9duy1m0zyvio4'.
07-Nov-2024 23:23:38
07-Nov-2024 23:23:38 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:23:38 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
07-Nov-2024 23:23:38 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
07-Nov-2024 23:23:38 =================================================================
07-Nov-2024 23:23:38
07-Nov-2024 23:23:39 PASSED
07-Nov-2024 23:23:39 Unmounting client from /tmp/onedata/mnt/6no7gnsnvglyiggz
07-Nov-2024 23:23:39
07-Nov-2024 23:23:39
07-Nov-2024 23:23:39 Unmounting client from /tmp/onedata/mnt/6ou9duy1m0zyvio4
07-Nov-2024 23:23:39
07-Nov-2024 23:23:39
07-Nov-2024 23:24:13 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:24:13 =================================================================
07-Nov-2024 23:24:13 - Executing scenario 'Big file transfer with MD5 check'
07-Nov-2024 23:24:13 - from feature 'Multiprovider_replication'
07-Nov-2024 23:24:13 -----------------------------------------------------------------
07-Nov-2024 23:24:13 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:24:13 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:24:13 using [token, token] by [user1, user2]"'
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:24:13 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/cdm1do259x82z34a
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/cdm1do259x82z34a --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/cdm1do259x82z34a
07-Nov-2024 23:24:13 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '4809462613151643153'...
07-Nov-2024 23:24:13 Getting configuration...
07-Nov-2024 23:24:13 Oneclient has been successfully mounted in '/tmp/onedata/mnt/cdm1do259x82z34a'.
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:24:13 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:24:13 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/064phnfwxi4mjx9d
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/064phnfwxi4mjx9d --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/064phnfwxi4mjx9d
07-Nov-2024 23:24:13 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '5580305753302765013'...
07-Nov-2024 23:24:13 Getting configuration...
07-Nov-2024 23:24:13 Oneclient has been successfully mounted in '/tmp/onedata/mnt/064phnfwxi4mjx9d'.
07-Nov-2024 23:24:13
07-Nov-2024 23:24:13 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:24:13 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
07-Nov-2024 23:24:13 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
07-Nov-2024 23:24:13 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
07-Nov-2024 23:24:13 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
07-Nov-2024 23:24:13 =================================================================
07-Nov-2024 23:24:13
07-Nov-2024 23:24:14 PASSED
07-Nov-2024 23:24:14 Unmounting client from /tmp/onedata/mnt/cdm1do259x82z34a
07-Nov-2024 23:24:14
07-Nov-2024 23:24:14
07-Nov-2024 23:24:14 Unmounting client from /tmp/onedata/mnt/064phnfwxi4mjx9d
07-Nov-2024 23:24:14
07-Nov-2024 23:24:14
07-Nov-2024 23:25:04 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:25:04 =================================================================
07-Nov-2024 23:25:04 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
07-Nov-2024 23:25:04 - from feature 'Multiprovider_replication'
07-Nov-2024 23:25:04 -----------------------------------------------------------------
07-Nov-2024 23:25:04 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:25:04 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:25:04 using [token, token] by [user1, user2]"'
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:25:04 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/9sy9t9wpu4y42y8v
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/9sy9t9wpu4y42y8v --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/9sy9t9wpu4y42y8v
07-Nov-2024 23:25:04 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '1776981464597997915'...
07-Nov-2024 23:25:04 Getting configuration...
07-Nov-2024 23:25:04 Oneclient has been successfully mounted in '/tmp/onedata/mnt/9sy9t9wpu4y42y8v'.
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:25:04 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:25:04 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/lvhl1zsr3z096lnq
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/lvhl1zsr3z096lnq --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/lvhl1zsr3z096lnq
07-Nov-2024 23:25:04 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '18134560850497856971'...
07-Nov-2024 23:25:04 Getting configuration...
07-Nov-2024 23:25:04 Oneclient has been successfully mounted in '/tmp/onedata/mnt/lvhl1zsr3z096lnq'.
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
07-Nov-2024 23:25:04 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
07-Nov-2024 23:25:04 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
07-Nov-2024 23:25:04 =================================================================
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 PASSED
07-Nov-2024 23:25:04 Unmounting client from /tmp/onedata/mnt/9sy9t9wpu4y42y8v
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04 Unmounting client from /tmp/onedata/mnt/lvhl1zsr3z096lnq
07-Nov-2024 23:25:04
07-Nov-2024 23:25:04
07-Nov-2024 23:25:44 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:25:44 =================================================================
07-Nov-2024 23:25:44 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
07-Nov-2024 23:25:44 - from feature 'Multiprovider_replication'
07-Nov-2024 23:25:44 -----------------------------------------------------------------
07-Nov-2024 23:25:44 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:25:44 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:25:44 using [token, token] by [user1, user2]"'
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:25:44 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/d6jecnr7m3vcg0xq
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/d6jecnr7m3vcg0xq --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/d6jecnr7m3vcg0xq
07-Nov-2024 23:25:44 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '13316689005679325013'...
07-Nov-2024 23:25:44 Getting configuration...
07-Nov-2024 23:25:44 Oneclient has been successfully mounted in '/tmp/onedata/mnt/d6jecnr7m3vcg0xq'.
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:25:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:25:44 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/o5qb5a1b3n1z4y34
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/o5qb5a1b3n1z4y34 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/o5qb5a1b3n1z4y34
07-Nov-2024 23:25:44 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '7320095205165569021'...
07-Nov-2024 23:25:44 Getting configuration...
07-Nov-2024 23:25:44 Oneclient has been successfully mounted in '/tmp/onedata/mnt/o5qb5a1b3n1z4y34'.
07-Nov-2024 23:25:44
07-Nov-2024 23:25:44 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:25:44 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
07-Nov-2024 23:25:44 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
07-Nov-2024 23:25:44 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
07-Nov-2024 23:25:44 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
07-Nov-2024 23:25:44 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
07-Nov-2024 23:25:44 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
07-Nov-2024 23:25:44 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
07-Nov-2024 23:25:44 =================================================================
07-Nov-2024 23:25:44
07-Nov-2024 23:25:45 PASSED
07-Nov-2024 23:25:45 Unmounting client from /tmp/onedata/mnt/d6jecnr7m3vcg0xq
07-Nov-2024 23:25:45
07-Nov-2024 23:25:45
07-Nov-2024 23:25:45 Unmounting client from /tmp/onedata/mnt/o5qb5a1b3n1z4y34
07-Nov-2024 23:25:45
07-Nov-2024 23:25:45
07-Nov-2024 23:26:44 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:26:44 =================================================================
07-Nov-2024 23:26:44 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
07-Nov-2024 23:26:44 - from feature 'Multiprovider_replication'
07-Nov-2024 23:26:44 -----------------------------------------------------------------
07-Nov-2024 23:26:44 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:26:44 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:26:44 using [token, token] by [user1, user2]"'
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:26:44 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/2sghnvp3wy5mc2dt
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/2sghnvp3wy5mc2dt --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/2sghnvp3wy5mc2dt
07-Nov-2024 23:26:44 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '11620478591531882295'...
07-Nov-2024 23:26:44 Getting configuration...
07-Nov-2024 23:26:44 Oneclient has been successfully mounted in '/tmp/onedata/mnt/2sghnvp3wy5mc2dt'.
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:26:44 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:26:44 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/hd3408davdorr3aa
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/hd3408davdorr3aa --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/hd3408davdorr3aa
07-Nov-2024 23:26:44 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '5858053480328687141'...
07-Nov-2024 23:26:44 Getting configuration...
07-Nov-2024 23:26:44 Oneclient has been successfully mounted in '/tmp/onedata/mnt/hd3408davdorr3aa'.
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
07-Nov-2024 23:26:44 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
07-Nov-2024 23:26:44 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
07-Nov-2024 23:26:44 =================================================================
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 PASSED
07-Nov-2024 23:26:44 Unmounting client from /tmp/onedata/mnt/2sghnvp3wy5mc2dt
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44 Unmounting client from /tmp/onedata/mnt/hd3408davdorr3aa
07-Nov-2024 23:26:44
07-Nov-2024 23:26:44
07-Nov-2024 23:27:30 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
07-Nov-2024 23:27:30 =================================================================
07-Nov-2024 23:27:30 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
07-Nov-2024 23:27:30 - from feature 'Multiprovider_replication'
07-Nov-2024 23:27:30 -----------------------------------------------------------------
07-Nov-2024 23:27:30 -- Executing step: 'Given "oneclients [client11, client21]
07-Nov-2024 23:27:30 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
07-Nov-2024 23:27:30 using [token, token] by [user1, user2]"'
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-46bx5', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5'
07-Nov-2024 23:27:30 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-46bx5' successfully started
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/ea94tc5cxzfzzitx
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ea94tc5cxzfzzitx --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ea94tc5cxzfzzitx
07-Nov-2024 23:27:30 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '4405042070059707101'...
07-Nov-2024 23:27:30 Getting configuration...
07-Nov-2024 23:27:30 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ea94tc5cxzfzzitx'.
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
07-Nov-2024 23:27:30 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-6zj96', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96'
07-Nov-2024 23:27:30 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-6zj96' successfully started
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/0f9zs33fcpk4j9hq
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/0f9zs33fcpk4j9hq --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/0f9zs33fcpk4j9hq
07-Nov-2024 23:27:30 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '14045135047266991301'...
07-Nov-2024 23:27:30 Getting configuration...
07-Nov-2024 23:27:30 Oneclient has been successfully mounted in '/tmp/onedata/mnt/0f9zs33fcpk4j9hq'.
07-Nov-2024 23:27:30
07-Nov-2024 23:27:30 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
07-Nov-2024 23:27:30 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
07-Nov-2024 23:27:30 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
07-Nov-2024 23:27:30 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
07-Nov-2024 23:27:30 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
07-Nov-2024 23:27:30 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
07-Nov-2024 23:27:30 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
07-Nov-2024 23:27:30 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
07-Nov-2024 23:27:30 =================================================================
07-Nov-2024 23:27:30
07-Nov-2024 23:27:40 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
07-Nov-2024 23:27:40 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
07-Nov-2024 23:27:40 PASSED
07-Nov-2024 23:27:40 Unmounting client from /tmp/onedata/mnt/ea94tc5cxzfzzitx
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 Unmounting client from /tmp/onedata/mnt/0f9zs33fcpk4j9hq
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1731022050.6569753', '-c', '/tmp/logs']
07-Nov-2024 23:27:40 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-qvdw5. See /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-cross-support-job-3p-users-qvdw5/entrypoint.log for more details
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-46bx5: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneclient-krakow-7d9476b8bc-46bx5/oneclient_logs
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40             628   0%  613.28kB/s    0:00:00 (xfr#1, to-chk=64/80)
07-Nov-2024 23:27:40             628   0%  613.28kB/s    0:00:00 (xfr#1, to-chk=57/80)
07-Nov-2024 23:27:40          78,338   3%   74.71MB/s    0:00:00 (xfr#2, to-chk=63/80)
07-Nov-2024 23:27:40          78,800   3%   75.15MB/s    0:00:00 (xfr#3, to-chk=59/80)
07-Nov-2024 23:27:40         354,469  16%   24.15MB/s    0:00:00 (xfr#4, to-chk=58/80)
07-Nov-2024 23:27:40         354,931  16%   22.57MB/s    0:00:00 (xfr#5, to-chk=57/80)
07-Nov-2024 23:27:40         394,154  17%   22.11MB/s    0:00:00 (xfr#6, to-chk=56/80)
07-Nov-2024 23:27:40         394,616  17%   22.14MB/s    0:00:00 (xfr#7, to-chk=52/80)
07-Nov-2024 23:27:40         509,543  23%   23.14MB/s    0:00:00 (xfr#8, to-chk=51/80)
07-Nov-2024 23:27:40         510,005  23%   23.16MB/s    0:00:00 (xfr#9, to-chk=50/80)
07-Nov-2024 23:27:40         582,553  26%   26.46MB/s    0:00:00 (xfr#10, to-chk=49/80)
07-Nov-2024 23:27:40         583,111  26%   25.28MB/s    0:00:00 (xfr#11, to-chk=45/80)
07-Nov-2024 23:27:40         826,452  37%   34.27MB/s    0:00:00 (xfr#12, to-chk=44/80)
07-Nov-2024 23:27:40         827,010  37%   34.29MB/s    0:00:00 (xfr#13, to-chk=43/80)
07-Nov-2024 23:27:40         855,007  38%   35.45MB/s    0:00:00 (xfr#14, to-chk=42/80)
07-Nov-2024 23:27:40         855,373  38%   33.99MB/s    0:00:00 (xfr#15, to-chk=38/80)
07-Nov-2024 23:27:40         952,958  43%   37.87MB/s    0:00:00 (xfr#16, to-chk=37/80)
07-Nov-2024 23:27:40         953,324  43%   37.88MB/s    0:00:00 (xfr#17, to-chk=36/80)
07-Nov-2024 23:27:40       1,005,033  45%   36.86MB/s    0:00:00 (xfr#18, to-chk=35/80)
07-Nov-2024 23:27:40       1,005,495  45%   36.88MB/s    0:00:00 (xfr#19, to-chk=31/80)
07-Nov-2024 23:27:40       1,349,148  61%   45.95MB/s    0:00:00 (xfr#20, to-chk=30/80)
07-Nov-2024 23:27:40       1,349,610  61%   45.97MB/s    0:00:00 (xfr#21, to-chk=29/80)
07-Nov-2024 23:27:40       1,386,035  63%   47.21MB/s    0:00:00 (xfr#22, to-chk=28/80)
07-Nov-2024 23:27:40       1,386,497  63%   45.60MB/s    0:00:00 (xfr#23, to-chk=24/80)
07-Nov-2024 23:27:40       1,509,378  68%   37.88MB/s    0:00:00 (xfr#24, to-chk=23/80)
07-Nov-2024 23:27:40       1,509,840  68%   37.89MB/s    0:00:00 (xfr#25, to-chk=22/80)
07-Nov-2024 23:27:40       1,548,131  70%   36.01MB/s    0:00:00 (xfr#26, to-chk=21/80)
07-Nov-2024 23:27:40       1,548,689  70%   36.02MB/s    0:00:00 (xfr#27, to-chk=17/80)
07-Nov-2024 23:27:40       1,696,926  77%   38.53MB/s    0:00:00 (xfr#28, to-chk=16/80)
07-Nov-2024 23:27:40       1,697,484  77%   38.54MB/s    0:00:00 (xfr#29, to-chk=15/80)
07-Nov-2024 23:27:40       1,769,854  80%   38.36MB/s    0:00:00 (xfr#30, to-chk=14/80)
07-Nov-2024 23:27:40       1,770,412  80%   38.37MB/s    0:00:00 (xfr#31, to-chk=10/80)
07-Nov-2024 23:27:40       2,021,440  92%   39.34MB/s    0:00:00 (xfr#32, to-chk=9/80)
07-Nov-2024 23:27:40       2,021,998  92%   39.35MB/s    0:00:00 (xfr#33, to-chk=8/80)
07-Nov-2024 23:27:40       2,059,921  93%   39.29MB/s    0:00:00 (xfr#34, to-chk=7/80)
07-Nov-2024 23:27:40       2,060,671  93%   39.30MB/s    0:00:00 (xfr#35, to-chk=3/80)
07-Nov-2024 23:27:40       2,179,017  99%   35.83MB/s    0:00:00 (xfr#36, to-chk=2/80)
07-Nov-2024 23:27:40       2,179,767  99%   35.84MB/s    0:00:00 (xfr#37, to-chk=1/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   36.05MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   35.44MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   35.44MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   35.44MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   34.85MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,192,663  99%   34.85MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-6zj96: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneclient-paris-5cc45c8cb7-6zj96/oneclient_logs
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          61,875   2%   59.01MB/s    0:00:00 (xfr#1, to-chk=64/80)
07-Nov-2024 23:27:40          61,875   2%   59.01MB/s    0:00:00 (xfr#1, to-chk=58/80)
07-Nov-2024 23:27:40          62,337   2%   59.45MB/s    0:00:00 (xfr#2, to-chk=60/80)
07-Nov-2024 23:27:40         313,011  14%   74.63MB/s    0:00:00 (xfr#3, to-chk=59/80)
07-Nov-2024 23:27:40         313,473  14%   74.74MB/s    0:00:00 (xfr#4, to-chk=58/80)
07-Nov-2024 23:27:40         353,865  16%   42.18MB/s    0:00:00 (xfr#5, to-chk=57/80)
07-Nov-2024 23:27:40         354,519  16%   42.26MB/s    0:00:00 (xfr#6, to-chk=53/80)
07-Nov-2024 23:27:40         531,818  24%   17.49MB/s    0:00:00 (xfr#7, to-chk=52/80)
07-Nov-2024 23:27:40         532,472  24%   17.51MB/s    0:00:00 (xfr#8, to-chk=51/80)
07-Nov-2024 23:27:40         573,532  26%   18.23MB/s    0:00:00 (xfr#9, to-chk=50/80)
07-Nov-2024 23:27:40         574,090  26%   18.25MB/s    0:00:00 (xfr#10, to-chk=46/80)
07-Nov-2024 23:27:40         697,331  32%   10.23MB/s    0:00:00 (xfr#11, to-chk=45/80)
07-Nov-2024 23:27:40         697,889  32%   10.24MB/s    0:00:00 (xfr#12, to-chk=44/80)
07-Nov-2024 23:27:40         814,015  38%   11.76MB/s    0:00:00 (xfr#13, to-chk=43/80)
07-Nov-2024 23:27:40         814,573  38%   11.77MB/s    0:00:00 (xfr#14, to-chk=39/80)
07-Nov-2024 23:27:40       1,225,050  57%   15.37MB/s    0:00:00 (xfr#15, to-chk=38/80)
07-Nov-2024 23:27:40       1,225,608  57%   15.38MB/s    0:00:00 (xfr#16, to-chk=37/80)
07-Nov-2024 23:27:40       1,258,976  58%   15.39MB/s    0:00:00 (xfr#17, to-chk=36/80)
07-Nov-2024 23:27:40       1,259,726  59%   15.40MB/s    0:00:00 (xfr#18, to-chk=32/80)
07-Nov-2024 23:27:40       1,389,196  65%   15.77MB/s    0:00:00 (xfr#19, to-chk=31/80)
07-Nov-2024 23:27:40       1,389,946  65%   15.59MB/s    0:00:00 (xfr#20, to-chk=30/80)
07-Nov-2024 23:27:40       1,448,502  67%   16.06MB/s    0:00:00 (xfr#21, to-chk=29/80)
07-Nov-2024 23:27:40       1,449,060  67%   16.07MB/s    0:00:00 (xfr#22, to-chk=25/80)
07-Nov-2024 23:27:40       1,692,598  79%   18.55MB/s    0:00:00 (xfr#23, to-chk=24/80)
07-Nov-2024 23:27:40       1,693,156  79%   17.18MB/s    0:00:00 (xfr#24, to-chk=23/80)
07-Nov-2024 23:27:40       1,717,389  80%   17.24MB/s    0:00:00 (xfr#25, to-chk=22/80)
07-Nov-2024 23:27:40       1,717,755  80%   17.24MB/s    0:00:00 (xfr#26, to-chk=18/80)
07-Nov-2024 23:27:40       1,721,888  80%   17.29MB/s    0:00:00 (xfr#27, to-chk=17/80)
07-Nov-2024 23:27:40       1,845,278  86%   16.76MB/s    0:00:00 (xfr#28, to-chk=16/80)
07-Nov-2024 23:27:40       1,845,644  86%   16.76MB/s    0:00:00 (xfr#29, to-chk=15/80)
07-Nov-2024 23:27:40       1,876,582  87%   17.04MB/s    0:00:00 (xfr#30, to-chk=14/80)
07-Nov-2024 23:27:40       1,877,236  87%   17.05MB/s    0:00:00 (xfr#31, to-chk=10/80)
07-Nov-2024 23:27:40       1,973,031  92%   17.75MB/s    0:00:00 (xfr#32, to-chk=9/80)
07-Nov-2024 23:27:40       1,973,685  92%   17.76MB/s    0:00:00 (xfr#33, to-chk=8/80)
07-Nov-2024 23:27:40       2,001,200  93%   18.00MB/s    0:00:00 (xfr#34, to-chk=7/80)
07-Nov-2024 23:27:40       2,001,854  93%   18.01MB/s    0:00:00 (xfr#35, to-chk=3/80)
07-Nov-2024 23:27:40       2,105,607  98%   18.77MB/s    0:00:00 (xfr#36, to-chk=2/80)
07-Nov-2024 23:27:40       2,106,261  98%   18.77MB/s    0:00:00 (xfr#37, to-chk=1/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   19.01MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   18.33MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   18.16MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   18.16MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   18.16MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40       2,132,923  99%   18.16MB/s    0:00:00 (xfr#38, to-chk=0/80)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-krakow-0/cluster-manager
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40           6,857  50%    3.27MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-krakow-0/op-panel
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          16,553  16%   15.79MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40          34,026  33%   32.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40          34,026  33%   32.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40          50,376  49%   48.04MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40          50,667  50%   48.32MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40          50,667  50%   24.16MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-krakow-0/op-worker
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          43,123  11%   41.13MB/s    0:00:00 (xfr#2, to-chk=67/72)
07-Nov-2024 23:27:40          73,010  19%   69.63MB/s    0:00:00 (xfr#3, to-chk=65/72)
07-Nov-2024 23:27:40          73,010  19%   69.63MB/s    0:00:00 (xfr#4, to-chk=63/72)
07-Nov-2024 23:27:40          73,010  19%   69.63MB/s    0:00:00 (xfr#5, to-chk=61/72)
07-Nov-2024 23:27:40         101,415  27%   96.72MB/s    0:00:00 (xfr#6, to-chk=59/72)
07-Nov-2024 23:27:40         101,565  27%   96.86MB/s    0:00:00 (xfr#7, to-chk=57/72)
07-Nov-2024 23:27:40         101,862  27%   97.14MB/s    0:00:00 (xfr#8, to-chk=51/72)
07-Nov-2024 23:27:40         156,462  42%  149.21MB/s    0:00:00 (xfr#9, to-chk=49/72)
07-Nov-2024 23:27:40         156,622  42%  149.37MB/s    0:00:00 (xfr#10, to-chk=39/72)
07-Nov-2024 23:27:40         157,286  42%  150.00MB/s    0:00:00 (xfr#11, to-chk=38/72)
07-Nov-2024 23:27:40         158,547  42%  151.20MB/s    0:00:00 (xfr#12, to-chk=37/72)
07-Nov-2024 23:27:40         159,358  43%  151.98MB/s    0:00:00 (xfr#13, to-chk=36/72)
07-Nov-2024 23:27:40         159,674  43%  152.28MB/s    0:00:00 (xfr#14, to-chk=35/72)
07-Nov-2024 23:27:40         160,146  43%  152.73MB/s    0:00:00 (xfr#15, to-chk=34/72)
07-Nov-2024 23:27:40         160,774  43%  153.33MB/s    0:00:00 (xfr#16, to-chk=33/72)
07-Nov-2024 23:27:40         161,576  43%   77.05MB/s    0:00:00 (xfr#17, to-chk=32/72)
07-Nov-2024 23:27:40         162,054  43%   77.27MB/s    0:00:00 (xfr#18, to-chk=31/72)
07-Nov-2024 23:27:40         163,339  44%   77.89MB/s    0:00:00 (xfr#19, to-chk=30/72)
07-Nov-2024 23:27:40         163,655  44%   78.04MB/s    0:00:00 (xfr#20, to-chk=29/72)
07-Nov-2024 23:27:40         164,124  44%   78.26MB/s    0:00:00 (xfr#21, to-chk=28/72)
07-Nov-2024 23:27:40         165,247  44%   78.80MB/s    0:00:00 (xfr#22, to-chk=27/72)
07-Nov-2024 23:27:40         165,566  44%   78.95MB/s    0:00:00 (xfr#23, to-chk=26/72)
07-Nov-2024 23:27:40         165,882  44%   79.10MB/s    0:00:00 (xfr#24, to-chk=25/72)
07-Nov-2024 23:27:40         166,354  45%   79.32MB/s    0:00:00 (xfr#25, to-chk=24/72)
07-Nov-2024 23:27:40         166,667  45%   79.47MB/s    0:00:00 (xfr#26, to-chk=23/72)
07-Nov-2024 23:27:40         166,827  45%   53.03MB/s    0:00:00 (xfr#27, to-chk=22/72)
07-Nov-2024 23:27:40         170,623  46%   54.24MB/s    0:00:00 (xfr#28, to-chk=21/72)
07-Nov-2024 23:27:40         174,838  47%   55.58MB/s    0:00:00 (xfr#29, to-chk=20/72)
07-Nov-2024 23:27:40         175,975  47%   55.94MB/s    0:00:00 (xfr#30, to-chk=19/72)
07-Nov-2024 23:27:40         177,568  48%   56.45MB/s    0:00:00 (xfr#31, to-chk=18/72)
07-Nov-2024 23:27:40         179,255  48%   56.98MB/s    0:00:00 (xfr#32, to-chk=17/72)
07-Nov-2024 23:27:40         183,016  49%   58.18MB/s    0:00:00 (xfr#33, to-chk=16/72)
07-Nov-2024 23:27:40         185,977  50%   59.12MB/s    0:00:00 (xfr#34, to-chk=15/72)
07-Nov-2024 23:27:40         188,539  51%   44.95MB/s    0:00:00 (xfr#35, to-chk=14/72)
07-Nov-2024 23:27:40         189,775  51%   45.25MB/s    0:00:00 (xfr#36, to-chk=13/72)
07-Nov-2024 23:27:40         191,938  51%   45.76MB/s    0:00:00 (xfr#37, to-chk=12/72)
07-Nov-2024 23:27:40         192,485  52%   45.89MB/s    0:00:00 (xfr#38, to-chk=11/72)
07-Nov-2024 23:27:40         195,845  53%   46.69MB/s    0:00:00 (xfr#39, to-chk=10/72)
07-Nov-2024 23:27:40         196,298  53%   46.80MB/s    0:00:00 (xfr#40, to-chk=9/72)
07-Nov-2024 23:27:40         200,550  54%   47.81MB/s    0:00:00 (xfr#41, to-chk=8/72)
07-Nov-2024 23:27:40         203,206  55%   38.76MB/s    0:00:00 (xfr#42, to-chk=7/72)
07-Nov-2024 23:27:40         205,463  55%   39.19MB/s    0:00:00 (xfr#43, to-chk=6/72)
07-Nov-2024 23:27:40         208,518  56%   39.77MB/s    0:00:00 (xfr#44, to-chk=5/72)
07-Nov-2024 23:27:40         211,915  57%   40.42MB/s    0:00:00 (xfr#45, to-chk=4/72)
07-Nov-2024 23:27:40         212,201  57%   40.47MB/s    0:00:00 (xfr#46, to-chk=1/72)
07-Nov-2024 23:27:40         212,487  57%   40.53MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         212,487  57%   25.33MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         212,487  57%   25.33MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         212,487  57%   25.33MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         212,487  57%   25.33MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         212,487  57%   25.33MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-paris-0/cluster-manager
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-paris-0/op-panel
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40          33,565  33%   16.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40          33,565  33%   16.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40          49,687  49%   15.80MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40          49,978  50%   15.89MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40          49,978  50%    9.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-oneprovider-paris-0/op-worker
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          56,327  14%   53.72MB/s    0:00:00 (xfr#2, to-chk=67/72)
07-Nov-2024 23:27:40          86,479  21%   82.47MB/s    0:00:00 (xfr#3, to-chk=65/72)
07-Nov-2024 23:27:40          86,479  21%   82.47MB/s    0:00:00 (xfr#4, to-chk=63/72)
07-Nov-2024 23:27:40          86,479  21%   82.47MB/s    0:00:00 (xfr#5, to-chk=61/72)
07-Nov-2024 23:27:40         115,236  28%  109.90MB/s    0:00:00 (xfr#6, to-chk=59/72)
07-Nov-2024 23:27:40         115,386  29%  110.04MB/s    0:00:00 (xfr#7, to-chk=57/72)
07-Nov-2024 23:27:40         115,683  29%  110.32MB/s    0:00:00 (xfr#8, to-chk=51/72)
07-Nov-2024 23:27:40         170,295  42%   81.20MB/s    0:00:00 (xfr#9, to-chk=49/72)
07-Nov-2024 23:27:40         170,579  42%   81.34MB/s    0:00:00 (xfr#10, to-chk=39/72)
07-Nov-2024 23:27:40         171,306  43%   81.69MB/s    0:00:00 (xfr#11, to-chk=38/72)
07-Nov-2024 23:27:40         172,930  43%   54.97MB/s    0:00:00 (xfr#12, to-chk=37/72)
07-Nov-2024 23:27:40         173,753  43%   55.23MB/s    0:00:00 (xfr#13, to-chk=36/72)
07-Nov-2024 23:27:40         174,035  43%   55.32MB/s    0:00:00 (xfr#14, to-chk=35/72)
07-Nov-2024 23:27:40         174,876  43%   55.59MB/s    0:00:00 (xfr#15, to-chk=34/72)
07-Nov-2024 23:27:40         175,711  44%   55.86MB/s    0:00:00 (xfr#16, to-chk=33/72)
07-Nov-2024 23:27:40         176,528  44%   56.12MB/s    0:00:00 (xfr#17, to-chk=32/72)
07-Nov-2024 23:27:40         176,972  44%   56.26MB/s    0:00:00 (xfr#18, to-chk=31/72)
07-Nov-2024 23:27:40         178,284  44%   42.51MB/s    0:00:00 (xfr#19, to-chk=30/72)
07-Nov-2024 23:27:40         178,727  44%   42.61MB/s    0:00:00 (xfr#20, to-chk=29/72)
07-Nov-2024 23:27:40         179,424  45%   42.78MB/s    0:00:00 (xfr#21, to-chk=28/72)
07-Nov-2024 23:27:40         180,748  45%   43.09MB/s    0:00:00 (xfr#22, to-chk=27/72)
07-Nov-2024 23:27:40         181,026  45%   43.16MB/s    0:00:00 (xfr#23, to-chk=26/72)
07-Nov-2024 23:27:40         181,310  45%   34.58MB/s    0:00:00 (xfr#24, to-chk=25/72)
07-Nov-2024 23:27:40         181,748  45%   34.67MB/s    0:00:00 (xfr#25, to-chk=24/72)
07-Nov-2024 23:27:40         182,030  45%   34.72MB/s    0:00:00 (xfr#26, to-chk=23/72)
07-Nov-2024 23:27:40         182,308  45%   34.77MB/s    0:00:00 (xfr#27, to-chk=22/72)
07-Nov-2024 23:27:40         186,002  46%   29.56MB/s    0:00:00 (xfr#28, to-chk=21/72)
07-Nov-2024 23:27:40         190,217  47%   30.23MB/s    0:00:00 (xfr#29, to-chk=20/72)
07-Nov-2024 23:27:40         191,354  48%   30.41MB/s    0:00:00 (xfr#30, to-chk=19/72)
07-Nov-2024 23:27:40         192,947  48%   30.67MB/s    0:00:00 (xfr#31, to-chk=18/72)
07-Nov-2024 23:27:40         194,477  48%   26.50MB/s    0:00:00 (xfr#32, to-chk=17/72)
07-Nov-2024 23:27:40         198,236  49%   27.01MB/s    0:00:00 (xfr#33, to-chk=16/72)
07-Nov-2024 23:27:40         201,197  50%   27.41MB/s    0:00:00 (xfr#34, to-chk=15/72)
07-Nov-2024 23:27:40         203,816  51%   27.77MB/s    0:00:00 (xfr#35, to-chk=14/72)
07-Nov-2024 23:27:40         204,898  51%   27.92MB/s    0:00:00 (xfr#36, to-chk=13/72)
07-Nov-2024 23:27:40         207,118  52%   24.69MB/s    0:00:00 (xfr#37, to-chk=12/72)
07-Nov-2024 23:27:40         207,563  52%   24.74MB/s    0:00:00 (xfr#38, to-chk=11/72)
07-Nov-2024 23:27:40         210,923  53%   25.14MB/s    0:00:00 (xfr#39, to-chk=10/72)
07-Nov-2024 23:27:40         211,376  53%   25.20MB/s    0:00:00 (xfr#40, to-chk=9/72)
07-Nov-2024 23:27:40         215,526  54%   22.84MB/s    0:00:00 (xfr#41, to-chk=8/72)
07-Nov-2024 23:27:40         218,082  54%   23.11MB/s    0:00:00 (xfr#42, to-chk=7/72)
07-Nov-2024 23:27:40         220,182  55%   23.33MB/s    0:00:00 (xfr#43, to-chk=6/72)
07-Nov-2024 23:27:40         223,080  56%   23.64MB/s    0:00:00 (xfr#44, to-chk=5/72)
07-Nov-2024 23:27:40         226,377  56%   21.59MB/s    0:00:00 (xfr#45, to-chk=4/72)
07-Nov-2024 23:27:40         226,662  56%   21.62MB/s    0:00:00 (xfr#46, to-chk=1/72)
07-Nov-2024 23:27:40         226,947  57%   21.64MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         226,947  57%   21.64MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         226,947  57%   21.64MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         226,947  57%   18.04MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         226,947  57%   18.04MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40         226,947  57%   18.04MB/s    0:00:00 (xfr#47, to-chk=0/72)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-onezone-0/cluster-manager
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-onezone-0/oz-panel
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          22,483  13%   21.44MB/s    0:00:00 (xfr#2, to-chk=9/14)
07-Nov-2024 23:27:40          45,975  27%   43.85MB/s    0:00:00 (xfr#3, to-chk=7/14)
07-Nov-2024 23:27:40          61,167  36%   58.33MB/s    0:00:00 (xfr#4, to-chk=5/14)
07-Nov-2024 23:27:40          83,447  49%   79.58MB/s    0:00:00 (xfr#5, to-chk=3/14)
07-Nov-2024 23:27:40          83,738  50%   79.86MB/s    0:00:00 (xfr#6, to-chk=1/14)
07-Nov-2024 23:27:40          83,738  50%   26.62MB/s    0:00:00 (xfr#6, to-chk=0/14)
07-Nov-2024 23:27:40 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.11.07-23.18.53/pod-logs/dev-onezone-0/oz-worker
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
07-Nov-2024 23:27:40               0   0%    0.00kB/s    0:00:00 
07-Nov-2024 23:27:40          13,121   6%   12.51MB/s    0:00:00 (xfr#2, to-chk=13/18)
07-Nov-2024 23:27:40          26,835  14%   25.59MB/s    0:00:00 (xfr#3, to-chk=11/18)
07-Nov-2024 23:27:40          26,835  14%   25.59MB/s    0:00:00 (xfr#4, to-chk=9/18)
07-Nov-2024 23:27:40          39,476  20%   37.65MB/s    0:00:00 (xfr#5, to-chk=7/18)
07-Nov-2024 23:27:40          39,567  20%   37.73MB/s    0:00:00 (xfr#6, to-chk=5/18)
07-Nov-2024 23:27:40          39,864  20%   38.02MB/s    0:00:00 (xfr#7, to-chk=3/18)
07-Nov-2024 23:27:40          94,993  50%   90.59MB/s    0:00:00 (xfr#8, to-chk=1/18)
07-Nov-2024 23:27:40          94,993  50%   30.20MB/s    0:00:00 (xfr#8, to-chk=0/18)
07-Nov-2024 23:27:40 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1731022050.6569753 exists, exporting anyway.
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 =============================== warnings summary ===============================
07-Nov-2024 23:27:40 tests/utils/rest_utils.py:98
07-Nov-2024 23:27:40   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/rest_utils.py:98: SyntaxWarning: invalid escape sequence '\ '
07-Nov-2024 23:27:40     print("""
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 tests/utils/path_utils.py:112
07-Nov-2024 23:27:40   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
07-Nov-2024 23:27:40     return path.replace("'", "\\'").replace(' ', '\ ')
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 tests/utils/acceptance_utils.py:55
07-Nov-2024 23:27:40   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
07-Nov-2024 23:27:40     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 tests/utils/acceptance_utils.py:57
07-Nov-2024 23:27:40   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
07-Nov-2024 23:27:40     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
07-Nov-2024 23:27:40
07-Nov-2024 23:27:40 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
07-Nov-2024 23:27:40 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance/test-reports/results.xml -
07-Nov-2024 23:27:40 ================== 9 passed, 4 warnings in 530.13s (0:08:50) ===================
07-Nov-2024 23:27:46 release "dev" uninstalled
07-Nov-2024 23:27:46 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
07-Nov-2024 23:27:46 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
07-Nov-2024 23:27:50 No resources found
07-Nov-2024 23:27:51 Sidecar injection has been disabled
07-Nov-2024 23:27:51 Cleaning helm release "dev"...
07-Nov-2024 23:27:51 Deleted 1 helm deployments
07-Nov-2024 23:27:51 Deleted 0 k8s deployments
07-Nov-2024 23:27:51 Deleted 0 k8s services
07-Nov-2024 23:27:51 Deleted 0 persistent volumes
07-Nov-2024 23:27:52 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
07-Nov-2024 23:27:52 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
07-Nov-2024 23:27:52 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
07-Nov-2024 23:27:52 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
07-Nov-2024 23:27:52 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
07-Nov-2024 23:27:52 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
07-Nov-2024 23:27:52 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
07-Nov-2024 23:27:52 Finished task 'Run acceptance oneclient tests' with result: Success
07-Nov-2024 23:27:52 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
07-Nov-2024 23:27:52 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH...
07-Nov-2024 23:27:52 Finished task 'Parse test results' with result: Success
07-Nov-2024 23:27:52 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoHostname} with S3
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoPort} with 10161
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.planRepository.branchName} with develop
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoHostname} with S3
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoPort} with 10161
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.planRepository.branchName} with develop
07-Nov-2024 23:27:52
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
07-Nov-2024 23:27:52 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
07-Nov-2024 23:27:52
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3360 (ODSRV-OAP-MRDH-3360)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3360-ScriptBuildTask-1519151987085236430.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance
07-Nov-2024 23:27:52 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_directio_hardlinks.tar.gz
07-Nov-2024 23:27:52 Uploading artifact
07-Nov-2024 23:27:52     source path: surefire_multiprovider_replication_directio_hardlinks.tar.gz
07-Nov-2024 23:27:52     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_directio_hardlinks.tar.gz
07-Nov-2024 23:27:52 Finished task 'Pack and push surefire artifact' with result: Success
07-Nov-2024 23:27:52 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
07-Nov-2024 23:27:52 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
07-Nov-2024 23:27:52
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3360 (ODSRV-OAP-MRDH-3360)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3360-ScriptBuildTask-4440650034866161030.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH
07-Nov-2024 23:27:52 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
07-Nov-2024 23:27:53 Finished task 'Pack logs' with result: Success
07-Nov-2024 23:27:53 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
07-Nov-2024 23:27:53
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
07-Nov-2024 23:27:53 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
07-Nov-2024 23:27:53
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio hardlinks #3360 (ODSRV-OAP-MRDH-3360)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRDH-3360-ScriptBuildTask-17359546994979054541.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH/onedata-acceptance
07-Nov-2024 23:27:53   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
07-Nov-2024 23:27:53                                  Dload  Upload   Total   Spent    Left  Speed
07-Nov-2024 23:27:53
07-Nov-2024 23:27:53   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
07-Nov-2024 23:27:53 100  4822  100  4822    0     0  62623      0 --:--:-- --:--:-- --:--:-- 62623
07-Nov-2024 23:27:53 Clearing /tmp/onedata and /home/bamboo/.one-env
07-Nov-2024 23:27:54 Cleaning helm deployments
07-Nov-2024 23:27:54 Cleanining pods
07-Nov-2024 23:27:54 Cleaning kube persistant volumes
07-Nov-2024 23:27:55 Cleaning dockswift container
07-Nov-2024 23:27:55 Cleaning docker containers
07-Nov-2024 23:27:56 Stalled docker containers to remove:
07-Nov-2024 23:27:56 72d36a0b4565 da0652860d90 8ab28795ec1b 732a08e0b5ab 977e39bff32b 5080848385ac
07-Nov-2024 23:27:56 Removing stalled docker containers
07-Nov-2024 23:27:57 Error response from daemon: Cannot kill container: 72d36a0b4565: Container 72d36a0b45658e0a72045ad4dd139d69d0641984429586e5ca482c5eb5d1cbf8 is not running
07-Nov-2024 23:27:57 72d36a0b4565
07-Nov-2024 23:27:57 Error response from daemon: Cannot kill container: da0652860d90: Container da0652860d90d8ec1b55f96a6bf5b3648d2200c38edce06f6d97ffff1cfd16e3 is not running
07-Nov-2024 23:27:57 da0652860d90
07-Nov-2024 23:27:57 Error response from daemon: Cannot kill container: 8ab28795ec1b: Container 8ab28795ec1b80b81c39944c638da97051f9c7f18debd8d135d421b196f15504 is not running
07-Nov-2024 23:27:57 8ab28795ec1b
07-Nov-2024 23:27:57 Error response from daemon: Cannot kill container: 732a08e0b5ab: Container 732a08e0b5abf00a73020e132d66a2c31122aa788f28ecb88a7bf1f0e7cf3e4d is not running
07-Nov-2024 23:27:57 732a08e0b5ab
07-Nov-2024 23:27:57 Error response from daemon: Cannot kill container: 977e39bff32b: Container 977e39bff32b00584a117cf4bd2de84fa958a252d53b29f5070f4aaef5f4de45 is not running
07-Nov-2024 23:27:57 977e39bff32b
07-Nov-2024 23:27:57 5080848385ac
07-Nov-2024 23:27:57 5080848385ac
07-Nov-2024 23:27:57 Stalled docker volumes to remove:
07-Nov-2024 23:27:57
07-Nov-2024 23:27:57 Removing stalled docker volumes
07-Nov-2024 23:27:57 Removing stalled loopdevices
07-Nov-2024 23:27:58 Done
07-Nov-2024 23:27:58 Finished task 'Clear env and working dir' with result: Success
07-Nov-2024 23:27:58 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
07-Nov-2024 23:27:58 Running post build plugin 'Docker Container Cleanup'
07-Nov-2024 23:27:58 Running post build plugin 'NCover Results Collector'
07-Nov-2024 23:27:58 Running post build plugin 'Build Results Label Collector'
07-Nov-2024 23:27:58 Running post build plugin 'Clover Results Collector'
07-Nov-2024 23:27:58 Running post build plugin 'npm Cache Cleanup'
07-Nov-2024 23:27:58 Running post build plugin 'Artifact Copier'
07-Nov-2024 23:27:58 Publishing an artifact: test_logs.tar.gz
07-Nov-2024 23:27:58 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 91.37 ms
07-Nov-2024 23:27:58 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRDH'
07-Nov-2024 23:27:58 Finalising the build...
07-Nov-2024 23:27:58 Stopping timer.
07-Nov-2024 23:27:58 Build ODSRV-OAP-MRDH-3360 completed.
07-Nov-2024 23:27:58 Running on server: post build plugin 'Build Hanging Detection Configuration'
07-Nov-2024 23:27:58 Running on server: post build plugin 'NCover Results Collector'
07-Nov-2024 23:27:58 Running on server: post build plugin 'Build Labeller'
07-Nov-2024 23:27:58 Running on server: post build plugin 'Clover Delta Calculator'
07-Nov-2024 23:27:58 Running on server: post build plugin 'Maven Dependencies Postprocessor'
07-Nov-2024 23:27:58 All post build plugins have finished
07-Nov-2024 23:27:58 Generating build results summary...
07-Nov-2024 23:27:58 Saving build results to disk...
07-Nov-2024 23:27:59 Store variable context...
07-Nov-2024 23:27:59 Finished building ODSRV-OAP-MRDH-3360.