oneclient acceptance tests using environment deployed from packages

Build: #3372 was successful

Job: multiprovider replication proxyio was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,387 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
30-Nov-2024 00:57:44 Adding user `space_owner' ...
30-Nov-2024 00:57:44 Adding new group `space_owner' (24849) ...
30-Nov-2024 00:57:44 Adding new user `space_owner' (24849) with group `space_owner' ...
30-Nov-2024 00:57:44 Creating home directory `/home/space_owner' ...
30-Nov-2024 00:57:44 Copying files from `/etc/skel' ...
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
30-Nov-2024 00:57:44 Adding user `user1' ...
30-Nov-2024 00:57:44 Adding new group `user1' (25687) ...
30-Nov-2024 00:57:44 Adding new user `user1' (25687) with group `user1' ...
30-Nov-2024 00:57:44 Creating home directory `/home/user1' ...
30-Nov-2024 00:57:44 Copying files from `/etc/skel' ...
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
30-Nov-2024 00:57:44 Adding user `user2' ...
30-Nov-2024 00:57:44 Adding new group `user2' (30628) ...
30-Nov-2024 00:57:44 Adding new user `user2' (30628) with group `user2' ...
30-Nov-2024 00:57:44 Creating home directory `/home/user2' ...
30-Nov-2024 00:57:44 Copying files from `/etc/skel' ...
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
30-Nov-2024 00:57:44 Adding user `space_owner' ...
30-Nov-2024 00:57:44 Adding new group `space_owner' (24849) ...
30-Nov-2024 00:57:44 Adding new user `space_owner' (24849) with group `space_owner' ...
30-Nov-2024 00:57:44 Creating home directory `/home/space_owner' ...
30-Nov-2024 00:57:44 Copying files from `/etc/skel' ...
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
30-Nov-2024 00:57:44 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
30-Nov-2024 00:57:44 Adding user `user1' ...
30-Nov-2024 00:57:44 Adding new group `user1' (25687) ...
30-Nov-2024 00:57:44 Adding new user `user1' (25687) with group `user1' ...
30-Nov-2024 00:57:44 Creating home directory `/home/user1' ...
30-Nov-2024 00:57:44 Copying files from `/etc/skel' ...
30-Nov-2024 00:57:45 id: ‘user2’: no such user
30-Nov-2024 00:57:45 command terminated with exit code 1
30-Nov-2024 00:57:47 command terminated with exit code 1
30-Nov-2024 00:57:49 command terminated with exit code 1
30-Nov-2024 00:57:52 command terminated with exit code 1
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
30-Nov-2024 00:58:32 Adding user `user2' ...
30-Nov-2024 00:58:32 Adding new group `user2' (30628) ...
30-Nov-2024 00:58:32 Adding new user `user2' (30628) with group `user2' ...
30-Nov-2024 00:58:32 Creating home directory `/home/user2' ...
30-Nov-2024 00:58:32 Copying files from `/etc/skel' ...
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
30-Nov-2024 00:58:32 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 =================================================================
30-Nov-2024 00:58:32 - Executing scenario 'Create files on one provider and see them on the other provider'
30-Nov-2024 00:58:32 - from feature 'Multiprovider_replication'
30-Nov-2024 00:58:32 -----------------------------------------------------------------
30-Nov-2024 00:58:32 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:58:32 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:58:32 using [token, token] by [user1, user2]"'
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 00:58:32 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/j0e2hhbykqrucr81
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/j0e2hhbykqrucr81 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/j0e2hhbykqrucr81
30-Nov-2024 00:58:32 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '17099395378758628491'...
30-Nov-2024 00:58:32 Getting configuration...
30-Nov-2024 00:58:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/j0e2hhbykqrucr81'.
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:58:32 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 00:58:32 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/6i8zfoskwss2iym1
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/6i8zfoskwss2iym1 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/6i8zfoskwss2iym1
30-Nov-2024 00:58:32 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '17441542383733071277'...
30-Nov-2024 00:58:32 Getting configuration...
30-Nov-2024 00:58:32 Oneclient has been successfully mounted in '/tmp/onedata/mnt/6i8zfoskwss2iym1'.
30-Nov-2024 00:58:32
30-Nov-2024 00:58:32 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
30-Nov-2024 00:58:32 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
30-Nov-2024 00:58:32 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
30-Nov-2024 00:58:32 =================================================================
30-Nov-2024 00:58:32
30-Nov-2024 00:58:33 PASSED
30-Nov-2024 00:58:33 Unmounting client from /tmp/onedata/mnt/j0e2hhbykqrucr81
30-Nov-2024 00:58:33
30-Nov-2024 00:58:33
30-Nov-2024 00:58:33 Unmounting client from /tmp/onedata/mnt/6i8zfoskwss2iym1
30-Nov-2024 00:58:33
30-Nov-2024 00:58:33
30-Nov-2024 00:59:07 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:59:07 =================================================================
30-Nov-2024 00:59:07 - Executing scenario 'Create empty file on one provider and read it on the other provider'
30-Nov-2024 00:59:07 - from feature 'Multiprovider_replication'
30-Nov-2024 00:59:07 -----------------------------------------------------------------
30-Nov-2024 00:59:07 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:59:07 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:59:07 using [token, token] by [user1, user2]"'
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 00:59:07 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/y9sdq6pg0cxcoyc0
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/y9sdq6pg0cxcoyc0 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/y9sdq6pg0cxcoyc0
30-Nov-2024 00:59:07 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '5330161531093787184'...
30-Nov-2024 00:59:07 Getting configuration...
30-Nov-2024 00:59:07 Oneclient has been successfully mounted in '/tmp/onedata/mnt/y9sdq6pg0cxcoyc0'.
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:59:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 00:59:07 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/i0c6npdb9fsm2f49
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/i0c6npdb9fsm2f49 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/i0c6npdb9fsm2f49
30-Nov-2024 00:59:07 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '12946476083205361638'...
30-Nov-2024 00:59:07 Getting configuration...
30-Nov-2024 00:59:07 Oneclient has been successfully mounted in '/tmp/onedata/mnt/i0c6npdb9fsm2f49'.
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
30-Nov-2024 00:59:07 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
30-Nov-2024 00:59:07 =================================================================
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 PASSED
30-Nov-2024 00:59:07 Unmounting client from /tmp/onedata/mnt/y9sdq6pg0cxcoyc0
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07 Unmounting client from /tmp/onedata/mnt/i0c6npdb9fsm2f49
30-Nov-2024 00:59:07
30-Nov-2024 00:59:07
30-Nov-2024 00:59:41 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 00:59:41 =================================================================
30-Nov-2024 00:59:41 - Executing scenario 'Write to file on one provider and check size on the other provider'
30-Nov-2024 00:59:41 - from feature 'Multiprovider_replication'
30-Nov-2024 00:59:41 -----------------------------------------------------------------
30-Nov-2024 00:59:41 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 00:59:41 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 00:59:41 using [token, token] by [user1, user2]"'
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 00:59:41 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/h92ypof05l8gerom
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/h92ypof05l8gerom --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/h92ypof05l8gerom
30-Nov-2024 00:59:41 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2190483402703627671'...
30-Nov-2024 00:59:41 Getting configuration...
30-Nov-2024 00:59:41 Oneclient has been successfully mounted in '/tmp/onedata/mnt/h92ypof05l8gerom'.
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 00:59:41 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 00:59:41 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/t110my2jtwsffll5
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/t110my2jtwsffll5 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/t110my2jtwsffll5
30-Nov-2024 00:59:41 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '13745355947734846005'...
30-Nov-2024 00:59:41 Getting configuration...
30-Nov-2024 00:59:41 Oneclient has been successfully mounted in '/tmp/onedata/mnt/t110my2jtwsffll5'.
30-Nov-2024 00:59:41
30-Nov-2024 00:59:41 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
30-Nov-2024 00:59:41 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
30-Nov-2024 00:59:41 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
30-Nov-2024 00:59:41 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
30-Nov-2024 00:59:41 =================================================================
30-Nov-2024 00:59:41
30-Nov-2024 00:59:42 PASSED
30-Nov-2024 00:59:42 Unmounting client from /tmp/onedata/mnt/h92ypof05l8gerom
30-Nov-2024 00:59:42
30-Nov-2024 00:59:42
30-Nov-2024 00:59:42 Unmounting client from /tmp/onedata/mnt/t110my2jtwsffll5
30-Nov-2024 00:59:42
30-Nov-2024 00:59:42
30-Nov-2024 01:00:15 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:00:15 =================================================================
30-Nov-2024 01:00:15 - Executing scenario 'Write to file on one provider and read on the other provider'
30-Nov-2024 01:00:15 - from feature 'Multiprovider_replication'
30-Nov-2024 01:00:15 -----------------------------------------------------------------
30-Nov-2024 01:00:15 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:00:15 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:00:15 using [token, token] by [user1, user2]"'
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:00:15 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/z3cimbm24pzel63e
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/z3cimbm24pzel63e --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/z3cimbm24pzel63e
30-Nov-2024 01:00:15 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2719102040321851004'...
30-Nov-2024 01:00:15 Getting configuration...
30-Nov-2024 01:00:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/z3cimbm24pzel63e'.
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:00:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:00:15 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/l5cug458zp99honk
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/l5cug458zp99honk --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/l5cug458zp99honk
30-Nov-2024 01:00:15 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11435140916437352474'...
30-Nov-2024 01:00:15 Getting configuration...
30-Nov-2024 01:00:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/l5cug458zp99honk'.
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:00:15 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
30-Nov-2024 01:00:15 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
30-Nov-2024 01:00:15 =================================================================
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 PASSED
30-Nov-2024 01:00:15 Unmounting client from /tmp/onedata/mnt/z3cimbm24pzel63e
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15 Unmounting client from /tmp/onedata/mnt/l5cug458zp99honk
30-Nov-2024 01:00:15
30-Nov-2024 01:00:15
30-Nov-2024 01:00:51 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:00:51 =================================================================
30-Nov-2024 01:00:51 - Executing scenario 'Big file transfer with MD5 check'
30-Nov-2024 01:00:51 - from feature 'Multiprovider_replication'
30-Nov-2024 01:00:51 -----------------------------------------------------------------
30-Nov-2024 01:00:51 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:00:51 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:00:51 using [token, token] by [user1, user2]"'
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:00:51 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/i10pnnhuobkhml6u
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/i10pnnhuobkhml6u --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/i10pnnhuobkhml6u
30-Nov-2024 01:00:51 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '93032801292824095'...
30-Nov-2024 01:00:51 Getting configuration...
30-Nov-2024 01:00:51 Oneclient has been successfully mounted in '/tmp/onedata/mnt/i10pnnhuobkhml6u'.
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:00:51 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:00:51 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/fw2yjnjbemar99zx
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/fw2yjnjbemar99zx --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/fw2yjnjbemar99zx
30-Nov-2024 01:00:51 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '5110560127636982768'...
30-Nov-2024 01:00:51 Getting configuration...
30-Nov-2024 01:00:51 Oneclient has been successfully mounted in '/tmp/onedata/mnt/fw2yjnjbemar99zx'.
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:00:51 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
30-Nov-2024 01:00:51 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
30-Nov-2024 01:00:51 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
30-Nov-2024 01:00:51 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
30-Nov-2024 01:00:51 =================================================================
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 PASSED
30-Nov-2024 01:00:51 Unmounting client from /tmp/onedata/mnt/i10pnnhuobkhml6u
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51 Unmounting client from /tmp/onedata/mnt/fw2yjnjbemar99zx
30-Nov-2024 01:00:51
30-Nov-2024 01:00:51
30-Nov-2024 01:01:47 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:01:47 =================================================================
30-Nov-2024 01:01:47 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
30-Nov-2024 01:01:47 - from feature 'Multiprovider_replication'
30-Nov-2024 01:01:47 -----------------------------------------------------------------
30-Nov-2024 01:01:47 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:01:47 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:01:47 using [token, token] by [user1, user2]"'
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:01:47 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/vdjhkqfpo7du2sm3
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/vdjhkqfpo7du2sm3 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/vdjhkqfpo7du2sm3
30-Nov-2024 01:01:47 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '3579940335932308622'...
30-Nov-2024 01:01:47 Getting configuration...
30-Nov-2024 01:01:47 Oneclient has been successfully mounted in '/tmp/onedata/mnt/vdjhkqfpo7du2sm3'.
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:01:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:01:47 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/zkdq9hhcsmnm50w4
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/zkdq9hhcsmnm50w4 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/zkdq9hhcsmnm50w4
30-Nov-2024 01:01:47 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3521373072209379762'...
30-Nov-2024 01:01:47 Getting configuration...
30-Nov-2024 01:01:47 Oneclient has been successfully mounted in '/tmp/onedata/mnt/zkdq9hhcsmnm50w4'.
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 01:01:47 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
30-Nov-2024 01:01:47 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
30-Nov-2024 01:01:47 =================================================================
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 PASSED
30-Nov-2024 01:01:47 Unmounting client from /tmp/onedata/mnt/vdjhkqfpo7du2sm3
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47 Unmounting client from /tmp/onedata/mnt/zkdq9hhcsmnm50w4
30-Nov-2024 01:01:47
30-Nov-2024 01:01:47
30-Nov-2024 01:02:27 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:02:27 =================================================================
30-Nov-2024 01:02:27 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
30-Nov-2024 01:02:27 - from feature 'Multiprovider_replication'
30-Nov-2024 01:02:27 -----------------------------------------------------------------
30-Nov-2024 01:02:27 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:02:27 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:02:27 using [token, token] by [user1, user2]"'
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:02:27 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/euxh3ypcu1okhybf
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/euxh3ypcu1okhybf --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/euxh3ypcu1okhybf
30-Nov-2024 01:02:27 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '16868546424498543905'...
30-Nov-2024 01:02:27 Getting configuration...
30-Nov-2024 01:02:27 Oneclient has been successfully mounted in '/tmp/onedata/mnt/euxh3ypcu1okhybf'.
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:02:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:02:27 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/kvqj20lkvaebci2t
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/kvqj20lkvaebci2t --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/kvqj20lkvaebci2t
30-Nov-2024 01:02:27 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11397676003639609039'...
30-Nov-2024 01:02:27 Getting configuration...
30-Nov-2024 01:02:27 Oneclient has been successfully mounted in '/tmp/onedata/mnt/kvqj20lkvaebci2t'.
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:02:27 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 01:02:27 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
30-Nov-2024 01:02:27 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
30-Nov-2024 01:02:27 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
30-Nov-2024 01:02:27 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
30-Nov-2024 01:02:27 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
30-Nov-2024 01:02:27 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
30-Nov-2024 01:02:27 =================================================================
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 PASSED
30-Nov-2024 01:02:27 Unmounting client from /tmp/onedata/mnt/euxh3ypcu1okhybf
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27 Unmounting client from /tmp/onedata/mnt/kvqj20lkvaebci2t
30-Nov-2024 01:02:27
30-Nov-2024 01:02:27
30-Nov-2024 01:03:16 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:03:16 =================================================================
30-Nov-2024 01:03:16 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
30-Nov-2024 01:03:16 - from feature 'Multiprovider_replication'
30-Nov-2024 01:03:16 -----------------------------------------------------------------
30-Nov-2024 01:03:16 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:03:16 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:03:16 using [token, token] by [user1, user2]"'
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:03:16 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/uu8y801bn0xmqnsl
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/uu8y801bn0xmqnsl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/uu8y801bn0xmqnsl
30-Nov-2024 01:03:16 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '4970200436477996057'...
30-Nov-2024 01:03:16 Getting configuration...
30-Nov-2024 01:03:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/uu8y801bn0xmqnsl'.
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:03:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:03:16 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/058l82fkrqat2s3v
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/058l82fkrqat2s3v --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/058l82fkrqat2s3v
30-Nov-2024 01:03:16 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '8143872852791076807'...
30-Nov-2024 01:03:16 Getting configuration...
30-Nov-2024 01:03:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/058l82fkrqat2s3v'.
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
30-Nov-2024 01:03:16 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
30-Nov-2024 01:03:16 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
30-Nov-2024 01:03:16 =================================================================
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 PASSED
30-Nov-2024 01:03:16 Unmounting client from /tmp/onedata/mnt/uu8y801bn0xmqnsl
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16 Unmounting client from /tmp/onedata/mnt/058l82fkrqat2s3v
30-Nov-2024 01:03:16
30-Nov-2024 01:03:16
30-Nov-2024 01:04:02 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
30-Nov-2024 01:04:02 =================================================================
30-Nov-2024 01:04:02 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
30-Nov-2024 01:04:02 - from feature 'Multiprovider_replication'
30-Nov-2024 01:04:02 -----------------------------------------------------------------
30-Nov-2024 01:04:02 -- Executing step: 'Given "oneclients [client11, client21]
30-Nov-2024 01:04:02 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
30-Nov-2024 01:04:02 using [token, token] by [user1, user2]"'
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-hntnl', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl'
30-Nov-2024 01:04:02 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-hntnl' successfully started
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/lvv07xla3hb1j8ae
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/lvv07xla3hb1j8ae --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/lvv07xla3hb1j8ae
30-Nov-2024 01:04:02 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '1782971635789434998'...
30-Nov-2024 01:04:02 Getting configuration...
30-Nov-2024 01:04:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/lvv07xla3hb1j8ae'.
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
30-Nov-2024 01:04:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-sk67f', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f'
30-Nov-2024 01:04:02 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-sk67f' successfully started
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/q0b5qc0rf00mcpeb
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/q0b5qc0rf00mcpeb --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/q0b5qc0rf00mcpeb
30-Nov-2024 01:04:02 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '3640110876248554958'...
30-Nov-2024 01:04:02 Getting configuration...
30-Nov-2024 01:04:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/q0b5qc0rf00mcpeb'.
30-Nov-2024 01:04:02
30-Nov-2024 01:04:02 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
30-Nov-2024 01:04:02 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
30-Nov-2024 01:04:02 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
30-Nov-2024 01:04:02 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
30-Nov-2024 01:04:02 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
30-Nov-2024 01:04:02 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
30-Nov-2024 01:04:02 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
30-Nov-2024 01:04:02 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
30-Nov-2024 01:04:02 =================================================================
30-Nov-2024 01:04:02
30-Nov-2024 01:04:12 PASSED
30-Nov-2024 01:04:12 Unmounting client from /tmp/onedata/mnt/lvv07xla3hb1j8ae
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 Unmounting client from /tmp/onedata/mnt/q0b5qc0rf00mcpeb
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1732928642.6633275', '-c', '/tmp/logs']
30-Nov-2024 01:04:12 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-dsmz2. See /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-cross-support-job-3p-users-dsmz2/entrypoint.log for more details
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-hntnl: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneclient-krakow-7d9476b8bc-hntnl/oneclient_logs
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=66/81)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          25,779   1%   24.58MB/s    0:00:00 (xfr#1, to-chk=65/81)
30-Nov-2024 01:04:12          25,779   1%   24.58MB/s    0:00:00 (xfr#1, to-chk=58/81)
30-Nov-2024 01:04:12          26,337   1%   25.12MB/s    0:00:00 (xfr#2, to-chk=61/81)
30-Nov-2024 01:04:12          30,481   1%   29.07MB/s    0:00:00 (xfr#3, to-chk=60/81)
30-Nov-2024 01:04:12         108,244   6%  103.23MB/s    0:00:00 (xfr#4, to-chk=59/81)
30-Nov-2024 01:04:12         108,802   6%  103.76MB/s    0:00:00 (xfr#5, to-chk=58/81)
30-Nov-2024 01:04:12         134,704   8%   64.23MB/s    0:00:00 (xfr#6, to-chk=57/81)
30-Nov-2024 01:04:12         135,166   8%   64.45MB/s    0:00:00 (xfr#7, to-chk=53/81)
30-Nov-2024 01:04:12         217,915  13%   69.27MB/s    0:00:00 (xfr#8, to-chk=52/81)
30-Nov-2024 01:04:12         218,377  13%   69.42MB/s    0:00:00 (xfr#9, to-chk=51/81)
30-Nov-2024 01:04:12         337,179  20%   53.59MB/s    0:00:00 (xfr#10, to-chk=50/81)
30-Nov-2024 01:04:12         337,737  20%   46.01MB/s    0:00:00 (xfr#11, to-chk=46/81)
30-Nov-2024 01:04:12         606,855  36%   52.61MB/s    0:00:00 (xfr#12, to-chk=45/81)
30-Nov-2024 01:04:12         607,413  36%   52.66MB/s    0:00:00 (xfr#13, to-chk=44/81)
30-Nov-2024 01:04:12         629,701  38%   54.59MB/s    0:00:00 (xfr#14, to-chk=43/81)
30-Nov-2024 01:04:12         630,163  38%   54.63MB/s    0:00:00 (xfr#15, to-chk=39/81)
30-Nov-2024 01:04:12         703,932  42%   41.96MB/s    0:00:00 (xfr#16, to-chk=38/81)
30-Nov-2024 01:04:12         704,394  42%   41.99MB/s    0:00:00 (xfr#17, to-chk=37/81)
30-Nov-2024 01:04:12         761,472  46%   42.72MB/s    0:00:00 (xfr#18, to-chk=36/81)
30-Nov-2024 01:04:12         762,030  46%   42.75MB/s    0:00:00 (xfr#19, to-chk=32/81)
30-Nov-2024 01:04:12         935,234  56%   49.55MB/s    0:00:00 (xfr#20, to-chk=31/81)
30-Nov-2024 01:04:12         935,792  56%   49.58MB/s    0:00:00 (xfr#21, to-chk=30/81)
30-Nov-2024 01:04:12       1,009,157  61%   53.47MB/s    0:00:00 (xfr#22, to-chk=29/81)
30-Nov-2024 01:04:12       1,009,619  61%   50.68MB/s    0:00:00 (xfr#23, to-chk=25/81)
30-Nov-2024 01:04:12       1,234,013  74%   56.04MB/s    0:00:00 (xfr#24, to-chk=24/81)
30-Nov-2024 01:04:12       1,234,475  74%   56.06MB/s    0:00:00 (xfr#25, to-chk=23/81)
30-Nov-2024 01:04:12       1,290,357  78%   38.46MB/s    0:00:00 (xfr#26, to-chk=22/81)
30-Nov-2024 01:04:12       1,290,819  78%   37.30MB/s    0:00:00 (xfr#27, to-chk=18/81)
30-Nov-2024 01:04:12       1,458,489  88%   38.64MB/s    0:00:00 (xfr#28, to-chk=17/81)
30-Nov-2024 01:04:12       1,458,951  88%   38.65MB/s    0:00:00 (xfr#29, to-chk=16/81)
30-Nov-2024 01:04:12       1,475,411  89%   39.09MB/s    0:00:00 (xfr#30, to-chk=15/81)
30-Nov-2024 01:04:12       1,475,969  89%   39.10MB/s    0:00:00 (xfr#31, to-chk=11/81)
30-Nov-2024 01:04:12       1,532,203  93%   39.49MB/s    0:00:00 (xfr#32, to-chk=10/81)
30-Nov-2024 01:04:12       1,532,761  93%   39.51MB/s    0:00:00 (xfr#33, to-chk=9/81)
30-Nov-2024 01:04:12       1,533,389  93%   39.52MB/s    0:00:00 (xfr#34, to-chk=8/81)
30-Nov-2024 01:04:12       1,557,857  94%   40.15MB/s    0:00:00 (xfr#35, to-chk=7/81)
30-Nov-2024 01:04:12       1,558,415  94%   40.17MB/s    0:00:00 (xfr#36, to-chk=3/81)
30-Nov-2024 01:04:12       1,632,467  99%   40.97MB/s    0:00:00 (xfr#37, to-chk=2/81)
30-Nov-2024 01:04:12       1,633,025  99%   39.93MB/s    0:00:00 (xfr#38, to-chk=1/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   40.25MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   37.37MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   37.37MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   36.50MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12       1,645,921  99%   36.50MB/s    0:00:00 (xfr#39, to-chk=0/81)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-sk67f: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneclient-paris-5cc45c8cb7-sk67f/oneclient_logs
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          72,359   4%   34.50MB/s    0:00:00 (xfr#1, to-chk=64/80)
30-Nov-2024 01:04:12          72,359   4%   34.50MB/s    0:00:00 (xfr#1, to-chk=58/80)
30-Nov-2024 01:04:12          72,821   4%   34.72MB/s    0:00:00 (xfr#2, to-chk=60/80)
30-Nov-2024 01:04:12         308,624  18%   98.11MB/s    0:00:00 (xfr#3, to-chk=59/80)
30-Nov-2024 01:04:12         309,086  18%   98.26MB/s    0:00:00 (xfr#4, to-chk=58/80)
30-Nov-2024 01:04:12         336,014  20%   80.11MB/s    0:00:00 (xfr#5, to-chk=57/80)
30-Nov-2024 01:04:12         336,476  20%   80.22MB/s    0:00:00 (xfr#6, to-chk=53/80)
30-Nov-2024 01:04:12         438,400  26%   83.62MB/s    0:00:00 (xfr#7, to-chk=52/80)
30-Nov-2024 01:04:12         438,862  26%   83.71MB/s    0:00:00 (xfr#8, to-chk=51/80)
30-Nov-2024 01:04:12         541,811  32%   51.67MB/s    0:00:00 (xfr#9, to-chk=50/80)
30-Nov-2024 01:04:12         542,177  32%   51.71MB/s    0:00:00 (xfr#10, to-chk=46/80)
30-Nov-2024 01:04:12         546,324  33%   52.10MB/s    0:00:00 (xfr#11, to-chk=45/80)
30-Nov-2024 01:04:12         750,936  45%   47.74MB/s    0:00:00 (xfr#12, to-chk=44/80)
30-Nov-2024 01:04:12         751,302  45%   47.77MB/s    0:00:00 (xfr#13, to-chk=43/80)
30-Nov-2024 01:04:12         776,374  46%   49.36MB/s    0:00:00 (xfr#14, to-chk=42/80)
30-Nov-2024 01:04:12         776,932  46%   49.40MB/s    0:00:00 (xfr#15, to-chk=38/80)
30-Nov-2024 01:04:12         855,276  51%   37.08MB/s    0:00:00 (xfr#16, to-chk=37/80)
30-Nov-2024 01:04:12         855,834  51%   37.10MB/s    0:00:00 (xfr#17, to-chk=36/80)
30-Nov-2024 01:04:12         874,767  52%   37.92MB/s    0:00:00 (xfr#18, to-chk=35/80)
30-Nov-2024 01:04:12         875,133  52%   37.94MB/s    0:00:00 (xfr#19, to-chk=31/80)
30-Nov-2024 01:04:12         985,971  59%   39.18MB/s    0:00:00 (xfr#20, to-chk=30/80)
30-Nov-2024 01:04:12         986,337  59%   39.19MB/s    0:00:00 (xfr#21, to-chk=29/80)
30-Nov-2024 01:04:12       1,013,371  61%   38.66MB/s    0:00:00 (xfr#22, to-chk=28/80)
30-Nov-2024 01:04:12       1,013,737  61%   38.67MB/s    0:00:00 (xfr#23, to-chk=24/80)
30-Nov-2024 01:04:12       1,103,698  66%   38.98MB/s    0:00:00 (xfr#24, to-chk=23/80)
30-Nov-2024 01:04:12       1,104,064  66%   39.00MB/s    0:00:00 (xfr#25, to-chk=22/80)
30-Nov-2024 01:04:12       1,134,484  68%   40.07MB/s    0:00:00 (xfr#26, to-chk=21/80)
30-Nov-2024 01:04:12       1,134,850  68%   40.08MB/s    0:00:00 (xfr#27, to-chk=17/80)
30-Nov-2024 01:04:12       1,275,285  77%   39.23MB/s    0:00:00 (xfr#28, to-chk=16/80)
30-Nov-2024 01:04:12       1,275,651  77%   39.24MB/s    0:00:00 (xfr#29, to-chk=15/80)
30-Nov-2024 01:04:12       1,296,481  78%   38.64MB/s    0:00:00 (xfr#30, to-chk=14/80)
30-Nov-2024 01:04:12       1,296,847  78%   38.65MB/s    0:00:00 (xfr#31, to-chk=10/80)
30-Nov-2024 01:04:12       1,373,773  83%   37.43MB/s    0:00:00 (xfr#32, to-chk=9/80)
30-Nov-2024 01:04:12       1,374,139  83%   37.44MB/s    0:00:00 (xfr#33, to-chk=8/80)
30-Nov-2024 01:04:12       1,419,556  85%   36.59MB/s    0:00:00 (xfr#34, to-chk=7/80)
30-Nov-2024 01:04:12       1,420,018  85%   36.60MB/s    0:00:00 (xfr#35, to-chk=3/80)
30-Nov-2024 01:04:12       1,621,947  98%   37.73MB/s    0:00:00 (xfr#36, to-chk=2/80)
30-Nov-2024 01:04:12       1,622,409  98%   37.74MB/s    0:00:00 (xfr#37, to-chk=1/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   37.51MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   36.63MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12       1,651,824  99%   35.80MB/s    0:00:00 (xfr#38, to-chk=0/80)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-krakow-0/cluster-manager
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12           6,857  50%    3.27MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-krakow-0/op-worker
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          30,157  10%   28.76MB/s    0:00:00 (xfr#2, to-chk=67/72)
30-Nov-2024 01:04:12          47,835  16%   45.62MB/s    0:00:00 (xfr#3, to-chk=65/72)
30-Nov-2024 01:04:12          47,835  16%   45.62MB/s    0:00:00 (xfr#4, to-chk=63/72)
30-Nov-2024 01:04:12          47,835  16%   45.62MB/s    0:00:00 (xfr#5, to-chk=61/72)
30-Nov-2024 01:04:12          64,390  22%   61.41MB/s    0:00:00 (xfr#6, to-chk=59/72)
30-Nov-2024 01:04:12          64,540  22%   61.55MB/s    0:00:00 (xfr#7, to-chk=57/72)
30-Nov-2024 01:04:12          64,837  22%   61.83MB/s    0:00:00 (xfr#8, to-chk=51/72)
30-Nov-2024 01:04:12         118,380  40%   28.22MB/s    0:00:00 (xfr#9, to-chk=49/72)
30-Nov-2024 01:04:12         118,696  40%   28.30MB/s    0:00:00 (xfr#10, to-chk=39/72)
30-Nov-2024 01:04:12         119,801  41%   22.85MB/s    0:00:00 (xfr#11, to-chk=38/72)
30-Nov-2024 01:04:12         120,591  41%   23.00MB/s    0:00:00 (xfr#12, to-chk=37/72)
30-Nov-2024 01:04:12         120,754  41%   23.03MB/s    0:00:00 (xfr#13, to-chk=36/72)
30-Nov-2024 01:04:12         121,397  41%   23.15MB/s    0:00:00 (xfr#14, to-chk=35/72)
30-Nov-2024 01:04:12         121,713  41%   23.21MB/s    0:00:00 (xfr#15, to-chk=34/72)
30-Nov-2024 01:04:12         122,338  41%   19.45MB/s    0:00:00 (xfr#16, to-chk=33/72)
30-Nov-2024 01:04:12         122,810  42%   19.52MB/s    0:00:00 (xfr#17, to-chk=32/72)
30-Nov-2024 01:04:12         123,126  42%   19.57MB/s    0:00:00 (xfr#18, to-chk=31/72)
30-Nov-2024 01:04:12         123,442  42%   19.62MB/s    0:00:00 (xfr#19, to-chk=30/72)
30-Nov-2024 01:04:12         124,718  42%   19.82MB/s    0:00:00 (xfr#20, to-chk=29/72)
30-Nov-2024 01:04:12         125,358  43%   17.08MB/s    0:00:00 (xfr#21, to-chk=28/72)
30-Nov-2024 01:04:12         126,301  43%   17.21MB/s    0:00:00 (xfr#22, to-chk=27/72)
30-Nov-2024 01:04:12         126,461  43%   17.23MB/s    0:00:00 (xfr#23, to-chk=26/72)
30-Nov-2024 01:04:12         127,086  43%   17.31MB/s    0:00:00 (xfr#24, to-chk=25/72)
30-Nov-2024 01:04:12         127,246  43%   17.34MB/s    0:00:00 (xfr#25, to-chk=24/72)
30-Nov-2024 01:04:12         127,562  43%   15.21MB/s    0:00:00 (xfr#26, to-chk=23/72)
30-Nov-2024 01:04:12         127,878  43%   15.24MB/s    0:00:00 (xfr#27, to-chk=22/72)
30-Nov-2024 01:04:12         130,477  44%   15.55MB/s    0:00:00 (xfr#28, to-chk=21/72)
30-Nov-2024 01:04:12         130,930  44%   15.61MB/s    0:00:00 (xfr#29, to-chk=20/72)
30-Nov-2024 01:04:12         132,409  45%   14.03MB/s    0:00:00 (xfr#30, to-chk=19/72)
30-Nov-2024 01:04:12         135,407  46%   14.35MB/s    0:00:00 (xfr#31, to-chk=18/72)
30-Nov-2024 01:04:12         138,710  47%   13.23MB/s    0:00:00 (xfr#32, to-chk=17/72)
30-Nov-2024 01:04:12         143,019  49%   13.64MB/s    0:00:00 (xfr#33, to-chk=16/72)
30-Nov-2024 01:04:12         146,721  50%   13.99MB/s    0:00:00 (xfr#34, to-chk=15/72)
30-Nov-2024 01:04:12         147,838  50%   14.10MB/s    0:00:00 (xfr#35, to-chk=14/72)
30-Nov-2024 01:04:12         150,038  51%   13.01MB/s    0:00:00 (xfr#36, to-chk=13/72)
30-Nov-2024 01:04:12         151,611  52%   13.14MB/s    0:00:00 (xfr#37, to-chk=12/72)
30-Nov-2024 01:04:12         153,717  52%   13.33MB/s    0:00:00 (xfr#38, to-chk=11/72)
30-Nov-2024 01:04:12         156,222  53%   13.54MB/s    0:00:00 (xfr#39, to-chk=10/72)
30-Nov-2024 01:04:12         157,245  53%   12.50MB/s    0:00:00 (xfr#40, to-chk=9/72)
30-Nov-2024 01:04:12         160,585  55%   12.76MB/s    0:00:00 (xfr#41, to-chk=8/72)
30-Nov-2024 01:04:12         163,491  56%   12.99MB/s    0:00:00 (xfr#42, to-chk=7/72)
30-Nov-2024 01:04:12         167,230  57%   13.29MB/s    0:00:00 (xfr#43, to-chk=6/72)
30-Nov-2024 01:04:12         171,482  58%   12.58MB/s    0:00:00 (xfr#44, to-chk=5/72)
30-Nov-2024 01:04:12         172,029  59%   12.62MB/s    0:00:00 (xfr#45, to-chk=4/72)
30-Nov-2024 01:04:12         172,315  59%   12.64MB/s    0:00:00 (xfr#46, to-chk=1/72)
30-Nov-2024 01:04:12         172,601  59%   11.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         172,601  59%   11.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         172,601  59%   11.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         172,601  59%   10.97MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         172,601  59%   10.97MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         172,601  59%   10.97MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-krakow-0/op-panel
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          16,535  16%   15.77MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12          33,989  33%   32.41MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12          33,989  33%   32.41MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12          50,321  49%   23.99MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12          50,612  50%   24.13MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12          50,612  50%   16.09MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-paris-0/cluster-manager
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-paris-0/op-worker
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          41,780  13%   39.84MB/s    0:00:00 (xfr#2, to-chk=67/72)
30-Nov-2024 01:04:12          59,560  18%   56.80MB/s    0:00:00 (xfr#3, to-chk=65/72)
30-Nov-2024 01:04:12          59,560  18%   56.80MB/s    0:00:00 (xfr#4, to-chk=63/72)
30-Nov-2024 01:04:12          59,560  18%   56.80MB/s    0:00:00 (xfr#5, to-chk=61/72)
30-Nov-2024 01:04:12          76,217  23%   72.69MB/s    0:00:00 (xfr#6, to-chk=59/72)
30-Nov-2024 01:04:12          76,367  24%   72.83MB/s    0:00:00 (xfr#7, to-chk=57/72)
30-Nov-2024 01:04:12          76,664  24%   73.11MB/s    0:00:00 (xfr#8, to-chk=51/72)
30-Nov-2024 01:04:12         131,398  41%  125.31MB/s    0:00:00 (xfr#9, to-chk=49/72)
30-Nov-2024 01:04:12         131,834  41%   62.86MB/s    0:00:00 (xfr#10, to-chk=39/72)
30-Nov-2024 01:04:12         132,963  41%   63.40MB/s    0:00:00 (xfr#11, to-chk=38/72)
30-Nov-2024 01:04:12         133,924  42%   63.86MB/s    0:00:00 (xfr#12, to-chk=37/72)
30-Nov-2024 01:04:12         134,202  42%   63.99MB/s    0:00:00 (xfr#13, to-chk=36/72)
30-Nov-2024 01:04:12         134,869  42%   64.31MB/s    0:00:00 (xfr#14, to-chk=35/72)
30-Nov-2024 01:04:12         135,520  42%   64.62MB/s    0:00:00 (xfr#15, to-chk=34/72)
30-Nov-2024 01:04:12         136,325  42%   65.00MB/s    0:00:00 (xfr#16, to-chk=33/72)
30-Nov-2024 01:04:12         136,761  43%   65.21MB/s    0:00:00 (xfr#17, to-chk=32/72)
30-Nov-2024 01:04:12         137,043  43%   65.35MB/s    0:00:00 (xfr#18, to-chk=31/72)
30-Nov-2024 01:04:12         137,321  43%   65.48MB/s    0:00:00 (xfr#19, to-chk=30/72)
30-Nov-2024 01:04:12         138,747  43%   66.16MB/s    0:00:00 (xfr#20, to-chk=29/72)
30-Nov-2024 01:04:12         139,234  43%   66.39MB/s    0:00:00 (xfr#21, to-chk=28/72)
30-Nov-2024 01:04:12         140,433  44%   66.96MB/s    0:00:00 (xfr#22, to-chk=27/72)
30-Nov-2024 01:04:12         140,715  44%   44.73MB/s    0:00:00 (xfr#23, to-chk=26/72)
30-Nov-2024 01:04:12         141,528  44%   44.99MB/s    0:00:00 (xfr#24, to-chk=25/72)
30-Nov-2024 01:04:12         141,806  44%   45.08MB/s    0:00:00 (xfr#25, to-chk=24/72)
30-Nov-2024 01:04:12         142,090  44%   45.17MB/s    0:00:00 (xfr#26, to-chk=23/72)
30-Nov-2024 01:04:12         142,372  44%   45.26MB/s    0:00:00 (xfr#27, to-chk=22/72)
30-Nov-2024 01:04:12         144,871  45%   46.05MB/s    0:00:00 (xfr#28, to-chk=21/72)
30-Nov-2024 01:04:12         145,324  45%   46.20MB/s    0:00:00 (xfr#29, to-chk=20/72)
30-Nov-2024 01:04:12         146,803  46%   46.67MB/s    0:00:00 (xfr#30, to-chk=19/72)
30-Nov-2024 01:04:12         149,652  47%   47.57MB/s    0:00:00 (xfr#31, to-chk=18/72)
30-Nov-2024 01:04:12         152,955  48%   48.62MB/s    0:00:00 (xfr#32, to-chk=17/72)
30-Nov-2024 01:04:12         157,162  49%   37.47MB/s    0:00:00 (xfr#33, to-chk=16/72)
30-Nov-2024 01:04:12         160,864  50%   38.35MB/s    0:00:00 (xfr#34, to-chk=15/72)
30-Nov-2024 01:04:12         161,824  50%   38.58MB/s    0:00:00 (xfr#35, to-chk=14/72)
30-Nov-2024 01:04:12         163,867  51%   39.07MB/s    0:00:00 (xfr#36, to-chk=13/72)
30-Nov-2024 01:04:12         165,283  52%   39.41MB/s    0:00:00 (xfr#37, to-chk=12/72)
30-Nov-2024 01:04:12         167,389  52%   31.93MB/s    0:00:00 (xfr#38, to-chk=11/72)
30-Nov-2024 01:04:12         169,894  53%   32.40MB/s    0:00:00 (xfr#39, to-chk=10/72)
30-Nov-2024 01:04:12         170,917  53%   32.60MB/s    0:00:00 (xfr#40, to-chk=9/72)
30-Nov-2024 01:04:12         174,157  54%   33.22MB/s    0:00:00 (xfr#41, to-chk=8/72)
30-Nov-2024 01:04:12         177,061  55%   33.77MB/s    0:00:00 (xfr#42, to-chk=7/72)
30-Nov-2024 01:04:12         180,698  56%   34.47MB/s    0:00:00 (xfr#43, to-chk=6/72)
30-Nov-2024 01:04:12         184,850  58%   35.26MB/s    0:00:00 (xfr#44, to-chk=5/72)
30-Nov-2024 01:04:12         185,297  58%   35.34MB/s    0:00:00 (xfr#45, to-chk=4/72)
30-Nov-2024 01:04:12         185,582  58%   35.40MB/s    0:00:00 (xfr#46, to-chk=1/72)
30-Nov-2024 01:04:12         185,867  58%   29.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         185,867  58%   29.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         185,867  58%   29.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         185,867  58%   29.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         185,867  58%   29.54MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12         185,867  58%   25.32MB/s    0:00:00 (xfr#47, to-chk=0/72)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-oneprovider-paris-0/op-panel
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          16,498  16%   15.73MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12          33,913  33%   32.34MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12          33,913  33%   32.34MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12          50,208  49%   47.88MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12          50,499  50%   48.16MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12          50,499  50%   48.16MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-onezone-0/oz-worker
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          13,212   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
30-Nov-2024 01:04:12          27,019  14%   25.77MB/s    0:00:00 (xfr#3, to-chk=11/18)
30-Nov-2024 01:04:12          27,019  14%   25.77MB/s    0:00:00 (xfr#4, to-chk=9/18)
30-Nov-2024 01:04:12          39,751  20%   37.91MB/s    0:00:00 (xfr#5, to-chk=7/18)
30-Nov-2024 01:04:12          39,842  20%   38.00MB/s    0:00:00 (xfr#6, to-chk=5/18)
30-Nov-2024 01:04:12          40,139  21%   38.28MB/s    0:00:00 (xfr#7, to-chk=3/18)
30-Nov-2024 01:04:12          95,488  50%   30.35MB/s    0:00:00 (xfr#8, to-chk=1/18)
30-Nov-2024 01:04:12          95,488  50%   18.21MB/s    0:00:00 (xfr#8, to-chk=0/18)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-onezone-0/oz-panel
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12          21,411  13%   20.42MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12          43,817  27%   41.79MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12          59,009  36%   56.28MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12          80,217  49%   76.50MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12          80,508  50%   76.78MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12          80,508  50%   38.39MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.11.30-00.55.27/pod-logs/dev-onezone-0/cluster-manager
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
30-Nov-2024 01:04:12               0   0%    0.00kB/s    0:00:00 
30-Nov-2024 01:04:12           1,978  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
30-Nov-2024 01:04:12           4,666  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
30-Nov-2024 01:04:12           4,666  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
30-Nov-2024 01:04:12           6,441  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
30-Nov-2024 01:04:12           6,703  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
30-Nov-2024 01:04:12           6,703  50%    3.20MB/s    0:00:00 (xfr#6, to-chk=0/14)
30-Nov-2024 01:04:12 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1732928642.6633275 exists, exporting anyway.
30-Nov-2024 01:04:12 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
30-Nov-2024 01:04:12 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 =============================== warnings summary ===============================
30-Nov-2024 01:04:12 tests/utils/rest_utils.py:97
30-Nov-2024 01:04:12   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
30-Nov-2024 01:04:12     print("""
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 tests/utils/path_utils.py:112
30-Nov-2024 01:04:12   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
30-Nov-2024 01:04:12     return path.replace("'", "\\'").replace(' ', '\ ')
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 tests/utils/acceptance_utils.py:55
30-Nov-2024 01:04:12   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
30-Nov-2024 01:04:12     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 tests/utils/acceptance_utils.py:57
30-Nov-2024 01:04:12   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
30-Nov-2024 01:04:12     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
30-Nov-2024 01:04:12
30-Nov-2024 01:04:12 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
30-Nov-2024 01:04:12 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/test-reports/results.xml -
30-Nov-2024 01:04:12 ================== 9 passed, 4 warnings in 527.92s (0:08:47) ===================
30-Nov-2024 01:04:16 release "dev" uninstalled
30-Nov-2024 01:04:17 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
30-Nov-2024 01:04:17 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
30-Nov-2024 01:04:19 No resources found
30-Nov-2024 01:04:20 Sidecar injection has been disabled
30-Nov-2024 01:04:20 Cleaning helm release "dev"...
30-Nov-2024 01:04:20 Deleted 1 helm deployments
30-Nov-2024 01:04:20 Deleted 0 k8s deployments
30-Nov-2024 01:04:20 Deleted 0 k8s services
30-Nov-2024 01:04:20 Deleted 0 persistent volumes
30-Nov-2024 01:04:21 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 01:04:21 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
30-Nov-2024 01:04:21 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 01:04:21 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
30-Nov-2024 01:04:21 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
30-Nov-2024 01:04:21 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
30-Nov-2024 01:04:21 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
30-Nov-2024 01:04:21 Finished task 'Run acceptance oneclient tests' with result: Success
30-Nov-2024 01:04:21 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
30-Nov-2024 01:04:21 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP...
30-Nov-2024 01:04:21 Finished task 'Parse test results' with result: Success
30-Nov-2024 01:04:21 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoHostname} with S3
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoPort} with 10161
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.planRepository.branchName} with develop
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoHostname} with S3
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoPort} with 10161
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.planRepository.branchName} with develop
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
30-Nov-2024 01:04:21 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 01:04:21
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3372 (ODSRV-OAP-MRP-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3372-ScriptBuildTask-7881289777459298314.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance
30-Nov-2024 01:04:21 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_proxyio.tar.gz
30-Nov-2024 01:04:21 Uploading artifact
30-Nov-2024 01:04:21     source path: surefire_multiprovider_replication_proxyio.tar.gz
30-Nov-2024 01:04:21     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_proxyio.tar.gz
30-Nov-2024 01:04:21 Finished task 'Pack and push surefire artifact' with result: Success
30-Nov-2024 01:04:21 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 01:04:21 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 01:04:21
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3372 (ODSRV-OAP-MRP-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3372-ScriptBuildTask-500569634783565745.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP
30-Nov-2024 01:04:21 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
30-Nov-2024 01:04:21 Finished task 'Pack logs' with result: Success
30-Nov-2024 01:04:21 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
30-Nov-2024 01:04:21
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
30-Nov-2024 01:04:21 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
30-Nov-2024 01:04:21
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3372 (ODSRV-OAP-MRP-3372)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3372-ScriptBuildTask-7071499199441622269.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance
30-Nov-2024 01:04:21   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
30-Nov-2024 01:04:21                                  Dload  Upload   Total   Spent    Left  Speed
30-Nov-2024 01:04:21
30-Nov-2024 01:04:21   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
30-Nov-2024 01:04:21   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
30-Nov-2024 01:04:21 100  4822  100  4822    0     0  61037      0 --:--:-- --:--:-- --:--:-- 60275
30-Nov-2024 01:04:21 Clearing /tmp/onedata and /home/bamboo/.one-env
30-Nov-2024 01:04:22 Cleaning helm deployments
30-Nov-2024 01:04:22 Cleanining pods
30-Nov-2024 01:04:22 Cleaning kube persistant volumes
30-Nov-2024 01:04:23 Cleaning dockswift container
30-Nov-2024 01:04:23 Cleaning docker containers
30-Nov-2024 01:04:25 Stalled docker containers to remove:
30-Nov-2024 01:04:25 7878608664c0 f4ea2e0b8f2d 135c9d3f79ea 9cd7828b7928 b838abbb2243 34f46052ce88 76a9452fb7e8 4caed1f1aa77 7b63693a3bac 26401fe9da1e 26a593ae0081 11e3432dbba5 155cfcce9c32 5aacba3d6267 b7a0eab1f03e cd6ec4f1f858 eecbc0cb695c d8bf37ea5930 209ed180fcc9 44ef66f46fcf
30-Nov-2024 01:04:25 Removing stalled docker containers
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: 7878608664c0: Container 7878608664c0ae9ebaf6cebe89a452597286ad590f895fca206d8c428038bf43 is not running
30-Nov-2024 01:04:25 7878608664c0
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: f4ea2e0b8f2d: Container f4ea2e0b8f2de96dd863a973e0af13ca4f2785daf3e487cfd36493a36f28a51b is not running
30-Nov-2024 01:04:25 f4ea2e0b8f2d
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: 135c9d3f79ea: Container 135c9d3f79ea479148e1219234e54c05ff4f1a120f8ba56c997f1f8e288b9f60 is not running
30-Nov-2024 01:04:25 135c9d3f79ea
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: 9cd7828b7928: Container 9cd7828b7928d6f3bf83900fd1eec9354780d41ff4ffb17cfe7b349ecadb51de is not running
30-Nov-2024 01:04:25 9cd7828b7928
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: b838abbb2243: Container b838abbb2243692e859f3c690f0057d00e5a7e795ee68ebe27c755ac897b5877 is not running
30-Nov-2024 01:04:25 b838abbb2243
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: 34f46052ce88: Container 34f46052ce884eea66a08cfb54d868acabb3347adebad19b6b3f154f49e41fc5 is not running
30-Nov-2024 01:04:25 34f46052ce88
30-Nov-2024 01:04:25 Error response from daemon: Cannot kill container: 76a9452fb7e8: Container 76a9452fb7e838995f4ff2855f610a9fe5eceb7152ef442bd672f38ae0906943 is not running
30-Nov-2024 01:04:25 76a9452fb7e8
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 4caed1f1aa77: Container 4caed1f1aa77c049f0a4a245a3a24c3fa6462186ee033f7dec22a6b9aa80811d is not running
30-Nov-2024 01:04:26 4caed1f1aa77
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 7b63693a3bac: Container 7b63693a3bac1ff091918be208814e1143e5bb776b312aed94467ba3637f9c45 is not running
30-Nov-2024 01:04:26 7b63693a3bac
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 26401fe9da1e: Container 26401fe9da1ec2d7ae7a56f7b1954a9358aba18393d4027ffface12f64e26154 is not running
30-Nov-2024 01:04:26 26401fe9da1e
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 26a593ae0081: Container 26a593ae00810ac17ddad087a85c770bb17d6908c1e43c406725fc6f9d5a085d is not running
30-Nov-2024 01:04:26 26a593ae0081
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 11e3432dbba5: Container 11e3432dbba5392524d11667cbed04fead8fa4fafdd9d1935751fa48c1940845 is not running
30-Nov-2024 01:04:26 11e3432dbba5
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 155cfcce9c32: Container 155cfcce9c32a99a6e71ccdbdb3adad6ab912d0c8a46e9921741864f792ef843 is not running
30-Nov-2024 01:04:26 155cfcce9c32
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 5aacba3d6267: Container 5aacba3d6267254486dd09f23e226ff152932e0d8ad0e7516faf90dd639b99c7 is not running
30-Nov-2024 01:04:26 5aacba3d6267
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: b7a0eab1f03e: Container b7a0eab1f03ec80a85b74fea3b6b6113c2e4433e2eeef2af0623d17664f8bd5c is not running
30-Nov-2024 01:04:26 b7a0eab1f03e
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: cd6ec4f1f858: Container cd6ec4f1f858ba8e339a32b1bd27eed911cc9b0f4f6cfed1760af22ec667a10d is not running
30-Nov-2024 01:04:26 cd6ec4f1f858
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: eecbc0cb695c: Container eecbc0cb695c181b75c960efa5c329254b9209164096843554c6e1ebc2151e79 is not running
30-Nov-2024 01:04:26 eecbc0cb695c
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: d8bf37ea5930: Container d8bf37ea5930a3d12b1f4c000ca134b709f245cd9fa33134ea465ece9a156a59 is not running
30-Nov-2024 01:04:26 d8bf37ea5930
30-Nov-2024 01:04:26 Error response from daemon: Cannot kill container: 209ed180fcc9: Container 209ed180fcc9934ce22ca663245a351ff5190ccd2d74ee34e0560b8a7f56f7b2 is not running
30-Nov-2024 01:04:26 209ed180fcc9
30-Nov-2024 01:04:27 44ef66f46fcf
30-Nov-2024 01:04:27 44ef66f46fcf
30-Nov-2024 01:04:27 Stalled docker volumes to remove:
30-Nov-2024 01:04:27
30-Nov-2024 01:04:27 Removing stalled docker volumes
30-Nov-2024 01:04:27 Removing stalled loopdevices
30-Nov-2024 01:04:27 Done
30-Nov-2024 01:04:27 Finished task 'Clear env and working dir' with result: Success
30-Nov-2024 01:04:27 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
30-Nov-2024 01:04:27 Running post build plugin 'Docker Container Cleanup'
30-Nov-2024 01:04:27 Running post build plugin 'NCover Results Collector'
30-Nov-2024 01:04:27 Running post build plugin 'Build Results Label Collector'
30-Nov-2024 01:04:27 Running post build plugin 'Clover Results Collector'
30-Nov-2024 01:04:27 Running post build plugin 'npm Cache Cleanup'
30-Nov-2024 01:04:27 Running post build plugin 'Artifact Copier'
30-Nov-2024 01:04:27 Publishing an artifact: test_logs.tar.gz
30-Nov-2024 01:04:27 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 55.48 ms
30-Nov-2024 01:04:28 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP'
30-Nov-2024 01:04:28 Finalising the build...
30-Nov-2024 01:04:28 Stopping timer.
30-Nov-2024 01:04:28 Build ODSRV-OAP-MRP-3372 completed.
30-Nov-2024 01:04:28 Running on server: post build plugin 'Build Hanging Detection Configuration'
30-Nov-2024 01:04:28 Running on server: post build plugin 'NCover Results Collector'
30-Nov-2024 01:04:28 Running on server: post build plugin 'Build Labeller'
30-Nov-2024 01:04:28 Running on server: post build plugin 'Clover Delta Calculator'
30-Nov-2024 01:04:28 Running on server: post build plugin 'Maven Dependencies Postprocessor'
30-Nov-2024 01:04:28 All post build plugins have finished
30-Nov-2024 01:04:28 Generating build results summary...
30-Nov-2024 01:04:28 Saving build results to disk...
30-Nov-2024 01:04:28 Store variable context...
30-Nov-2024 01:04:28 Finished building ODSRV-OAP-MRP-3372.