oneclient acceptance tests using environment deployed from packages

Build: #3374 failed

Job: multiprovider replication proxyio was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,384 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:42:30 Adding user `space_owner' ...
03-Dec-2024 18:42:30 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:42:30 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:42:30 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:42:30 Copying files from `/etc/skel' ...
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:42:30 Adding user `user1' ...
03-Dec-2024 18:42:30 Adding new group `user1' (25687) ...
03-Dec-2024 18:42:30 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:42:30 Creating home directory `/home/user1' ...
03-Dec-2024 18:42:30 Copying files from `/etc/skel' ...
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:42:30 Adding user `user2' ...
03-Dec-2024 18:42:30 Adding new group `user2' (30628) ...
03-Dec-2024 18:42:30 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:42:30 Creating home directory `/home/user2' ...
03-Dec-2024 18:42:30 Copying files from `/etc/skel' ...
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:42:30 Adding user `space_owner' ...
03-Dec-2024 18:42:30 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:42:30 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:42:30 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:42:30 Copying files from `/etc/skel' ...
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:42:30 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:42:30 id: ‘user2’: no such user
03-Dec-2024 18:42:30 command terminated with exit code 1
03-Dec-2024 18:42:32 command terminated with exit code 1
03-Dec-2024 18:42:34 command terminated with exit code 1
03-Dec-2024 18:42:37 command terminated with exit code 1
03-Dec-2024 18:43:19 Adding user `user1' ...
03-Dec-2024 18:43:19 Adding new group `user1' (25687) ...
03-Dec-2024 18:43:19 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:43:19 Creating home directory `/home/user1' ...
03-Dec-2024 18:43:19 Copying files from `/etc/skel' ...
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:43:19 Adding user `user2' ...
03-Dec-2024 18:43:19 Adding new group `user2' (30628) ...
03-Dec-2024 18:43:19 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:43:19 Creating home directory `/home/user2' ...
03-Dec-2024 18:43:19 Copying files from `/etc/skel' ...
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:43:19 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 =================================================================
03-Dec-2024 18:43:19 - Executing scenario 'Create files on one provider and see them on the other provider'
03-Dec-2024 18:43:19 - from feature 'Multiprovider_replication'
03-Dec-2024 18:43:19 -----------------------------------------------------------------
03-Dec-2024 18:43:19 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:43:19 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:43:19 using [token, token] by [user1, user2]"'
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:43:19 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/rr5avj61pcs6o7qq
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/rr5avj61pcs6o7qq --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/rr5avj61pcs6o7qq
03-Dec-2024 18:43:19 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '977640866731291504'...
03-Dec-2024 18:43:19 Getting configuration...
03-Dec-2024 18:43:19 Oneclient has been successfully mounted in '/tmp/onedata/mnt/rr5avj61pcs6o7qq'.
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:43:19 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:43:19 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/trcinyah10st5j9y
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/trcinyah10st5j9y --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/trcinyah10st5j9y
03-Dec-2024 18:43:19 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '10633816891447155333'...
03-Dec-2024 18:43:19 Getting configuration...
03-Dec-2024 18:43:19 Oneclient has been successfully mounted in '/tmp/onedata/mnt/trcinyah10st5j9y'.
03-Dec-2024 18:43:19
03-Dec-2024 18:43:19 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
03-Dec-2024 18:43:19 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:43:19 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:43:19 =================================================================
03-Dec-2024 18:43:19
03-Dec-2024 18:43:20 PASSED
03-Dec-2024 18:43:20 Unmounting client from /tmp/onedata/mnt/rr5avj61pcs6o7qq
03-Dec-2024 18:43:20
03-Dec-2024 18:43:20
03-Dec-2024 18:43:20 Unmounting client from /tmp/onedata/mnt/trcinyah10st5j9y
03-Dec-2024 18:43:20
03-Dec-2024 18:43:20
03-Dec-2024 18:44:05 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:44:05 =================================================================
03-Dec-2024 18:44:05 - Executing scenario 'Create empty file on one provider and read it on the other provider'
03-Dec-2024 18:44:05 - from feature 'Multiprovider_replication'
03-Dec-2024 18:44:05 -----------------------------------------------------------------
03-Dec-2024 18:44:05 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:44:05 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:44:05 using [token, token] by [user1, user2]"'
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:44:05 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/jvek4t5g56ae63fl
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/jvek4t5g56ae63fl --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/jvek4t5g56ae63fl
03-Dec-2024 18:44:05 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10317648311124273673'...
03-Dec-2024 18:44:05 Getting configuration...
03-Dec-2024 18:44:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/jvek4t5g56ae63fl'.
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:44:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:44:05 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/7z4spwai5n7yl0fp
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/7z4spwai5n7yl0fp --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/7z4spwai5n7yl0fp
03-Dec-2024 18:44:05 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '974676171488241995'...
03-Dec-2024 18:44:05 Getting configuration...
03-Dec-2024 18:44:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/7z4spwai5n7yl0fp'.
03-Dec-2024 18:44:05
03-Dec-2024 18:44:05 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:44:05 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
03-Dec-2024 18:44:05 =================================================================
03-Dec-2024 18:44:05
03-Dec-2024 18:44:06 PASSED
03-Dec-2024 18:44:06 Unmounting client from /tmp/onedata/mnt/jvek4t5g56ae63fl
03-Dec-2024 18:44:06
03-Dec-2024 18:44:06
03-Dec-2024 18:44:06 Unmounting client from /tmp/onedata/mnt/7z4spwai5n7yl0fp
03-Dec-2024 18:44:06
03-Dec-2024 18:44:06
03-Dec-2024 18:44:47 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:44:47 =================================================================
03-Dec-2024 18:44:47 - Executing scenario 'Write to file on one provider and check size on the other provider'
03-Dec-2024 18:44:47 - from feature 'Multiprovider_replication'
03-Dec-2024 18:44:47 -----------------------------------------------------------------
03-Dec-2024 18:44:47 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:44:47 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:44:47 using [token, token] by [user1, user2]"'
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:44:47 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/4scn5wzvhtry4axw
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/4scn5wzvhtry4axw --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/4scn5wzvhtry4axw
03-Dec-2024 18:44:47 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '9952529343477646473'...
03-Dec-2024 18:44:47 Getting configuration...
03-Dec-2024 18:44:47 Oneclient has been successfully mounted in '/tmp/onedata/mnt/4scn5wzvhtry4axw'.
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:44:47 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:44:47 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/uaa19o3tuqjvuxym
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/uaa19o3tuqjvuxym --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/uaa19o3tuqjvuxym
03-Dec-2024 18:44:47 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '5783327959336280073'...
03-Dec-2024 18:44:47 Getting configuration...
03-Dec-2024 18:44:47 Oneclient has been successfully mounted in '/tmp/onedata/mnt/uaa19o3tuqjvuxym'.
03-Dec-2024 18:44:47
03-Dec-2024 18:44:47 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:44:47 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:44:47 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
03-Dec-2024 18:44:47 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
03-Dec-2024 18:44:47 =================================================================
03-Dec-2024 18:44:47
03-Dec-2024 18:44:48 PASSED
03-Dec-2024 18:44:48 Unmounting client from /tmp/onedata/mnt/4scn5wzvhtry4axw
03-Dec-2024 18:44:48
03-Dec-2024 18:44:48
03-Dec-2024 18:44:48 Unmounting client from /tmp/onedata/mnt/uaa19o3tuqjvuxym
03-Dec-2024 18:44:48
03-Dec-2024 18:44:48
03-Dec-2024 18:45:23 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:45:23 =================================================================
03-Dec-2024 18:45:23 - Executing scenario 'Write to file on one provider and read on the other provider'
03-Dec-2024 18:45:23 - from feature 'Multiprovider_replication'
03-Dec-2024 18:45:23 -----------------------------------------------------------------
03-Dec-2024 18:45:23 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:45:23 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:45:23 using [token, token] by [user1, user2]"'
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:45:23 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/25x7y4kdkmvbr5yn
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/25x7y4kdkmvbr5yn --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/25x7y4kdkmvbr5yn
03-Dec-2024 18:45:23 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '10742824469718203351'...
03-Dec-2024 18:45:23 Getting configuration...
03-Dec-2024 18:45:23 Oneclient has been successfully mounted in '/tmp/onedata/mnt/25x7y4kdkmvbr5yn'.
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:45:23 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:45:23 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/h4klwkxyb9s47gjt
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/h4klwkxyb9s47gjt --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/h4klwkxyb9s47gjt
03-Dec-2024 18:45:23 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '10230551426571458875'...
03-Dec-2024 18:45:23 Getting configuration...
03-Dec-2024 18:45:23 Oneclient has been successfully mounted in '/tmp/onedata/mnt/h4klwkxyb9s47gjt'.
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:45:23 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:45:23 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
03-Dec-2024 18:45:23 =================================================================
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 PASSED
03-Dec-2024 18:45:23 Unmounting client from /tmp/onedata/mnt/25x7y4kdkmvbr5yn
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23 Unmounting client from /tmp/onedata/mnt/h4klwkxyb9s47gjt
03-Dec-2024 18:45:23
03-Dec-2024 18:45:23
03-Dec-2024 18:45:59 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:45:59 =================================================================
03-Dec-2024 18:45:59 - Executing scenario 'Big file transfer with MD5 check'
03-Dec-2024 18:45:59 - from feature 'Multiprovider_replication'
03-Dec-2024 18:45:59 -----------------------------------------------------------------
03-Dec-2024 18:45:59 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:45:59 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:45:59 using [token, token] by [user1, user2]"'
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:45:59 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/lrd1s7z9v07iq0gt
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/lrd1s7z9v07iq0gt --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/lrd1s7z9v07iq0gt
03-Dec-2024 18:45:59 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '2156028634848521037'...
03-Dec-2024 18:45:59 Getting configuration...
03-Dec-2024 18:45:59 Oneclient has been successfully mounted in '/tmp/onedata/mnt/lrd1s7z9v07iq0gt'.
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:45:59 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:45:59 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/i8wzov0z9j3bn71k
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/i8wzov0z9j3bn71k --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/i8wzov0z9j3bn71k
03-Dec-2024 18:45:59 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '7010262773389639527'...
03-Dec-2024 18:45:59 Getting configuration...
03-Dec-2024 18:45:59 Oneclient has been successfully mounted in '/tmp/onedata/mnt/i8wzov0z9j3bn71k'.
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:45:59 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:45:59 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:45:59 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:45:59 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:45:59 =================================================================
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 PASSED
03-Dec-2024 18:45:59 Unmounting client from /tmp/onedata/mnt/lrd1s7z9v07iq0gt
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59 Unmounting client from /tmp/onedata/mnt/i8wzov0z9j3bn71k
03-Dec-2024 18:45:59
03-Dec-2024 18:45:59
03-Dec-2024 18:47:15 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:47:15 =================================================================
03-Dec-2024 18:47:15 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
03-Dec-2024 18:47:15 - from feature 'Multiprovider_replication'
03-Dec-2024 18:47:15 -----------------------------------------------------------------
03-Dec-2024 18:47:15 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:47:15 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:47:15 using [token, token] by [user1, user2]"'
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:47:15 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/hbu4317mryllwx0n
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/hbu4317mryllwx0n --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/hbu4317mryllwx0n
03-Dec-2024 18:47:15 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '793223069160870551'...
03-Dec-2024 18:47:15 Getting configuration...
03-Dec-2024 18:47:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/hbu4317mryllwx0n'.
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:47:15 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:47:15 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/4zk5fsdqw4rv9mxy
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/4zk5fsdqw4rv9mxy --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/4zk5fsdqw4rv9mxy
03-Dec-2024 18:47:15 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '843444845472873811'...
03-Dec-2024 18:47:15 Getting configuration...
03-Dec-2024 18:47:15 Oneclient has been successfully mounted in '/tmp/onedata/mnt/4zk5fsdqw4rv9mxy'.
03-Dec-2024 18:47:15
03-Dec-2024 18:47:15 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:47:15 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
03-Dec-2024 18:47:15 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
03-Dec-2024 18:47:15 =================================================================
03-Dec-2024 18:47:15
03-Dec-2024 18:47:16 PASSED
03-Dec-2024 18:47:16 Unmounting client from /tmp/onedata/mnt/hbu4317mryllwx0n
03-Dec-2024 18:47:16
03-Dec-2024 18:47:16
03-Dec-2024 18:47:16 Unmounting client from /tmp/onedata/mnt/4zk5fsdqw4rv9mxy
03-Dec-2024 18:47:16
03-Dec-2024 18:47:16
03-Dec-2024 18:48:02 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:48:02 =================================================================
03-Dec-2024 18:48:02 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
03-Dec-2024 18:48:02 - from feature 'Multiprovider_replication'
03-Dec-2024 18:48:02 -----------------------------------------------------------------
03-Dec-2024 18:48:02 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:48:02 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:48:02 using [token, token] by [user1, user2]"'
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:48:02 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/x3b8n8cn5uol5uqi
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/x3b8n8cn5uol5uqi --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/x3b8n8cn5uol5uqi
03-Dec-2024 18:48:02 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '12163947173308503622'...
03-Dec-2024 18:48:02 Getting configuration...
03-Dec-2024 18:48:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/x3b8n8cn5uol5uqi'.
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:48:02 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:48:02 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/kk0tukngpi3mpkrt
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/kk0tukngpi3mpkrt --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/kk0tukngpi3mpkrt
03-Dec-2024 18:48:02 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '15929290927914227014'...
03-Dec-2024 18:48:02 Getting configuration...
03-Dec-2024 18:48:02 Oneclient has been successfully mounted in '/tmp/onedata/mnt/kk0tukngpi3mpkrt'.
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:48:02 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:48:02 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:48:02 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
03-Dec-2024 18:48:02 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
03-Dec-2024 18:48:02 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
03-Dec-2024 18:48:02 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
03-Dec-2024 18:48:02 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
03-Dec-2024 18:48:02 =================================================================
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 PASSED
03-Dec-2024 18:48:02 Unmounting client from /tmp/onedata/mnt/x3b8n8cn5uol5uqi
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02 Unmounting client from /tmp/onedata/mnt/kk0tukngpi3mpkrt
03-Dec-2024 18:48:02
03-Dec-2024 18:48:02
03-Dec-2024 18:49:16 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:49:16 =================================================================
03-Dec-2024 18:49:16 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
03-Dec-2024 18:49:16 - from feature 'Multiprovider_replication'
03-Dec-2024 18:49:16 -----------------------------------------------------------------
03-Dec-2024 18:49:16 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:49:16 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:49:16 using [token, token] by [user1, user2]"'
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:49:16 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/j2znpl973iuwy3w0
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/j2znpl973iuwy3w0 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/j2znpl973iuwy3w0
03-Dec-2024 18:49:16 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '1829943689860747518'...
03-Dec-2024 18:49:16 Getting configuration...
03-Dec-2024 18:49:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/j2znpl973iuwy3w0'.
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:49:16 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:49:16 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/7kn44bnd7v35s0mp
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/7kn44bnd7v35s0mp --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/7kn44bnd7v35s0mp
03-Dec-2024 18:49:16 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '9229193633555804551'...
03-Dec-2024 18:49:16 Getting configuration...
03-Dec-2024 18:49:16 Oneclient has been successfully mounted in '/tmp/onedata/mnt/7kn44bnd7v35s0mp'.
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
03-Dec-2024 18:49:16 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
03-Dec-2024 18:49:16 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
03-Dec-2024 18:49:16 =================================================================
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 PASSED
03-Dec-2024 18:49:16 Unmounting client from /tmp/onedata/mnt/j2znpl973iuwy3w0
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16 Unmounting client from /tmp/onedata/mnt/7kn44bnd7v35s0mp
03-Dec-2024 18:49:16
03-Dec-2024 18:49:16
03-Dec-2024 18:50:08 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_proxyio] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:50:08 =================================================================
03-Dec-2024 18:50:08 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
03-Dec-2024 18:50:08 - from feature 'Multiprovider_replication'
03-Dec-2024 18:50:08 -----------------------------------------------------------------
03-Dec-2024 18:50:08 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:50:08 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:50:08 using [token, token] by [user1, user2]"'
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-2rh6q', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q'
03-Dec-2024 18:50:08 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-2rh6q' successfully started
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/iltk1qoz8edijop6
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/iltk1qoz8edijop6 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/iltk1qoz8edijop6
03-Dec-2024 18:50:08 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '13012717201425023089'...
03-Dec-2024 18:50:08 Getting configuration...
03-Dec-2024 18:50:08 Oneclient has been successfully mounted in '/tmp/onedata/mnt/iltk1qoz8edijop6'.
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:50:08 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-tl4js', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js'
03-Dec-2024 18:50:08 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-tl4js' successfully started
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 Mounting client with --force-proxy-io flag in /tmp/onedata/mnt/p1wuxwdu1sxuqds5
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/p1wuxwdu1sxuqds5 --force-proxy-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/p1wuxwdu1sxuqds5
03-Dec-2024 18:50:08 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1504795400818105350'...
03-Dec-2024 18:50:08 Getting configuration...
03-Dec-2024 18:50:08 Oneclient has been successfully mounted in '/tmp/onedata/mnt/p1wuxwdu1sxuqds5'.
03-Dec-2024 18:50:08
03-Dec-2024 18:50:08 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:50:08 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:50:08 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:50:08 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:50:08 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
03-Dec-2024 18:50:08 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
03-Dec-2024 18:50:08 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
03-Dec-2024 18:50:08 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
03-Dec-2024 18:50:08 =================================================================
03-Dec-2024 18:50:08
03-Dec-2024 18:50:20 PASSED
03-Dec-2024 18:50:20 Unmounting client from /tmp/onedata/mnt/iltk1qoz8edijop6
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:50:20 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:50:20 Unmounting client from /tmp/onedata/mnt/p1wuxwdu1sxuqds5
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1733251808.6585546', '-c', '/tmp/logs']
03-Dec-2024 18:50:20 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-8d6v5. See /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-cross-support-job-3p-users-8d6v5/entrypoint.log for more details
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-2rh6q: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneclient-krakow-7d9476b8bc-2rh6q/oneclient_logs
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=64/79)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          22,876   1%   21.82MB/s    0:00:00 (xfr#1, to-chk=63/79)
03-Dec-2024 18:50:20          22,876   1%   21.82MB/s    0:00:00 (xfr#1, to-chk=57/79)
03-Dec-2024 18:50:20          23,146   1%   22.07MB/s    0:00:00 (xfr#2, to-chk=59/79)
03-Dec-2024 18:50:20          85,757   4%   40.89MB/s    0:00:00 (xfr#3, to-chk=58/79)
03-Dec-2024 18:50:20          86,027   4%   27.35MB/s    0:00:00 (xfr#4, to-chk=57/79)
03-Dec-2024 18:50:20         111,372   5%   35.40MB/s    0:00:00 (xfr#5, to-chk=56/79)
03-Dec-2024 18:50:20         112,026   5%   26.71MB/s    0:00:00 (xfr#6, to-chk=52/79)
03-Dec-2024 18:50:20         189,908   9%   36.22MB/s    0:00:00 (xfr#7, to-chk=51/79)
03-Dec-2024 18:50:20         190,562   9%   36.35MB/s    0:00:00 (xfr#8, to-chk=50/79)
03-Dec-2024 18:50:20         289,274  14%   39.41MB/s    0:00:00 (xfr#9, to-chk=49/79)
03-Dec-2024 18:50:20         289,928  14%   34.56MB/s    0:00:00 (xfr#10, to-chk=45/79)
03-Dec-2024 18:50:20         595,219  29%   29.88MB/s    0:00:00 (xfr#11, to-chk=44/79)
03-Dec-2024 18:50:20         595,873  29%   29.91MB/s    0:00:00 (xfr#12, to-chk=43/79)
03-Dec-2024 18:50:20         654,141  32%   31.19MB/s    0:00:00 (xfr#13, to-chk=42/79)
03-Dec-2024 18:50:20         654,699  32%   31.22MB/s    0:00:00 (xfr#14, to-chk=38/79)
03-Dec-2024 18:50:20         835,194  41%   30.63MB/s    0:00:00 (xfr#15, to-chk=37/79)
03-Dec-2024 18:50:20         835,752  41%   30.66MB/s    0:00:00 (xfr#16, to-chk=36/79)
03-Dec-2024 18:50:20         953,001  47%   28.40MB/s    0:00:00 (xfr#17, to-chk=35/79)
03-Dec-2024 18:50:20         953,367  47%   28.41MB/s    0:00:00 (xfr#18, to-chk=31/79)
03-Dec-2024 18:50:20       1,320,119  66%   35.97MB/s    0:00:00 (xfr#19, to-chk=30/79)
03-Dec-2024 18:50:20       1,320,485  66%   34.98MB/s    0:00:00 (xfr#20, to-chk=29/79)
03-Dec-2024 18:50:20       1,337,688  67%   35.44MB/s    0:00:00 (xfr#21, to-chk=28/79)
03-Dec-2024 18:50:20       1,338,246  67%   35.45MB/s    0:00:00 (xfr#22, to-chk=24/79)
03-Dec-2024 18:50:20       1,393,041  69%   36.90MB/s    0:00:00 (xfr#23, to-chk=23/79)
03-Dec-2024 18:50:20       1,393,599  69%   36.92MB/s    0:00:00 (xfr#24, to-chk=22/79)
03-Dec-2024 18:50:20       1,510,737  75%   38.94MB/s    0:00:00 (xfr#25, to-chk=21/79)
03-Dec-2024 18:50:20       1,511,199  75%   38.95MB/s    0:00:00 (xfr#26, to-chk=17/79)
03-Dec-2024 18:50:20       1,779,655  89%   43.52MB/s    0:00:00 (xfr#27, to-chk=16/79)
03-Dec-2024 18:50:20       1,780,117  89%   43.53MB/s    0:00:00 (xfr#28, to-chk=15/79)
03-Dec-2024 18:50:20       1,802,519  90%   42.98MB/s    0:00:00 (xfr#29, to-chk=14/79)
03-Dec-2024 18:50:20       1,802,981  90%   42.99MB/s    0:00:00 (xfr#30, to-chk=10/79)
03-Dec-2024 18:50:20       1,876,890  94%   44.75MB/s    0:00:00 (xfr#31, to-chk=9/79)
03-Dec-2024 18:50:20       1,877,352  94%   44.76MB/s    0:00:00 (xfr#32, to-chk=8/79)
03-Dec-2024 18:50:20       1,902,335  95%   44.25MB/s    0:00:00 (xfr#33, to-chk=7/79)
03-Dec-2024 18:50:20       1,902,605  95%   44.26MB/s    0:00:00 (xfr#34, to-chk=3/79)
03-Dec-2024 18:50:20       1,977,504  99%   44.90MB/s    0:00:00 (xfr#35, to-chk=2/79)
03-Dec-2024 18:50:20       1,977,774  99%   43.86MB/s    0:00:00 (xfr#36, to-chk=1/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   44.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   43.15MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   41.27MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20       1,990,669  99%   41.27MB/s    0:00:00 (xfr#37, to-chk=0/79)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-tl4js: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneclient-paris-5cc45c8cb7-tl4js/oneclient_logs
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          77,724   4%   24.71MB/s    0:00:00 (xfr#1, to-chk=64/80)
03-Dec-2024 18:50:20          77,724   4%   24.71MB/s    0:00:00 (xfr#1, to-chk=58/80)
03-Dec-2024 18:50:20          78,090   4%   24.82MB/s    0:00:00 (xfr#2, to-chk=60/80)
03-Dec-2024 18:50:20         377,325  19%   13.33MB/s    0:00:00 (xfr#3, to-chk=59/80)
03-Dec-2024 18:50:20         377,691  19%   13.34MB/s    0:00:00 (xfr#4, to-chk=58/80)
03-Dec-2024 18:50:20         476,113  24%   12.97MB/s    0:00:00 (xfr#5, to-chk=57/80)
03-Dec-2024 18:50:20         476,671  24%   12.99MB/s    0:00:00 (xfr#6, to-chk=53/80)
03-Dec-2024 18:50:20         808,430  42%   12.05MB/s    0:00:00 (xfr#7, to-chk=52/80)
03-Dec-2024 18:50:20         808,988  42%   12.05MB/s    0:00:00 (xfr#8, to-chk=51/80)
03-Dec-2024 18:50:20         834,576  43%   12.44MB/s    0:00:00 (xfr#9, to-chk=50/80)
03-Dec-2024 18:50:20         835,038  43%   12.44MB/s    0:00:00 (xfr#10, to-chk=46/80)
03-Dec-2024 18:50:20         919,142  48%   13.28MB/s    0:00:00 (xfr#11, to-chk=45/80)
03-Dec-2024 18:50:20         919,604  48%   13.29MB/s    0:00:00 (xfr#12, to-chk=44/80)
03-Dec-2024 18:50:20         947,060  49%   13.68MB/s    0:00:00 (xfr#13, to-chk=43/80)
03-Dec-2024 18:50:20         947,714  49%   13.69MB/s    0:00:00 (xfr#14, to-chk=39/80)
03-Dec-2024 18:50:20       1,033,821  54%   14.72MB/s    0:00:00 (xfr#15, to-chk=38/80)
03-Dec-2024 18:50:20       1,034,475  54%   14.72MB/s    0:00:00 (xfr#16, to-chk=37/80)
03-Dec-2024 18:50:20       1,132,521  59%   15.65MB/s    0:00:00 (xfr#17, to-chk=36/80)
03-Dec-2024 18:50:20       1,132,791  59%   15.43MB/s    0:00:00 (xfr#18, to-chk=32/80)
03-Dec-2024 18:50:20       1,325,676  69%   18.06MB/s    0:00:00 (xfr#19, to-chk=31/80)
03-Dec-2024 18:50:20       1,325,946  69%   17.81MB/s    0:00:00 (xfr#20, to-chk=30/80)
03-Dec-2024 18:50:20       1,344,224  70%   18.06MB/s    0:00:00 (xfr#21, to-chk=29/80)
03-Dec-2024 18:50:20       1,344,686  70%   18.06MB/s    0:00:00 (xfr#22, to-chk=25/80)
03-Dec-2024 18:50:20       1,460,779  76%   17.41MB/s    0:00:00 (xfr#23, to-chk=24/80)
03-Dec-2024 18:50:20       1,461,241  76%   17.42MB/s    0:00:00 (xfr#24, to-chk=23/80)
03-Dec-2024 18:50:20       1,494,752  78%   17.60MB/s    0:00:00 (xfr#25, to-chk=22/80)
03-Dec-2024 18:50:20       1,495,118  78%   17.60MB/s    0:00:00 (xfr#26, to-chk=18/80)
03-Dec-2024 18:50:20       1,653,097  86%   18.55MB/s    0:00:00 (xfr#27, to-chk=17/80)
03-Dec-2024 18:50:20       1,653,463  86%   18.55MB/s    0:00:00 (xfr#28, to-chk=16/80)
03-Dec-2024 18:50:20       1,654,091  86%   18.34MB/s    0:00:00 (xfr#29, to-chk=15/80)
03-Dec-2024 18:50:20       1,677,552  87%   18.60MB/s    0:00:00 (xfr#30, to-chk=14/80)
03-Dec-2024 18:50:20       1,678,014  87%   18.61MB/s    0:00:00 (xfr#31, to-chk=10/80)
03-Dec-2024 18:50:20       1,771,977  92%   19.42MB/s    0:00:00 (xfr#32, to-chk=9/80)
03-Dec-2024 18:50:20       1,772,439  92%   19.43MB/s    0:00:00 (xfr#33, to-chk=8/80)
03-Dec-2024 18:50:20       1,794,903  93%   19.45MB/s    0:00:00 (xfr#34, to-chk=7/80)
03-Dec-2024 18:50:20       1,795,269  93%   19.46MB/s    0:00:00 (xfr#35, to-chk=3/80)
03-Dec-2024 18:50:20       1,881,340  98%   20.16MB/s    0:00:00 (xfr#36, to-chk=2/80)
03-Dec-2024 18:50:20       1,881,706  98%   20.16MB/s    0:00:00 (xfr#37, to-chk=1/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.46MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   20.24MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   19.58MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   19.38MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20       1,909,741  99%   19.38MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-krakow-0/cluster-manager
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20           6,857  50%    3.27MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-krakow-0/op-panel
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          16,594  16%   15.83MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20          34,110  33%   32.53MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20          34,110  33%   32.53MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20          50,501  49%   48.16MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20          50,792  50%   48.44MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20          50,792  50%   16.15MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-krakow-0/op-worker
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          31,104   9%   29.66MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:50:20          49,752  14%   47.45MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:50:20          49,752  14%   47.45MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:50:20          49,752  14%   47.45MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:50:20          67,258  20%   64.14MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:50:20          67,407  20%   64.28MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:50:20          67,704  20%   64.57MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:50:20         132,345  39%   63.11MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:50:20         132,661  39%   63.26MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:50:20         133,133  39%   63.48MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:50:20         133,917  40%   63.86MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:50:20         135,805  40%   64.76MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:50:20         136,751  41%   65.21MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:50:20         137,067  41%   65.36MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:50:20         138,404  41%   44.00MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:50:20         139,668  41%   44.40MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:50:20         140,461  42%   44.65MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:50:20         140,933  42%   44.80MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:50:20         141,249  42%   44.90MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:50:20         141,565  42%   45.00MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:50:20         142,037  42%   45.15MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:50:20         142,358  42%   45.25MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:50:20         143,003  42%   45.46MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:50:20         143,787  43%   45.71MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:50:20         144,439  43%   45.92MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:50:20         144,599  43%   34.48MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:50:20         147,882  44%   35.26MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:50:20         152,538  45%   36.37MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:50:20         153,997  46%   36.72MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:50:20         156,787  47%   37.38MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:50:20         158,722  47%   37.84MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:50:20         162,860  48%   38.83MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:50:20         164,381  49%   39.19MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:50:20         164,950  49%   31.46MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:50:20         168,540  50%   32.15MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:50:20         169,144  50%   32.26MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:50:20         171,116  51%   32.64MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:50:20         176,280  52%   33.62MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:50:20         180,894  54%   34.50MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:50:20         185,034  55%   35.29MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:50:20         188,223  56%   35.90MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:50:20         191,050  57%   36.44MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:50:20         196,177  58%   37.42MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:50:20         199,859  59%   31.77MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:50:20         200,145  60%   31.81MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:50:20         200,431  60%   31.86MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         200,431  60%   11.95MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         200,431  60%   11.95MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         200,431  60%   11.95MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         200,431  60%   11.95MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         200,431  60%   11.95MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-paris-0/cluster-manager
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-paris-0/op-panel
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          16,325  16%   15.57MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20          33,565  33%   16.01MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20          33,565  33%   16.01MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20          49,687  49%   15.80MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20          49,978  50%   15.89MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20          49,978  50%    9.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-oneprovider-paris-0/op-worker
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          41,782  11%   39.85MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:50:20          59,562  17%   56.80MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:50:20          59,562  17%   28.40MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:50:20          59,562  17%   28.40MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:50:20          76,219  21%   36.34MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:50:20          76,368  21%   36.42MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:50:20          76,665  21%   36.56MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:50:20         141,240  40%   44.90MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:50:20         141,522  40%   44.99MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:50:20         141,806  40%   45.08MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:50:20         142,554  40%   45.32MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:50:20         144,053  41%   45.79MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:50:20         145,017  41%   46.10MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:50:20         145,295  41%   46.19MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:50:20         146,762  41%   46.65MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:50:20         148,058  42%   47.07MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:50:20         148,869  42%   35.49MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:50:20         149,303  42%   35.60MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:50:20         149,583  42%   35.66MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:50:20         149,865  42%   35.73MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:50:20         150,670  43%   35.92MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:50:20         151,303  43%   36.07MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:50:20         152,099  43%   36.26MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:50:20         152,847  43%   36.44MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:50:20         153,532  43%   29.28MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:50:20         153,814  43%   29.34MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:50:20         156,997  44%   29.94MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:50:20         161,546  46%   30.81MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:50:20         162,905  46%   25.89MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:50:20         165,695  47%   26.34MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:50:20         167,630  47%   22.84MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:50:20         171,611  49%   23.38MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:50:20         173,025  49%   23.57MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:50:20         173,592  49%   23.65MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:50:20         177,180  50%   24.14MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:50:20         177,684  50%   24.21MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:50:20         179,556  51%   24.46MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:50:20         184,618  52%   22.01MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:50:20         189,232  54%   22.56MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:50:20         193,278  55%   23.04MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:50:20         196,469  56%   23.42MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:50:20         199,196  56%   23.75MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:50:20         204,323  58%   24.36MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:50:20         207,903  59%   24.78MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:50:20         208,188  59%   24.82MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:50:20         208,473  59%   22.09MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         208,473  59%   14.20MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         208,473  59%   14.20MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         208,473  59%   14.20MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         208,473  59%   14.20MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20         208,473  59%   13.25MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-onezone-0/cluster-manager
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20           6,700  50%    3.19MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-onezone-0/oz-panel
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          22,642  13%   21.59MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:50:20          46,295  27%   44.15MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:50:20          61,487  36%   58.64MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:50:20          83,926  49%   80.04MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:50:20          84,217  50%   40.16MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:50:20          84,217  50%   26.77MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:50:20 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.40.03/pod-logs/dev-onezone-0/oz-worker
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
03-Dec-2024 18:50:20               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:50:20          13,216   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
03-Dec-2024 18:50:20          27,027  12%   25.77MB/s    0:00:00 (xfr#3, to-chk=11/18)
03-Dec-2024 18:50:20          27,027  12%   25.77MB/s    0:00:00 (xfr#4, to-chk=9/18)
03-Dec-2024 18:50:20          39,763  18%   37.92MB/s    0:00:00 (xfr#5, to-chk=7/18)
03-Dec-2024 18:50:20          39,853  18%   38.01MB/s    0:00:00 (xfr#6, to-chk=5/18)
03-Dec-2024 18:50:20          40,150  18%   38.29MB/s    0:00:00 (xfr#7, to-chk=3/18)
03-Dec-2024 18:50:20         106,526  50%  101.59MB/s    0:00:00 (xfr#8, to-chk=1/18)
03-Dec-2024 18:50:20         106,526  50%   50.80MB/s    0:00:00 (xfr#8, to-chk=0/18)
03-Dec-2024 18:50:20 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/oneclient/logs/multiprovider_proxyio/test_multiprovider_replication.1733251808.6585546 exists, exporting anyway.
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 =============================== warnings summary ===============================
03-Dec-2024 18:50:20 tests/utils/rest_utils.py:97
03-Dec-2024 18:50:20   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:50:20     print("""
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 tests/utils/path_utils.py:112
03-Dec-2024 18:50:20   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:50:20     return path.replace("'", "\\'").replace(' ', '\ ')
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 tests/utils/acceptance_utils.py:55
03-Dec-2024 18:50:20   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:50:20     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 tests/utils/acceptance_utils.py:57
03-Dec-2024 18:50:20   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:50:20     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:50:20
03-Dec-2024 18:50:20 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
03-Dec-2024 18:50:20 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance/test-reports/results.xml -
03-Dec-2024 18:50:20 ================== 9 passed, 4 warnings in 620.19s (0:10:20) ===================
03-Dec-2024 18:50:25 release "dev" uninstalled
03-Dec-2024 18:50:26 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
03-Dec-2024 18:50:26 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
03-Dec-2024 18:50:28 No resources found
03-Dec-2024 18:50:29 Sidecar injection has been disabled
03-Dec-2024 18:50:29 Cleaning helm release "dev"...
03-Dec-2024 18:50:29 Deleted 1 helm deployments
03-Dec-2024 18:50:29 Deleted 0 k8s deployments
03-Dec-2024 18:50:29 Deleted 0 k8s services
03-Dec-2024 18:50:29 Deleted 0 persistent volumes
03-Dec-2024 18:50:29 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:50:29 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
03-Dec-2024 18:50:29 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:50:29 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
03-Dec-2024 18:50:29 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
03-Dec-2024 18:50:29 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:50:29 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
03-Dec-2024 18:50:29 Finished task 'Run acceptance oneclient tests' with result: Success
03-Dec-2024 18:50:29 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
03-Dec-2024 18:50:29 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP...
03-Dec-2024 18:50:29 Finished task 'Parse test results' with result: Success
03-Dec-2024 18:50:29 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:50:29
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:50:29 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:50:29
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3374 (ODSRV-OAP-MRP-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3374-ScriptBuildTask-12504975701667070010.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance
03-Dec-2024 18:50:29 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_proxyio.tar.gz
03-Dec-2024 18:50:30 Uploading artifact
03-Dec-2024 18:50:30     source path: surefire_multiprovider_replication_proxyio.tar.gz
03-Dec-2024 18:50:30     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_proxyio.tar.gz
03-Dec-2024 18:50:30 Finished task 'Pack and push surefire artifact' with result: Success
03-Dec-2024 18:50:30 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:50:30 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:50:30
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3374 (ODSRV-OAP-MRP-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3374-ScriptBuildTask-9597820810233206391.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP
03-Dec-2024 18:50:30 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
03-Dec-2024 18:50:30 Finished task 'Pack logs' with result: Success
03-Dec-2024 18:50:30 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:50:30
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
03-Dec-2024 18:50:30 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:50:30
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication proxyio #3374 (ODSRV-OAP-MRP-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRP-3374-ScriptBuildTask-9681504053216383567.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP/onedata-acceptance
03-Dec-2024 18:50:30   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
03-Dec-2024 18:50:30                                  Dload  Upload   Total   Spent    Left  Speed
03-Dec-2024 18:50:30
03-Dec-2024 18:50:30   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
03-Dec-2024 18:50:30 Clearing /tmp/onedata and /home/bamboo/.one-env
03-Dec-2024 18:50:30 100  4822  100  4822    0     0  61037      0 --:--:-- --:--:-- --:--:-- 61037
03-Dec-2024 18:50:31 Cleaning helm deployments
03-Dec-2024 18:50:31 Cleanining pods
03-Dec-2024 18:50:31 Cleaning kube persistant volumes
03-Dec-2024 18:50:32 Cleaning dockswift container
03-Dec-2024 18:50:32 Cleaning docker containers
03-Dec-2024 18:50:35 Stalled docker containers to remove:
03-Dec-2024 18:50:35 6e3a69dc5228 2f2374b426a5 a984a497dfd7 ae1f5a11f18a 5f50d0c2010b fe6aaca52e42 785c40980837 5dbac7677ea5 bd2a728982f2 4d4b68ae1434 203a453da0f2 cc0d55b3329a 9725184c7da0 41fa957ad163 1b31b55f68cf bb141cf1e631 d5af6c9a29d5 7e9a84419363 f4a5c754b2a5 febfdc39db11
03-Dec-2024 18:50:35 Removing stalled docker containers
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: 6e3a69dc5228: Container 6e3a69dc5228ef40a219eec477b267dcee4110c13d06c90908fa0f367e4d68f7 is not running
03-Dec-2024 18:50:35 6e3a69dc5228
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: 2f2374b426a5: Container 2f2374b426a5a9c84e90cb6cafe87e8f087638450a3ad0add392ca30f5f2b6fe is not running
03-Dec-2024 18:50:35 2f2374b426a5
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: a984a497dfd7: Container a984a497dfd70c2974994bf673049eb882cc9bd7e146c9e52f81cb1ae70328a4 is not running
03-Dec-2024 18:50:35 a984a497dfd7
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: ae1f5a11f18a: Container ae1f5a11f18a190b22e6896745b73aea82cc94ba72316400ab68df7d70d041b2 is not running
03-Dec-2024 18:50:35 ae1f5a11f18a
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: 5f50d0c2010b: Container 5f50d0c2010bb3fb730dc44600b63a18d5db630d90745f22a976d499cdf969ae is not running
03-Dec-2024 18:50:35 5f50d0c2010b
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: fe6aaca52e42: Container fe6aaca52e42ffbed81b41ea7c3eebc6ade7297fce760a36f1ee4fb13364011f is not running
03-Dec-2024 18:50:35 fe6aaca52e42
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: 785c40980837: Container 785c409808370b43105f4a39cf78d7bb720e0772320a7a1a7626c88ea2a16ed9 is not running
03-Dec-2024 18:50:35 785c40980837
03-Dec-2024 18:50:35 Error response from daemon: Cannot kill container: 5dbac7677ea5: Container 5dbac7677ea57bfb4d07824f614ca68435287be8b5c3052059dd6b23d9ada37b is not running
03-Dec-2024 18:50:35 5dbac7677ea5
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: bd2a728982f2: Container bd2a728982f2c488d726848dac7fab49a40e332f3b20eab27ad826dbeae92a07 is not running
03-Dec-2024 18:50:36 bd2a728982f2
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 4d4b68ae1434: Container 4d4b68ae1434fa8bc9364d0168ec58145efe716ee73acc95ef27947b1f914bc2 is not running
03-Dec-2024 18:50:36 4d4b68ae1434
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 203a453da0f2: Container 203a453da0f2ced59adfcb1a97022dcabc0b1e413805d954c99a75fbd2e47925 is not running
03-Dec-2024 18:50:36 203a453da0f2
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: cc0d55b3329a: Container cc0d55b3329aa08f9016f2d120dcc1def433f1e1a91f1c3dadbf83875d2e32f0 is not running
03-Dec-2024 18:50:36 cc0d55b3329a
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 9725184c7da0: Container 9725184c7da0ee4a97cc6d998dbbcc0020f2440ad2b2e869f237e197950c7807 is not running
03-Dec-2024 18:50:36 9725184c7da0
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 41fa957ad163: Container 41fa957ad16345168064fb3e3ef3ab899b942c8e05ffe615b6e92a2f6122ff51 is not running
03-Dec-2024 18:50:36 41fa957ad163
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 1b31b55f68cf: Container 1b31b55f68cf2691826f1636d0e2ef9e013afd625b971f0d09be175e2418cb4a is not running
03-Dec-2024 18:50:36 1b31b55f68cf
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: bb141cf1e631: Container bb141cf1e63129d04f861bbe40da8ac6951fd4c2749996c3ff04499d41bd8a7b is not running
03-Dec-2024 18:50:36 bb141cf1e631
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: d5af6c9a29d5: Container d5af6c9a29d59a010500d80733c11634e3b74f47dd2f203a3d1d558fbcdf5730 is not running
03-Dec-2024 18:50:36 d5af6c9a29d5
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: 7e9a84419363: Container 7e9a84419363bf90fce9b60539b6957c0171cf5c36ead21accba7c5ed645a188 is not running
03-Dec-2024 18:50:36 7e9a84419363
03-Dec-2024 18:50:36 Error response from daemon: Cannot kill container: f4a5c754b2a5: Container f4a5c754b2a5570f752265e8f73425c6a3da96bee3d0a34476ea3dcfd625fa6f is not running
03-Dec-2024 18:50:36 f4a5c754b2a5
03-Dec-2024 18:50:37 febfdc39db11
03-Dec-2024 18:50:37 febfdc39db11
03-Dec-2024 18:50:37 Stalled docker volumes to remove:
03-Dec-2024 18:50:37
03-Dec-2024 18:50:37 Removing stalled docker volumes
03-Dec-2024 18:50:37 Removing stalled loopdevices
03-Dec-2024 18:50:37 Done
03-Dec-2024 18:50:37 Finished task 'Clear env and working dir' with result: Success
03-Dec-2024 18:50:37 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
03-Dec-2024 18:50:37 Running post build plugin 'Docker Container Cleanup'
03-Dec-2024 18:50:37 Running post build plugin 'NCover Results Collector'
03-Dec-2024 18:50:37 Running post build plugin 'Build Results Label Collector'
03-Dec-2024 18:50:37 Running post build plugin 'Clover Results Collector'
03-Dec-2024 18:50:37 Running post build plugin 'npm Cache Cleanup'
03-Dec-2024 18:50:37 Running post build plugin 'Artifact Copier'
03-Dec-2024 18:50:37 Publishing an artifact: test_logs.tar.gz
03-Dec-2024 18:50:37 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 60.13 ms
03-Dec-2024 18:50:38 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRP'
03-Dec-2024 18:50:38 Finalising the build...
03-Dec-2024 18:50:38 Stopping timer.
03-Dec-2024 18:50:38 Build ODSRV-OAP-MRP-3374 completed.
03-Dec-2024 18:50:38 Running on server: post build plugin 'Build Hanging Detection Configuration'
03-Dec-2024 18:50:38 Running on server: post build plugin 'NCover Results Collector'
03-Dec-2024 18:50:38 Running on server: post build plugin 'Build Labeller'
03-Dec-2024 18:50:38 Running on server: post build plugin 'Clover Delta Calculator'
03-Dec-2024 18:50:38 Running on server: post build plugin 'Maven Dependencies Postprocessor'
03-Dec-2024 18:50:38 All post build plugins have finished
03-Dec-2024 18:50:38 Generating build results summary...
03-Dec-2024 18:50:38 Saving build results to disk...
03-Dec-2024 18:50:38 Store variable context...
03-Dec-2024 18:50:38 Finished building ODSRV-OAP-MRP-3374.