oneclient acceptance tests using environment deployed from packages

Build: #3374 failed

Job: multiprovider replication directio was successful

Stages & jobs

  1. Qnthack - copy quarantine

  2. Acceptance Test

  3. Qnthack - rerun

    Final

Build log

The build generated 1,482 lines of output.   The output is too long and has been truncated to the last 1,000 lines. Download or view full build log.

03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:35:04 Adding user `space_owner' ...
03-Dec-2024 18:35:04 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:35:04 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:35:04 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:35:04 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:35:04 Adding user `user1' ...
03-Dec-2024 18:35:04 Adding new group `user1' (25687) ...
03-Dec-2024 18:35:04 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:35:04 Creating home directory `/home/user1' ...
03-Dec-2024 18:35:04 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:35:04 Adding user `user2' ...
03-Dec-2024 18:35:04 Adding new group `user2' (30628) ...
03-Dec-2024 18:35:04 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:35:04 Creating home directory `/home/user2' ...
03-Dec-2024 18:35:04 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-krakow-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'space_owner']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '24849', 'space_owner']
03-Dec-2024 18:35:04 Adding user `space_owner' ...
03-Dec-2024 18:35:04 Adding new group `space_owner' (24849) ...
03-Dec-2024 18:35:04 Adding new user `space_owner' (24849) with group `space_owner' ...
03-Dec-2024 18:35:04 Creating home directory `/home/space_owner' ...
03-Dec-2024 18:35:04 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user1']
03-Dec-2024 18:35:04 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '25687', 'user1']
03-Dec-2024 18:35:04 id: ‘user2’: no such user
03-Dec-2024 18:35:04 command terminated with exit code 1
03-Dec-2024 18:35:05 command terminated with exit code 1
03-Dec-2024 18:35:08 command terminated with exit code 1
03-Dec-2024 18:35:10 command terminated with exit code 1
03-Dec-2024 18:35:50 Adding user `user1' ...
03-Dec-2024 18:35:50 Adding new group `user1' (25687) ...
03-Dec-2024 18:35:50 Adding new user `user1' (25687) with group `user1' ...
03-Dec-2024 18:35:50 Creating home directory `/home/user1' ...
03-Dec-2024 18:35:50 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'id', '-u', 'user2']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'adduser', '--disabled-password', '--gecos', '""', '--uid', '30628', 'user2']
03-Dec-2024 18:35:50 Adding user `user2' ...
03-Dec-2024 18:35:50 Adding new group `user2' (30628) ...
03-Dec-2024 18:35:50 Adding new user `user2' (30628) with group `user2' ...
03-Dec-2024 18:35:50 Creating home directory `/home/user2' ...
03-Dec-2024 18:35:50 Copying files from `/etc/skel' ...
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space1', '/etc/group']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '54356', 'space1']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user1']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space1', 'user2']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'space2', '/etc/group']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '55062', 'space2']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user1']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'space2', 'user2']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'grep', '-q', 'fuse', '/etc/group']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'groupadd', '-g', '46411', 'fuse']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user1']
03-Dec-2024 18:35:50 Running command: ['kubectl', 'exec', 'dev-oneprovider-paris-0', '--', 'usermod', '-a', '-G', 'fuse', 'user2']
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 =================================================================
03-Dec-2024 18:35:50 - Executing scenario 'Create files on one provider and see them on the other provider'
03-Dec-2024 18:35:50 - from feature 'Multiprovider_replication'
03-Dec-2024 18:35:50 -----------------------------------------------------------------
03-Dec-2024 18:35:50 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:35:50 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:35:50 using [token, token] by [user1, user2]"'
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:35:50 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/cxirn767onwat14z
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/cxirn767onwat14z --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/cxirn767onwat14z
03-Dec-2024 18:35:50 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '18085263287513360380'...
03-Dec-2024 18:35:50 Getting configuration...
03-Dec-2024 18:35:50 Oneclient has been successfully mounted in '/tmp/onedata/mnt/cxirn767onwat14z'.
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:35:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:35:50 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/1giwmf5h3m8nmiov
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/1giwmf5h3m8nmiov --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/1giwmf5h3m8nmiov
03-Dec-2024 18:35:50 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '11348037284438131156'...
03-Dec-2024 18:35:50 Getting configuration...
03-Dec-2024 18:35:50 Oneclient has been successfully mounted in '/tmp/onedata/mnt/1giwmf5h3m8nmiov'.
03-Dec-2024 18:35:50
03-Dec-2024 18:35:50 -- Executing step: 'When "user1 creates regular files [space1/file1, space1/file2, space1/file3] on client11"'
03-Dec-2024 18:35:50 -- Executing step: 'Then "user2 can stat [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:35:50 -- Executing step: 'Then "user2 sees [file1, file2, file3] in space1 on client21"'
03-Dec-2024 18:35:50 =================================================================
03-Dec-2024 18:35:50
03-Dec-2024 18:35:51 PASSED
03-Dec-2024 18:35:51 Unmounting client from /tmp/onedata/mnt/cxirn767onwat14z
03-Dec-2024 18:35:51
03-Dec-2024 18:35:51
03-Dec-2024 18:35:51 Unmounting client from /tmp/onedata/mnt/1giwmf5h3m8nmiov
03-Dec-2024 18:35:51
03-Dec-2024 18:35:51
03-Dec-2024 18:36:25 tests/oneclient/scenarios/test_multiprovider_replication.py::test_create_empty_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:36:25 =================================================================
03-Dec-2024 18:36:25 - Executing scenario 'Create empty file on one provider and read it on the other provider'
03-Dec-2024 18:36:25 - from feature 'Multiprovider_replication'
03-Dec-2024 18:36:25 -----------------------------------------------------------------
03-Dec-2024 18:36:25 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:36:25 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:36:25 using [token, token] by [user1, user2]"'
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:36:25 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/xi6cfxr3eyy68i2o
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/xi6cfxr3eyy68i2o --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/xi6cfxr3eyy68i2o
03-Dec-2024 18:36:25 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '15966886309954508817'...
03-Dec-2024 18:36:25 Getting configuration...
03-Dec-2024 18:36:25 Oneclient has been successfully mounted in '/tmp/onedata/mnt/xi6cfxr3eyy68i2o'.
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:36:25 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:36:25 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/a3wb17cvf5wewb00
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/a3wb17cvf5wewb00 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/a3wb17cvf5wewb00
03-Dec-2024 18:36:25 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '6164982927434567728'...
03-Dec-2024 18:36:25 Getting configuration...
03-Dec-2024 18:36:25 Oneclient has been successfully mounted in '/tmp/onedata/mnt/a3wb17cvf5wewb00'.
03-Dec-2024 18:36:25
03-Dec-2024 18:36:25 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:36:25 -- Executing step: 'Then "user2 reads "" from file space1/file on client21"'
03-Dec-2024 18:36:25 =================================================================
03-Dec-2024 18:36:25
03-Dec-2024 18:36:26 PASSED
03-Dec-2024 18:36:26 Unmounting client from /tmp/onedata/mnt/xi6cfxr3eyy68i2o
03-Dec-2024 18:36:26
03-Dec-2024 18:36:26
03-Dec-2024 18:36:26 Unmounting client from /tmp/onedata/mnt/a3wb17cvf5wewb00
03-Dec-2024 18:36:26
03-Dec-2024 18:36:26
03-Dec-2024 18:36:58 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_check_size[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:36:58 =================================================================
03-Dec-2024 18:36:58 - Executing scenario 'Write to file on one provider and check size on the other provider'
03-Dec-2024 18:36:58 - from feature 'Multiprovider_replication'
03-Dec-2024 18:36:58 -----------------------------------------------------------------
03-Dec-2024 18:36:58 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:36:58 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:36:58 using [token, token] by [user1, user2]"'
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:36:58 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/05t1tcd02ur2dgao
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/05t1tcd02ur2dgao --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/05t1tcd02ur2dgao
03-Dec-2024 18:36:58 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '8834725354893833159'...
03-Dec-2024 18:36:58 Getting configuration...
03-Dec-2024 18:36:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/05t1tcd02ur2dgao'.
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:36:58 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:36:58 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/qxcishhuj1zss8tk
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/qxcishhuj1zss8tk --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/qxcishhuj1zss8tk
03-Dec-2024 18:36:58 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '17968102088111859594'...
03-Dec-2024 18:36:58 Getting configuration...
03-Dec-2024 18:36:58 Oneclient has been successfully mounted in '/tmp/onedata/mnt/qxcishhuj1zss8tk'.
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 -- Executing step: 'When "user1 creates regular files [space1/file] on client11"'
03-Dec-2024 18:36:58 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:36:58 -- Executing step: 'Then "size of user1's space1/file1 is 17 bytes on client11"'
03-Dec-2024 18:36:58 -- Executing step: 'Then "size of user2's space1/file1 is 17 bytes on client21"'
03-Dec-2024 18:36:58 =================================================================
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 PASSED
03-Dec-2024 18:36:58 Unmounting client from /tmp/onedata/mnt/05t1tcd02ur2dgao
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58 Unmounting client from /tmp/onedata/mnt/qxcishhuj1zss8tk
03-Dec-2024 18:36:58
03-Dec-2024 18:36:58
03-Dec-2024 18:37:31 tests/oneclient/scenarios/test_multiprovider_replication.py::test_write_and_read[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:37:31 =================================================================
03-Dec-2024 18:37:31 - Executing scenario 'Write to file on one provider and read on the other provider'
03-Dec-2024 18:37:31 - from feature 'Multiprovider_replication'
03-Dec-2024 18:37:31 -----------------------------------------------------------------
03-Dec-2024 18:37:31 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:37:31 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:37:31 using [token, token] by [user1, user2]"'
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:37:31 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/oudgvq9c54nfygx4
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/oudgvq9c54nfygx4 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/oudgvq9c54nfygx4
03-Dec-2024 18:37:31 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '18393251862515240520'...
03-Dec-2024 18:37:31 Getting configuration...
03-Dec-2024 18:37:31 Oneclient has been successfully mounted in '/tmp/onedata/mnt/oudgvq9c54nfygx4'.
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:37:31 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:37:31 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/krmynjrwcq8si293
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/krmynjrwcq8si293 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/krmynjrwcq8si293
03-Dec-2024 18:37:31 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '14505085006383342099'...
03-Dec-2024 18:37:31 Getting configuration...
03-Dec-2024 18:37:31 Oneclient has been successfully mounted in '/tmp/onedata/mnt/krmynjrwcq8si293'.
03-Dec-2024 18:37:31
03-Dec-2024 18:37:31 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:37:31 -- Executing step: 'When "user1 writes "TEST TEXT ONEDATA" to space1/file1 on client11"'
03-Dec-2024 18:37:31 -- Executing step: 'Then "user2 reads "TEST TEXT ONEDATA" from file space1/file1 on client21"'
03-Dec-2024 18:37:31 =================================================================
03-Dec-2024 18:37:31
03-Dec-2024 18:37:32 PASSED
03-Dec-2024 18:37:32 Unmounting client from /tmp/onedata/mnt/oudgvq9c54nfygx4
03-Dec-2024 18:37:32
03-Dec-2024 18:37:32
03-Dec-2024 18:37:32 Unmounting client from /tmp/onedata/mnt/krmynjrwcq8si293
03-Dec-2024 18:37:32
03-Dec-2024 18:37:32
03-Dec-2024 18:38:05 tests/oneclient/scenarios/test_multiprovider_replication.py::test_big_transfer_and_md5_check[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:38:05 =================================================================
03-Dec-2024 18:38:05 - Executing scenario 'Big file transfer with MD5 check'
03-Dec-2024 18:38:05 - from feature 'Multiprovider_replication'
03-Dec-2024 18:38:05 -----------------------------------------------------------------
03-Dec-2024 18:38:05 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:38:05 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:38:05 using [token, token] by [user1, user2]"'
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:38:05 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/nfaiz36z64m7qo49
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/nfaiz36z64m7qo49 --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/nfaiz36z64m7qo49
03-Dec-2024 18:38:05 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '15266510706354833490'...
03-Dec-2024 18:38:05 Getting configuration...
03-Dec-2024 18:38:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/nfaiz36z64m7qo49'.
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:38:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:38:05 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/y13t9lxn3yxz3xrg
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/y13t9lxn3yxz3xrg --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/y13t9lxn3yxz3xrg
03-Dec-2024 18:38:05 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '14975132826165386857'...
03-Dec-2024 18:38:05 Getting configuration...
03-Dec-2024 18:38:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/y13t9lxn3yxz3xrg'.
03-Dec-2024 18:38:05
03-Dec-2024 18:38:05 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:38:05 -- Executing step: 'When "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:38:05 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:38:05 -- Executing step: 'Then "user1 writes 8 MB of random characters to space1/file1 on client11 and saves MD5"'
03-Dec-2024 18:38:05 -- Executing step: 'Then "user2 checks MD5 of space1/file1 on client21"'
03-Dec-2024 18:38:05 =================================================================
03-Dec-2024 18:38:05
03-Dec-2024 18:38:06 PASSED
03-Dec-2024 18:38:06 Unmounting client from /tmp/onedata/mnt/nfaiz36z64m7qo49
03-Dec-2024 18:38:06
03-Dec-2024 18:38:06
03-Dec-2024 18:38:06 Unmounting client from /tmp/onedata/mnt/y13t9lxn3yxz3xrg
03-Dec-2024 18:38:06
03-Dec-2024 18:38:06
03-Dec-2024 18:39:27 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_override[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:39:27 =================================================================
03-Dec-2024 18:39:27 - Executing scenario 'Create nonempty file on one provider and override its contents on the other provider'
03-Dec-2024 18:39:27 - from feature 'Multiprovider_replication'
03-Dec-2024 18:39:27 -----------------------------------------------------------------
03-Dec-2024 18:39:27 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:39:27 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:39:27 using [token, token] by [user1, user2]"'
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:39:27 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/yqmbaie7afsbrl6h
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/yqmbaie7afsbrl6h --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/yqmbaie7afsbrl6h
03-Dec-2024 18:39:27 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '13923986781344211807'...
03-Dec-2024 18:39:27 Getting configuration...
03-Dec-2024 18:39:27 Oneclient has been successfully mounted in '/tmp/onedata/mnt/yqmbaie7afsbrl6h'.
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:39:27 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:39:27 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/yr35p109pda9wqaq
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/yr35p109pda9wqaq --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/yr35p109pda9wqaq
03-Dec-2024 18:39:27 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '17809303249387139391'...
03-Dec-2024 18:39:27 Getting configuration...
03-Dec-2024 18:39:27 Oneclient has been successfully mounted in '/tmp/onedata/mnt/yr35p109pda9wqaq'.
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:39:27 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user2 reads "123456789" from file space1/file1 on client21"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user2 writes "abcd" to space1/file1 on client21"'
03-Dec-2024 18:39:27 -- Executing step: 'When "user1 reads "abcd" from file space1/file1 on client11"'
03-Dec-2024 18:39:27 =================================================================
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 PASSED
03-Dec-2024 18:39:27 Unmounting client from /tmp/onedata/mnt/yqmbaie7afsbrl6h
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27 Unmounting client from /tmp/onedata/mnt/yr35p109pda9wqaq
03-Dec-2024 18:39:27
03-Dec-2024 18:39:27
03-Dec-2024 18:40:07 tests/oneclient/scenarios/test_multiprovider_replication.py::test_remote_file_removal[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:40:07 =================================================================
03-Dec-2024 18:40:07 - Executing scenario 'Create nonempty file on one provider and remove it on the other provider'
03-Dec-2024 18:40:07 - from feature 'Multiprovider_replication'
03-Dec-2024 18:40:07 -----------------------------------------------------------------
03-Dec-2024 18:40:07 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:40:07 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:40:07 using [token, token] by [user1, user2]"'
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:40:07 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/fa8ecikm6haz4xly
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/fa8ecikm6haz4xly --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/fa8ecikm6haz4xly
03-Dec-2024 18:40:07 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '334015711406216665'...
03-Dec-2024 18:40:07 Getting configuration...
03-Dec-2024 18:40:07 Oneclient has been successfully mounted in '/tmp/onedata/mnt/fa8ecikm6haz4xly'.
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:40:07 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:40:07 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/ufam90yhzaoy110g
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/ufam90yhzaoy110g --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/ufam90yhzaoy110g
03-Dec-2024 18:40:07 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '4544773658138666307'...
03-Dec-2024 18:40:07 Getting configuration...
03-Dec-2024 18:40:07 Oneclient has been successfully mounted in '/tmp/onedata/mnt/ufam90yhzaoy110g'.
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:40:07 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:40:07 -- Executing step: 'When "user1 writes "123456789" to space1/file1 on client11"'
03-Dec-2024 18:40:07 -- Executing step: 'When "user1 deletes files [space1/file1] on client11"'
03-Dec-2024 18:40:07 -- Executing step: 'Then "user1 can't stat [file1] in space1 on client11"'
03-Dec-2024 18:40:07 -- Executing step: 'Then "user2 can't stat [file1] in space1 on client21"'
03-Dec-2024 18:40:07 -- Executing step: 'Then "user1 doesn't see [file1] in space1 on client11"'
03-Dec-2024 18:40:07 -- Executing step: 'Then "user2 doesn't see [file1] in space1 on client21"'
03-Dec-2024 18:40:07 =================================================================
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 PASSED
03-Dec-2024 18:40:07 Unmounting client from /tmp/onedata/mnt/fa8ecikm6haz4xly
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07 Unmounting client from /tmp/onedata/mnt/ufam90yhzaoy110g
03-Dec-2024 18:40:07
03-Dec-2024 18:40:07
03-Dec-2024 18:41:05 tests/oneclient/scenarios/test_multiprovider_replication.py::test_sequential_appends[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:41:05 =================================================================
03-Dec-2024 18:41:05 - Executing scenario 'Create nonempty file, append remotely, append locally and read both'
03-Dec-2024 18:41:05 - from feature 'Multiprovider_replication'
03-Dec-2024 18:41:05 -----------------------------------------------------------------
03-Dec-2024 18:41:05 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:41:05 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:41:05 using [token, token] by [user1, user2]"'
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:41:05 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/dtk4jr897a9ba07x
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/dtk4jr897a9ba07x --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/dtk4jr897a9ba07x
03-Dec-2024 18:41:05 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '11107068401797697582'...
03-Dec-2024 18:41:05 Getting configuration...
03-Dec-2024 18:41:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/dtk4jr897a9ba07x'.
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:41:05 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:41:05 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/mqnfiy294stwsvlr
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/mqnfiy294stwsvlr --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/mqnfiy294stwsvlr
03-Dec-2024 18:41:05 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '7992471654907307076'...
03-Dec-2024 18:41:05 Getting configuration...
03-Dec-2024 18:41:05 Oneclient has been successfully mounted in '/tmp/onedata/mnt/mqnfiy294stwsvlr'.
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user1 writes "a" to space1/file1 on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user2 can stat [file1] in space1 on client21"'
03-Dec-2024 18:41:05 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user2 reads "a" from file space1/file1 on client21"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user2 appends "b" to space1/file1 on client21"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user1 reads "ab" from file space1/file1 on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'When "user1 appends "c" to space1/file1 on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'Then "user1 reads "abc" from file space1/file1 on client11"'
03-Dec-2024 18:41:05 -- Executing step: 'Then "user2 reads "abc" from file space1/file1 on client21"'
03-Dec-2024 18:41:05 =================================================================
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 PASSED
03-Dec-2024 18:41:05 Unmounting client from /tmp/onedata/mnt/dtk4jr897a9ba07x
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05 Unmounting client from /tmp/onedata/mnt/mqnfiy294stwsvlr
03-Dec-2024 18:41:05
03-Dec-2024 18:41:05
03-Dec-2024 18:41:50 tests/oneclient/scenarios/test_multiprovider_replication.py::test_conflict_on_disjoint_blocks[multiprovider_directio_env] <- ../../../../../../../../usr/local/lib/python3.12/dist-packages/pytest_bdd/scenario.py
03-Dec-2024 18:41:50 =================================================================
03-Dec-2024 18:41:50 - Executing scenario 'Concurrently write disjoint ranges and read the same on both providers'
03-Dec-2024 18:41:50 - from feature 'Multiprovider_replication'
03-Dec-2024 18:41:50 -----------------------------------------------------------------
03-Dec-2024 18:41:50 -- Executing step: 'Given "oneclients [client11, client21]
03-Dec-2024 18:41:50 mounted on client_hosts [oneclient-1, oneclient-2] respectively,
03-Dec-2024 18:41:50 using [token, token] by [user1, user2]"'
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-krakow-7d9476b8bc-78mrv', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 starting rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv'
03-Dec-2024 18:41:50 rpyc server for user 'user1' on client host 'dev-oneclient-krakow-7d9476b8bc-78mrv' successfully started
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/0x5npu7uamvbejsg
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/0x5npu7uamvbejsg --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/0x5npu7uamvbejsg
03-Dec-2024 18:41:50 Connecting to provider 'dev-oneprovider-krakow.default.svc.cluster.local:443' using session ID: '14223968577001614413'...
03-Dec-2024 18:41:50 Getting configuration...
03-Dec-2024 18:41:50 Oneclient has been successfully mounted in '/tmp/onedata/mnt/0x5npu7uamvbejsg'.
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/onedata/mnt']
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/rpyc_logs']
03-Dec-2024 18:41:50 Running command: ['./onenv', 'exec', 'dev-oneclient-paris-5cc45c8cb7-l9x5z', '--', 'mkdir', '-p', '-m 777', '/tmp/logs/oc_logs']
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 starting rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z'
03-Dec-2024 18:41:50 rpyc server for user 'user2' on client host 'dev-oneclient-paris-5cc45c8cb7-l9x5z' successfully started
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 Mounting client with --force-direct-io flag in /tmp/onedata/mnt/d7hi2b5q75jlusfh
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 rpyc running command: oneclient --log-dir /tmp/logs/oc_logs/d7hi2b5q75jlusfh --force-direct-io -v2 --insecure --message-trace-log /tmp/onedata/mnt/d7hi2b5q75jlusfh
03-Dec-2024 18:41:50 Connecting to provider 'dev-oneprovider-paris.default.svc.cluster.local:443' using session ID: '1260530371272154470'...
03-Dec-2024 18:41:50 Getting configuration...
03-Dec-2024 18:41:50 Oneclient has been successfully mounted in '/tmp/onedata/mnt/d7hi2b5q75jlusfh'.
03-Dec-2024 18:41:50
03-Dec-2024 18:41:50 -- Executing step: 'When "user1 creates regular files [space1/file1] on client11"'
03-Dec-2024 18:41:50 -- Executing step: 'When "user2 sees [file1] in space1 on client21"'
03-Dec-2024 18:41:50 -- Executing step: 'When "user1 changes space1/file1 mode to 666 on client11"'
03-Dec-2024 18:41:50 -- Executing step: 'When "mode of user2's space1/file1 is 666 on client21"'
03-Dec-2024 18:41:50 -- Executing step: 'When "user2 writes "defg" at offset 3 to space1/file1 on client21"'
03-Dec-2024 18:41:50 -- Executing step: 'When "user1 writes "abc" at offset 0 to space1/file1 on client11"'
03-Dec-2024 18:41:50 -- Executing step: 'Then "user1 reads "abcdefg" from file space1/file1 on client11"'
03-Dec-2024 18:41:50 -- Executing step: 'Then "user2 reads "abcdefg" from file space1/file1 on client21"'
03-Dec-2024 18:41:50 =================================================================
03-Dec-2024 18:41:50
03-Dec-2024 18:42:01 PASSED
03-Dec-2024 18:42:01 Unmounting client from /tmp/onedata/mnt/0x5npu7uamvbejsg
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 Unmounting client from /tmp/onedata/mnt/d7hi2b5q75jlusfh
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:42:01 Defaulted container "oneclient" out of: oneclient, wait-for-onezone (init), wait-for-token-dispenser (init)
03-Dec-2024 18:42:01 Running command: ['./onenv', 'export', '/mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1733251311.0492423', '-c', '/tmp/logs']
03-Dec-2024 18:42:01 [WARNING] Couldn't get entrypoint logs for pod dev-cross-support-job-3p-users-ptvxg. See /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-cross-support-job-3p-users-ptvxg/entrypoint.log for more details
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneclient-krakow-7d9476b8bc-78mrv: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneclient-krakow-7d9476b8bc-78mrv/oneclient_logs
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=65/80)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          26,478   1%   25.25MB/s    0:00:00 (xfr#1, to-chk=64/80)
03-Dec-2024 18:42:01          26,478   1%   25.25MB/s    0:00:00 (xfr#1, to-chk=58/80)
03-Dec-2024 18:42:01          27,324   1%   26.06MB/s    0:00:00 (xfr#2, to-chk=60/80)
03-Dec-2024 18:42:01         109,319   5%  104.25MB/s    0:00:00 (xfr#3, to-chk=59/80)
03-Dec-2024 18:42:01         110,165   5%  105.06MB/s    0:00:00 (xfr#4, to-chk=58/80)
03-Dec-2024 18:42:01         110,793   5%  105.66MB/s    0:00:00 (xfr#5, to-chk=57/80)
03-Dec-2024 18:42:01         166,203   8%   31.70MB/s    0:00:00 (xfr#6, to-chk=56/80)
03-Dec-2024 18:42:01         166,761   8%   31.81MB/s    0:00:00 (xfr#7, to-chk=52/80)
03-Dec-2024 18:42:01         348,156  17%   41.50MB/s    0:00:00 (xfr#8, to-chk=51/80)
03-Dec-2024 18:42:01         348,714  18%   36.95MB/s    0:00:00 (xfr#9, to-chk=50/80)
03-Dec-2024 18:42:01         372,613  19%   39.48MB/s    0:00:00 (xfr#10, to-chk=49/80)
03-Dec-2024 18:42:01         373,075  19%   39.53MB/s    0:00:00 (xfr#11, to-chk=45/80)
03-Dec-2024 18:42:01         449,994  23%   42.91MB/s    0:00:00 (xfr#12, to-chk=44/80)
03-Dec-2024 18:42:01         450,456  23%   39.05MB/s    0:00:00 (xfr#13, to-chk=43/80)
03-Dec-2024 18:42:01         549,066  28%   34.91MB/s    0:00:00 (xfr#14, to-chk=42/80)
03-Dec-2024 18:42:01         549,528  28%   34.94MB/s    0:00:00 (xfr#15, to-chk=38/80)
03-Dec-2024 18:42:01         899,672  46%   40.86MB/s    0:00:00 (xfr#16, to-chk=37/80)
03-Dec-2024 18:42:01         900,134  46%   40.88MB/s    0:00:00 (xfr#17, to-chk=36/80)
03-Dec-2024 18:42:01         928,181  47%   40.24MB/s    0:00:00 (xfr#18, to-chk=35/80)
03-Dec-2024 18:42:01         928,451  47%   40.25MB/s    0:00:00 (xfr#19, to-chk=31/80)
03-Dec-2024 18:42:01       1,007,446  52%   35.58MB/s    0:00:00 (xfr#20, to-chk=30/80)
03-Dec-2024 18:42:01       1,007,716  52%   35.59MB/s    0:00:00 (xfr#21, to-chk=29/80)
03-Dec-2024 18:42:01       1,041,132  53%   34.24MB/s    0:00:00 (xfr#22, to-chk=28/80)
03-Dec-2024 18:42:01       1,041,594  53%   34.25MB/s    0:00:00 (xfr#23, to-chk=24/80)
03-Dec-2024 18:42:01       1,307,641  67%   36.68MB/s    0:00:00 (xfr#24, to-chk=23/80)
03-Dec-2024 18:42:01       1,308,103  67%   36.69MB/s    0:00:00 (xfr#25, to-chk=22/80)
03-Dec-2024 18:42:01       1,335,272  68%   37.45MB/s    0:00:00 (xfr#26, to-chk=21/80)
03-Dec-2024 18:42:01       1,335,638  68%   37.46MB/s    0:00:00 (xfr#27, to-chk=17/80)
03-Dec-2024 18:42:01       1,414,881  73%   33.73MB/s    0:00:00 (xfr#28, to-chk=16/80)
03-Dec-2024 18:42:01       1,415,247  73%   33.74MB/s    0:00:00 (xfr#29, to-chk=15/80)
03-Dec-2024 18:42:01       1,432,266  73%   34.15MB/s    0:00:00 (xfr#30, to-chk=14/80)
03-Dec-2024 18:42:01       1,432,632  73%   34.16MB/s    0:00:00 (xfr#31, to-chk=10/80)
03-Dec-2024 18:42:01       1,491,583  77%   33.87MB/s    0:00:00 (xfr#32, to-chk=9/80)
03-Dec-2024 18:42:01       1,491,949  77%   33.88MB/s    0:00:00 (xfr#33, to-chk=8/80)
03-Dec-2024 18:42:01       1,588,033  81%   34.42MB/s    0:00:00 (xfr#34, to-chk=7/80)
03-Dec-2024 18:42:01       1,588,495  82%   34.43MB/s    0:00:00 (xfr#35, to-chk=3/80)
03-Dec-2024 18:42:01       1,922,306  99%   37.41MB/s    0:00:00 (xfr#36, to-chk=2/80)
03-Dec-2024 18:42:01       1,922,768  99%   37.42MB/s    0:00:00 (xfr#37, to-chk=1/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   37.67MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   36.92MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01       1,935,617  99%   36.92MB/s    0:00:00 (xfr#38, to-chk=0/80)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneclient-paris-5cc45c8cb7-l9x5z: /tmp/logs -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneclient-paris-5cc45c8cb7-l9x5z/oneclient_logs
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=67/82)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          27,162   1%   25.90MB/s    0:00:00 (xfr#1, to-chk=66/82)
03-Dec-2024 18:42:01          27,162   1%   25.90MB/s    0:00:00 (xfr#1, to-chk=60/82)
03-Dec-2024 18:42:01          27,432   1%   26.16MB/s    0:00:00 (xfr#2, to-chk=62/82)
03-Dec-2024 18:42:01         139,869   7%   16.67MB/s    0:00:00 (xfr#3, to-chk=61/82)
03-Dec-2024 18:42:01         140,139   7%   16.71MB/s    0:00:00 (xfr#4, to-chk=60/82)
03-Dec-2024 18:42:01         163,787   8%   17.36MB/s    0:00:00 (xfr#5, to-chk=59/82)
03-Dec-2024 18:42:01         164,153   8%   17.39MB/s    0:00:00 (xfr#6, to-chk=55/82)
03-Dec-2024 18:42:01         240,430  13%   16.38MB/s    0:00:00 (xfr#7, to-chk=54/82)
03-Dec-2024 18:42:01         240,796  13%   16.40MB/s    0:00:00 (xfr#8, to-chk=53/82)
03-Dec-2024 18:42:01         274,588  14%   13.78MB/s    0:00:00 (xfr#9, to-chk=52/82)
03-Dec-2024 18:42:01         275,050  14%   13.81MB/s    0:00:00 (xfr#10, to-chk=48/82)
03-Dec-2024 18:42:01         423,676  23%   17.57MB/s    0:00:00 (xfr#11, to-chk=47/82)
03-Dec-2024 18:42:01         424,138  23%   17.59MB/s    0:00:00 (xfr#12, to-chk=46/82)
03-Dec-2024 18:42:01         424,766  23%   16.20MB/s    0:00:00 (xfr#13, to-chk=45/82)
03-Dec-2024 18:42:01         455,334  24%   12.77MB/s    0:00:00 (xfr#14, to-chk=44/82)
03-Dec-2024 18:42:01         455,796  24%   12.78MB/s    0:00:00 (xfr#15, to-chk=40/82)
03-Dec-2024 18:42:01         544,513  29%   12.08MB/s    0:00:00 (xfr#16, to-chk=39/82)
03-Dec-2024 18:42:01         544,975  29%   12.09MB/s    0:00:00 (xfr#17, to-chk=38/82)
03-Dec-2024 18:42:01         545,603  29%   12.10MB/s    0:00:00 (xfr#18, to-chk=37/82)
03-Dec-2024 18:42:01         619,816  33%   12.06MB/s    0:00:00 (xfr#19, to-chk=36/82)
03-Dec-2024 18:42:01         620,470  33%   12.08MB/s    0:00:00 (xfr#20, to-chk=32/82)
03-Dec-2024 18:42:01         878,123  47%   11.47MB/s    0:00:00 (xfr#21, to-chk=31/82)
03-Dec-2024 18:42:01         878,777  47%   11.33MB/s    0:00:00 (xfr#22, to-chk=30/82)
03-Dec-2024 18:42:01         899,447  48%   11.59MB/s    0:00:00 (xfr#23, to-chk=29/82)
03-Dec-2024 18:42:01         900,005  48%   11.60MB/s    0:00:00 (xfr#24, to-chk=25/82)
03-Dec-2024 18:42:01         974,708  52%   12.07MB/s    0:00:00 (xfr#25, to-chk=24/82)
03-Dec-2024 18:42:01         975,266  52%   12.08MB/s    0:00:00 (xfr#26, to-chk=23/82)
03-Dec-2024 18:42:01         975,894  52%   12.09MB/s    0:00:00 (xfr#27, to-chk=22/82)
03-Dec-2024 18:42:01         994,158  53%   12.31MB/s    0:00:00 (xfr#28, to-chk=21/82)
03-Dec-2024 18:42:01         994,524  53%   12.16MB/s    0:00:00 (xfr#29, to-chk=17/82)
03-Dec-2024 18:42:01       1,100,915  59%   11.93MB/s    0:00:00 (xfr#30, to-chk=16/82)
03-Dec-2024 18:42:01       1,101,281  59%   11.93MB/s    0:00:00 (xfr#31, to-chk=15/82)
03-Dec-2024 18:42:01       1,153,262  62%   11.58MB/s    0:00:00 (xfr#32, to-chk=14/82)
03-Dec-2024 18:42:01       1,153,820  62%   11.58MB/s    0:00:00 (xfr#33, to-chk=10/82)
03-Dec-2024 18:42:01       1,368,396  74%   11.35MB/s    0:00:00 (xfr#34, to-chk=9/82)
03-Dec-2024 18:42:01       1,368,954  74%   11.35MB/s    0:00:00 (xfr#35, to-chk=8/82)
03-Dec-2024 18:42:01       1,460,270  79%   11.80MB/s    0:00:00 (xfr#36, to-chk=7/82)
03-Dec-2024 18:42:01       1,460,828  79%   11.81MB/s    0:00:00 (xfr#37, to-chk=3/82)
03-Dec-2024 18:42:01       1,810,781  98%   11.14MB/s    0:00:00 (xfr#38, to-chk=2/82)
03-Dec-2024 18:42:01       1,811,339  98%   11.14MB/s    0:00:00 (xfr#39, to-chk=1/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   11.25MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   10.26MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01       1,840,248  99%   10.26MB/s    0:00:00 (xfr#40, to-chk=0/82)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-krakow-0/op-panel
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          18,169  16%   17.33MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01          37,278  33%   35.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01          37,278  33%   35.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01          55,244  49%   52.68MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01          55,535  50%   52.96MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01          55,535  50%   10.59MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-krakow-0/cluster-manager
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01           2,022  14%    1.93MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01           4,776  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01           4,776  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01           6,595  48%    6.29MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01           6,857  50%    6.54MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-krakow-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-krakow-0/op-worker
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          30,404   9%   29.00MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:42:01          48,334  15%   46.09MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:42:01          48,334  15%   23.05MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:42:01          48,334  15%   23.05MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:42:01          65,136  21%   31.06MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:42:01          65,285  21%   31.13MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:42:01          65,582  21%   31.27MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:42:01         122,298  40%   58.32MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:42:01         122,458  40%   58.39MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:42:01         123,783  40%   39.35MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:42:01         123,945  40%   39.40MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:42:01         124,105  40%   39.45MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:42:01         124,421  40%   39.55MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:42:01         125,049  41%   39.75MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:42:01         125,365  41%   39.85MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:42:01         125,993  41%   40.05MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:42:01         126,314  41%   40.15MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:42:01         126,630  41%   40.25MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:42:01         126,946  41%   40.36MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:42:01         127,415  41%   40.50MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:42:01         128,376  42%   30.61MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:42:01         129,160  42%   30.79MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:42:01         129,785  42%   30.94MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:42:01         131,669  43%   31.39MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:42:01         132,141  43%   31.50MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:42:01         132,303  43%   31.54MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:42:01         136,042  44%   32.43MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:42:01         137,179  45%   32.71MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:42:01         140,120  46%   33.41MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:42:01         143,460  47%   34.20MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:42:01         148,111  48%   35.31MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:42:01         149,342  49%   35.61MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:42:01         150,972  49%   28.80MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:42:01         155,016  50%   29.57MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:42:01         157,558  51%   30.05MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:42:01         162,152  53%   30.93MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:42:01         162,704  53%   31.03MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:42:01         166,349  54%   31.73MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:42:01         166,802  54%   31.81MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:42:01         168,395  55%   32.12MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:42:01         171,299  56%   32.67MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:42:01         173,804  57%   27.63MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:42:01         177,107  58%   28.15MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:42:01         181,193  59%   28.80MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:42:01         181,479  59%   28.85MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:42:01         181,765  59%   28.89MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         181,765  59%   24.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         181,765  59%   24.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         181,765  59%   24.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         181,765  59%   24.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         181,765  59%   24.76MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-paris-0/op-panel
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          17,656  16%   16.84MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01          36,248  33%   34.57MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01          36,334  33%   34.65MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01          53,787  49%   51.30MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01          54,078  50%   51.57MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01          54,078  50%   51.57MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-paris-0/cluster-manager
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01           2,018  14%    1.92MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01           4,766  34%    4.55MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01           4,766  34%    4.55MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01           6,581  48%    6.28MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01           6,843  50%    6.53MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-oneprovider-paris-0: /volumes/persistence/var/log/op_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-oneprovider-paris-0/op-worker
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=69/72)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          41,667  12%   39.74MB/s    0:00:00 (xfr#2, to-chk=67/72)
03-Dec-2024 18:42:01          59,345  18%   56.60MB/s    0:00:00 (xfr#3, to-chk=65/72)
03-Dec-2024 18:42:01          59,345  18%   56.60MB/s    0:00:00 (xfr#4, to-chk=63/72)
03-Dec-2024 18:42:01          59,345  18%   56.60MB/s    0:00:00 (xfr#5, to-chk=61/72)
03-Dec-2024 18:42:01          75,902  23%   72.39MB/s    0:00:00 (xfr#6, to-chk=59/72)
03-Dec-2024 18:42:01          76,051  23%   72.53MB/s    0:00:00 (xfr#7, to-chk=57/72)
03-Dec-2024 18:42:01          76,348  23%   72.81MB/s    0:00:00 (xfr#8, to-chk=51/72)
03-Dec-2024 18:42:01         133,575  40%  127.39MB/s    0:00:00 (xfr#9, to-chk=49/72)
03-Dec-2024 18:42:01         133,857  40%   63.83MB/s    0:00:00 (xfr#10, to-chk=39/72)
03-Dec-2024 18:42:01         135,445  41%   64.59MB/s    0:00:00 (xfr#11, to-chk=38/72)
03-Dec-2024 18:42:01         135,727  41%   64.72MB/s    0:00:00 (xfr#12, to-chk=37/72)
03-Dec-2024 18:42:01         136,009  41%   64.85MB/s    0:00:00 (xfr#13, to-chk=36/72)
03-Dec-2024 18:42:01         136,661  41%   65.17MB/s    0:00:00 (xfr#14, to-chk=35/72)
03-Dec-2024 18:42:01         137,251  41%   65.45MB/s    0:00:00 (xfr#15, to-chk=34/72)
03-Dec-2024 18:42:01         137,531  41%   65.58MB/s    0:00:00 (xfr#16, to-chk=33/72)
03-Dec-2024 18:42:01         138,339  42%   65.97MB/s    0:00:00 (xfr#17, to-chk=32/72)
03-Dec-2024 18:42:01         138,619  42%   66.10MB/s    0:00:00 (xfr#18, to-chk=31/72)
03-Dec-2024 18:42:01         138,897  42%   66.23MB/s    0:00:00 (xfr#19, to-chk=30/72)
03-Dec-2024 18:42:01         139,178  42%   66.37MB/s    0:00:00 (xfr#20, to-chk=29/72)
03-Dec-2024 18:42:01         139,842  42%   66.68MB/s    0:00:00 (xfr#21, to-chk=28/72)
03-Dec-2024 18:42:01         141,041  42%   44.84MB/s    0:00:00 (xfr#22, to-chk=27/72)
03-Dec-2024 18:42:01         142,005  43%   45.14MB/s    0:00:00 (xfr#23, to-chk=26/72)
03-Dec-2024 18:42:01         142,810  43%   45.40MB/s    0:00:00 (xfr#24, to-chk=25/72)
03-Dec-2024 18:42:01         144,783  44%   46.03MB/s    0:00:00 (xfr#25, to-chk=24/72)
03-Dec-2024 18:42:01         145,588  44%   46.28MB/s    0:00:00 (xfr#26, to-chk=23/72)
03-Dec-2024 18:42:01         145,871  44%   46.37MB/s    0:00:00 (xfr#27, to-chk=22/72)
03-Dec-2024 18:42:01         149,453  45%   47.51MB/s    0:00:00 (xfr#28, to-chk=21/72)
03-Dec-2024 18:42:01         150,590  45%   47.87MB/s    0:00:00 (xfr#29, to-chk=20/72)
03-Dec-2024 18:42:01         153,439  46%   48.78MB/s    0:00:00 (xfr#30, to-chk=19/72)
03-Dec-2024 18:42:01         156,679  47%   49.81MB/s    0:00:00 (xfr#31, to-chk=18/72)
03-Dec-2024 18:42:01         161,228  49%   51.25MB/s    0:00:00 (xfr#32, to-chk=17/72)
03-Dec-2024 18:42:01         162,302  49%   51.59MB/s    0:00:00 (xfr#33, to-chk=16/72)
03-Dec-2024 18:42:01         163,832  49%   39.06MB/s    0:00:00 (xfr#34, to-chk=15/72)
03-Dec-2024 18:42:01         167,876  51%   40.02MB/s    0:00:00 (xfr#35, to-chk=14/72)
03-Dec-2024 18:42:01         170,326  51%   40.61MB/s    0:00:00 (xfr#36, to-chk=13/72)
03-Dec-2024 18:42:01         174,818  53%   41.68MB/s    0:00:00 (xfr#37, to-chk=12/72)
03-Dec-2024 18:42:01         175,208  53%   41.77MB/s    0:00:00 (xfr#38, to-chk=11/72)
03-Dec-2024 18:42:01         178,853  54%   42.64MB/s    0:00:00 (xfr#39, to-chk=10/72)
03-Dec-2024 18:42:01         179,306  54%   42.75MB/s    0:00:00 (xfr#40, to-chk=9/72)
03-Dec-2024 18:42:01         180,899  55%   43.13MB/s    0:00:00 (xfr#41, to-chk=8/72)
03-Dec-2024 18:42:01         183,803  55%   43.82MB/s    0:00:00 (xfr#42, to-chk=7/72)
03-Dec-2024 18:42:01         186,308  56%   44.42MB/s    0:00:00 (xfr#43, to-chk=6/72)
03-Dec-2024 18:42:01         189,611  57%   45.21MB/s    0:00:00 (xfr#44, to-chk=5/72)
03-Dec-2024 18:42:01         193,600  58%   46.16MB/s    0:00:00 (xfr#45, to-chk=4/72)
03-Dec-2024 18:42:01         193,885  59%   36.98MB/s    0:00:00 (xfr#46, to-chk=1/72)
03-Dec-2024 18:42:01         194,170  59%   37.03MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         194,170  59%   26.45MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         194,170  59%   26.45MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         194,170  59%   23.15MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         194,170  59%   23.15MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01         194,170  59%   23.15MB/s    0:00:00 (xfr#47, to-chk=0/72)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_worker -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-onezone-0/oz-worker
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=15/18)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          13,212   6%   12.60MB/s    0:00:00 (xfr#2, to-chk=13/18)
03-Dec-2024 18:42:01          27,019  13%   25.77MB/s    0:00:00 (xfr#3, to-chk=11/18)
03-Dec-2024 18:42:01          27,019  13%   25.77MB/s    0:00:00 (xfr#4, to-chk=9/18)
03-Dec-2024 18:42:01          39,751  20%   37.91MB/s    0:00:00 (xfr#5, to-chk=7/18)
03-Dec-2024 18:42:01          39,841  20%   38.00MB/s    0:00:00 (xfr#6, to-chk=5/18)
03-Dec-2024 18:42:01          40,138  20%   38.28MB/s    0:00:00 (xfr#7, to-chk=3/18)
03-Dec-2024 18:42:01          97,939  50%   93.40MB/s    0:00:00 (xfr#8, to-chk=1/18)
03-Dec-2024 18:42:01          97,939  50%   31.13MB/s    0:00:00 (xfr#8, to-chk=0/18)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/cluster_manager -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-onezone-0/cluster-manager
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01           1,977  14%    1.89MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01           4,664  34%    4.45MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01           4,664  34%    4.45MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01           6,438  48%    6.14MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01           6,700  50%    6.39MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01           6,700  50%    3.19MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [INFO] Rsyncing from pod dev-onezone-0: /volumes/persistence/var/log/oz_panel -> /home/bamboo/.one-env/deployments/2024.12.03-18.32.58/pod-logs/dev-onezone-0/oz-panel
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 (xfr#1, to-chk=11/14)
03-Dec-2024 18:42:01               0   0%    0.00kB/s    0:00:00 
03-Dec-2024 18:42:01          22,482  13%   21.44MB/s    0:00:00 (xfr#2, to-chk=9/14)
03-Dec-2024 18:42:01          45,973  27%   43.84MB/s    0:00:00 (xfr#3, to-chk=7/14)
03-Dec-2024 18:42:01          61,165  36%   58.33MB/s    0:00:00 (xfr#4, to-chk=5/14)
03-Dec-2024 18:42:01          83,444  49%   39.79MB/s    0:00:00 (xfr#5, to-chk=3/14)
03-Dec-2024 18:42:01          83,735  50%   39.93MB/s    0:00:00 (xfr#6, to-chk=1/14)
03-Dec-2024 18:42:01          83,735  50%   26.62MB/s    0:00:00 (xfr#6, to-chk=0/14)
03-Dec-2024 18:42:01 [WARNING] Directory /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/oneclient/logs/multiprovider_directio_env/test_multiprovider_replication.1733251311.0492423 exists, exporting anyway.
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 =============================== warnings summary ===============================
03-Dec-2024 18:42:01 tests/utils/rest_utils.py:97
03-Dec-2024 18:42:01   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/utils/rest_utils.py:97: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:42:01     print("""
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 tests/utils/path_utils.py:112
03-Dec-2024 18:42:01   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/utils/path_utils.py:112: SyntaxWarning: invalid escape sequence '\ '
03-Dec-2024 18:42:01     return path.replace("'", "\\'").replace(' ', '\ ')
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 tests/utils/acceptance_utils.py:55
03-Dec-2024 18:42:01   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/utils/acceptance_utils.py:55: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:42:01     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 tests/utils/acceptance_utils.py:57
03-Dec-2024 18:42:01   /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/tests/utils/acceptance_utils.py:57: SyntaxWarning: invalid escape sequence '\d'
03-Dec-2024 18:42:01     '(?P<seconds>\d*\.?\d+([eE][-+]?\d+)?) seconds?'))
03-Dec-2024 18:42:01
03-Dec-2024 18:42:01 -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
03-Dec-2024 18:42:01 - generated xml file: /mnt/storage/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance/test-reports/results.xml -
03-Dec-2024 18:42:01 ================== 9 passed, 4 warnings in 545.02s (0:09:05) ===================
03-Dec-2024 18:42:05 release "dev" uninstalled
03-Dec-2024 18:42:05 persistentvolumeclaim "local-volume-1-dev-oneprovider-krakow-0" deleted
03-Dec-2024 18:42:05 persistentvolumeclaim "local-volume-1-dev-oneprovider-paris-0" deleted
03-Dec-2024 18:42:07 No resources found
03-Dec-2024 18:42:08 Sidecar injection has been disabled
03-Dec-2024 18:42:08 Cleaning helm release "dev"...
03-Dec-2024 18:42:08 Deleted 1 helm deployments
03-Dec-2024 18:42:08 Deleted 0 k8s deployments
03-Dec-2024 18:42:08 Deleted 0 k8s services
03-Dec-2024 18:42:08 Deleted 0 persistent volumes
03-Dec-2024 18:42:08 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:42:08 [INFO] Using image docker.onedata.org/onezone-dev:develop for service onezone
03-Dec-2024 18:42:08 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:42:08 [INFO] Using image docker.onedata.org/oneprovider-dev:develop for service oneprovider
03-Dec-2024 18:42:08 [INFO] Using image docker.onedata.org/rest-cli:develop for service rest-cli
03-Dec-2024 18:42:08 [INFO] ENV variable "bamboo_planRepository_branchName" is set to develop - using it as current branch name
03-Dec-2024 18:42:08 [INFO] Using image docker.onedata.org/oneclient-dev:develop for service oneclient
03-Dec-2024 18:42:08 Finished task 'Run acceptance oneclient tests' with result: Success
03-Dec-2024 18:42:08 Starting task 'Parse test results' of type 'com.atlassian.bamboo.plugins.testresultparser:task.testresultparser.junit'
03-Dec-2024 18:42:08 Parsing test results under /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD...
03-Dec-2024 18:42:08 Finished task 'Parse test results' with result: Success
03-Dec-2024 18:42:08 All conditions for task 'Pack and push surefire artifact' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoHostname} with S3
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoPort} with 10161
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.artifactRepoUsername} with ubuntu
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.planRepository.branchName} with develop
03-Dec-2024 18:42:08
Substituting variable: ${bamboo.planRepository.name} with onedata-acceptance
03-Dec-2024 18:42:08 Starting task 'Pack and push surefire artifact' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:42:08
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio #3374 (ODSRV-OAP-MRD-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRD-3374-ScriptBuildTask-3991593848522506290.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance
03-Dec-2024 18:42:08 ./bamboos/artifacts/push_artifact.py --hostname S3 --port 10161 --username ubuntu --branch develop --plan onedata-acceptance --artifact-name surefire_multiprovider_replication_directio.tar.gz
03-Dec-2024 18:42:09 Uploading artifact
03-Dec-2024 18:42:09     source path: surefire_multiprovider_replication_directio.tar.gz
03-Dec-2024 18:42:09     dest.  path: artifacts/onedata-acceptance/develop/surefire_multiprovider_replication_directio.tar.gz
03-Dec-2024 18:42:09 Finished task 'Pack and push surefire artifact' with result: Success
03-Dec-2024 18:42:09 All conditions for task 'Pack logs' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:42:09 Starting task 'Pack logs' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:42:09
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio #3374 (ODSRV-OAP-MRD-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRD-3374-ScriptBuildTask-15185594392303480260.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD
03-Dec-2024 18:42:09 cp: cannot stat 'onedata-acceptance/one_env/sources_info.yaml': No such file or directory
03-Dec-2024 18:42:09 Finished task 'Pack logs' with result: Success
03-Dec-2024 18:42:09 All conditions for task 'Clear env and working dir' were met. Conditions: Variable bamboo.buildNumber matches pattern [4-9]|.{2,}
03-Dec-2024 18:42:09
Substituting variable: ${bamboo.OnedataFinalTasksURL} with https://raw.githubusercontent.com/onedata/bamboos/develop/final_tasks.sh
03-Dec-2024 18:42:09 Starting task 'Clear env and working dir' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
03-Dec-2024 18:42:09
Beginning to execute external process for build 'Onedata Products - oneclient acceptance pkg - multiprovider replication directio #3374 (ODSRV-OAP-MRD-3374)'
... running command line:
/home/bamboo/bamboo-agent-home/temp/ODSRV-OAP-MRD-3374-ScriptBuildTask-17654871808694846781.sh
... in: /home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD/onedata-acceptance
03-Dec-2024 18:42:09   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
03-Dec-2024 18:42:09                                  Dload  Upload   Total   Spent    Left  Speed
03-Dec-2024 18:42:09
03-Dec-2024 18:42:09   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
03-Dec-2024 18:42:09 100  4822  100  4822    0     0  61037      0 --:--:-- --:--:-- --:--:-- 61037
03-Dec-2024 18:42:09 Clearing /tmp/onedata and /home/bamboo/.one-env
03-Dec-2024 18:42:10 Cleaning helm deployments
03-Dec-2024 18:42:10 Cleanining pods
03-Dec-2024 18:42:10 Cleaning kube persistant volumes
03-Dec-2024 18:42:10 Cleaning dockswift container
03-Dec-2024 18:42:10 Cleaning docker containers
03-Dec-2024 18:42:12 Stalled docker containers to remove:
03-Dec-2024 18:42:12 f321271943a6 8bc21203c7be f93ee2d15c36 8a5be8db1cb9 8431c2200688 ef1171b64a02 d006cb057b72 e0bd5d1d6736 cb2ee834d33e 5be6b2d6d6a4 9f4684c2254d 28279e451e40 cff092b268de 2c48b34b0e98 cf8f184594ec bc102a0adcd4 b10152cf1066 fc3ea272a3cc 67ef2ed6f66f c316db4aa4e2
03-Dec-2024 18:42:12 Removing stalled docker containers
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: f321271943a6: Container f321271943a6538c1492832ed6dd15d97a789bc7e79fe77902cac032c9c83abb is not running
03-Dec-2024 18:42:13 f321271943a6
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 8bc21203c7be: Container 8bc21203c7bedfcf1e70fc040b5d8c5da1159fd9d024b3cc434738c88ec6666a is not running
03-Dec-2024 18:42:13 8bc21203c7be
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: f93ee2d15c36: Container f93ee2d15c36042455780a8dd783a5b1ea917badc3f4f7421cb6f5f2661cb9e1 is not running
03-Dec-2024 18:42:13 f93ee2d15c36
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 8a5be8db1cb9: Container 8a5be8db1cb97c7e6e7dedd7aff5f33ba5799d116590f1f41e1a4823f7fa0c38 is not running
03-Dec-2024 18:42:13 8a5be8db1cb9
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 8431c2200688: Container 8431c2200688e0cd59d4977fb7412a91f0bf1a27e1d25e111f9ea7265d150216 is not running
03-Dec-2024 18:42:13 8431c2200688
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: ef1171b64a02: Container ef1171b64a029ac8f37b509ee763ce32c4b76b801abe51949ba48e6a9b6cc5af is not running
03-Dec-2024 18:42:13 ef1171b64a02
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: d006cb057b72: Container d006cb057b72fc7534e4f23e769e386b69ea418cc26c8c16072a6e7d307e2607 is not running
03-Dec-2024 18:42:13 d006cb057b72
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: e0bd5d1d6736: Container e0bd5d1d6736e949830342484f8b93dfc0c38c908071011e5cfaf7a2fd689849 is not running
03-Dec-2024 18:42:13 e0bd5d1d6736
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: cb2ee834d33e: Container cb2ee834d33e7e82b210029e67f233995ee3d68be7b5841092da4df8e2c6f404 is not running
03-Dec-2024 18:42:13 cb2ee834d33e
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 5be6b2d6d6a4: Container 5be6b2d6d6a47634309028c8bfee4fb262141dc781230ca3fae6d726b9f0bcd9 is not running
03-Dec-2024 18:42:13 5be6b2d6d6a4
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 9f4684c2254d: Container 9f4684c2254dfc4b5f22b5df4345ba8a103fb8a6d27af4ea4c404863542b1e4b is not running
03-Dec-2024 18:42:13 9f4684c2254d
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 28279e451e40: Container 28279e451e409aed5fd8504ba472a64b4e7e3393f92645ae2243b12b3f814926 is not running
03-Dec-2024 18:42:13 28279e451e40
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: cff092b268de: Container cff092b268debb4905c75a56742d5bd4fdfdd01d1bd325ad7dc43d1a02dfa0b6 is not running
03-Dec-2024 18:42:13 cff092b268de
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: 2c48b34b0e98: Container 2c48b34b0e98de80661330e506abc4b74c9317bbab5b41b68f680eb43e310415 is not running
03-Dec-2024 18:42:13 2c48b34b0e98
03-Dec-2024 18:42:13 Error response from daemon: Cannot kill container: cf8f184594ec: Container cf8f184594ec5153144feb3510fed41cb255d3d80455600fc899a3cf0e5b9f42 is not running
03-Dec-2024 18:42:14 cf8f184594ec
03-Dec-2024 18:42:14 Error response from daemon: Cannot kill container: bc102a0adcd4: Container bc102a0adcd4b959e749423862546d030abe11e10643ad625cf18579639e5796 is not running
03-Dec-2024 18:42:14 bc102a0adcd4
03-Dec-2024 18:42:14 Error response from daemon: Cannot kill container: b10152cf1066: Container b10152cf10667e24aa22e930ea161e3ff5b13d66b8a76bdec0666df09f8297ed is not running
03-Dec-2024 18:42:14 b10152cf1066
03-Dec-2024 18:42:14 Error response from daemon: Cannot kill container: fc3ea272a3cc: Container fc3ea272a3cc2d69ff061a6711d4b18409a403072f8f228e2ca4bd85cd8b6189 is not running
03-Dec-2024 18:42:14 fc3ea272a3cc
03-Dec-2024 18:42:14 Error response from daemon: Cannot kill container: 67ef2ed6f66f: Container 67ef2ed6f66f2bc7f81edad30d4cfb7d2e7cb106126b32bdeaab90a4f10dac42 is not running
03-Dec-2024 18:42:14 67ef2ed6f66f
03-Dec-2024 18:42:14 c316db4aa4e2
03-Dec-2024 18:42:14 c316db4aa4e2
03-Dec-2024 18:42:14 Stalled docker volumes to remove:
03-Dec-2024 18:42:14
03-Dec-2024 18:42:14 Removing stalled docker volumes
03-Dec-2024 18:42:14 Removing stalled loopdevices
03-Dec-2024 18:42:15 Done
03-Dec-2024 18:42:15 Finished task 'Clear env and working dir' with result: Success
03-Dec-2024 18:42:15 Skipping task 'Qnthack - always fail on build 2' because of unfulfilled condition. Reason: Variable bamboo.buildNumber matches pattern 2
03-Dec-2024 18:42:15 Running post build plugin 'Docker Container Cleanup'
03-Dec-2024 18:42:15 Running post build plugin 'NCover Results Collector'
03-Dec-2024 18:42:15 Running post build plugin 'Build Results Label Collector'
03-Dec-2024 18:42:15 Running post build plugin 'Clover Results Collector'
03-Dec-2024 18:42:15 Running post build plugin 'npm Cache Cleanup'
03-Dec-2024 18:42:15 Running post build plugin 'Artifact Copier'
03-Dec-2024 18:42:15 Publishing an artifact: test_logs.tar.gz
03-Dec-2024 18:42:15 Finished publishing of artifact Non required job artifact Http Compression On : [test_logs.tar.gz], patterns: [test_logs.tar.gz] in 76.79 ms
03-Dec-2024 18:42:15 Successfully removed working directory at '/home/bamboo/bamboo-agent-home/xml-data/build-dir/ODSRV-OAP-MRD'
03-Dec-2024 18:42:15 Finalising the build...
03-Dec-2024 18:42:15 Stopping timer.
03-Dec-2024 18:42:15 Build ODSRV-OAP-MRD-3374 completed.
03-Dec-2024 18:42:15 Running on server: post build plugin 'Build Hanging Detection Configuration'
03-Dec-2024 18:42:15 Running on server: post build plugin 'NCover Results Collector'
03-Dec-2024 18:42:15 Running on server: post build plugin 'Build Labeller'
03-Dec-2024 18:42:15 Running on server: post build plugin 'Clover Delta Calculator'
03-Dec-2024 18:42:15 Running on server: post build plugin 'Maven Dependencies Postprocessor'
03-Dec-2024 18:42:15 All post build plugins have finished
03-Dec-2024 18:42:15 Generating build results summary...
03-Dec-2024 18:42:15 Saving build results to disk...
03-Dec-2024 18:42:15 Store variable context...
03-Dec-2024 18:42:15 Finished building ODSRV-OAP-MRD-3374.