Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001296039s trace:
https://jaeger.dev.storj.io/trace/35e35ba0941f6cf1
FAIL (2026-05-24 17:50:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001320576s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
4.059681452s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:44:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.059699526s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.74461153s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:44:36 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 5.744638301s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
4.008889605s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:43:49 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.00890755s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.932094107s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:42:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.932109505s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.827663479s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:42:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.8276896s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.033350059s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:42:04 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.033390866s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.721292892s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:41:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.721306357s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
3.916943671s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:41:04 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.916954853s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.512428167s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:41:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.512458405s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.983036783s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:40:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.983060127s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
4.305042678s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:39:52 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.305066093s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.839325121s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:39:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.839349457s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
3.977103298s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:39:09 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.97736646s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.469262222s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:38:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.469284405s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.857050437s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:38:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.857064994s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
3.973280393s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:38:12 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.97330456s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
24.25121634s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:38:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.251243022s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.696981972s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:37:30 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 6.69702261s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.107138024s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:36:50 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.107163683s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.712189874s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:36:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.712211764s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
4.151851408s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:36:27 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.151864903s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
3.971090005s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:35:51 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.971162365s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
7.253499533s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:35:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.253520051s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.918229083s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:35:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.918248008s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.152498304s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:35:02 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.152525696s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.762015692s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:34:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.762038726s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
3.950420186s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:34:09 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 3.950444782s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [X...........X...............................................] duration:
24.726337951s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:34:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.726414447s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.11852485s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:33:40 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.118549898s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.X...........X..............................................] duration:
7.326699207s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:33:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.326713154s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..X...........X.............................................] duration:
6.679663118s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:32:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.679685422s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...X...........X............................................] duration:
6.796093453s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:32:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.796108161s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.151359831s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:32:26 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.151381353s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.109717333s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:31:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.109744685s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....X...........X...........................................] duration:
7.050193358s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:31:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.050215489s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.074533038s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:31:15 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.074558035s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.21062977s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:30:47 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.210655109s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....X...........X..........................................] duration:
16.379526278s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:30:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 16.379545214s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......X...........X.........................................] duration:
36.35007018s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:30:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 36.350090168s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.813228125s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:29:33 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.813255558s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......X...........X........................................] duration:
6.940175772s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:29:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.940200288s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.09622487s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:28:36 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.096242845s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
4.071891268s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:28:21 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 4.071914364s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........X...........X.......................................] duration:
16.940334433s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:28:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 16.940351445s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........X...........X......................................] duration:
17.212574733s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:27:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.212590795s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.692595813s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:27:37 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 5.692609138s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.05854432s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:27:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 6.058568665s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........X...........X.....................................] duration:
14.021671495s trace:
https://jaeger.dev.storj.io/trace/7ff3407f5d52c65f
FAIL (2026-05-24 17:26:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 14.021701954s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.323918393s trace:
https://jaeger.dev.storj.io/trace/4dbec51c2511c446
FAIL (2026-05-24 17:26:18 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
8.437055023s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.917400970 (574h12m18.438224715s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.918564570 (574h12m18.439388325s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.919783306 (574h12m18.440607061s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.920955152 (574h12m18.441778897s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.922161203 (574h12m18.442984968s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.923526478 (574h12m18.444350223s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.924759090 (574h12m18.445582835s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.925870040 (574h12m18.446693785s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.927047337 (574h12m18.447871082s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.928363307 (574h12m18.449187052s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.929573235 (574h12m18.450396991s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.930852096 (574h12m18.451675841s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.932068537 (574h12m18.452892282s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:07.933235203 (574h12m18.454058948s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Uploading piece...
May 24 17:00:09.006228623 (574h12m19.527052378s) [upload=550742]: Next returned nil segment
May 24 17:00:09.006244474 (574h12m19.527068229s) [upload=550742]: Waiting for error group managing segments...
May 24 17:00:09.289444894 (574h12m19.810268639s) [noise=true , address=212.102.52.213:4326 , piece_id=EOJW5RI6BICW3PV23MJQL724UN2G5YYLBWPAYCUS3EBO2JTHSJYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290196047 (574h12m19.811019812s) [noise=true , address=212.102.52.215:4370 , piece_id=R5EF4DUUPSRQO4ARGO4CWKJWYFBK5B4MXANM5LSATW5E4EHW2XHA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.290263135 (574h12m19.8110869s) [noise=true , address=212.102.52.216:4414 , piece_id=HEISAHE5WVNKBMRLZQJ47IWGZFTFFVK53GTFI2OPYC7C4WFLB44Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291050016 (574h12m19.811873771s) [noise=true , address=212.102.52.215:4372 , piece_id=FTRV34BNHAAQTE37LGQGODQWMBCCV5UYY7ZABCNAPS7C2G4X2M4A, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291252433 (574h12m19.812076198s) [noise=true , address=212.102.52.213:4325 , piece_id=7FZQKJVPU7CNCWN6VAW2CUVBXHNUBDK5OJDKWSHHXPGN3IJCPRMQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.291594485 (574h12m19.81241825s) [noise=true , address=212.102.52.215:4390 , piece_id=DK6VEDKZPKQW4VPVEPQBLU2XGXUUB4LU7R6RMDEICFLCTKYHOYQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.292235157 (574h12m19.813058912s) [noise=true , address=212.102.52.213:4339 , piece_id=KXKNMM6B4ZGLWWZWVB6ZJIXHRF4PJLO7S76NUTIPAHZNE75HJ73Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.293306662 (574h12m19.814130428s) [noise=true , address=212.102.52.216:4412 , piece_id=VYVEDSSQLTYY2LB7I2263UN7CFCLVJFRHVXCZBM5O4C6SUDBLMRQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.294913228 (574h12m19.815736983s) [noise=true , address=212.102.52.216:4404 , piece_id=SQKMLLSNXJMQRK5AIFUYTPBPZBV77N6YC7E7K3A3NSG4P56LSOBQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.298879585 (574h12m19.81970333s) [noise=true , address=212.102.52.217:4420 , piece_id=H3F24PDKPKG6KZP7LDUUBXJ2EWFJESIOGCGJT2W2UUSP7ODI6QXQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299027668 (574h12m19.819851413s) [noise=true , address=212.102.52.214:4345 , piece_id=MXJV5EEK3BEDWUAWZMC6CQ2JXHNUWHYGG7AGBAN5IXQEWSLS43DQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.299516592 (574h12m19.820340337s) [noise=true , address=212.102.52.216:4408 , piece_id=2XU4MRKGDB6X5WZUUYWYAYJ6PKMSCWWW655OEX4HNGJL3BEJ3GVA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.300511700 (574h12m19.821335445s) [noise=true , address=212.102.52.213:4340 , piece_id=U37J5DRZLFZ7TUV7LGNKOHLE27NSAEBO7JKJHDI5XL2GU2VHVGPA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.301548899 (574h12m19.822372654s) [noise=true , address=212.102.52.217:4437 , piece_id=5WX5UKGNPLY5OH6U5HRSP6XFYWHWHQTZW45KD3W3VXW3ROQBMZDA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.303632485 (574h12m19.82445624s) [noise=true , address=212.102.52.215:4369 , piece_id=JUFX4KYPYZKILKS6FZSI4TGNRCAS6KCRSTRPJ27FTQJYPMTARX4Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304121798 (574h12m19.824945543s) [noise=true , address=212.102.52.214:4357 , piece_id=TB5ZRYHHM7V2ARMV65K7OVTPWW6DDDPPA5DLMJGXLWBUDI2D3Z5Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: <nil>
May 24 17:00:09.304134162 (574h12m19.824957907s) [seg_pos={0 0}, upload=550742]: Satisfied cohort requirements after 16 pieces
May 24 17:00:09.304365533 (574h12m19.825189288s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304376445 (574h12m19.82520019s) [noise=true , address=212.102.52.214:4349 , piece_id=CKCBIARJYRJ6J2CW4WIYEK2FQNSDMNVR2KU3HZPFSQUBXVVIVKQA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304388327 (574h12m19.825212072s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304393817 (574h12m19.825217572s) [noise=true , address=212.102.52.217:4427 , piece_id=RGAV2LRMYPM2ELZ6WD35U7TLKZKYYY5GCKVQX3MHLY3N7QJDVHYA, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304522823 (574h12m19.825346578s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304531891 (574h12m19.825355646s) [noise=true , address=212.102.52.214:4358 , piece_id=NGOQDC5VVPKOVLZJXO3D4GYVMJ4ZHKDYFNY6UKWZSFMOFW74S63Q, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304691776 (574h12m19.825515531s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zek7Hwkv4dNwwxz5yKmj9eGCKieCopNGDLQyWHt8wF6dPDNWd): protocol: expected piece hash; context canceled; EOF
May 24 17:00:09.304699961 (574h12m19.825523706s) [noise=true , address=212.102.52.217:4428 , piece_id=454LQ76C4YXS65FCUSEXMRZPGAD5TXVPWGLIX2ZA6UXKC6QFWBYQ, seg_pos={0 0}, upload=550742]: Long tail cancellation due to optimal threshold
May 24 17:00:09.304729618 (574h12m19.825553363s) [seg_pos={0 0}, upload=550742]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 17:00:09.304816744 (574h12m19.825640499s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 17:00:09.304822455 (574h12m19.82564621s) [upload=550742]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 17:00:49.945461696 (574h13m0.466285441s) [upload=550742]: Done uploading segments...
May 24 17:00:49.945480471 (574h13m0.466304216s) [upload=550742]: Upload finished. err: <nil>
Duration: 5.323965143s
core
uplink
uk-select-1
uk1-placement-17
|