Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.010372419s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:51:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 4.010393569s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
7.753196657s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:50:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 7.753216917s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.74889881s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:50:00 UTC)
orbiter warning: context deadline exceeded
Duration: 6.748925421s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
11.211211035s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:49:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 11.211232828s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
6.713177349s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:49:39 UTC)
orbiter warning: context deadline exceeded
Duration: 6.713202117s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.113260501s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:48:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 5.113306438s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
6.885379933s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:48:30 UTC)
orbiter warning: context deadline exceeded
Duration: 6.885402426s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.029086626s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:48:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 4.029104912s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
6.744689898s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:47:34 UTC)
orbiter warning: context deadline exceeded
Duration: 6.744703023s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.107973739s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:47:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 4.107996703s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
4 out of 60 is failed (threshold=3) [X.XXX.......................................................] duration:
6.601870793s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:47:11 UTC)
orbiter warning: context deadline exceeded
Duration: 6.601891111s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
4 out of 60 is failed (threshold=3) [.X.XXX......................................................] duration:
6.840982075s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:46:28 UTC)
orbiter warning: context deadline exceeded
Duration: 6.841004928s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.04528633s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:46:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 4.045307289s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [X.X.XXX.....................................................] duration:
6.727575923s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:46:03 UTC)
orbiter warning: context deadline exceeded
Duration: 6.727645516s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.350146514s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:45:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 4.350181392s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001635934s trace:
https://jaeger.dev.storj.io/trace/17aceacd274ea904
FAIL (2026-05-26 02:45:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece...
May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment
May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments...
May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil>
May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces
May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF
May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold
May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments...
May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil>
Duration: 1m0.001652607s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.X.X.XXX....................................................] duration:
17.498550267s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:45:01 UTC)
orbiter warning: context deadline exceeded
Duration: 17.498576899s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..X.X.XXX...................................................] duration:
8.624013769s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:44:27 UTC)
orbiter warning: context deadline exceeded
Duration: 8.62404573s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...X.X.XXX..................................................] duration:
6.638865056s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:43:18 UTC)
orbiter warning: context deadline exceeded
Duration: 6.638878171s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [....X.X.XXX.................................................] duration:
6.494777141s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:42:26 UTC)
orbiter warning: context deadline exceeded
Duration: 6.494800696s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.....X.X.XXX................................................] duration:
12.753868794s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:42:06 UTC)
orbiter warning: context deadline exceeded
Duration: 12.75389296s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [......X.X.XXX...............................................] duration:
9.453760825s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:41:33 UTC)
orbiter warning: context deadline exceeded
Duration: 9.453780833s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.......X.X.XXX..............................................] duration:
6.615325158s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:40:48 UTC)
orbiter warning: context deadline exceeded
Duration: 6.615344203s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [........X.X.XXX.............................................] duration:
7.074598508s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:40:15 UTC)
orbiter warning: context deadline exceeded
Duration: 7.074613036s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X.XXX............................................] duration:
7.54770511s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:39:30 UTC)
orbiter warning: context deadline exceeded
Duration: 7.547728355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [X.........X.X.XXX...........................................] duration:
7.871419124s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:38:50 UTC)
orbiter warning: context deadline exceeded
Duration: 7.871443482s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [.X.........X.X.XXX..........................................] duration:
6.838696477s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:37:39 UTC)
orbiter warning: context deadline exceeded
Duration: 6.838785075s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [..X.........X.X.XXX.........................................] duration:
7.363757424s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:37:13 UTC)
orbiter warning: context deadline exceeded
Duration: 7.363775348s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [...X.........X.X.XXX........................................] duration:
7.16406271s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:36:35 UTC)
orbiter warning: context deadline exceeded
Duration: 7.164083059s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [....X.........X.X.XXX.......................................] duration:
6.699682892s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:35:49 UTC)
orbiter warning: context deadline exceeded
Duration: 6.699712158s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [.....X.........X.X.XXX......................................] duration:
12.54531521s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:35:19 UTC)
orbiter warning: context deadline exceeded
Duration: 12.545336901s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [......X.........X.X.XXX.....................................] duration:
6.635120385s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:33:58 UTC)
orbiter warning: context deadline exceeded
Duration: 6.635157186s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [.......X.........X.X.XXX....................................] duration:
13.438792957s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:33:17 UTC)
orbiter warning: context deadline exceeded
Duration: 13.438812464s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [........X.........X.X.XXX...................................] duration:
6.594084026s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:31:58 UTC)
orbiter warning: context deadline exceeded
Duration: 6.594102451s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [.........X.........X.X.XXX..................................] duration:
6.689266928s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:30:44 UTC)
orbiter warning: context deadline exceeded
Duration: 6.689289982s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [X.........X.........X.X.XXX.................................] duration:
6.741622171s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:29:43 UTC)
orbiter warning: context deadline exceeded
Duration: 6.741644774s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.X.........X.........X.X.XXX................................] duration:
6.779177682s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:28:40 UTC)
orbiter warning: context deadline exceeded
Duration: 6.779197388s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [..X.........X.........X.X.XXX...............................] duration:
35.630193849s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:27:56 UTC)
orbiter warning: context deadline exceeded
Duration: 35.630212684s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [...X.........X.........X.X.XXX..............................] duration:
6.683624463s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:26:54 UTC)
orbiter warning: context deadline exceeded
Duration: 6.683647447s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [....X.........X.........X.X.XXX.............................] duration:
15.065188071s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:26:18 UTC)
orbiter warning: context deadline exceeded
Duration: 15.065207258s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.....X.........X.........X.X.XXX............................] duration:
6.613560688s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:24:58 UTC)
orbiter warning: context deadline exceeded
Duration: 6.613582401s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [......X.........X.........X.X.XXX...........................] duration:
6.912083167s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:23:59 UTC)
orbiter warning: context deadline exceeded
Duration: 6.912104629s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.......X.........X.........X.X.XXX..........................] duration:
6.942211222s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:23:40 UTC)
orbiter warning: context deadline exceeded
Duration: 6.942250777s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [........X.........X.........X.X.XXX.........................] duration:
6.712595252s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:22:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.712615622s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.........X.........X.........X.X.XXX........................] duration:
6.509369675s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:22:16 UTC)
orbiter warning: context deadline exceeded
Duration: 6.509388903s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [..........X.........X.........X.X.XXX.......................] duration:
6.701382533s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:21:10 UTC)
orbiter warning: context deadline exceeded
Duration: 6.701410986s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [...........X.........X.........X.X.XXX......................] duration:
6.982131703s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:20:27 UTC)
orbiter warning: context deadline exceeded
Duration: 6.982152992s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [............X.........X.........X.X.XXX.....................] duration:
6.871255774s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:19:36 UTC)
orbiter warning: context deadline exceeded
Duration: 6.871299438s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.............X.........X.........X.X.XXX....................] duration:
10.733228738s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:19:04 UTC)
orbiter warning: context deadline exceeded
Duration: 10.733239368s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [..............X.........X.........X.X.XXX...................] duration:
6.957233343s trace:
https://jaeger.dev.storj.io/trace/29fde4220e25f444
FAIL (2026-05-26 02:18:15 UTC)
orbiter warning: context deadline exceeded
Duration: 6.957253461s
core
uplink
us-select-1
us1-placement-20
|