Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......................................X......] duration:
6.665409962s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:18:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.665432185s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.054705644s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:18:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.054731224s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.104851436s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:17:43 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.104892644s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......................................X.....] duration:
6.540635405s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:17:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.540660532s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.348776291s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:16:42 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.348791369s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......................................X....] duration:
6.721209123s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:16:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.721250853s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................X.......................................X...] duration:
6.853845912s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:16:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.853881038s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.................X.......................................X..] duration:
6.807132736s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:15:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.80715527s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.071160157s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:15:31 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.07118292s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................................X.] duration:
6.834546636s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:15:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.83459573s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................................X] duration:
1m0.000739693s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:14:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000760001s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.145655913s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:14:22 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.145684637s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.015145486s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:13:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.015173571s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
7.651914541s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:13:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.651942833s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.512218739s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:12:54 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.51224036s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
14.597566168s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:12:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 14.597581888s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.869550588s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:12:37 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 3.869575636s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
48.422107715s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:12:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 48.422128844s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.97918926s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:12:16 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 3.979214207s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
4.192990631s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:11:15 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.193003426s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
20.088320875s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:11:10 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 20.088348457s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [X......................X....................................] duration:
6.742833135s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:11:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.742892397s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.X......................X...................................] duration:
6.84368009s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:10:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.843696773s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
7.026760806s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:09:43 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 7.026784611s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..X......................X..................................] duration:
6.811272897s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:09:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.811294888s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...X......................X.................................] duration:
6.818492059s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:09:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.818515123s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
4.080618525s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:09:16 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.080646118s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....X......................X................................] duration:
7.36022341s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:08:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.36025433s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
4.645266163s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:08:14 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.64529046s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....X......................X...............................] duration:
6.985595108s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:08:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.985620027s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......X......................X..............................] duration:
6.572485836s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:07:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.572513228s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.0563184s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:07:15 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.056334059s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration:
6.598710681s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:06:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.598739975s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.407460408s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:06:24 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 5.407477212s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........X......................X............................] duration:
7.609007917s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:06:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.609034677s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.371156737s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:05:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.371174241s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration:
6.443695464s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:05:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.443717597s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration:
6.801471024s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:05:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.801492817s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
7.194538145s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:04:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 7.194557s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration:
6.768283595s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:04:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.768312321s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.181814645s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:04:07 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.18185929s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............X......................X........................] duration:
13.203857465s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:03:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.203880318s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.864686572s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:03:06 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 5.864704336s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration:
12.305430144s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:02:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.30545907s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
6.597442307s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:01:59 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 6.597469018s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............X......................X......................] duration:
19.371432927s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:01:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 19.371447364s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration:
58.279564985s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:01:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 58.279602337s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.142237055s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:00:42 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.142264345s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................X......................X....................] duration:
6.867162276s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:00:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.867189579s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.007827563s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 15:59:52 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.007855046s
core
uplink
uk-select-1
uk1-placement-17
|