Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...................................X..................XX....] duration:
6.692675798s trace:
https://jaeger.dev.storj.io/trace/282833b08f778c77
FAIL (2026-05-24 16:31:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.692696328s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [....................................X..................XX...] duration:
6.778812581s trace:
https://jaeger.dev.storj.io/trace/282833b08f778c77
FAIL (2026-05-24 16:31:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.778836979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
7.945101868s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:30:33 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 7.945131315s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X..................XX..] duration:
6.841415634s trace:
https://jaeger.dev.storj.io/trace/282833b08f778c77
FAIL (2026-05-24 16:30:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.841447656s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
8.485618688s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:29:44 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 8.485651732s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [......................................X..................XX.] duration:
22.872693451s trace:
https://jaeger.dev.storj.io/trace/282833b08f778c77
FAIL (2026-05-24 16:29:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 22.872761942s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.......................................X..................XX] duration:
1m0.000609989s trace:
https://jaeger.dev.storj.io/trace/282833b08f778c77
FAIL (2026-05-24 16:28:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000621863s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
4.043538667s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:28:32 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.043554188s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.6624374s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:27:56 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 5.662460244s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [X.......................................X..................X] duration:
1m0.00128166s trace:
https://jaeger.dev.storj.io/trace/3eddbdbac5045913
FAIL (2026-05-24 16:27:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001303343s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.444957034s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:27:27 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.444979557s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
4.354936615s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:26:13 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.354959118s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................................X..................] duration:
8.92495738s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:26:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.924976907s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
9.327432189s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:25:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 9.327457758s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..X.......................................X.................] duration:
6.658379759s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:25:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.658406008s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................X................] duration:
6.537950419s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:24:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.537992388s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
3.931731562s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:24:41 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 3.931745808s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
37.609483893s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:24:36 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 37.609528999s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....X.......................................X...............] duration:
6.701821679s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:23:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.701834773s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....X.......................................X..............] duration:
7.91755233s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:23:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.917566427s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.543541368s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:23:15 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 5.54356813s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......X.......................................X.............] duration:
6.612165058s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:22:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.612188622s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.428483749s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:22:06 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.428513988s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......X.......................................X............] duration:
12.228431069s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:21:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.228470114s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.012277447s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:21:25 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 5.012290843s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........X.......................................X...........] duration:
6.672989623s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:20:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.673022036s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
4.117527582s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:20:23 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.117551457s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........X.......................................X..........] duration:
6.660738518s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:20:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.660751063s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........X.......................................X.........] duration:
26.90310318s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:20:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.903132418s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........X.......................................X........] duration:
6.641259029s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:19:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.64127457s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.093725089s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:19:25 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 6.093749996s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
14.22504051s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:19:12 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 14.225063083s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............X.......................................X.......] duration:
6.611107749s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:19:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.61115042s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......................................X......] duration:
6.665409962s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:18:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.665432185s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.054705644s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:18:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.054731224s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.104851436s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:17:43 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.104892644s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......................................X.....] duration:
6.540635405s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:17:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.540660532s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.348776291s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:16:42 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.348791369s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......................................X....] duration:
6.721209123s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:16:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.721250853s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................X.......................................X...] duration:
6.853845912s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:16:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.853881038s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.................X.......................................X..] duration:
6.807132736s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:15:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.80715527s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.071160157s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:15:31 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.07118292s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................................X.] duration:
6.834546636s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:15:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.83459573s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................................X] duration:
1m0.000739693s trace:
https://jaeger.dev.storj.io/trace/6c5817106fdea34f
FAIL (2026-05-24 16:14:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000760001s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.145655913s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:14:22 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.145684637s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.015145486s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:13:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.015173571s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
7.651914541s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:13:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.651942833s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.512218739s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:12:54 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 4.51224036s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
14.597566168s trace:
https://jaeger.dev.storj.io/trace/68d890f77e4ed7b6
FAIL (2026-05-24 16:12:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 14.597581888s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.869550588s trace:
https://jaeger.dev.storj.io/trace/726d967d3480d6f2
FAIL (2026-05-24 16:12:37 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
9191s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454251466 (572h54m51.975075211s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.454686537 (572h54m51.975510282s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.456338348 (572h54m51.977162083s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.457584686 (572h54m51.978408431s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.458762683 (572h54m51.979586418s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.460022868 (572h54m51.980846623s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.461193031 (572h54m51.982016786s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462221493 (572h54m51.983045238s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.462316104 (572h54m51.983139849s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463664968 (572h54m51.984488713s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.463781450 (572h54m51.984605185s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.464724820 (572h54m51.985548565s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465365813 (572h54m51.986189558s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:41.465908378 (572h54m51.986732123s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Uploading piece...
May 24 15:42:42.525990798 (572h54m53.046814543s) [upload=549502]: Next returned nil segment
May 24 15:42:42.526009154 (572h54m53.046832899s) [upload=549502]: Waiting for error group managing segments...
May 24 15:42:42.802925467 (572h54m53.323749212s) [noise=true , address=212.102.52.216:4399 , piece_id=EVDP2ZW4VIKEDMTNGJCPHC4AWGSSAGMAPFTD4U3I3VJMETZ42APA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.803691930 (572h54m53.324515665s) [noise=true , address=212.102.52.214:4367 , piece_id=2RSEE3YTK5NH5EPF6EHWR3ZY2TC6HLO3SVTUPFAHMIEN5UK6QQIQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.813999647 (572h54m53.334823392s) [noise=true , address=212.102.52.215:4386 , piece_id=JG56HLTL65E2YZ4VRBITMPVFTATV6UGBL7B7M5BQMKX6NYIBBQ6Q, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.817790400 (572h54m53.338614135s) [noise=true , address=212.102.52.214:4353 , piece_id=TB7I6F4AEOSY2CFX7VYL7CCDBPSD64XEUDRTM2MQWKK7EGH4YLAQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.819933029 (572h54m53.340756784s) [noise=true , address=212.102.52.215:4390 , piece_id=J5PUSE6Z7VIU4IH7M4JVEOMU6XZSPJA2ZWJWVBC7X5RHHLMIOYLA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.820504679 (572h54m53.341328425s) [noise=true , address=212.102.52.217:4433 , piece_id=PLGAOW45ISCAK4TNFQQQLENDC44JGJC7IT77C3UVVHXIOUS45JKA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821178916 (572h54m53.342002661s) [noise=true , address=212.102.52.213:4322 , piece_id=I3OKH57Z7EYKBDQAWTPQIDABLOGS53GCWIBEH637PYWQH34UCNQQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.821759163 (572h54m53.342582908s) [noise=true , address=212.102.52.216:4405 , piece_id=L6TQU5NZLIJ3UTWUICFU7OIDW5S7VJZUL3I53KBLK4BLC25MTE3A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826675233 (572h54m53.347498978s) [noise=true , address=212.102.52.213:4341 , piece_id=NU6LB3MDV2YIVYKGQ2UU6GXCWATGDYJJRYTDVP4V7D7YR54NH2ZQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.826801724 (572h54m53.347625469s) [noise=true , address=212.102.52.215:4382 , piece_id=F5VUJGG7CALDMLFBHZTUPF53F6FMZYV3MJPD52LF5RJRN3CEAZAA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.827620657 (572h54m53.348444402s) [noise=true , address=212.102.52.216:4407 , piece_id=XX7LX6VOWL4NLSL5ZPWAWDX45DMZJBUOEUN2DCPIE3UKWWFHHHZA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.831874443 (572h54m53.352698188s) [noise=true , address=212.102.52.217:4420 , piece_id=OJIL5LF6JE2CMRTDCZ343FUN6MJK33J5GTFTBSANXULNYVOZQPJA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.833605907 (572h54m53.354429653s) [noise=true , address=212.102.52.213:4339 , piece_id=ZGMRQI5L5GDJDESBPRAXXIX3BZRJODICDBXWPFKUFCMPO35WE5SQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.845785837 (572h54m53.366609582s) [noise=true , address=212.102.52.216:4402 , piece_id=6SK4UCNK354UGDG3CFUF5ITZKNBT46EN226R2JXS54QM52E53GYA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.865130318 (572h54m53.385954063s) [noise=true , address=212.102.52.213:4324 , piece_id=WN74PDV6UE5WK7XN76QRJJCWU5X5JPY5JEZ4EPBMTBX2M2QGYVGQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867430607 (572h54m53.388254352s) [noise=true , address=212.102.52.215:4370 , piece_id=T23U7X4SOVCPDK2WIL6H43S7DK7AQUZVVDIZWVP27VTGM7JY3PTA, seg_pos={0 0}, upload=549502]: Done uploading piece. err: <nil>
May 24 15:42:42.867449272 (572h54m53.388273017s) [seg_pos={0 0}, upload=549502]: Satisfied cohort requirements after 16 pieces
May 24 15:42:42.867622703 (572h54m53.388446448s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127nGTmG2mLmVxiFuin8vjeHf2TFe9unF75777yZifJiVFXkFX9): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867628624 (572h54m53.388452369s) [noise=true , address=212.102.52.214:4358 , piece_id=445S3DDT2EVEE7PZC5FDSLGSCO6CAMB476XPHFDCFA5JU36WAU4A, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867734937 (572h54m53.388558682s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867739356 (572h54m53.388563101s) [noise=true , address=212.102.52.217:4424 , piece_id=XNLWRUBO5RBDYMCLGOIDSBLBDIVSJC7MV2AIQXRJALNQXVK4QSPQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867772449 (572h54m53.388596204s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127vua8xA3HHNDurSeqQEtNeQ7R4WJz2kTegBasccKVGrshF1dY): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867787528 (572h54m53.388611283s) [noise=true , address=212.102.52.214:4347 , piece_id=ZVAS5TWU6T4YAWAKHI3FKOWVK2MGCD624HN552YTKAVSWUIMYZNQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867834928 (572h54m53.388658673s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG): protocol: expected piece hash; context canceled; EOF
May 24 15:42:42.867840127 (572h54m53.388663873s) [noise=true , address=212.102.52.217:4431 , piece_id=JQZHD7DXPDCP6X6JBPZCDFDOYFEEQE2QKRUW4QU46PM6XJGXCBXQ, seg_pos={0 0}, upload=549502]: Long tail cancellation due to optimal threshold
May 24 15:42:42.867872219 (572h54m53.388695974s) [seg_pos={0 0}, upload=549502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 24 15:42:42.867948244 (572h54m53.388771979s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 24 15:42:42.867957662 (572h54m53.388781407s) [upload=549502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 24 15:42:54.203307397 (572h55m4.724131142s) [upload=549502]: Done uploading segments...
May 24 15:42:54.203322785 (572h55m4.72414653s) [upload=549502]: Upload finished. err: <nil>
Duration: 3.869575636s
core
uplink
uk-select-1
uk1-placement-17
|