Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............................X..................XX...........] duration: 4.263837053s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:09:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.263852443s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..................XX..........] duration: 4.170636184s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:07:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.170658385s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..................XX.........] duration: 4.927350658s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:07:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.927371826s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..................XX........] duration: 4.700559776s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:06:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.700579874s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [................................X..................XX.......] duration: 4.022203328s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:05:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.022223447s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..................XX......] duration: 4.089804794s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:04:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.089825724s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [X.................................X..................XX.....] duration: 33.86504217s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:04:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 33.865063961s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X.................................X..................XX....] duration: 4.924724925s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:03:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.924737959s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..X.................................X..................XX...] duration: 48.852026755s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:03:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 48.852041032s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...X.................................X..................XX..] duration: 5.316448211s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:01:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 5.316470042s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....X.................................X..................XX.] duration: 4.030635198s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:00:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 4.030648784s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.....X.................................X..................XX] duration: 1m0.001399648s trace: https://jaeger.dev.storj.io/trace/58020a6ddb181d40 FAIL (2026-05-26 09:00:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 09:00:17.186970808 (30h56m2.970310917s) [upload=29607]: Starting upload May 26 09:00:17.187032346 (30h56m2.970372455s) [upload=29607]: Done starting upload May 26 09:00:17.187073424 (30h56m2.970413523s) [upload=29607]: Uploading segments... May 26 09:00:17.187266803 (30h56m2.970606912s) [upload=29607]: Got next segment. Inline: false May 26 09:00:17.187329984 (30h56m2.970670113s) [upload=29607]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 09:00:17.187337287 (30h56m2.970677396s) [upload=29607]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 09:00:45.218487893 (30h56m31.001827992s) [upload=29607]: Next segment err: context deadline exceeded May 26 09:00:45.218690590 (30h56m31.002030689s) [upload=29607]: Done uploading segments... May 26 09:00:45.218723512 (30h56m31.002063611s) [upload=29607]: Upload finished. err: context deadline exceeded Duration: 1m0.001408264s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......X.................................X..................X] duration: 1m0.001240156s trace: https://jaeger.dev.storj.io/trace/566e6ea288b906b1 FAIL (2026-05-26 08:59:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 08:59:03.918993559 (30h54m49.702333658s) [upload=29588]: Starting upload May 26 08:59:03.919024408 (30h54m49.702364507s) [upload=29588]: Done starting upload May 26 08:59:03.919141842 (30h54m49.702481931s) [upload=29588]: Uploading segments... May 26 08:59:03.919293762 (30h54m49.702633861s) [upload=29588]: Got next segment. Inline: false May 26 08:59:03.919317407 (30h54m49.702657506s) [upload=29588]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 08:59:03.919320834 (30h54m49.702660923s) [upload=29588]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 08:59:44.994075006 (30h55m30.777415105s) [upload=29588]: Next segment err: context deadline exceeded May 26 08:59:44.994284686 (30h55m30.777624785s) [upload=29588]: Done uploading segments... May 26 08:59:44.994314342 (30h55m30.777654432s) [upload=29588]: Upload finished. err: context deadline exceeded Duration: 1m0.00125824s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......X.................................X..................] duration: 3.938512262s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:58:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.938531819s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........X.................................X.................] duration: 5.957006844s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.95702591s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........X.................................X................] duration: 6.018287518s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:57:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.018303659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........X.................................X...............] duration: 4.13668451s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:56:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.136710028s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........X.................................X..............] duration: 4.179986879s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:55:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.180015132s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............X.................................X.............] duration: 3.95901195s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:54:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.959043037s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............X.................................X............] duration: 4.264001984s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:54:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.264024577s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............X.................................X...........] duration: 4.107245492s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:53:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.107262406s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............X.................................X..........] duration: 5.198025549s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:52:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.198049515s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................X.................................X.........] duration: 4.116590653s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:51:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.116605712s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................X.................................X........] duration: 3.98674113s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:50:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.986766349s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................X.................................X.......] duration: 4.043398772s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:50:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.043420874s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X.................................X......] duration: 4.177404068s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:49:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.177428956s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X.................................X.....] duration: 4.18660613s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:48:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.186628412s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.................................X....] duration: 3.980550491s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:47:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.980564468s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X.................................X...] duration: 3.966062439s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:47:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.96608412s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.................................X..] duration: 3.969691343s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:46:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.969704077s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................X.................................X.] duration: 30.05864963s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:46:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.058659729s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.................................X] duration: 1m11.51954984s trace: https://jaeger.dev.storj.io/trace/5686ad302398da0e FAIL (2026-05-26 08:45:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 29355]: Uploading piece... May 26 08:45:24.942551099 (30h41m10.725891188s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943035022 (30h41m10.726375111s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.943740128 (30h41m10.727080227s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944205736 (30h41m10.727545825s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.944322910 (30h41m10.727663009s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945007216 (30h41m10.728347315s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.945688025 (30h41m10.729028124s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946118596 (30h41m10.729458695s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.946491187 (30h41m10.729831287s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.947083337 (30h41m10.730423436s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948177124 (30h41m10.731517224s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.948598388 (30h41m10.731938487s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949019141 (30h41m10.73235924s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949215626 (30h41m10.732555735s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:24.949509006 (30h41m10.732849105s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Uploading piece... May 26 08:45:26.014312038 (30h41m11.797652137s) [upload=29355]: Next returned nil segment May 26 08:45:26.014333158 (30h41m11.797673248s) [upload=29355]: Waiting for error group managing segments... May 26 08:45:26.298866183 (30h41m12.082206282s) [noise=true , address=212.102.52.215:4387 , piece_id=J5TXUMKYCE2FPFCTGSW3VEETJHMZ4BK2V2ROBOMUF4NFOLF7N4GQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.300774454 (30h41m12.084114543s) [noise=true , address=212.102.52.216:4401 , piece_id=35WQMEULJTMRC5S3JAWSUOADXPPRGBLTOYAX2VOOYKDRCAPNX7QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.302091988 (30h41m12.085432077s) [noise=true , address=212.102.52.217:4417 , piece_id=MQQZMZJH3DRTOWPACYXTAKVTB5DRHTME7BKJ4YB6GN6ANGVC2LYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.303435151 (30h41m12.08677525s) [noise=true , address=212.102.52.214:4356 , piece_id=BVCGHEPUHZ4Z27KVO2KHEDLPBKH5Z3QRN5VFKLZBCMRENKUJXE6A, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307456904 (30h41m12.090797003s) [noise=true , address=212.102.52.214:4365 , piece_id=4OV55D2GKJRBWPWSCXNANRHRCCZ6D4CURXMXJNZ5ZPWJ42GLLUUQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307554160 (30h41m12.090894249s) [noise=true , address=212.102.52.217:4439 , piece_id=H7OIP2BGV2LCFOH6JEAIZ667L4IXRF5SUZQWKXPMI4ROUAAY65QA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.307891795 (30h41m12.091231894s) [noise=true , address=212.102.52.213:4343 , piece_id=LCLXVMWOXJJ4LYLH4V5S6DHLCLCIZUBUDTUIOJFUSFORWLLSTMNA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310752021 (30h41m12.09409212s) [noise=true , address=212.102.52.213:4342 , piece_id=YXOXTEARBSZU7ZDBMEECCWPE47NFV4GFIZJX3KXS67UNPJ275LPA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.310926915 (30h41m12.094267014s) [noise=true , address=212.102.52.214:4350 , piece_id=TQSGXMITQXAKPRIKTX3A5D4Y55IGK4ZMRHIJ3H5H72P3K2ZIZIKQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315327302 (30h41m12.098667401s) [noise=true , address=212.102.52.213:4332 , piece_id=RHKFE5TUJ4LTQVU52ENSPTFCXEDCACVWXD4AIFLZSSTXKNRTYZ5Q, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.315935101 (30h41m12.0992752s) [noise=true , address=212.102.52.216:4399 , piece_id=4OJU66ULXKV7JSYC4IG6JGVAZ42DRXJKQHAV6YJHA53K6UMPUPCQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.321618445 (30h41m12.104958544s) [noise=true , address=212.102.52.215:4379 , piece_id=HTBVOKIZP57Y2Q4DTEYH6N5AIPEPT5AUD7II53MVWU557Z6U5OVA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.323112587 (30h41m12.106452686s) [noise=true , address=212.102.52.213:4340 , piece_id=W34WA4KVILT3PNDYPYNUIRNLFKFOI7KYLGXOPPZTANBK7VRGARYA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.329490736 (30h41m12.112830835s) [noise=true , address=212.102.52.217:4430 , piece_id=O5QJDIENGZXMPWY5GB253ISTGF7SZAJK6ZV2IPANQ3YWQ6FRYAYQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.353881595 (30h41m12.137221694s) [noise=true , address=212.102.52.214:4363 , piece_id=2IKJOPGJUNVG2V4H2PJLB77D4TQJJJUIYAQXCEATZVWMT4T2CZMQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356680305 (30h41m12.140020404s) [noise=true , address=212.102.52.216:4415 , piece_id=POTYHSG6OCQASB353DC6LEH6QFZUOADPIKJ43IKDZR2DFPIQ5IRA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: <nil> May 26 08:45:26.356699312 (30h41m12.140039411s) [seg_pos={0 0}, upload=29355]: Satisfied cohort requirements after 16 pieces May 26 08:45:26.356950430 (30h41m12.14029054s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tyfw7Bp6ma6jTKyBJaSfr5u8w2CwExJVAwkeabjMnsHWWsDdf): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356967333 (30h41m12.140307442s) [noise=true , address=212.102.52.217:4429 , piece_id=Q2KQSEBGZXGN3YW6BG7KPH4LT5ASREULNBXDDE2TMSKCINKIOVDA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.356988753 (30h41m12.140328852s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fPSAqiinK7evjPu4BhmWSHtspDDDqAF1bYZpBdS5qV9tEsbXL): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.356996178 (30h41m12.140336277s) [noise=true , address=212.102.52.215:4373 , piece_id=GCXRRQJJNOT7KXSGB4VXFTJD7IXLRBHFF2CMESY2UJSXULG5P2DA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357054700 (30h41m12.140394799s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J6FD4Y3i9TV7hgSi3QNR8Bf27t9oenvhecVTgy4cMySGFw6Go): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357062154 (30h41m12.140402253s) [noise=true , address=212.102.52.215:4377 , piece_id=I6BPI4SBEES5IB72WBPZHKJHUAU4J6XTUM6EFEJHEO5GDG52ATEQ, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357154811 (30h41m12.14049491s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:187dp7vshTxbunLshbNesCbHBDA4aA7uSFseAvRokmJRWef24E): protocol: expected piece hash; context canceled; EOF May 26 08:45:26.357160662 (30h41m12.140500761s) [noise=true , address=212.102.52.216:4413 , piece_id=62TSUUQES3253TUZ7O5RZCSGZGHWARHRFXPJDMAH6KFOUD4CNFAA, seg_pos={0 0}, upload=29355]: Long tail cancellation due to optimal threshold May 26 08:45:26.357175080 (30h41m12.140515179s) [seg_pos={0 0}, upload=29355]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:45:26.357245053 (30h41m12.140585152s) [upload=29355]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:45:26.357249481 (30h41m12.14058957s) [upload=29355]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:45:46.434632966 (30h41m32.217973065s) [upload=29355]: Done uploading segments... May 26 08:45:46.434701647 (30h41m32.218041736s) [upload=29355]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m11.519567875s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.06605455s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:43:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.066076221s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.380539957s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:42:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 5.380560185s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.709001659s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:41:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 5.709032227s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.517051325s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:40:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.517063607s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 35.29517029s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:40:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 35.295188003s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 3.965502539s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:39:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 3.96552996s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 3.962503228s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:38:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 3.96252008s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.161843457s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:38:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.161861782s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.162548485s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:37:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.16256687s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.203396023s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:37:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.203414118s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.099159707s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:36:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.099183483s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.472736329s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:36:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.472759724s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.160968619s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:35:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.16098947s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.143654014s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:35:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.143666467s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.023359847s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:34:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.023380105s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.005393156s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:33:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 4.0054161s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.20979052s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:32:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 5.209814996s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.17383829s trace: https://jaeger.dev.storj.io/trace/41267ee1c5917b88 FAIL (2026-05-26 08:32:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ODQA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece... May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments... May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil> May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments... May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil> Duration: 5.173858989s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)