Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....X...X........................................] duration:
4.260936015s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:56:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.260962376s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [X.........X.....X...X.......................................] duration:
4.293231097s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:55:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.293358641s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.X.........X.....X...X......................................] duration:
3.971905365s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:54:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.971926115s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..X.........X.....X...X.....................................] duration:
4.143780655s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:53:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.143805103s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...X.........X.....X...X....................................] duration:
4.107935925s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:53:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.107960863s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [....X.........X.....X...X...................................] duration:
4.019702003s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:52:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.019715989s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........X.....X...X..................................] duration:
4.567515695s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:52:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.567538057s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [......X.........X.....X...X.................................] duration:
9.766917646s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:51:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 9.766959114s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........X.....X...X................................] duration:
3.93573458s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:50:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.935758264s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [........X.........X.....X...X...............................] duration:
3.998889318s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:49:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.998903254s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........X.....X...X..............................] duration:
4.945807691s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:48:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.945831086s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..........X.........X.....X...X.............................] duration:
4.237964316s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:47:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.237994104s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...........X.........X.....X...X............................] duration:
4.941829731s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:46:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.941848446s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [............X.........X.....X...X...........................] duration:
3.930086854s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:45:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.930108426s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.............X.........X.....X...X..........................] duration:
4.195879678s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:45:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.195900979s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..............X.........X.....X...X.........................] duration:
3.898658745s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:44:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.898678433s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...............X.........X.....X...X........................] duration:
3.966309581s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:43:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.966335059s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [................X.........X.....X...X.......................] duration:
6.788940392s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:42:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 6.788965229s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.................X.........X.....X...X......................] duration:
3.935199721s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:41:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.9352463s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..................X.........X.....X...X.....................] duration:
4.816726158s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:40:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.816746145s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...................X.........X.....X...X....................] duration:
4.116246457s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:39:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.116265876s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [....................X.........X.....X...X...................] duration:
4.124314041s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:39:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.124343267s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.........X.....X...X..................] duration:
4.463923404s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:39:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.463946698s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [......................X.........X.....X...X.................] duration:
4.358555389s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:39:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.358575779s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.........X.....X...X................] duration:
4.135302199s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:38:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.135344609s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [........................X.........X.....X...X...............] duration:
3.968619741s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:37:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.968641242s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.........X.....X...X..............] duration:
4.219447806s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:36:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.219466461s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.........X.....X...X.............] duration:
3.969908993s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:35:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.969981521s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.........X.....X...X............] duration:
24.817718034s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:35:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 24.817737452s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [............................X.........X.....X...X...........] duration:
23.459130482s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:34:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 23.459157404s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.........X.....X...X..........] duration:
4.12431527s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:33:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.124335999s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..............................X.........X.....X...X.........] duration:
3.98143169s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:32:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.981444594s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...............................X.........X.....X...X........] duration:
4.61214691s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:32:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.612158051s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [................................X.........X.....X...X.......] duration:
4.376175564s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:32:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.376198288s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.................................X.........X.....X...X......] duration:
4.211540194s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:31:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.211562376s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [..................................X.........X.....X...X.....] duration:
3.95685286s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:30:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 3.956875244s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [...................................X.........X.....X...X....] duration:
4.285605099s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:29:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.285648671s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [....................................X.........X.....X...X...] duration:
6.330171496s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:28:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 6.330191084s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X.........X.....X...X..] duration:
4.243086137s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:28:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 4.243097187s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [......................................X.........X.....X...X.] duration:
58.194621982s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:27:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 58.194637862s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [.......................................X.........X.....X...X] duration:
1m0.001313153s trace:
https://jaeger.dev.storj.io/trace/4e48245c0b50a21a
FAIL (2026-05-25 08:26:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 25 08:26:46.035810041 (6h22m31.81915013s) [upload=6137]: Starting upload May 25 08:26:46.035848194 (6h22m31.819188293s) [upload=6137]: Done starting upload May 25 08:26:46.035953274 (6h22m31.819293363s) [upload=6137]: Uploading segments... May 25 08:26:46.036030622 (6h22m31.819370721s) [upload=6137]: Got next segment. Inline: false May 25 08:26:46.036060699 (6h22m31.819400798s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 25 08:26:46.036064066 (6h22m31.819404165s) [upload=6137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin May 25 08:26:56.790181286 (6h22m42.573521385s) [upload=6137]: Next segment err: context deadline exceeded May 25 08:26:56.790377070 (6h22m42.573717159s) [upload=6137]: Done uploading segments... May 25 08:26:56.790413249 (6h22m42.573753348s) [upload=6137]: Upload finished. err: context deadline exceeded
Duration: 1m0.001327981s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [........................................X.........X.....X...] duration:
4.100970714s trace:
https://jaeger.dev.storj.io/trace/144d39178c68837
FAIL (2026-05-25 08:25:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
, piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545699663 (6h19m34.329039762s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545982843 (6h19m34.329322942s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545999043 (6h19m34.329339142s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546239642 (6h19m34.329579741s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546381854 (6h19m34.329721953s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546493267 (6h19m34.329833366s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546621762 (6h19m34.329961861s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546713286 (6h19m34.330053385s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546856440 (6h19m34.330196539s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546940450 (6h19m34.330280539s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547078242 (6h19m34.330418331s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547303022 (6h19m34.330643121s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547522991 (6h19m34.33086309s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547787276 (6h19m34.331127375s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.548525324 (6h19m34.331865423s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:49.610210263 (6h19m35.393550362s) [upload=6080]: Next returned nil segment
May 25 08:23:49.610220692 (6h19m35.393560791s) [upload=6080]: Waiting for error group managing segments...
May 25 08:23:49.893558152 (6h19m35.676898251s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894157516 (6h19m35.677497615s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894519837 (6h19m35.677859946s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.900938334 (6h19m35.684278433s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.902493371 (6h19m35.68583347s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.905653560 (6h19m35.688993649s) [noise=true , address=212.102.52.214:4352 , piece_id=ISHVAMUB2GZDIUQOMCLB7QJ77YH46YW6B7ZL27X52DPCIHBFHOBA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.906030189 (6h19m35.689370289s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911170577 (6h19m35.694510676s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911545653 (6h19m35.694885752s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.915089896 (6h19m35.698429995s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.917470267 (6h19m35.700810366s) [noise=true , address=212.102.52.213:4340 , piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.918496214 (6h19m35.701836324s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.952683916 (6h19m35.736024015s) [noise=true , address=212.102.52.216:4413 , piece_id=PSL5INEUF3CADO5QVUIWFHWJRSG4LW733S6AJASDD77GGIXCBGVA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.955937675 (6h19m35.739277774s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.960108533 (6h19m35.743448632s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967209412 (6h19m35.750549511s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967228058 (6h19m35.750568157s) [seg_pos={0 0}, upload=6080]: Satisfied cohort requirements after 16 pieces
May 25 08:23:49.967442637 (6h19m35.750782736s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ku2quD8AHh79sZcysV979DNjGBVGAazWZM7P5vPeckaKfoBL5): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967449610 (6h19m35.750789709s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967476491 (6h19m35.750816591s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967501529 (6h19m35.750841628s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967676664 (6h19m35.751016763s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967701480 (6h19m35.751041579s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967818093 (6h19m35.751158192s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BxSouF8VxKdtKF8TvqPyZFEkAM8qwmgC8ibpwDKpiob8jDp4q): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967824234 (6h19m35.751164333s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967840456 (6h19m35.751180555s) [seg_pos={0 0}, upload=6080]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 08:23:49.967914356 (6h19m35.751254455s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 08:23:49.967918575 (6h19m35.751258674s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 08:23:57.851733943 (6h19m43.635074042s) [upload=6080]: Done uploading segments...
May 25 08:23:57.851802473 (6h19m43.635142563s) [upload=6080]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.100991935s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [.........................................X.........X.....X..] duration:
4.166518022s trace:
https://jaeger.dev.storj.io/trace/144d39178c68837
FAIL (2026-05-25 08:24:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
, piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545699663 (6h19m34.329039762s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545982843 (6h19m34.329322942s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545999043 (6h19m34.329339142s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546239642 (6h19m34.329579741s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546381854 (6h19m34.329721953s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546493267 (6h19m34.329833366s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546621762 (6h19m34.329961861s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546713286 (6h19m34.330053385s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546856440 (6h19m34.330196539s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546940450 (6h19m34.330280539s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547078242 (6h19m34.330418331s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547303022 (6h19m34.330643121s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547522991 (6h19m34.33086309s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547787276 (6h19m34.331127375s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.548525324 (6h19m34.331865423s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:49.610210263 (6h19m35.393550362s) [upload=6080]: Next returned nil segment
May 25 08:23:49.610220692 (6h19m35.393560791s) [upload=6080]: Waiting for error group managing segments...
May 25 08:23:49.893558152 (6h19m35.676898251s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894157516 (6h19m35.677497615s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894519837 (6h19m35.677859946s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.900938334 (6h19m35.684278433s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.902493371 (6h19m35.68583347s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.905653560 (6h19m35.688993649s) [noise=true , address=212.102.52.214:4352 , piece_id=ISHVAMUB2GZDIUQOMCLB7QJ77YH46YW6B7ZL27X52DPCIHBFHOBA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.906030189 (6h19m35.689370289s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911170577 (6h19m35.694510676s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911545653 (6h19m35.694885752s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.915089896 (6h19m35.698429995s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.917470267 (6h19m35.700810366s) [noise=true , address=212.102.52.213:4340 , piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.918496214 (6h19m35.701836324s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.952683916 (6h19m35.736024015s) [noise=true , address=212.102.52.216:4413 , piece_id=PSL5INEUF3CADO5QVUIWFHWJRSG4LW733S6AJASDD77GGIXCBGVA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.955937675 (6h19m35.739277774s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.960108533 (6h19m35.743448632s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967209412 (6h19m35.750549511s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967228058 (6h19m35.750568157s) [seg_pos={0 0}, upload=6080]: Satisfied cohort requirements after 16 pieces
May 25 08:23:49.967442637 (6h19m35.750782736s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ku2quD8AHh79sZcysV979DNjGBVGAazWZM7P5vPeckaKfoBL5): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967449610 (6h19m35.750789709s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967476491 (6h19m35.750816591s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967501529 (6h19m35.750841628s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967676664 (6h19m35.751016763s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967701480 (6h19m35.751041579s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967818093 (6h19m35.751158192s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BxSouF8VxKdtKF8TvqPyZFEkAM8qwmgC8ibpwDKpiob8jDp4q): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967824234 (6h19m35.751164333s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967840456 (6h19m35.751180555s) [seg_pos={0 0}, upload=6080]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 08:23:49.967914356 (6h19m35.751254455s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 08:23:49.967918575 (6h19m35.751258674s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 08:23:57.851733943 (6h19m43.635074042s) [upload=6080]: Done uploading segments...
May 25 08:23:57.851802473 (6h19m43.635142563s) [upload=6080]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.166539242s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [..........................................X.........X.....X.] duration:
4.044766805s trace:
https://jaeger.dev.storj.io/trace/144d39178c68837
FAIL (2026-05-25 08:24:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
, piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545699663 (6h19m34.329039762s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545982843 (6h19m34.329322942s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545999043 (6h19m34.329339142s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546239642 (6h19m34.329579741s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546381854 (6h19m34.329721953s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546493267 (6h19m34.329833366s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546621762 (6h19m34.329961861s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546713286 (6h19m34.330053385s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546856440 (6h19m34.330196539s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546940450 (6h19m34.330280539s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547078242 (6h19m34.330418331s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547303022 (6h19m34.330643121s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547522991 (6h19m34.33086309s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547787276 (6h19m34.331127375s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.548525324 (6h19m34.331865423s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:49.610210263 (6h19m35.393550362s) [upload=6080]: Next returned nil segment
May 25 08:23:49.610220692 (6h19m35.393560791s) [upload=6080]: Waiting for error group managing segments...
May 25 08:23:49.893558152 (6h19m35.676898251s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894157516 (6h19m35.677497615s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894519837 (6h19m35.677859946s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.900938334 (6h19m35.684278433s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.902493371 (6h19m35.68583347s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.905653560 (6h19m35.688993649s) [noise=true , address=212.102.52.214:4352 , piece_id=ISHVAMUB2GZDIUQOMCLB7QJ77YH46YW6B7ZL27X52DPCIHBFHOBA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.906030189 (6h19m35.689370289s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911170577 (6h19m35.694510676s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911545653 (6h19m35.694885752s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.915089896 (6h19m35.698429995s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.917470267 (6h19m35.700810366s) [noise=true , address=212.102.52.213:4340 , piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.918496214 (6h19m35.701836324s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.952683916 (6h19m35.736024015s) [noise=true , address=212.102.52.216:4413 , piece_id=PSL5INEUF3CADO5QVUIWFHWJRSG4LW733S6AJASDD77GGIXCBGVA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.955937675 (6h19m35.739277774s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.960108533 (6h19m35.743448632s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967209412 (6h19m35.750549511s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967228058 (6h19m35.750568157s) [seg_pos={0 0}, upload=6080]: Satisfied cohort requirements after 16 pieces
May 25 08:23:49.967442637 (6h19m35.750782736s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ku2quD8AHh79sZcysV979DNjGBVGAazWZM7P5vPeckaKfoBL5): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967449610 (6h19m35.750789709s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967476491 (6h19m35.750816591s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967501529 (6h19m35.750841628s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967676664 (6h19m35.751016763s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967701480 (6h19m35.751041579s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967818093 (6h19m35.751158192s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BxSouF8VxKdtKF8TvqPyZFEkAM8qwmgC8ibpwDKpiob8jDp4q): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967824234 (6h19m35.751164333s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967840456 (6h19m35.751180555s) [seg_pos={0 0}, upload=6080]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 08:23:49.967914356 (6h19m35.751254455s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 08:23:49.967918575 (6h19m35.751258674s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 08:23:57.851733943 (6h19m43.635074042s) [upload=6080]: Done uploading segments...
May 25 08:23:57.851802473 (6h19m43.635142563s) [upload=6080]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.044779368s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [...........................................X.........X.....X] duration:
1m0.527227931s trace:
https://jaeger.dev.storj.io/trace/144d39178c68837
FAIL (2026-05-25 08:23:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
, piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545699663 (6h19m34.329039762s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545982843 (6h19m34.329322942s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.545999043 (6h19m34.329339142s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546239642 (6h19m34.329579741s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546381854 (6h19m34.329721953s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546493267 (6h19m34.329833366s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546621762 (6h19m34.329961861s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546713286 (6h19m34.330053385s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546856440 (6h19m34.330196539s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.546940450 (6h19m34.330280539s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547078242 (6h19m34.330418331s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547303022 (6h19m34.330643121s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547522991 (6h19m34.33086309s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.547787276 (6h19m34.331127375s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:48.548525324 (6h19m34.331865423s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Uploading piece...
May 25 08:23:49.610210263 (6h19m35.393550362s) [upload=6080]: Next returned nil segment
May 25 08:23:49.610220692 (6h19m35.393560791s) [upload=6080]: Waiting for error group managing segments...
May 25 08:23:49.893558152 (6h19m35.676898251s) [noise=true , address=212.102.52.217:4439 , piece_id=VRQR4TSDAML35MPPYILNZ6ATIYOJIU3Y6AJVT4FML3OQV4YVL67A, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894157516 (6h19m35.677497615s) [noise=true , address=212.102.52.216:4401 , piece_id=VG4BEY6K5OTYC57QBRP7NPET4RIELJEIY3INMY6ZJMM4V5APMOZA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.894519837 (6h19m35.677859946s) [noise=true , address=212.102.52.216:4415 , piece_id=LM7R7NBJV26GU6YLRFP4QI57JG7JWSHTML2MCI3MCFNWVYXVXOLA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.900938334 (6h19m35.684278433s) [noise=true , address=212.102.52.214:4360 , piece_id=V4SE7JFM523UWOJQFL2PKEAPD7YOPLGJDDUW3W74A2EDPT6RVDNA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.902493371 (6h19m35.68583347s) [noise=true , address=212.102.52.215:4377 , piece_id=3PAMAK34WT2SKIQ75POHSDZ7VWOCNM7KFNUN6GKRMIXGGQY7ENIA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.905653560 (6h19m35.688993649s) [noise=true , address=212.102.52.214:4352 , piece_id=ISHVAMUB2GZDIUQOMCLB7QJ77YH46YW6B7ZL27X52DPCIHBFHOBA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.906030189 (6h19m35.689370289s) [noise=true , address=212.102.52.217:4431 , piece_id=VORYIQMOJ45GI26RVZ6EY4Z7B3RVYCFFPHSHIZ4ALJ6HR7THQF3Q, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911170577 (6h19m35.694510676s) [noise=true , address=212.102.52.215:4387 , piece_id=5PJ3YK2W6CGET3BG276MXKCYJ6LCM3IZ6YQPXTQSF5X4NJN6JTQQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.911545653 (6h19m35.694885752s) [noise=true , address=212.102.52.214:4355 , piece_id=UBVZE5HWTIQM6EG5WOZ6PFPSEZHYJE7DDI6C4FBV53E6ISAMBQWQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.915089896 (6h19m35.698429995s) [noise=true , address=212.102.52.213:4343 , piece_id=3VVY6UZR5WTLJBINEF5CXD3ECZ6S7MLGVREI3JP54TQUNVZMDGAA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.917470267 (6h19m35.700810366s) [noise=true , address=212.102.52.213:4340 , piece_id=A5FHWH6NTT2U65P26XHA5IQ63XUHMBFNOJ53AYEIJEOSWZMLXFGA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.918496214 (6h19m35.701836324s) [noise=true , address=212.102.52.216:4399 , piece_id=DGIGIB6WRSZBQK6R6AMM5LPDRXJX4AAJLA4OTGXJW2IFNYYDAHMA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.952683916 (6h19m35.736024015s) [noise=true , address=212.102.52.216:4413 , piece_id=PSL5INEUF3CADO5QVUIWFHWJRSG4LW733S6AJASDD77GGIXCBGVA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.955937675 (6h19m35.739277774s) [noise=true , address=212.102.52.213:4332 , piece_id=O6YSGM2X6DEX3HJYBC7MDG7HE3RRTETBWAB5BCASAZSJBFQNY6BQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.960108533 (6h19m35.743448632s) [noise=true , address=212.102.52.217:4425 , piece_id=ND3C5XP42BMVRNU7UWFGEESPXXYZTNJ3IMX3VEFCF6DXYS5XMBSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967209412 (6h19m35.750549511s) [noise=true , address=212.102.52.215:4373 , piece_id=MICF73ABRFCNA2JI4L3GCJNYBIKL6HXOPZZARJBFJJMNMVMGKRHQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: <nil>
May 25 08:23:49.967228058 (6h19m35.750568157s) [seg_pos={0 0}, upload=6080]: Satisfied cohort requirements after 16 pieces
May 25 08:23:49.967442637 (6h19m35.750782736s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ku2quD8AHh79sZcysV979DNjGBVGAazWZM7P5vPeckaKfoBL5): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967449610 (6h19m35.750789709s) [noise=true , address=212.102.52.214:4345 , piece_id=N45FG264KIFAPUPFUKVAD6272NR7RMNS35HOEVUQ7E4AYDPW4WEA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967476491 (6h19m35.750816591s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967501529 (6h19m35.750841628s) [noise=true , address=212.102.52.215:4372 , piece_id=56KVLDTYT6HRIKF7TNFDNLN5J6G5XLM42JUZCRFND77WO44S7EDQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967676664 (6h19m35.751016763s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967701480 (6h19m35.751041579s) [noise=true , address=212.102.52.213:4331 , piece_id=ID3RQUTYQ3LJLO3R2X6A7P5ECAAPJLUKXF4A53NSC7TA2UEEDAYQ, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967818093 (6h19m35.751158192s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BxSouF8VxKdtKF8TvqPyZFEkAM8qwmgC8ibpwDKpiob8jDp4q): protocol: expected piece hash; context canceled; EOF
May 25 08:23:49.967824234 (6h19m35.751164333s) [noise=true , address=212.102.52.217:4418 , piece_id=YSI6YOS2EGIP5SNTLCHG26IYMDB3A6OFP3CEDLKM3AZIQUP5SHSA, seg_pos={0 0}, upload=6080]: Long tail cancellation due to optimal threshold
May 25 08:23:49.967840456 (6h19m35.751180555s) [seg_pos={0 0}, upload=6080]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 08:23:49.967914356 (6h19m35.751254455s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 08:23:49.967918575 (6h19m35.751258674s) [upload=6080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 08:23:57.851733943 (6h19m43.635074042s) [upload=6080]: Done uploading segments...
May 25 08:23:57.851802473 (6h19m43.635142563s) [upload=6080]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.527246736s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.........X.....] duration:
6.982562613s trace:
https://jaeger.dev.storj.io/trace/3485869bb2e5c930
FAIL (2026-05-25 08:22:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 16 but got 0)
======LOGS======
POGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Uploading piece...
May 25 08:19:05.117766300 (6h14m50.901106399s) [upload=6006]: Next segment err: context deadline exceeded
May 25 08:19:05.118088345 (6h14m50.901428444s) [noise=true , address=212.102.52.217:4434 , piece_id=KQG6RVZFANV62UKZNJIUJFXESPTAGMCGRXTP7MSDNJZVBKTBWWBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KMzn6eZL5cHZtrCcsMinV1AEroczRHipg53KnfZmVCFW1DsZM, address:212.102.52.217:4434): protocol: read tcp 188.166.225.170:49926->212.102.52.217:4434: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118316710 (6h14m50.901656809s) [noise=true , address=212.102.52.213:4342 , piece_id=NSUN5Z6W6ESOUOOYYF5XPMLYEXH7BFEZRXMGMZKN5ZA3EBOYEUAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K, address:212.102.52.213:4342): protocol: read tcp 188.166.225.170:58960->212.102.52.213:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118459954 (6h14m50.901800053s) [noise=true , address=212.102.52.215:4371 , piece_id=BHW6IUONRCFD34RP77CZHXXGTWB7VH3NAYPINQCBZZQV6NFX5NAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY, address:212.102.52.215:4371): protocol: read tcp 188.166.225.170:34824->212.102.52.215:4371: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118559303 (6h14m50.901899402s) [noise=true , address=212.102.52.217:4427 , piece_id=HX3YLZZMZDXS7HDGFG2GU6LPE3PS2IYNKZHFWPF7KYO4BOBAEZIQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp, address:212.102.52.217:4427): protocol: read tcp 188.166.225.170:48756->212.102.52.217:4427: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118674944 (6h14m50.902015043s) [noise=true , address=212.102.52.214:4364 , piece_id=BTZEZNNNBSVJ7XXEHYULUGRYOB3JF5LL3GFXWPMOYMW4ADYGTFGA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p, address:212.102.52.214:4364): protocol: read tcp 188.166.225.170:50004->212.102.52.214:4364: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118777600 (6h14m50.902117699s) [noise=true , address=212.102.52.216:4415 , piece_id=LDQEIE3SGAJNFVBEEZ27ZFWNKSSS2JZVYEABUOOUKU74HKMOSXBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT, address:212.102.52.216:4415): protocol: read tcp 188.166.225.170:45862->212.102.52.216:4415: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118805453 (6h14m50.902145542s) [noise=true , address=212.102.52.213:4340 , piece_id=5XTBBIAEJ4Y6JJIXUR43KAFEXAE3V6PKXZIORZIXZWLAUKGBM35A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM, address:212.102.52.213:4340): protocol: read tcp 188.166.225.170:51970->212.102.52.213:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118880506 (6h14m50.902220606s) [noise=true , address=212.102.52.213:4329 , piece_id=MIS6NL4X4HTHUPUUXEWD6WWTSWH4JY5NIAGGQOMHKODLPD6Z2HUQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J, address:212.102.52.213:4329): protocol: read tcp 188.166.225.170:58498->212.102.52.213:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118944478 (6h14m50.902284577s) [noise=true , address=212.102.52.213:4331 , piece_id=YGMIW7CVSZYA72PROVBMFOPHPB55CPEAUVCSUYDXPSLNRZQXJSNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn, address:212.102.52.213:4331): protocol: read tcp 188.166.225.170:36064->212.102.52.213:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118979285 (6h14m50.902319384s) [noise=true , address=212.102.52.215:4388 , piece_id=7NUQBSCYYB2NVIDQJYPBVQVDZVBL2PV53RR2GVDXVESORB3OFMCQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF, address:212.102.52.215:4388): protocol: read tcp 188.166.225.170:33096->212.102.52.215:4388: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119057244 (6h14m50.902397333s) [noise=true , address=212.102.52.216:4394 , piece_id=CI2FNS7JIJAR6RFA36TWUBGPPSDZUYG3VBZZIMWSKMW7PRMJPCNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1WM75xZMY7yQ1ga2AiqsvGZT3uptidF9pFi2T6yoc1jeqGPVcf, address:212.102.52.216:4394): protocol: read tcp 188.166.225.170:44174->212.102.52.216:4394: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119068846 (6h14m50.902408945s) [noise=true , address=212.102.52.215:4370 , piece_id=EQOTUHFSH37DPWFXKX63L7AZZ47NM7TXE6M2ET6HRXIUPUBE5SQQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD, address:212.102.52.215:4370): protocol: read tcp 188.166.225.170:59952->212.102.52.215:4370: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119084907 (6h14m50.902425006s) [noise=true , address=212.102.52.216:4399 , piece_id=4VMLOMHEBAWHHFQHWOVGFDAJ5R4ZP7HGWYTNJRT2FB4HP5CTVXEQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy, address:212.102.52.216:4399): protocol: read tcp 188.166.225.170:55390->212.102.52.216:4399: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119224593 (6h14m50.902564692s) [noise=true , address=212.102.52.214:4356 , piece_id=PFUE5DEXLVNJ2O7MW4TJYOKJ5BVT3T3XHPWQZTDGTRQSOLMIQ22A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd, address:212.102.52.214:4356): protocol: read tcp 188.166.225.170:43210->212.102.52.214:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119381422 (6h14m50.902721521s) [noise=true , address=212.102.52.214:4346 , piece_id=EAV3BFL5IY2MI2AVRPAH6TEIL6YE3ZTFCKRTDJAEMBOOLIMBWUVQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F, address:212.102.52.214:4346): protocol: read tcp 188.166.225.170:46098->212.102.52.214:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119588417 (6h14m50.902928506s) [noise=true , address=212.102.52.217:4440 , piece_id=22DGCTHMWQHD5S5GHMB6TACJOLJYTLOAWM77TJIZT3TBG7CCBHCA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk, address:212.102.52.217:4440): protocol: read tcp 188.166.225.170:35096->212.102.52.217:4440: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119734756 (6h14m50.903074845s) [noise=true , address=212.102.52.216:4400 , piece_id=BT3GXTY4X2MIQX6W66KOH5CQURUTFTGAIOA43TR7JJNW2A3XQEHQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz, address:212.102.52.216:4400): protocol: read tcp 188.166.225.170:44760->212.102.52.216:4400: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119782047 (6h14m50.903122146s) [noise=true , address=212.102.52.215:4390 , piece_id=JADWLBZHARQID2BRQ4WPOGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK, address:212.102.52.215:4390): protocol: read tcp 188.166.225.170:42360->212.102.52.215:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119881616 (6h14m50.903221716s) [noise=true , address=212.102.52.214:4359 , piece_id=RDGAIHZ6U57RX5RWNIDX5TUYXTKQTS3NEF6UJKF5KOQPNNOBUS3A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA, address:212.102.52.214:4359): protocol: read tcp 188.166.225.170:55742->212.102.52.214:4359: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119970095 (6h14m50.903310194s) [noise=true , address=212.102.52.217:4431 , piece_id=XCHNQP74SJCY4LD4FZP4I5V3JB72KRLIE22AAERGFVEAYBWBI5VQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG, address:212.102.52.217:4431): protocol: read tcp 188.166.225.170:57354->212.102.52.217:4431: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119993661 (6h14m50.90333376s) [seg_pos={0 0}, upload=6006]: Done waiting for segment. successful: 0 optimal: 16 errs: <nil>
Duration: 6.982600615s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.........X....] duration:
3.986056061s trace:
https://jaeger.dev.storj.io/trace/3485869bb2e5c930
FAIL (2026-05-25 08:21:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 16 but got 0)
======LOGS======
POGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Uploading piece...
May 25 08:19:05.117766300 (6h14m50.901106399s) [upload=6006]: Next segment err: context deadline exceeded
May 25 08:19:05.118088345 (6h14m50.901428444s) [noise=true , address=212.102.52.217:4434 , piece_id=KQG6RVZFANV62UKZNJIUJFXESPTAGMCGRXTP7MSDNJZVBKTBWWBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KMzn6eZL5cHZtrCcsMinV1AEroczRHipg53KnfZmVCFW1DsZM, address:212.102.52.217:4434): protocol: read tcp 188.166.225.170:49926->212.102.52.217:4434: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118316710 (6h14m50.901656809s) [noise=true , address=212.102.52.213:4342 , piece_id=NSUN5Z6W6ESOUOOYYF5XPMLYEXH7BFEZRXMGMZKN5ZA3EBOYEUAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K, address:212.102.52.213:4342): protocol: read tcp 188.166.225.170:58960->212.102.52.213:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118459954 (6h14m50.901800053s) [noise=true , address=212.102.52.215:4371 , piece_id=BHW6IUONRCFD34RP77CZHXXGTWB7VH3NAYPINQCBZZQV6NFX5NAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY, address:212.102.52.215:4371): protocol: read tcp 188.166.225.170:34824->212.102.52.215:4371: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118559303 (6h14m50.901899402s) [noise=true , address=212.102.52.217:4427 , piece_id=HX3YLZZMZDXS7HDGFG2GU6LPE3PS2IYNKZHFWPF7KYO4BOBAEZIQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp, address:212.102.52.217:4427): protocol: read tcp 188.166.225.170:48756->212.102.52.217:4427: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118674944 (6h14m50.902015043s) [noise=true , address=212.102.52.214:4364 , piece_id=BTZEZNNNBSVJ7XXEHYULUGRYOB3JF5LL3GFXWPMOYMW4ADYGTFGA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p, address:212.102.52.214:4364): protocol: read tcp 188.166.225.170:50004->212.102.52.214:4364: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118777600 (6h14m50.902117699s) [noise=true , address=212.102.52.216:4415 , piece_id=LDQEIE3SGAJNFVBEEZ27ZFWNKSSS2JZVYEABUOOUKU74HKMOSXBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT, address:212.102.52.216:4415): protocol: read tcp 188.166.225.170:45862->212.102.52.216:4415: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118805453 (6h14m50.902145542s) [noise=true , address=212.102.52.213:4340 , piece_id=5XTBBIAEJ4Y6JJIXUR43KAFEXAE3V6PKXZIORZIXZWLAUKGBM35A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM, address:212.102.52.213:4340): protocol: read tcp 188.166.225.170:51970->212.102.52.213:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118880506 (6h14m50.902220606s) [noise=true , address=212.102.52.213:4329 , piece_id=MIS6NL4X4HTHUPUUXEWD6WWTSWH4JY5NIAGGQOMHKODLPD6Z2HUQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J, address:212.102.52.213:4329): protocol: read tcp 188.166.225.170:58498->212.102.52.213:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118944478 (6h14m50.902284577s) [noise=true , address=212.102.52.213:4331 , piece_id=YGMIW7CVSZYA72PROVBMFOPHPB55CPEAUVCSUYDXPSLNRZQXJSNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn, address:212.102.52.213:4331): protocol: read tcp 188.166.225.170:36064->212.102.52.213:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118979285 (6h14m50.902319384s) [noise=true , address=212.102.52.215:4388 , piece_id=7NUQBSCYYB2NVIDQJYPBVQVDZVBL2PV53RR2GVDXVESORB3OFMCQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF, address:212.102.52.215:4388): protocol: read tcp 188.166.225.170:33096->212.102.52.215:4388: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119057244 (6h14m50.902397333s) [noise=true , address=212.102.52.216:4394 , piece_id=CI2FNS7JIJAR6RFA36TWUBGPPSDZUYG3VBZZIMWSKMW7PRMJPCNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1WM75xZMY7yQ1ga2AiqsvGZT3uptidF9pFi2T6yoc1jeqGPVcf, address:212.102.52.216:4394): protocol: read tcp 188.166.225.170:44174->212.102.52.216:4394: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119068846 (6h14m50.902408945s) [noise=true , address=212.102.52.215:4370 , piece_id=EQOTUHFSH37DPWFXKX63L7AZZ47NM7TXE6M2ET6HRXIUPUBE5SQQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD, address:212.102.52.215:4370): protocol: read tcp 188.166.225.170:59952->212.102.52.215:4370: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119084907 (6h14m50.902425006s) [noise=true , address=212.102.52.216:4399 , piece_id=4VMLOMHEBAWHHFQHWOVGFDAJ5R4ZP7HGWYTNJRT2FB4HP5CTVXEQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy, address:212.102.52.216:4399): protocol: read tcp 188.166.225.170:55390->212.102.52.216:4399: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119224593 (6h14m50.902564692s) [noise=true , address=212.102.52.214:4356 , piece_id=PFUE5DEXLVNJ2O7MW4TJYOKJ5BVT3T3XHPWQZTDGTRQSOLMIQ22A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd, address:212.102.52.214:4356): protocol: read tcp 188.166.225.170:43210->212.102.52.214:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119381422 (6h14m50.902721521s) [noise=true , address=212.102.52.214:4346 , piece_id=EAV3BFL5IY2MI2AVRPAH6TEIL6YE3ZTFCKRTDJAEMBOOLIMBWUVQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F, address:212.102.52.214:4346): protocol: read tcp 188.166.225.170:46098->212.102.52.214:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119588417 (6h14m50.902928506s) [noise=true , address=212.102.52.217:4440 , piece_id=22DGCTHMWQHD5S5GHMB6TACJOLJYTLOAWM77TJIZT3TBG7CCBHCA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk, address:212.102.52.217:4440): protocol: read tcp 188.166.225.170:35096->212.102.52.217:4440: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119734756 (6h14m50.903074845s) [noise=true , address=212.102.52.216:4400 , piece_id=BT3GXTY4X2MIQX6W66KOH5CQURUTFTGAIOA43TR7JJNW2A3XQEHQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz, address:212.102.52.216:4400): protocol: read tcp 188.166.225.170:44760->212.102.52.216:4400: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119782047 (6h14m50.903122146s) [noise=true , address=212.102.52.215:4390 , piece_id=JADWLBZHARQID2BRQ4WPOGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK, address:212.102.52.215:4390): protocol: read tcp 188.166.225.170:42360->212.102.52.215:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119881616 (6h14m50.903221716s) [noise=true , address=212.102.52.214:4359 , piece_id=RDGAIHZ6U57RX5RWNIDX5TUYXTKQTS3NEF6UJKF5KOQPNNOBUS3A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA, address:212.102.52.214:4359): protocol: read tcp 188.166.225.170:55742->212.102.52.214:4359: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119970095 (6h14m50.903310194s) [noise=true , address=212.102.52.217:4431 , piece_id=XCHNQP74SJCY4LD4FZP4I5V3JB72KRLIE22AAERGFVEAYBWBI5VQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG, address:212.102.52.217:4431): protocol: read tcp 188.166.225.170:57354->212.102.52.217:4431: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119993661 (6h14m50.90333376s) [seg_pos={0 0}, upload=6006]: Done waiting for segment. successful: 0 optimal: 16 errs: <nil>
Duration: 3.986069607s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.........X...] duration:
6.21391649s trace:
https://jaeger.dev.storj.io/trace/3485869bb2e5c930
FAIL (2026-05-25 08:20:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 16 but got 0)
======LOGS======
POGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Uploading piece...
May 25 08:19:05.117766300 (6h14m50.901106399s) [upload=6006]: Next segment err: context deadline exceeded
May 25 08:19:05.118088345 (6h14m50.901428444s) [noise=true , address=212.102.52.217:4434 , piece_id=KQG6RVZFANV62UKZNJIUJFXESPTAGMCGRXTP7MSDNJZVBKTBWWBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KMzn6eZL5cHZtrCcsMinV1AEroczRHipg53KnfZmVCFW1DsZM, address:212.102.52.217:4434): protocol: read tcp 188.166.225.170:49926->212.102.52.217:4434: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118316710 (6h14m50.901656809s) [noise=true , address=212.102.52.213:4342 , piece_id=NSUN5Z6W6ESOUOOYYF5XPMLYEXH7BFEZRXMGMZKN5ZA3EBOYEUAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K, address:212.102.52.213:4342): protocol: read tcp 188.166.225.170:58960->212.102.52.213:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118459954 (6h14m50.901800053s) [noise=true , address=212.102.52.215:4371 , piece_id=BHW6IUONRCFD34RP77CZHXXGTWB7VH3NAYPINQCBZZQV6NFX5NAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY, address:212.102.52.215:4371): protocol: read tcp 188.166.225.170:34824->212.102.52.215:4371: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118559303 (6h14m50.901899402s) [noise=true , address=212.102.52.217:4427 , piece_id=HX3YLZZMZDXS7HDGFG2GU6LPE3PS2IYNKZHFWPF7KYO4BOBAEZIQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp, address:212.102.52.217:4427): protocol: read tcp 188.166.225.170:48756->212.102.52.217:4427: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118674944 (6h14m50.902015043s) [noise=true , address=212.102.52.214:4364 , piece_id=BTZEZNNNBSVJ7XXEHYULUGRYOB3JF5LL3GFXWPMOYMW4ADYGTFGA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p, address:212.102.52.214:4364): protocol: read tcp 188.166.225.170:50004->212.102.52.214:4364: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118777600 (6h14m50.902117699s) [noise=true , address=212.102.52.216:4415 , piece_id=LDQEIE3SGAJNFVBEEZ27ZFWNKSSS2JZVYEABUOOUKU74HKMOSXBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT, address:212.102.52.216:4415): protocol: read tcp 188.166.225.170:45862->212.102.52.216:4415: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118805453 (6h14m50.902145542s) [noise=true , address=212.102.52.213:4340 , piece_id=5XTBBIAEJ4Y6JJIXUR43KAFEXAE3V6PKXZIORZIXZWLAUKGBM35A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM, address:212.102.52.213:4340): protocol: read tcp 188.166.225.170:51970->212.102.52.213:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118880506 (6h14m50.902220606s) [noise=true , address=212.102.52.213:4329 , piece_id=MIS6NL4X4HTHUPUUXEWD6WWTSWH4JY5NIAGGQOMHKODLPD6Z2HUQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J, address:212.102.52.213:4329): protocol: read tcp 188.166.225.170:58498->212.102.52.213:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118944478 (6h14m50.902284577s) [noise=true , address=212.102.52.213:4331 , piece_id=YGMIW7CVSZYA72PROVBMFOPHPB55CPEAUVCSUYDXPSLNRZQXJSNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn, address:212.102.52.213:4331): protocol: read tcp 188.166.225.170:36064->212.102.52.213:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118979285 (6h14m50.902319384s) [noise=true , address=212.102.52.215:4388 , piece_id=7NUQBSCYYB2NVIDQJYPBVQVDZVBL2PV53RR2GVDXVESORB3OFMCQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF, address:212.102.52.215:4388): protocol: read tcp 188.166.225.170:33096->212.102.52.215:4388: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119057244 (6h14m50.902397333s) [noise=true , address=212.102.52.216:4394 , piece_id=CI2FNS7JIJAR6RFA36TWUBGPPSDZUYG3VBZZIMWSKMW7PRMJPCNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1WM75xZMY7yQ1ga2AiqsvGZT3uptidF9pFi2T6yoc1jeqGPVcf, address:212.102.52.216:4394): protocol: read tcp 188.166.225.170:44174->212.102.52.216:4394: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119068846 (6h14m50.902408945s) [noise=true , address=212.102.52.215:4370 , piece_id=EQOTUHFSH37DPWFXKX63L7AZZ47NM7TXE6M2ET6HRXIUPUBE5SQQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD, address:212.102.52.215:4370): protocol: read tcp 188.166.225.170:59952->212.102.52.215:4370: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119084907 (6h14m50.902425006s) [noise=true , address=212.102.52.216:4399 , piece_id=4VMLOMHEBAWHHFQHWOVGFDAJ5R4ZP7HGWYTNJRT2FB4HP5CTVXEQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy, address:212.102.52.216:4399): protocol: read tcp 188.166.225.170:55390->212.102.52.216:4399: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119224593 (6h14m50.902564692s) [noise=true , address=212.102.52.214:4356 , piece_id=PFUE5DEXLVNJ2O7MW4TJYOKJ5BVT3T3XHPWQZTDGTRQSOLMIQ22A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd, address:212.102.52.214:4356): protocol: read tcp 188.166.225.170:43210->212.102.52.214:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119381422 (6h14m50.902721521s) [noise=true , address=212.102.52.214:4346 , piece_id=EAV3BFL5IY2MI2AVRPAH6TEIL6YE3ZTFCKRTDJAEMBOOLIMBWUVQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F, address:212.102.52.214:4346): protocol: read tcp 188.166.225.170:46098->212.102.52.214:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119588417 (6h14m50.902928506s) [noise=true , address=212.102.52.217:4440 , piece_id=22DGCTHMWQHD5S5GHMB6TACJOLJYTLOAWM77TJIZT3TBG7CCBHCA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk, address:212.102.52.217:4440): protocol: read tcp 188.166.225.170:35096->212.102.52.217:4440: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119734756 (6h14m50.903074845s) [noise=true , address=212.102.52.216:4400 , piece_id=BT3GXTY4X2MIQX6W66KOH5CQURUTFTGAIOA43TR7JJNW2A3XQEHQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz, address:212.102.52.216:4400): protocol: read tcp 188.166.225.170:44760->212.102.52.216:4400: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119782047 (6h14m50.903122146s) [noise=true , address=212.102.52.215:4390 , piece_id=JADWLBZHARQID2BRQ4WPOGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK, address:212.102.52.215:4390): protocol: read tcp 188.166.225.170:42360->212.102.52.215:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119881616 (6h14m50.903221716s) [noise=true , address=212.102.52.214:4359 , piece_id=RDGAIHZ6U57RX5RWNIDX5TUYXTKQTS3NEF6UJKF5KOQPNNOBUS3A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA, address:212.102.52.214:4359): protocol: read tcp 188.166.225.170:55742->212.102.52.214:4359: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119970095 (6h14m50.903310194s) [noise=true , address=212.102.52.217:4431 , piece_id=XCHNQP74SJCY4LD4FZP4I5V3JB72KRLIE22AAERGFVEAYBWBI5VQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG, address:212.102.52.217:4431): protocol: read tcp 188.166.225.170:57354->212.102.52.217:4431: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119993661 (6h14m50.90333376s) [seg_pos={0 0}, upload=6006]: Done waiting for segment. successful: 0 optimal: 16 errs: <nil>
Duration: 6.213937229s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.........X..] duration:
7.207480607s trace:
https://jaeger.dev.storj.io/trace/3485869bb2e5c930
FAIL (2026-05-25 08:20:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 16 but got 0)
======LOGS======
POGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Uploading piece...
May 25 08:19:05.117766300 (6h14m50.901106399s) [upload=6006]: Next segment err: context deadline exceeded
May 25 08:19:05.118088345 (6h14m50.901428444s) [noise=true , address=212.102.52.217:4434 , piece_id=KQG6RVZFANV62UKZNJIUJFXESPTAGMCGRXTP7MSDNJZVBKTBWWBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KMzn6eZL5cHZtrCcsMinV1AEroczRHipg53KnfZmVCFW1DsZM, address:212.102.52.217:4434): protocol: read tcp 188.166.225.170:49926->212.102.52.217:4434: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118316710 (6h14m50.901656809s) [noise=true , address=212.102.52.213:4342 , piece_id=NSUN5Z6W6ESOUOOYYF5XPMLYEXH7BFEZRXMGMZKN5ZA3EBOYEUAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K, address:212.102.52.213:4342): protocol: read tcp 188.166.225.170:58960->212.102.52.213:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118459954 (6h14m50.901800053s) [noise=true , address=212.102.52.215:4371 , piece_id=BHW6IUONRCFD34RP77CZHXXGTWB7VH3NAYPINQCBZZQV6NFX5NAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY, address:212.102.52.215:4371): protocol: read tcp 188.166.225.170:34824->212.102.52.215:4371: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118559303 (6h14m50.901899402s) [noise=true , address=212.102.52.217:4427 , piece_id=HX3YLZZMZDXS7HDGFG2GU6LPE3PS2IYNKZHFWPF7KYO4BOBAEZIQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp, address:212.102.52.217:4427): protocol: read tcp 188.166.225.170:48756->212.102.52.217:4427: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118674944 (6h14m50.902015043s) [noise=true , address=212.102.52.214:4364 , piece_id=BTZEZNNNBSVJ7XXEHYULUGRYOB3JF5LL3GFXWPMOYMW4ADYGTFGA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p, address:212.102.52.214:4364): protocol: read tcp 188.166.225.170:50004->212.102.52.214:4364: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118777600 (6h14m50.902117699s) [noise=true , address=212.102.52.216:4415 , piece_id=LDQEIE3SGAJNFVBEEZ27ZFWNKSSS2JZVYEABUOOUKU74HKMOSXBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT, address:212.102.52.216:4415): protocol: read tcp 188.166.225.170:45862->212.102.52.216:4415: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118805453 (6h14m50.902145542s) [noise=true , address=212.102.52.213:4340 , piece_id=5XTBBIAEJ4Y6JJIXUR43KAFEXAE3V6PKXZIORZIXZWLAUKGBM35A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM, address:212.102.52.213:4340): protocol: read tcp 188.166.225.170:51970->212.102.52.213:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118880506 (6h14m50.902220606s) [noise=true , address=212.102.52.213:4329 , piece_id=MIS6NL4X4HTHUPUUXEWD6WWTSWH4JY5NIAGGQOMHKODLPD6Z2HUQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J, address:212.102.52.213:4329): protocol: read tcp 188.166.225.170:58498->212.102.52.213:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118944478 (6h14m50.902284577s) [noise=true , address=212.102.52.213:4331 , piece_id=YGMIW7CVSZYA72PROVBMFOPHPB55CPEAUVCSUYDXPSLNRZQXJSNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn, address:212.102.52.213:4331): protocol: read tcp 188.166.225.170:36064->212.102.52.213:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118979285 (6h14m50.902319384s) [noise=true , address=212.102.52.215:4388 , piece_id=7NUQBSCYYB2NVIDQJYPBVQVDZVBL2PV53RR2GVDXVESORB3OFMCQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF, address:212.102.52.215:4388): protocol: read tcp 188.166.225.170:33096->212.102.52.215:4388: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119057244 (6h14m50.902397333s) [noise=true , address=212.102.52.216:4394 , piece_id=CI2FNS7JIJAR6RFA36TWUBGPPSDZUYG3VBZZIMWSKMW7PRMJPCNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1WM75xZMY7yQ1ga2AiqsvGZT3uptidF9pFi2T6yoc1jeqGPVcf, address:212.102.52.216:4394): protocol: read tcp 188.166.225.170:44174->212.102.52.216:4394: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119068846 (6h14m50.902408945s) [noise=true , address=212.102.52.215:4370 , piece_id=EQOTUHFSH37DPWFXKX63L7AZZ47NM7TXE6M2ET6HRXIUPUBE5SQQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD, address:212.102.52.215:4370): protocol: read tcp 188.166.225.170:59952->212.102.52.215:4370: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119084907 (6h14m50.902425006s) [noise=true , address=212.102.52.216:4399 , piece_id=4VMLOMHEBAWHHFQHWOVGFDAJ5R4ZP7HGWYTNJRT2FB4HP5CTVXEQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy, address:212.102.52.216:4399): protocol: read tcp 188.166.225.170:55390->212.102.52.216:4399: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119224593 (6h14m50.902564692s) [noise=true , address=212.102.52.214:4356 , piece_id=PFUE5DEXLVNJ2O7MW4TJYOKJ5BVT3T3XHPWQZTDGTRQSOLMIQ22A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd, address:212.102.52.214:4356): protocol: read tcp 188.166.225.170:43210->212.102.52.214:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119381422 (6h14m50.902721521s) [noise=true , address=212.102.52.214:4346 , piece_id=EAV3BFL5IY2MI2AVRPAH6TEIL6YE3ZTFCKRTDJAEMBOOLIMBWUVQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F, address:212.102.52.214:4346): protocol: read tcp 188.166.225.170:46098->212.102.52.214:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119588417 (6h14m50.902928506s) [noise=true , address=212.102.52.217:4440 , piece_id=22DGCTHMWQHD5S5GHMB6TACJOLJYTLOAWM77TJIZT3TBG7CCBHCA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk, address:212.102.52.217:4440): protocol: read tcp 188.166.225.170:35096->212.102.52.217:4440: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119734756 (6h14m50.903074845s) [noise=true , address=212.102.52.216:4400 , piece_id=BT3GXTY4X2MIQX6W66KOH5CQURUTFTGAIOA43TR7JJNW2A3XQEHQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz, address:212.102.52.216:4400): protocol: read tcp 188.166.225.170:44760->212.102.52.216:4400: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119782047 (6h14m50.903122146s) [noise=true , address=212.102.52.215:4390 , piece_id=JADWLBZHARQID2BRQ4WPOGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK, address:212.102.52.215:4390): protocol: read tcp 188.166.225.170:42360->212.102.52.215:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119881616 (6h14m50.903221716s) [noise=true , address=212.102.52.214:4359 , piece_id=RDGAIHZ6U57RX5RWNIDX5TUYXTKQTS3NEF6UJKF5KOQPNNOBUS3A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA, address:212.102.52.214:4359): protocol: read tcp 188.166.225.170:55742->212.102.52.214:4359: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119970095 (6h14m50.903310194s) [noise=true , address=212.102.52.217:4431 , piece_id=XCHNQP74SJCY4LD4FZP4I5V3JB72KRLIE22AAERGFVEAYBWBI5VQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG, address:212.102.52.217:4431): protocol: read tcp 188.166.225.170:57354->212.102.52.217:4431: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119993661 (6h14m50.90333376s) [seg_pos={0 0}, upload=6006]: Done waiting for segment. successful: 0 optimal: 16 errs: <nil>
Duration: 7.207501827s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.........X.] duration:
3.915761356s trace:
https://jaeger.dev.storj.io/trace/3485869bb2e5c930
FAIL (2026-05-25 08:19:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 16 but got 0)
======LOGS======
POGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Uploading piece...
May 25 08:19:05.117766300 (6h14m50.901106399s) [upload=6006]: Next segment err: context deadline exceeded
May 25 08:19:05.118088345 (6h14m50.901428444s) [noise=true , address=212.102.52.217:4434 , piece_id=KQG6RVZFANV62UKZNJIUJFXESPTAGMCGRXTP7MSDNJZVBKTBWWBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KMzn6eZL5cHZtrCcsMinV1AEroczRHipg53KnfZmVCFW1DsZM, address:212.102.52.217:4434): protocol: read tcp 188.166.225.170:49926->212.102.52.217:4434: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118316710 (6h14m50.901656809s) [noise=true , address=212.102.52.213:4342 , piece_id=NSUN5Z6W6ESOUOOYYF5XPMLYEXH7BFEZRXMGMZKN5ZA3EBOYEUAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K, address:212.102.52.213:4342): protocol: read tcp 188.166.225.170:58960->212.102.52.213:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118459954 (6h14m50.901800053s) [noise=true , address=212.102.52.215:4371 , piece_id=BHW6IUONRCFD34RP77CZHXXGTWB7VH3NAYPINQCBZZQV6NFX5NAQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY, address:212.102.52.215:4371): protocol: read tcp 188.166.225.170:34824->212.102.52.215:4371: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118559303 (6h14m50.901899402s) [noise=true , address=212.102.52.217:4427 , piece_id=HX3YLZZMZDXS7HDGFG2GU6LPE3PS2IYNKZHFWPF7KYO4BOBAEZIQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp, address:212.102.52.217:4427): protocol: read tcp 188.166.225.170:48756->212.102.52.217:4427: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118674944 (6h14m50.902015043s) [noise=true , address=212.102.52.214:4364 , piece_id=BTZEZNNNBSVJ7XXEHYULUGRYOB3JF5LL3GFXWPMOYMW4ADYGTFGA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p, address:212.102.52.214:4364): protocol: read tcp 188.166.225.170:50004->212.102.52.214:4364: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118777600 (6h14m50.902117699s) [noise=true , address=212.102.52.216:4415 , piece_id=LDQEIE3SGAJNFVBEEZ27ZFWNKSSS2JZVYEABUOOUKU74HKMOSXBA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT, address:212.102.52.216:4415): protocol: read tcp 188.166.225.170:45862->212.102.52.216:4415: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118805453 (6h14m50.902145542s) [noise=true , address=212.102.52.213:4340 , piece_id=5XTBBIAEJ4Y6JJIXUR43KAFEXAE3V6PKXZIORZIXZWLAUKGBM35A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM, address:212.102.52.213:4340): protocol: read tcp 188.166.225.170:51970->212.102.52.213:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118880506 (6h14m50.902220606s) [noise=true , address=212.102.52.213:4329 , piece_id=MIS6NL4X4HTHUPUUXEWD6WWTSWH4JY5NIAGGQOMHKODLPD6Z2HUQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J, address:212.102.52.213:4329): protocol: read tcp 188.166.225.170:58498->212.102.52.213:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118944478 (6h14m50.902284577s) [noise=true , address=212.102.52.213:4331 , piece_id=YGMIW7CVSZYA72PROVBMFOPHPB55CPEAUVCSUYDXPSLNRZQXJSNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1eyfVMwFVb4Q5nbc54PSLebuyWfm2rCgCfGrNc6AovSWqe6Upn, address:212.102.52.213:4331): protocol: read tcp 188.166.225.170:36064->212.102.52.213:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.118979285 (6h14m50.902319384s) [noise=true , address=212.102.52.215:4388 , piece_id=7NUQBSCYYB2NVIDQJYPBVQVDZVBL2PV53RR2GVDXVESORB3OFMCQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF, address:212.102.52.215:4388): protocol: read tcp 188.166.225.170:33096->212.102.52.215:4388: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119057244 (6h14m50.902397333s) [noise=true , address=212.102.52.216:4394 , piece_id=CI2FNS7JIJAR6RFA36TWUBGPPSDZUYG3VBZZIMWSKMW7PRMJPCNA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1WM75xZMY7yQ1ga2AiqsvGZT3uptidF9pFi2T6yoc1jeqGPVcf, address:212.102.52.216:4394): protocol: read tcp 188.166.225.170:44174->212.102.52.216:4394: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119068846 (6h14m50.902408945s) [noise=true , address=212.102.52.215:4370 , piece_id=EQOTUHFSH37DPWFXKX63L7AZZ47NM7TXE6M2ET6HRXIUPUBE5SQQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD, address:212.102.52.215:4370): protocol: read tcp 188.166.225.170:59952->212.102.52.215:4370: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119084907 (6h14m50.902425006s) [noise=true , address=212.102.52.216:4399 , piece_id=4VMLOMHEBAWHHFQHWOVGFDAJ5R4ZP7HGWYTNJRT2FB4HP5CTVXEQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy, address:212.102.52.216:4399): protocol: read tcp 188.166.225.170:55390->212.102.52.216:4399: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119224593 (6h14m50.902564692s) [noise=true , address=212.102.52.214:4356 , piece_id=PFUE5DEXLVNJ2O7MW4TJYOKJ5BVT3T3XHPWQZTDGTRQSOLMIQ22A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd, address:212.102.52.214:4356): protocol: read tcp 188.166.225.170:43210->212.102.52.214:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119381422 (6h14m50.902721521s) [noise=true , address=212.102.52.214:4346 , piece_id=EAV3BFL5IY2MI2AVRPAH6TEIL6YE3ZTFCKRTDJAEMBOOLIMBWUVQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F, address:212.102.52.214:4346): protocol: read tcp 188.166.225.170:46098->212.102.52.214:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119588417 (6h14m50.902928506s) [noise=true , address=212.102.52.217:4440 , piece_id=22DGCTHMWQHD5S5GHMB6TACJOLJYTLOAWM77TJIZT3TBG7CCBHCA, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk, address:212.102.52.217:4440): protocol: read tcp 188.166.225.170:35096->212.102.52.217:4440: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119734756 (6h14m50.903074845s) [noise=true , address=212.102.52.216:4400 , piece_id=BT3GXTY4X2MIQX6W66KOH5CQURUTFTGAIOA43TR7JJNW2A3XQEHQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz, address:212.102.52.216:4400): protocol: read tcp 188.166.225.170:44760->212.102.52.216:4400: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119782047 (6h14m50.903122146s) [noise=true , address=212.102.52.215:4390 , piece_id=JADWLBZHARQID2BRQ4WPOGTD4K45VQU6RS4YZ2ELAEU6M5KZVBRQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK, address:212.102.52.215:4390): protocol: read tcp 188.166.225.170:42360->212.102.52.215:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119881616 (6h14m50.903221716s) [noise=true , address=212.102.52.214:4359 , piece_id=RDGAIHZ6U57RX5RWNIDX5TUYXTKQTS3NEF6UJKF5KOQPNNOBUS3A, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA, address:212.102.52.214:4359): protocol: read tcp 188.166.225.170:55742->212.102.52.214:4359: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119970095 (6h14m50.903310194s) [noise=true , address=212.102.52.217:4431 , piece_id=XCHNQP74SJCY4LD4FZP4I5V3JB72KRLIE22AAERGFVEAYBWBI5VQ, seg_pos={0 0}, upload=6006]: Done uploading piece. err: ecclient: upload failed (node:12GmHVqJ4PzwRM3XoBVXVqdozGWQrn3CMjQ4sBVQAgxQh98pyWG, address:212.102.52.217:4431): protocol: read tcp 188.166.225.170:57354->212.102.52.217:4431: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
May 25 08:19:05.119993661 (6h14m50.90333376s) [seg_pos={0 0}, upload=6006]: Done waiting for segment. successful: 0 optimal: 16 errs: <nil>
Duration: 3.915772698s
core
uplink
uk-select-1
uk1-placement-17
|