Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.264490433s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:37:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.264507465s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.669455279s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:36:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.669478535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.228061293s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:35:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.228082924s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.899754123s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:34:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.899778139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.192708503s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:33:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 5.192733312s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.793249882s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:32:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.793276223s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 3.787283552s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:31:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.787312057s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.332352027s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:30:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.33237951s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.874519327s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:29:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.874546629s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.664033846s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:29:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.664056129s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 4.311408129s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:27:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.311433437s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.854130091s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:26:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.854154347s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.551554477s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:26:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.551577512s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 4.602764428s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:25:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.602786662s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.680424528s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:24:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.680452873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.371315346s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:24:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.371340805s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.749965973s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:22:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.749986543s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.843919437s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:22:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.843946941s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.344322607s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:21:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.344346543s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.851711083s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:20:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.851733638s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.593387252s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:20:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.593408014s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003548758s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:19:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 1m0.003569939s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.506754602s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:45:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.506806331s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 3.501652025s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:44:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.501675751s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [XXX.........................................................] duration: 3.580455531s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:44:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.580508192s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [XXXX........................................................] duration: 3.678712741s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:43:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.678733772s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [XXXXX.......................................................] duration: 3.558969277s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:43:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.558992574s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 6 out of 60 is failed (threshold=6) [XXXXXX......................................................] duration: 3.495003002s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:42:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.495026566s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [XXXXXXX.....................................................] duration: 3.608311162s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:42:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.608330659s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [XXXXXXXX....................................................] duration: 3.453454477s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:41:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.45347636s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [XXXXXXXXX...................................................] duration: 4.522370724s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:40:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.52239469s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [XXXXXXXXXX..................................................] duration: 3.522619138s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:39:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.522647011s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 11 out of 60 is failed (threshold=6) [XXXXXXXXXXX.................................................] duration: 3.609217647s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:39:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.609242837s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 12 out of 60 is failed (threshold=6) [XXXXXXXXXXXX................................................] duration: 3.631944383s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:38:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.631969491s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 13 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX...............................................] duration: 3.528195382s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:38:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.528215509s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 13 out of 60 is failed (threshold=6) [.XXXXXXXXXXXXX..............................................] duration: 3.561930998s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:37:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.561954053s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 14 out of 60 is failed (threshold=6) [X.XXXXXXXXXXXXX.............................................] duration: 3.561520409s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:37:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.56154227s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 15 out of 60 is failed (threshold=6) [XX.XXXXXXXXXXXXX............................................] duration: 3.582381635s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:36:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.582418406s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 16 out of 60 is failed (threshold=6) [XXX.XXXXXXXXXXXXX...........................................] duration: 3.566216898s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:35:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.566237466s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 17 out of 60 is failed (threshold=6) [XXXX.XXXXXXXXXXXXX..........................................] duration: 3.574533398s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:34:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.574558968s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 17 out of 60 is failed (threshold=6) [.XXXX.XXXXXXXXXXXXX.........................................] duration: 4.442838811s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:33:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.442876966s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [X.XXXX.XXXXXXXXXXXXX........................................] duration: 3.580238471s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:32:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.580260573s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [.X.XXXX.XXXXXXXXXXXXX.......................................] duration: 3.488548214s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:31:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.488564024s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [..X.XXXX.XXXXXXXXXXXXX......................................] duration: 3.469238542s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:31:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.469274161s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [X..X.XXXX.XXXXXXXXXXXXX.....................................] duration: 3.489316682s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:30:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.489404872s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [.X..X.XXXX.XXXXXXXXXXXXX....................................] duration: 3.602931202s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:29:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.602958224s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [..X..X.XXXX.XXXXXXXXXXXXX...................................] duration: 3.615927775s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:28:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.61595089s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [...X..X.XXXX.XXXXXXXXXXXXX..................................] duration: 3.496980753s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:28:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.496998398s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 20 out of 60 is failed (threshold=6) [X...X..X.XXXX.XXXXXXXXXXXXX.................................] duration: 3.457439027s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:26:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.457477252s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 20 out of 60 is failed (threshold=6) [.X...X..X.XXXX.XXXXXXXXXXXXX................................] duration: 3.64909644s trace: https://jaeger.dev.storj.io/trace/342eafb94e950cc2 FAIL (2026-04-11 16:25:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.649268592s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)