Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....X...................................X...................] duration: 4.248314063s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 18:01:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.24833791s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................................X..................] duration: 4.344003688s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 18:00:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.344032793s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................X.................] duration: 4.339739549s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 18:00:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.339777342s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................X................] duration: 4.259084327s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:59:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.259108624s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........X...................................X...............] duration: 4.709373517s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:58:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.709397904s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration: 4.460996115s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:58:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.461017466s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration: 4.425438873s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:57:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.42546285s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................................X............] duration: 4.663872185s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:57:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.663898206s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............X...................................X...........] duration: 4.668716544s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:56:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.668742163s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............X...................................X..........] duration: 4.303871251s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:55:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.303898102s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..............X...................................X.........] duration: 4.697724398s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:55:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.697743435s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...............X...................................X........] duration: 16.011976034s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:54:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 16.012000351s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [................X...................................X.......] duration: 4.756995816s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:52:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.757019761s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................X...................................X......] duration: 53.569296257s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:52:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 53.569319773s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................X...................................X.....] duration: 4.04590942s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:51:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.045933105s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...................X...................................X....] duration: 3.820882904s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:49:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 3.820905307s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....................X...................................X...] duration: 4.809729899s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:49:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.80975589s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...................................X..] duration: 4.298194967s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:47:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.298219985s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......................X...................................X.] duration: 4.682569216s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:46:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 4.68258202s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...................................X] duration: 1m0.200740166s trace: https://jaeger.dev.storj.io/trace/79eb809fc33d66c0 FAIL (2026-04-11 17:46:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ress=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.188269956 (97h59m26.00750598s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.190589153 (97h59m26.009825177s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.191766204 (97h59m26.011002228s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.192984455 (97h59m26.012220479s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.194356653 (97h59m26.013592687s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.195967172 (97h59m26.015203206s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.197401199 (97h59m26.016637223s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.198654488 (97h59m26.017890512s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.199929138 (97h59m26.019165172s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.202663926 (97h59m26.02189995s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:39.207732368 (97h59m26.026968392s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Uploading piece... Apr 11 17:45:40.003632480 (97h59m26.822868514s) [upload=94067]: Next returned nil segment Apr 11 17:45:40.003671335 (97h59m26.822907379s) [upload=94067]: Waiting for error group managing segments... Apr 11 17:45:40.390465810 (97h59m27.209701834s) [noise=true , address=185.167.204.206:4054 , piece_id=LA6LBQBWIBBWMYSPIBBXODTNDGVK7YFZDGNFRLF4SDR3TZUP4KSQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.397306122 (97h59m27.216542166s) [noise=true , address=185.167.204.205:4023 , piece_id=ZKDFRGFEDZLATIQFHKLH6JUL6ZTV2ZFBTJ6K55BMRD7AESQYZSCQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.406573458 (97h59m27.225809512s) [noise=true , address=185.167.204.205:4035 , piece_id=LPGKUR2S6K2JJIGMUVZOS4GBGTEV2CEXH7MQOF7OB4BZXCXEFSEQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.408815985 (97h59m27.228052009s) [noise=true , address=185.167.204.206:4051 , piece_id=U6H4V3KX6IR22EXQ7NFI4ZGEZ6GFXHMEJZZO7DGXJH7MBHRJ47FA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409236797 (97h59m27.228472821s) [noise=true , address=185.167.204.205:4004 , piece_id=WOWYN5LDM72F2BHRSMDTZITIETJUJ6EEFM7TLCZQNOGNIBFP2QMQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.409893836 (97h59m27.22912987s) [noise=true , address=185.167.204.205:4014 , piece_id=GOSUGFHXDHNVNFTQ63ZVVKN37ZGRLP6ATH7N3FKB4N5O76QGLKZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.410600339 (97h59m27.229836363s) [noise=true , address=185.167.204.206:4045 , piece_id=Q4X6WTNBKVN7X66GG7P3UGCXMHVHWPCXFTWR6YFGNJJ5M7L7NL7A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.413856193 (97h59m27.233092217s) [noise=true , address=185.167.204.206:4071 , piece_id=XLIJSMU3WJVZUD44UFSSLAERL5Y2DEIC2SXDKXUAIBEIUMCZ54NA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416497029 (97h59m27.235733053s) [noise=true , address=185.167.204.205:4012 , piece_id=UUUFHZCSHZDGWJNXNGHDNFZ5UUOXDK36E725OLJZIIY3FSA2MNHQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.416867133 (97h59m27.236103157s) [noise=true , address=185.167.204.205:4034 , piece_id=RRBVXJYU6T7WATOFZWY3LKWLZ4KGGKIOT6VOFHDU2EUBGRVSZ2IQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417289208 (97h59m27.236525232s) [noise=true , address=185.167.204.205:4033 , piece_id=24DLSHHLPPHG7UOROE5GCTR72BWNU7CQ7BMLL7GAUYTEFHSURIQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.417436021 (97h59m27.236672045s) [noise=true , address=185.167.204.205:4020 , piece_id=DYB4T5AHTHL6KRCLXAER7FWKGVHOXFRMWLPFKT5BTWZAQPIL5WZQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418277295 (97h59m27.237513319s) [noise=true , address=185.167.204.206:4064 , piece_id=K56N2526H7DQ4XMLAJNQAVJC5Z2URB6S5HXO3ULIUFZZYLOTXFUQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.418374121 (97h59m27.237610146s) [noise=true , address=185.167.204.206:4050 , piece_id=FEVKTGOBQCVNEKAAE4I3VMBAAQTLJLLVUNWB5VRDGE2IQ4Q4CISQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420016451 (97h59m27.239252476s) [noise=true , address=185.167.204.205:4031 , piece_id=2R2GRJZFGMRCHBIPPJKAEGJJAN2UFAJY5CBJ7VGLLZUOGZHUICBA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.420555562 (97h59m27.239791586s) [noise=true , address=185.167.204.206:4056 , piece_id=BOKJPHK6XDFXZRZBPVRL646SBB62LB357ZSGZPAIPVOKBVJT6S5A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.421679862 (97h59m27.240915906s) [noise=true , address=185.167.204.206:4069 , piece_id=XV4MUNWH2XGAYJWP5AX2VDCUCNGMU3EL32LTYPZNQ7FNDVPIC4LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.423475988 (97h59m27.242712023s) [noise=true , address=185.167.204.205:4028 , piece_id=UXGPDUGZ6ZXFVRASLXZKHYEWANGFF2GILJ4MMB3R5HCBNTZWGEHA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427208221 (97h59m27.246444255s) [noise=true , address=185.167.204.205:4009 , piece_id=H7TBMJJ63AMMICPOHSCFUSJ55JNV5NAY77JATPNECQEJRG5X44LQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.427313324 (97h59m27.246549348s) [noise=true , address=185.167.204.206:4043 , piece_id=5LPXNSQRW7L6RUWS7CNP6KQVWEIGZ3T2YDA2YT3HGX6E7UCV4BQA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.429146953 (97h59m27.248382977s) [noise=true , address=185.167.204.206:4040 , piece_id=TDSH3UDE2I77Q74VOCHIH7ER7EMVD6F23S7HQ7MLTVWKYXFVWONQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:45:40.433127856 (97h59m27.25236388s) [noise=true , address=185.167.204.206:4047 , piece_id=VFPG7ILQA474IBTUY7JRYJOLVUHAJTZS7B7MD5OU75ARJWTOBVFA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.650614980 (97h59m47.469851024s) [noise=true , address=89.149.201.147:4010 , piece_id=UDVYTZ5EEI7NK3XTUQIC54SFRES6YTYOWBDDZE5LAANHMY4FX7PA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:00.758626013 (97h59m47.577862037s) [noise=true , address=89.149.201.147:4014 , piece_id=3IJ5OQAMMV4RXVA7RQWLGQGSRA3YTJJUPDJS75AJNDFVDJUIUGLQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: <nil> Apr 11 17:46:38.478706057 (98h0m25.297942081s) [noise=true , address=81.171.14.70:4034 , piece_id=KIL3ZBPY2J74YWXMBYRSCT74CITDCAI6XSJ3P7PTW6JQSXYEWWFQ, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478848362 (98h0m25.298084386s) [noise=true , address=81.171.14.70:4037 , piece_id=L5TCIDIFPS2TOY3GX4QXZMQYZA4PRUQVPZHFAJKUGAZEE56MHL5Q, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60676->81.171.14.70:4037: use of closed network connection Apr 11 17:46:38.478940470 (98h0m25.298176494s) [noise=true , address=81.171.14.70:4026 , piece_id=CMMVMOUCEGZSNDNZ2EYK6UCHU6E7BJEODKZTMMOYT5MBETQEOKOA, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478963043 (98h0m25.298199067s) [noise=true , address=81.171.14.70:4038 , piece_id=J5MD3L2CGYIIUHD45Q7NTBFNY2KEI4T2XWRM3Z2C3VBFNJ3IYB4A, seg_pos={0 0}, upload=94067]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF Apr 11 17:46:38.478987780 (98h0m25.298223804s) [seg_pos={0 0}, upload=94067]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Apr 11 17:46:38.677860822 (98h0m25.497096846s) [upload=94067]: Done uploading segments... Apr 11 17:46:38.677900609 (98h0m25.497136633s) [upload=94067]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.200761316s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.323072586s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:45:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.323134815s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.460154806s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:44:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.460171457s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.718866394s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:43:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.718888164s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.762603348s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:43:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.762626764s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 4.455306737s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:42:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.455332157s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.688241521s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:41:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.688264506s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 3.827113357s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:41:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.827143867s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 4.779303285s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:40:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.779330998s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 4.354742136s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:40:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.35477014s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.434531649s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:40:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.434560394s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.312787033s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:39:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.312804817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.090949868s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:39:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 5.090974466s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.814387388s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:38:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.814411986s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.301240036s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:38:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.301264433s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.264490433s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:37:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.264507465s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.669455279s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:36:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.669478535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.228061293s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:35:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.228082924s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.899754123s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:34:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.899778139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.192708503s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:33:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 5.192733312s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.793249882s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:32:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.793276223s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 3.787283552s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:31:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.787312057s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.332352027s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:30:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.33237951s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.874519327s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:29:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.874546629s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.664033846s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:29:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.664056129s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 4.311408129s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:27:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.311433437s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.854130091s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:26:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 3.854154347s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.551554477s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:26:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.551577512s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 4.602764428s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:25:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.602786662s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.680424528s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:24:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.680452873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.371315346s trace: https://jaeger.dev.storj.io/trace/b94024357449d5a FAIL (2026-04-11 17:24:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, Piece ID: MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ) context deadline exceeded; piecestore: (Node ID: 12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, Piece ID: TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA) context deadline exceeded; piecestore: (Node ID: 1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, Piece ID: JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q) context deadline exceeded; piecestore: (Node ID: 121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, Piece ID: QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: 2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ) context deadline exceeded; piecestore: (Node ID: 12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, Piece ID: CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ) context deadline exceeded; piecestore: (Node ID: 12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, Piece ID: 6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: 7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA) context deadline exceeded; piecestore: (Node ID: 1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, Piece ID: WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA) context deadline exceeded; piecestore: (Node ID: 12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, Piece ID: PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ) context deadline exceeded; piecestore: (Node ID: 1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, Piece ID: U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A) context deadline exceeded; piecestore: (Node ID: 12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, Piece ID: GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A) context deadline exceeded ======LOGS====== SCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.356703700 (97h32m47.175939724s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357047453 (97h32m47.176283477s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357125203 (97h32m47.176361227s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357392039 (97h32m47.176628063s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.357460470 (97h32m47.176696494s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.375390063 (97h32m47.194626087s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.376636519 (97h32m47.195872553s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.378043795 (97h32m47.197279819s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:00.379286784 (97h32m47.198522808s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Uploading piece... Apr 11 17:19:01.166962921 (97h32m47.986198965s) [upload=93647]: Next returned nil segment Apr 11 17:19:01.167002417 (97h32m47.986238451s) [upload=93647]: Waiting for error group managing segments... Apr 11 17:19:01.551332300 (97h32m48.370568334s) [noise=true , address=185.167.204.205:4031 , piece_id=EYPG5BIBW2YJFZZURTVN7M37MEYEE2JWTGZ72UIZOJR4WDWTHDMA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.557528939 (97h32m48.376764973s) [noise=true , address=185.167.204.205:4008 , piece_id=2UYQFF25KYP2J73UYU4UZGPF6TJW63RB3G24JDUNYTLC3L6J52CQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.560716311 (97h32m48.379952345s) [noise=true , address=185.167.204.206:4068 , piece_id=MKERDXYOFPJCMHH5O4ZVCJNMSGRZVQOIELY63FYKCIKPP4DDD2RQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561309515 (97h32m48.380545549s) [noise=true , address=185.167.204.206:4053 , piece_id=CK72SDZXGOOFADHMK7ZX3J5HEORV4FVSQSG4O62BEA6VCKLDCIVQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.561505153 (97h32m48.380741177s) [noise=true , address=185.167.204.205:4018 , piece_id=3DTW67ZY7D2LPQ7NFKICXDIDUX2HVUA5SAGPP4WJK2WBQBJXDUDA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.564162361 (97h32m48.383398385s) [noise=true , address=185.167.204.206:4054 , piece_id=BUPVV47NTKMUAHZOIXXKJNR7XWRQBGRS6KXTQMH4TB5ZSXZSNMOQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.566907118 (97h32m48.386143142s) [noise=true , address=185.167.204.205:4011 , piece_id=ZGXGYTU76W3B23N3VKRIPN4E3JC7X3UIWL4FGZ46FKTUZZAJPIXQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.573762188 (97h32m48.392998212s) [noise=true , address=185.167.204.205:4033 , piece_id=TW7OTXBRIQSBVHT3TEJDD2JR35ZOTGGX5FPV65HE3X2RHYTTXEHA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575516214 (97h32m48.394752248s) [noise=true , address=185.167.204.206:4059 , piece_id=QEUTO66G5R5TBVFE52TAQROTYSTSR6ZTQOAYO2SWQZGVXJIYPGVA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.575931114 (97h32m48.395167138s) [noise=true , address=185.167.204.205:4019 , piece_id=IG7ORZ56L4PHGBJJQBPRB3PXTSBXESFM7OQ4Y4WPCQWDGYLVNRMQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.576339933 (97h32m48.395575957s) [noise=true , address=185.167.204.205:4016 , piece_id=JC73A6BELE2JBZ6CH2RGNVA4JYE76CNAM5B22772MDL5N2K4EP2Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.577375001 (97h32m48.396611035s) [noise=true , address=185.167.204.206:4062 , piece_id=DNSYXBJXMCSZZIVSH6HUNNYCJJEJCXF3NUP5QH7FTTDRMUXEFZ4A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.578967484 (97h32m48.398203508s) [noise=true , address=185.167.204.205:4029 , piece_id=WSAX6D2KZO75344XV4HALKTI73ZKILB7DRZAGUDMU5ROHGQONARQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.580695799 (97h32m48.399931833s) [noise=true , address=185.167.204.206:4050 , piece_id=WMK3VCKAF7AUUM5KKC5TRSSU2YMX4U7HKYK3HEIFXLR3HUZFNVFA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582363147 (97h32m48.401599181s) [noise=true , address=185.167.204.206:4037 , piece_id=JZBD3DPC3JTEWKVLJQTNUHNLSFKOPJCNXD5CH3IOHQET5OXT2NDQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.582921605 (97h32m48.402157639s) [noise=true , address=185.167.204.205:4015 , piece_id=XVO4YKLRGJZADITKMI5LD5LEFGZ7ZNHPOBKRWR5IQP5Z2LU3VCBQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.583864956 (97h32m48.40310098s) [noise=true , address=185.167.204.205:4006 , piece_id=GBQ7EUYLOS2TAT5UKDQ72L4ZEIXPPHVBXUVK3TWPZR3IRJVVYB7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.584110149 (97h32m48.403346183s) [noise=true , address=185.167.204.206:4070 , piece_id=U4VGASH7IUSKAWNHWRLNY5PJT5EEOML63FCCY2VXHNE4PYQASVUQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:01.585425147 (97h32m48.404661181s) [noise=true , address=185.167.204.205:4003 , piece_id=UQJEWTHSTNYJUYN3YRMS3FQP5MIWNINCQ326RXE72BWHYGBQ2I7A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:15.325464849 (97h33m2.144700903s) [noise=true , address=89.149.201.147:4019 , piece_id=6TVZA7TD7P4DSEGKG35M3FPDFZWSURUVMIPNMD2HGF2Y6DHNY4XQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:23.620132568 (97h33m10.439368592s) [noise=true , address=81.171.14.70:4033 , piece_id=3J5NNMZL6DSRASEOL4RDMVXAH73DMPM3BYSVWU3NF5YNBV7FCRGA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.280155073 (97h33m41.099391097s) [noise=true , address=81.171.14.70:4044 , piece_id=XSDKNWWGK5LMVSGOHX2OWE6752E7AFQUQIQZV3DPUJVUG45ULDTQ, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.587198457 (97h33m41.406434522s) [noise=true , address=89.149.201.147:4016 , piece_id=PXCAJGARJEOSCOBEVKWE4LEOG4ZVILJEYFVEBADHVIW3ZB6N7Y2A, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:54.877360342 (97h33m41.696596366s) [noise=true , address=81.171.14.70:4040 , piece_id=7R3Q2SHVP2WJUOGT3QUQJ5WKH6JAHNIHVEVROYLMJYZOQHX6IC7Q, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:57.203923606 (97h33m44.02315964s) [noise=true , address=81.171.14.70:4034 , piece_id=YKPNK6PSYKTEL3OWCBW2GLCQR2QUKXMIWKRYMTDO5NNY2MJET2WA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411265874 (97h33m45.230501898s) [noise=true , address=81.171.14.70:4029 , piece_id=7JKSCU63EJ5YQSIGLHRHKM5ZN4UKHGLJAZXN67NEVN4ZJ7WCCHOA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: <nil> Apr 11 17:19:58.411284840 (97h33m45.230520864s) [seg_pos={0 0}, upload=93647]: Satisfied cohort requirements after 26 pieces Apr 11 17:19:58.411443387 (97h33m45.230679411s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50256->89.149.201.147:4003: use of closed network connection Apr 11 17:19:58.411448526 (97h33m45.23068455s) [noise=true , address=89.149.201.147:4003 , piece_id=25J7WEKHRH5UGNDQTTBMK3QMJBILMZEYRIINJUMG3EHI5QKMRZYA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411557296 (97h33m45.23079332s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Apr 11 17:19:58.411562416 (97h33m45.23079844s) [noise=true , address=81.171.14.70:4047 , piece_id=7YG3DF7YOUD6KQ3EDC6LGE2JQDR3K5I4AF4O5C7MOXHESAR2ANJA, seg_pos={0 0}, upload=93647]: Long tail cancellation due to optimal threshold Apr 11 17:19:58.411576764 (97h33m45.230812788s) [seg_pos={0 0}, upload=93647]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 17:19:58.411641298 (97h33m45.230877322s) [upload=93647]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 17:19:58.411645617 (97h33m45.230881641s) [upload=93647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 17:19:58.670139284 (97h33m45.489375308s) [upload=93647]: Done uploading segments... Apr 11 17:19:58.670160715 (97h33m45.48939674s) [upload=93647]: Upload finished. err: <nil> Duration: 4.371340805s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)