Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.830806026s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:12:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.830833489s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.134304394s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:11:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.134333159s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.795607861s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.795636375s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.729501022s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:10:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.729537021s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.387776733s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:09:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.387803074s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.791954864s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:08:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.791982546s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.741476906s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:07:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.741507614s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.682321895s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:06:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.682352534s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.771020169s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:05:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.771051831s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.686528154s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:04:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.686558432s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.77464983s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.774676882s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.735882111s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:03:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.735915255s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.801414135s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:03:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.801435497s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.771094704s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:02:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.771123789s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.379731795s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:01:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.379758616s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.763265076s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 09:00:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.763303569s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.286433378s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:59:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.286468354s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.698518057s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:59:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.698536743s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.715554738s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:58:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.715584674s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.244203164s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:58:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.244235164s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.361697149s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:57:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.361729632s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.163257468s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:57:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.163288778s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.407154872s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:56:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.407178576s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.828030239s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:56:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.828060818s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.891437036s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:55:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.891462834s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.757824595s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:54:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.757867819s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.7419559s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.742035031s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.325507683s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:52:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.325529795s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m49.143644854s trace: https://jaeger.dev.storj.io/trace/ecc9c100203cede FAIL (2025-11-19 08:52:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece... Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece... Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments... Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil> Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces. Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments... Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m49.14367473s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.42452362s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:36:17 UTC) orbiter warning: context deadline exceeded Duration: 3.424557975s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 3.459603861s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:35:55 UTC) orbiter warning: context deadline exceeded Duration: 3.459658544s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 3.365951008s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:35:16 UTC) orbiter warning: context deadline exceeded Duration: 3.365974603s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 3.419184383s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:34:13 UTC) orbiter warning: context deadline exceeded Duration: 3.419203039s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 3.417302118s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:33:38 UTC) orbiter warning: context deadline exceeded Duration: 3.41732891s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 3.451720746s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:32:49 UTC) orbiter warning: context deadline exceeded Duration: 3.451745123s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 3.516788226s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:32:31 UTC) orbiter warning: context deadline exceeded Duration: 3.516811621s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 3.523334182s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:31:26 UTC) orbiter warning: context deadline exceeded Duration: 3.523365201s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.564380026s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:30:14 UTC) orbiter warning: context deadline exceeded Duration: 3.56439791s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.602218309s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:29:54 UTC) orbiter warning: context deadline exceeded Duration: 3.602253086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.606263363s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:29:14 UTC) orbiter warning: context deadline exceeded Duration: 3.606292378s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 3.529339528s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:28:33 UTC) orbiter warning: context deadline exceeded Duration: 3.529365117s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 4.495466877s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:28:16 UTC) orbiter warning: context deadline exceeded Duration: 4.495491945s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 3.458448035s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:27:13 UTC) orbiter warning: context deadline exceeded Duration: 3.458479155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 3.450291328s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:26:35 UTC) orbiter warning: context deadline exceeded Duration: 3.450323389s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 4.434660191s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:25:41 UTC) orbiter warning: context deadline exceeded Duration: 4.434687804s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 3.590121953s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:24:54 UTC) orbiter warning: context deadline exceeded Duration: 3.590151791s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 3.47349532s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:23:54 UTC) orbiter warning: context deadline exceeded Duration: 3.473524607s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 3.490507314s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:23:32 UTC) orbiter warning: context deadline exceeded Duration: 3.490527332s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 3.620503957s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:23:00 UTC) orbiter warning: context deadline exceeded Duration: 3.620539213s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 3.578896553s trace: https://jaeger.dev.storj.io/trace/2b48df6f0fd1300c FAIL (2025-11-19 08:22:05 UTC) orbiter warning: context deadline exceeded Duration: 3.578931418s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)