Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 520134 reports (Page 5326 of 10403)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.361355413s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:33:31 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.361456886s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.522791438s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:33:30 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.52282894s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.333396514s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:33:14 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.333429757s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
6.648521694s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:32:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.648555918s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.509010316s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:32:17 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.50903861s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
5.355697003s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:31:28 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.355722611s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.403758901s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:31:17 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.403779109s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.818757519s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:30:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.81878484s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
5.35548207s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:30:24 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.355514473s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
5.264368176s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:29:45 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.264397723s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.789615144s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:29:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.789632787s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.784309561s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:28:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.784427166s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
5.430637593s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:28:35 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.430746289s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
5.404331641s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:27:35 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.404361127s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.793735638s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:27:30 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.793799959s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
6.250292602s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:26:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.250329132s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
5.278990251s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:26:20 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.279066144s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
5.30718115s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:25:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.307212499s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
5.548094743s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:25:22 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.54813581s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
5.83266527s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:24:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.832690037s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
5.197400028s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:24:42 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.197442951s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.723498479s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:23:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.723532091s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.219407335s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:23:35 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.219438233s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.262358218s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:23:01 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.262390801s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.246710192s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:22:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.246738125s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
5.326926148s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:22:19 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.326962408s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
5.732511651s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:21:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.732529064s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
5.267873663s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:21:24 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.267905223s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
5.653600247s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:20:42 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.65363277s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.14249012s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:20:26 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.142519928s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
5.550176189s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:19:36 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.550276148s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.369167423s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:19:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.369195668s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
5.476975068s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:19:02 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.47717016s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.292615941s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:18:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.292648443s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
5.394395205s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:17:56 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.394416666s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
6.084575755s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:17:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.08459432s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
6.281174571s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:17:01 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.281207322s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
5.190815765s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:16:53 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.190847966s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
5.777074711s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:16:26 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.777108836s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
5.830451741s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:16:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.830472179s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
5.457249169s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:16:07 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.457282444s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
5.813119525s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:15:49 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.813145596s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
5.106271459s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:15:20 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.10629853s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.233957592s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:14:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.233985515s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
5.707744613s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:14:16 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.70778005s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
5.810601126s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:13:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.810631144s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
5.691243174s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:13:15 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.691279453s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
5.462186841s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:13:12 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.46222768s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.176534778s
trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:12:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045    , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047    , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041    , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032    , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033    , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040    , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029    , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038    , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028    , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034    , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009  , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002  , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015  , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018  , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004  , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.176559798s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001620558s
trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:12:34 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 30.001651449s core uplink eu1