Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 365764 reports (Page 260 of 7316)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............X............................................]
duration: 
5.911954851s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:54:07 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.911991761s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.................X..........................................]
duration: 
3.363816838s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:54:07 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.363853157s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................X...........................................]
duration: 
6.156741664s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:53:45 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.156767512s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [.X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X..X...]
duration: 
6.437274869s
trace: 
https://jaeger.dev.storj.io/trace/2f86366cb6f77d8e
FAIL (2025-12-31 18:53:26 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, Piece ID: 3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ) context deadline exceeded; piecestore: (Node ID: 1EZ6d8B2pdLZntgDTzJQJzx7o7A2qYK63NQrtN5ke91nmn4idj, Piece ID: BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ) context deadline exceeded
======LOGS======
Dec 31 18:51:17.512545337 (627h22m17.383628372s) [upload=549740]: Starting upload
Dec 31 18:51:17.512637953 (627h22m17.383720998s) [upload=549740]: Done starting upload
Dec 31 18:51:17.512738755 (627h22m17.3838218s) [upload=549740]: Uploading segments...
Dec 31 18:51:17.512939187 (627h22m17.384022222s) [upload=549740]: Got next segment. Inline: false
Dec 31 18:51:17.512982058 (627h22m17.384065093s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:51:17.512987448 (627h22m17.384070483s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:51:17.761956390 (627h22m17.633039435s) [seg_pos={0 0}, upload=549740]: Begin upload segment...
Dec 31 18:51:17.762015212 (627h22m17.633098257s) [seg_pos={0 0}, upload=549740]: Done begin upload segment.
Dec 31 18:51:17.762378534 (627h22m17.633461589s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.763733514 (627h22m17.634816549s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.764634750 (627h22m17.635717785s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.765665172 (627h22m17.636748207s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.766969565 (627h22m17.63805261s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767390808 (627h22m17.638473843s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767714754 (627h22m17.6387978s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.768549203 (627h22m17.639632249s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.769939160 (627h22m17.641022205s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770540024 (627h22m17.641623059s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770926891 (627h22m17.642009926s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.771710744 (627h22m17.642793779s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773200480 (627h22m17.644283525s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773478429 (627h22m17.644561474s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773884142 (627h22m17.644967177s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.777234892 (627h22m17.648317937s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:19.474161832 (627h22m19.345244867s) [upload=549740]: Next returned nil segment
Dec 31 18:51:19.474175608 (627h22m19.345258653s) [upload=549740]: Waiting for error group managing segments...
Dec 31 18:51:19.757541637 (627h22m19.628624672s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.759284305 (627h22m19.630367341s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.774277565 (627h22m19.6453606s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.778454638 (627h22m19.649537724s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.780861582 (627h22m19.651944617s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.791300688 (627h22m19.662383724s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.859129536 (627h22m19.730212581s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.916594266 (627h22m19.787677301s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.923139279 (627h22m19.794222314s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.936461486 (627h22m19.807544521s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.945967757 (627h22m19.817050812s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.948722172 (627h22m19.819805217s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050306934 (627h22m19.921389969s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050330379 (627h22m19.921413434s) [seg_pos={0 0}, upload=549740]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:51:20.050590054 (627h22m19.921673099s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050601495 (627h22m19.92168455s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050666860 (627h22m19.921749925s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050675766 (627h22m19.921758801s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050859085 (627h22m19.92194213s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050868464 (627h22m19.921951499s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050893631 (627h22m19.921976666s) [seg_pos={0 0}, upload=549740]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:51:20.050999182 (627h22m19.922082217s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:20.051007077 (627h22m19.922090112s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:20.351538912 (627h22m20.222621947s) [upload=549740]: Done uploading segments...
Dec 31 18:51:20.351557628 (627h22m20.222640673s) [upload=549740]: Upload finished. err: <nil>
Duration: 6.437298884s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration: 
5.948373132s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:53:15 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.948400363s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [..X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X..X..]
duration: 
5.843856367s
trace: 
https://jaeger.dev.storj.io/trace/2f86366cb6f77d8e
FAIL (2025-12-31 18:53:07 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, Piece ID: 3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ) context deadline exceeded; piecestore: (Node ID: 1EZ6d8B2pdLZntgDTzJQJzx7o7A2qYK63NQrtN5ke91nmn4idj, Piece ID: BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ) context deadline exceeded
======LOGS======
Dec 31 18:51:17.512545337 (627h22m17.383628372s) [upload=549740]: Starting upload
Dec 31 18:51:17.512637953 (627h22m17.383720998s) [upload=549740]: Done starting upload
Dec 31 18:51:17.512738755 (627h22m17.3838218s) [upload=549740]: Uploading segments...
Dec 31 18:51:17.512939187 (627h22m17.384022222s) [upload=549740]: Got next segment. Inline: false
Dec 31 18:51:17.512982058 (627h22m17.384065093s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:51:17.512987448 (627h22m17.384070483s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:51:17.761956390 (627h22m17.633039435s) [seg_pos={0 0}, upload=549740]: Begin upload segment...
Dec 31 18:51:17.762015212 (627h22m17.633098257s) [seg_pos={0 0}, upload=549740]: Done begin upload segment.
Dec 31 18:51:17.762378534 (627h22m17.633461589s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.763733514 (627h22m17.634816549s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.764634750 (627h22m17.635717785s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.765665172 (627h22m17.636748207s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.766969565 (627h22m17.63805261s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767390808 (627h22m17.638473843s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767714754 (627h22m17.6387978s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.768549203 (627h22m17.639632249s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.769939160 (627h22m17.641022205s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770540024 (627h22m17.641623059s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770926891 (627h22m17.642009926s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.771710744 (627h22m17.642793779s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773200480 (627h22m17.644283525s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773478429 (627h22m17.644561474s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773884142 (627h22m17.644967177s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.777234892 (627h22m17.648317937s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:19.474161832 (627h22m19.345244867s) [upload=549740]: Next returned nil segment
Dec 31 18:51:19.474175608 (627h22m19.345258653s) [upload=549740]: Waiting for error group managing segments...
Dec 31 18:51:19.757541637 (627h22m19.628624672s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.759284305 (627h22m19.630367341s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.774277565 (627h22m19.6453606s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.778454638 (627h22m19.649537724s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.780861582 (627h22m19.651944617s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.791300688 (627h22m19.662383724s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.859129536 (627h22m19.730212581s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.916594266 (627h22m19.787677301s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.923139279 (627h22m19.794222314s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.936461486 (627h22m19.807544521s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.945967757 (627h22m19.817050812s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.948722172 (627h22m19.819805217s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050306934 (627h22m19.921389969s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050330379 (627h22m19.921413434s) [seg_pos={0 0}, upload=549740]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:51:20.050590054 (627h22m19.921673099s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050601495 (627h22m19.92168455s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050666860 (627h22m19.921749925s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050675766 (627h22m19.921758801s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050859085 (627h22m19.92194213s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050868464 (627h22m19.921951499s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050893631 (627h22m19.921976666s) [seg_pos={0 0}, upload=549740]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:51:20.050999182 (627h22m19.922082217s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:20.051007077 (627h22m19.922090112s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:20.351538912 (627h22m20.222621947s) [upload=549740]: Done uploading segments...
Dec 31 18:51:20.351557628 (627h22m20.222640673s) [upload=549740]: Upload finished. err: <nil>
Duration: 5.843887948s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [..................X.........................................]
duration: 
3.656613148s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:53:02 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.656642504s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.......................................X..................X.]
duration: 
29.172205935s
trace: 
https://jaeger.dev.storj.io/trace/7f9ae895262c045c
FAIL (2025-12-31 18:52:51 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
[noise=true , address=145.79.227.30:4773   , piece_id=B5MLCUAOXRVUSDWBNLSZENQ2AQFLH7QV7O4FB3VG7RYLI46WWHPQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.136774370 (627h22m23.007857406s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.137704332 (627h22m23.008787377s) [noise=true , address=77.90.31.13:4651     , piece_id=TNW4CVSGETP4MPG6YQK4XQBWZKZPTCAGYOWQVXLPLV3QWU7DYHUQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.138257946 (627h22m23.009340991s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.138752678 (627h22m23.009835723s) [noise=true , address=45.91.116.10:4099    , piece_id=35XKK3DQTQWHWCHJZHMIB54PWNVW4VZ2E7FQBFC3AOOTXVZNSKBQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.139247169 (627h22m23.010330214s) [noise=true , address=145.79.227.29:4970   , piece_id=GQEEZJQHLPNX6LGQOJ6G2B4EAZDRCPYUWJ76OPWZIVOP6FEDDMCQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.139746811 (627h22m23.010829846s) [noise=true , address=145.79.227.44:4225   , piece_id=AO73FDFZIAAXIWTZ673DPGRP7YCAB5NDZXWDBS4VIBMEPGX4NCUQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.140313109 (627h22m23.011396144s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.142191897 (627h22m23.013274932s) [noise=true , address=77.90.31.21:4889     , piece_id=W6MX2IQQLPQNI3OFTWDZ5F4JKY4TWRJ2JEN2M5ID4LP75KJPT66A, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.144121091 (627h22m23.015204126s) [noise=true , address=77.90.31.18:4815     , piece_id=TL4HGDNTBHBMVCTTVKWCKPBZDI67K4H62FSMGX4J3VSRUDYESDJA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.146018954 (627h22m23.017101989s) [noise=true , address=45.91.116.5:4316     , piece_id=AKV5ZN4NUJJIMZBBY2XF2SMMCD3UEJOMEUSAKAE2G7FFFHG43QCA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.147430652 (627h22m23.018513687s) [noise=true , address=145.79.227.40:4074   , piece_id=TZXNAHOV6KJTP7TCD5DVX34GXLM525GJYQTW2ZLL3S4XLNLD4IWA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.148795801 (627h22m23.019878856s) [noise=true , address=145.79.227.26:4662   , piece_id=PYFPMDSDU7R3LZIO5RWFW7JJ562WXG76R4Z5GCHRFTEN7XPMU72A, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.149556410 (627h22m23.020639445s) [noise=true , address=145.79.227.48:4309   , piece_id=BC6M2D5L376K6IO7NSFUD2EP3REAA4GI4BQAPIICFTG6YP3LYGVQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.152241522 (627h22m23.023324557s) [noise=true , address=145.79.227.35:4504   , piece_id=HKQZEYV2LRDEYLNULYUGCSFPTQF25TAGYP4CNKXXYEP6MUOYFLSQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.153035064 (627h22m23.024118099s) [noise=true , address=45.91.116.9:4287     , piece_id=AQHFTDYADMSLQ6QDWAZL36UII5PN7JW7DWTFANK2SJCCRK4H3LZQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:24.607048741 (627h22m24.478131786s) [upload=549743]: Next returned nil segment
Dec 31 18:51:24.607068378 (627h22m24.478151423s) [upload=549743]: Waiting for error group managing segments...
Dec 31 18:51:25.043875591 (627h22m24.914958626s) [noise=true , address=145.79.227.48:4309   , piece_id=BC6M2D5L376K6IO7NSFUD2EP3REAA4GI4BQAPIICFTG6YP3LYGVQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.060501098 (627h22m24.931584133s) [noise=true , address=145.79.227.26:4662   , piece_id=PYFPMDSDU7R3LZIO5RWFW7JJ562WXG76R4Z5GCHRFTEN7XPMU72A, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.195254127 (627h22m25.066337162s) [noise=true , address=77.90.31.13:4651     , piece_id=TNW4CVSGETP4MPG6YQK4XQBWZKZPTCAGYOWQVXLPLV3QWU7DYHUQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.341576283 (627h22m25.212659318s) [noise=true , address=77.90.31.18:4815     , piece_id=TL4HGDNTBHBMVCTTVKWCKPBZDI67K4H62FSMGX4J3VSRUDYESDJA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.395979955 (627h22m25.267063s) [noise=true , address=45.91.116.10:4099    , piece_id=35XKK3DQTQWHWCHJZHMIB54PWNVW4VZ2E7FQBFC3AOOTXVZNSKBQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.435884300 (627h22m25.306967345s) [noise=true , address=45.91.116.9:4287     , piece_id=AQHFTDYADMSLQ6QDWAZL36UII5PN7JW7DWTFANK2SJCCRK4H3LZQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.445506492 (627h22m25.316589537s) [noise=true , address=45.91.116.5:4316     , piece_id=AKV5ZN4NUJJIMZBBY2XF2SMMCD3UEJOMEUSAKAE2G7FFFHG43QCA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.876085263 (627h22m25.747168308s) [noise=true , address=77.90.31.21:4889     , piece_id=W6MX2IQQLPQNI3OFTWDZ5F4JKY4TWRJ2JEN2M5ID4LP75KJPT66A, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.902767069 (627h22m25.773850104s) [noise=true , address=145.79.227.43:4187   , piece_id=JTDEN7FNTTVSNA2YWZ5FLQZPAN5BYMV7BBN32L7YVCXKRFLEDX3Q, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.903914785 (627h22m25.77499782s) [noise=true , address=145.79.227.35:4504   , piece_id=HKQZEYV2LRDEYLNULYUGCSFPTQF25TAGYP4CNKXXYEP6MUOYFLSQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.904281883 (627h22m25.775364918s) [noise=true , address=145.79.227.30:4773   , piece_id=B5MLCUAOXRVUSDWBNLSZENQ2AQFLH7QV7O4FB3VG7RYLI46WWHPQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.933616340 (627h22m25.804699375s) [noise=true , address=145.79.227.44:4225   , piece_id=AO73FDFZIAAXIWTZ673DPGRP7YCAB5NDZXWDBS4VIBMEPGX4NCUQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.973429411 (627h22m25.844512446s) [noise=true , address=145.79.227.40:4074   , piece_id=TZXNAHOV6KJTP7TCD5DVX34GXLM525GJYQTW2ZLL3S4XLNLD4IWA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:26.011366368 (627h22m25.882449403s) [noise=true , address=145.79.227.29:4970   , piece_id=GQEEZJQHLPNX6LGQOJ6G2B4EAZDRCPYUWJ76OPWZIVOP6FEDDMCQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:26.011386386 (627h22m25.882469431s) [seg_pos={0 0}, upload=549743]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:51:26.011559546 (627h22m25.882642581s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection; write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection
Dec 31 18:51:26.011565056 (627h22m25.882648101s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011801967 (627h22m25.882885012s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jL8XWaamTER1w2SeTtSkikARUpZ3SkrCzfGDQ4FWiXeeRRMws): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.011808990 (627h22m25.882892026s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011911055 (627h22m25.88299409s) [noise=true , address=77.90.31.19:4872     , piece_id=LWPSH5D3XY3CEBPWGSMEFJM5PWEYJPPMEQCIIPMIDSUISYY3AVIA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127ckxo8rSfJjtVZHEquzgsHGG78DiyoSRdqykfrzbfw1n5tfWL): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.011915623 (627h22m25.882998658s) [noise=true , address=77.90.31.19:4872     , piece_id=LWPSH5D3XY3CEBPWGSMEFJM5PWEYJPPMEQCIIPMIDSUISYY3AVIA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011996919 (627h22m25.883079954s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kGgrsNn5tv2GkcuVHHArCACwRB2qwbj3X3JmzVF4UL6dLRW1m): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.012002369 (627h22m25.883085404s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.012016706 (627h22m25.883099741s) [seg_pos={0 0}, upload=549743]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:51:26.012087230 (627h22m25.883170275s) [upload=549743]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:26.012091488 (627h22m25.883174533s) [upload=549743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:26.316490677 (627h22m26.187573713s) [upload=549743]: Done uploading segments...
Dec 31 18:51:26.316509083 (627h22m26.187592128s) [upload=549743]: Upload finished. err: <nil>
Duration: 29.172220602s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration: 
5.915875663s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:52:39 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.915903606s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [...................X........................................]
duration: 
3.484582747s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:52:31 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.484612754s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [........................................X..................X]
duration: 
1m0.004005909s
trace: 
https://jaeger.dev.storj.io/trace/7f9ae895262c045c
FAIL (2025-12-31 18:52:22 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
[noise=true , address=145.79.227.30:4773   , piece_id=B5MLCUAOXRVUSDWBNLSZENQ2AQFLH7QV7O4FB3VG7RYLI46WWHPQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.136774370 (627h22m23.007857406s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.137704332 (627h22m23.008787377s) [noise=true , address=77.90.31.13:4651     , piece_id=TNW4CVSGETP4MPG6YQK4XQBWZKZPTCAGYOWQVXLPLV3QWU7DYHUQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.138257946 (627h22m23.009340991s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.138752678 (627h22m23.009835723s) [noise=true , address=45.91.116.10:4099    , piece_id=35XKK3DQTQWHWCHJZHMIB54PWNVW4VZ2E7FQBFC3AOOTXVZNSKBQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.139247169 (627h22m23.010330214s) [noise=true , address=145.79.227.29:4970   , piece_id=GQEEZJQHLPNX6LGQOJ6G2B4EAZDRCPYUWJ76OPWZIVOP6FEDDMCQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.139746811 (627h22m23.010829846s) [noise=true , address=145.79.227.44:4225   , piece_id=AO73FDFZIAAXIWTZ673DPGRP7YCAB5NDZXWDBS4VIBMEPGX4NCUQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.140313109 (627h22m23.011396144s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.142191897 (627h22m23.013274932s) [noise=true , address=77.90.31.21:4889     , piece_id=W6MX2IQQLPQNI3OFTWDZ5F4JKY4TWRJ2JEN2M5ID4LP75KJPT66A, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.144121091 (627h22m23.015204126s) [noise=true , address=77.90.31.18:4815     , piece_id=TL4HGDNTBHBMVCTTVKWCKPBZDI67K4H62FSMGX4J3VSRUDYESDJA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.146018954 (627h22m23.017101989s) [noise=true , address=45.91.116.5:4316     , piece_id=AKV5ZN4NUJJIMZBBY2XF2SMMCD3UEJOMEUSAKAE2G7FFFHG43QCA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.147430652 (627h22m23.018513687s) [noise=true , address=145.79.227.40:4074   , piece_id=TZXNAHOV6KJTP7TCD5DVX34GXLM525GJYQTW2ZLL3S4XLNLD4IWA, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.148795801 (627h22m23.019878856s) [noise=true , address=145.79.227.26:4662   , piece_id=PYFPMDSDU7R3LZIO5RWFW7JJ562WXG76R4Z5GCHRFTEN7XPMU72A, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.149556410 (627h22m23.020639445s) [noise=true , address=145.79.227.48:4309   , piece_id=BC6M2D5L376K6IO7NSFUD2EP3REAA4GI4BQAPIICFTG6YP3LYGVQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.152241522 (627h22m23.023324557s) [noise=true , address=145.79.227.35:4504   , piece_id=HKQZEYV2LRDEYLNULYUGCSFPTQF25TAGYP4CNKXXYEP6MUOYFLSQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:23.153035064 (627h22m23.024118099s) [noise=true , address=45.91.116.9:4287     , piece_id=AQHFTDYADMSLQ6QDWAZL36UII5PN7JW7DWTFANK2SJCCRK4H3LZQ, seg_pos={0 0}, upload=549743]: Uploading piece...
Dec 31 18:51:24.607048741 (627h22m24.478131786s) [upload=549743]: Next returned nil segment
Dec 31 18:51:24.607068378 (627h22m24.478151423s) [upload=549743]: Waiting for error group managing segments...
Dec 31 18:51:25.043875591 (627h22m24.914958626s) [noise=true , address=145.79.227.48:4309   , piece_id=BC6M2D5L376K6IO7NSFUD2EP3REAA4GI4BQAPIICFTG6YP3LYGVQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.060501098 (627h22m24.931584133s) [noise=true , address=145.79.227.26:4662   , piece_id=PYFPMDSDU7R3LZIO5RWFW7JJ562WXG76R4Z5GCHRFTEN7XPMU72A, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.195254127 (627h22m25.066337162s) [noise=true , address=77.90.31.13:4651     , piece_id=TNW4CVSGETP4MPG6YQK4XQBWZKZPTCAGYOWQVXLPLV3QWU7DYHUQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.341576283 (627h22m25.212659318s) [noise=true , address=77.90.31.18:4815     , piece_id=TL4HGDNTBHBMVCTTVKWCKPBZDI67K4H62FSMGX4J3VSRUDYESDJA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.395979955 (627h22m25.267063s) [noise=true , address=45.91.116.10:4099    , piece_id=35XKK3DQTQWHWCHJZHMIB54PWNVW4VZ2E7FQBFC3AOOTXVZNSKBQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.435884300 (627h22m25.306967345s) [noise=true , address=45.91.116.9:4287     , piece_id=AQHFTDYADMSLQ6QDWAZL36UII5PN7JW7DWTFANK2SJCCRK4H3LZQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.445506492 (627h22m25.316589537s) [noise=true , address=45.91.116.5:4316     , piece_id=AKV5ZN4NUJJIMZBBY2XF2SMMCD3UEJOMEUSAKAE2G7FFFHG43QCA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.876085263 (627h22m25.747168308s) [noise=true , address=77.90.31.21:4889     , piece_id=W6MX2IQQLPQNI3OFTWDZ5F4JKY4TWRJ2JEN2M5ID4LP75KJPT66A, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.902767069 (627h22m25.773850104s) [noise=true , address=145.79.227.43:4187   , piece_id=JTDEN7FNTTVSNA2YWZ5FLQZPAN5BYMV7BBN32L7YVCXKRFLEDX3Q, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.903914785 (627h22m25.77499782s) [noise=true , address=145.79.227.35:4504   , piece_id=HKQZEYV2LRDEYLNULYUGCSFPTQF25TAGYP4CNKXXYEP6MUOYFLSQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.904281883 (627h22m25.775364918s) [noise=true , address=145.79.227.30:4773   , piece_id=B5MLCUAOXRVUSDWBNLSZENQ2AQFLH7QV7O4FB3VG7RYLI46WWHPQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.933616340 (627h22m25.804699375s) [noise=true , address=145.79.227.44:4225   , piece_id=AO73FDFZIAAXIWTZ673DPGRP7YCAB5NDZXWDBS4VIBMEPGX4NCUQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:25.973429411 (627h22m25.844512446s) [noise=true , address=145.79.227.40:4074   , piece_id=TZXNAHOV6KJTP7TCD5DVX34GXLM525GJYQTW2ZLL3S4XLNLD4IWA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:26.011366368 (627h22m25.882449403s) [noise=true , address=145.79.227.29:4970   , piece_id=GQEEZJQHLPNX6LGQOJ6G2B4EAZDRCPYUWJ76OPWZIVOP6FEDDMCQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: <nil>
Dec 31 18:51:26.011386386 (627h22m25.882469431s) [seg_pos={0 0}, upload=549743]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:51:26.011559546 (627h22m25.882642581s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection; write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53640->145.79.227.8:4363: use of closed network connection
Dec 31 18:51:26.011565056 (627h22m25.882648101s) [noise=true , address=145.79.227.8:4363    , piece_id=VU2ITRHBDVZZS7YEYXO2ZIAKOY66YCDYF4VRKYP5QV7U7EGZLDCQ, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011801967 (627h22m25.882885012s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jL8XWaamTER1w2SeTtSkikARUpZ3SkrCzfGDQ4FWiXeeRRMws): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.011808990 (627h22m25.882892026s) [noise=true , address=45.91.116.4:4944     , piece_id=NAONLXU57MD3PDFC7YCMMV3I4LVR3ZYUCE72RMQMU7I6KIYT67JA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011911055 (627h22m25.88299409s) [noise=true , address=77.90.31.19:4872     , piece_id=LWPSH5D3XY3CEBPWGSMEFJM5PWEYJPPMEQCIIPMIDSUISYY3AVIA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127ckxo8rSfJjtVZHEquzgsHGG78DiyoSRdqykfrzbfw1n5tfWL): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.011915623 (627h22m25.882998658s) [noise=true , address=77.90.31.19:4872     , piece_id=LWPSH5D3XY3CEBPWGSMEFJM5PWEYJPPMEQCIIPMIDSUISYY3AVIA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.011996919 (627h22m25.883079954s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kGgrsNn5tv2GkcuVHHArCACwRB2qwbj3X3JmzVF4UL6dLRW1m): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:26.012002369 (627h22m25.883085404s) [noise=true , address=145.79.227.3:4176    , piece_id=C2B3YV5K7WME65DACLT55Y4JXGOJCYNQQHGMWIQWSHIWNTCSLWCA, seg_pos={0 0}, upload=549743]: Long tail cancellation due to optimal threshold
Dec 31 18:51:26.012016706 (627h22m25.883099741s) [seg_pos={0 0}, upload=549743]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:51:26.012087230 (627h22m25.883170275s) [upload=549743]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:26.012091488 (627h22m25.883174533s) [upload=549743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:26.316490677 (627h22m26.187573713s) [upload=549743]: Done uploading segments...
Dec 31 18:51:26.316509083 (627h22m26.187592128s) [upload=549743]: Upload finished. err: <nil>
Duration: 1m0.00402832s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
2 out of 60 is failed (threshold=6) [X...................X.......................................]
duration: 
3.466834664s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:52:10 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.466897063s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [...X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X..X.]
duration: 
6.109470459s
trace: 
https://jaeger.dev.storj.io/trace/2f86366cb6f77d8e
FAIL (2025-12-31 18:52:03 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, Piece ID: 3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ) context deadline exceeded; piecestore: (Node ID: 1EZ6d8B2pdLZntgDTzJQJzx7o7A2qYK63NQrtN5ke91nmn4idj, Piece ID: BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ) context deadline exceeded
======LOGS======
Dec 31 18:51:17.512545337 (627h22m17.383628372s) [upload=549740]: Starting upload
Dec 31 18:51:17.512637953 (627h22m17.383720998s) [upload=549740]: Done starting upload
Dec 31 18:51:17.512738755 (627h22m17.3838218s) [upload=549740]: Uploading segments...
Dec 31 18:51:17.512939187 (627h22m17.384022222s) [upload=549740]: Got next segment. Inline: false
Dec 31 18:51:17.512982058 (627h22m17.384065093s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:51:17.512987448 (627h22m17.384070483s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:51:17.761956390 (627h22m17.633039435s) [seg_pos={0 0}, upload=549740]: Begin upload segment...
Dec 31 18:51:17.762015212 (627h22m17.633098257s) [seg_pos={0 0}, upload=549740]: Done begin upload segment.
Dec 31 18:51:17.762378534 (627h22m17.633461589s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.763733514 (627h22m17.634816549s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.764634750 (627h22m17.635717785s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.765665172 (627h22m17.636748207s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.766969565 (627h22m17.63805261s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767390808 (627h22m17.638473843s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767714754 (627h22m17.6387978s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.768549203 (627h22m17.639632249s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.769939160 (627h22m17.641022205s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770540024 (627h22m17.641623059s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770926891 (627h22m17.642009926s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.771710744 (627h22m17.642793779s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773200480 (627h22m17.644283525s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773478429 (627h22m17.644561474s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773884142 (627h22m17.644967177s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.777234892 (627h22m17.648317937s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:19.474161832 (627h22m19.345244867s) [upload=549740]: Next returned nil segment
Dec 31 18:51:19.474175608 (627h22m19.345258653s) [upload=549740]: Waiting for error group managing segments...
Dec 31 18:51:19.757541637 (627h22m19.628624672s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.759284305 (627h22m19.630367341s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.774277565 (627h22m19.6453606s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.778454638 (627h22m19.649537724s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.780861582 (627h22m19.651944617s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.791300688 (627h22m19.662383724s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.859129536 (627h22m19.730212581s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.916594266 (627h22m19.787677301s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.923139279 (627h22m19.794222314s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.936461486 (627h22m19.807544521s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.945967757 (627h22m19.817050812s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.948722172 (627h22m19.819805217s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050306934 (627h22m19.921389969s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050330379 (627h22m19.921413434s) [seg_pos={0 0}, upload=549740]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:51:20.050590054 (627h22m19.921673099s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050601495 (627h22m19.92168455s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050666860 (627h22m19.921749925s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050675766 (627h22m19.921758801s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050859085 (627h22m19.92194213s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050868464 (627h22m19.921951499s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050893631 (627h22m19.921976666s) [seg_pos={0 0}, upload=549740]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:51:20.050999182 (627h22m19.922082217s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:20.051007077 (627h22m19.922090112s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:20.351538912 (627h22m20.222621947s) [upload=549740]: Done uploading segments...
Dec 31 18:51:20.351557628 (627h22m20.222640673s) [upload=549740]: Upload finished. err: <nil>
Duration: 6.109489907s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X..X]
duration: 
30.00246514s
trace: 
https://jaeger.dev.storj.io/trace/2f86366cb6f77d8e
FAIL (2025-12-31 18:51:46 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, Piece ID: 3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ) context deadline exceeded; piecestore: (Node ID: 1EZ6d8B2pdLZntgDTzJQJzx7o7A2qYK63NQrtN5ke91nmn4idj, Piece ID: BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ) context deadline exceeded
======LOGS======
Dec 31 18:51:17.512545337 (627h22m17.383628372s) [upload=549740]: Starting upload
Dec 31 18:51:17.512637953 (627h22m17.383720998s) [upload=549740]: Done starting upload
Dec 31 18:51:17.512738755 (627h22m17.3838218s) [upload=549740]: Uploading segments...
Dec 31 18:51:17.512939187 (627h22m17.384022222s) [upload=549740]: Got next segment. Inline: false
Dec 31 18:51:17.512982058 (627h22m17.384065093s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:51:17.512987448 (627h22m17.384070483s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:51:17.761956390 (627h22m17.633039435s) [seg_pos={0 0}, upload=549740]: Begin upload segment...
Dec 31 18:51:17.762015212 (627h22m17.633098257s) [seg_pos={0 0}, upload=549740]: Done begin upload segment.
Dec 31 18:51:17.762378534 (627h22m17.633461589s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.763733514 (627h22m17.634816549s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.764634750 (627h22m17.635717785s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.765665172 (627h22m17.636748207s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.766969565 (627h22m17.63805261s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767390808 (627h22m17.638473843s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.767714754 (627h22m17.6387978s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.768549203 (627h22m17.639632249s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.769939160 (627h22m17.641022205s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770540024 (627h22m17.641623059s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.770926891 (627h22m17.642009926s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.771710744 (627h22m17.642793779s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773200480 (627h22m17.644283525s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773478429 (627h22m17.644561474s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.773884142 (627h22m17.644967177s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:17.777234892 (627h22m17.648317937s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Uploading piece...
Dec 31 18:51:19.474161832 (627h22m19.345244867s) [upload=549740]: Next returned nil segment
Dec 31 18:51:19.474175608 (627h22m19.345258653s) [upload=549740]: Waiting for error group managing segments...
Dec 31 18:51:19.757541637 (627h22m19.628624672s) [noise=true , address=145.79.227.19:4077   , piece_id=3C5RIE7VRY3K2BGE326XO5C75ROLCXHJOBFHETTNBYTBHGGPHVDA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.759284305 (627h22m19.630367341s) [noise=true , address=145.79.227.4:4185    , piece_id=LUSS4BIWP7DM377X5UH7OLNDOY22S64NXWSYOPYRN5GCWDVSVWPA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.774277565 (627h22m19.6453606s) [noise=true , address=145.79.227.36:4518   , piece_id=NAKX7KJOWM44VBBGWNKKH2ZQEXR2G4BKT6GGT3RPRM53O4UWIT3A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.778454638 (627h22m19.649537724s) [noise=true , address=145.79.227.2:4115    , piece_id=KBS52YK62X72HY6EPZ4UUPHK75OR6JRZCEJCWKX2O7JTOA5X474A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.780861582 (627h22m19.651944617s) [noise=true , address=145.79.227.51:4410   , piece_id=S4HFGNTZHBUIGGSKHE2H5UGN5574IMRS5HUDACLJQD7HQ63ZQL7Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.791300688 (627h22m19.662383724s) [noise=true , address=145.79.227.42:4121   , piece_id=DYPG3IDJIBQ2MBM3RPIE4E7DAJDZXIQRKMSE2TMW3II5U4PRMXEA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.859129536 (627h22m19.730212581s) [noise=true , address=145.79.227.32:4834   , piece_id=6X7QWYKFOUZXB4ROBBSMHIHJYWJF6Q7JY475PPTY3CDXGMVR2NIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.916594266 (627h22m19.787677301s) [noise=true , address=77.90.31.16:4735     , piece_id=K3QN6JAYIB4GZKGZNU3AFTCJNG7ISXGO5T2WISLUVS6UODQ5VC4A, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.923139279 (627h22m19.794222314s) [noise=true , address=77.90.31.14:4663     , piece_id=EZ3DQAFBEMYOMFSBYJDFJ7DO5KSGOCO4ZLHWYN6EMAKIJAYQVF5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.936461486 (627h22m19.807544521s) [noise=true , address=77.90.31.12:4590     , piece_id=Z3WZWWK2JBIWTRPJUCJU4A43DRAH4MC42H6CNQCX6PAJ66JZBUBQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.945967757 (627h22m19.817050812s) [noise=true , address=77.90.31.18:4805     , piece_id=3UZJJFUBSUQO7NFIVXHULOLQJ4JGKWTDTLIQ7GZQMBDMERNESMIQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:19.948722172 (627h22m19.819805217s) [noise=true , address=145.79.227.11:4731   , piece_id=PVZP4HLS2DXF3PWAPO4OTR6N6QI3E7JFOVXZ37DKLV4YRB5QGRXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050306934 (627h22m19.921389969s) [noise=true , address=45.91.116.10:4084    , piece_id=BY4WPLFRDGZUX6NQM3QY3QXRBKXZCGZQGJAENXWTCNCK2X7K6VXQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: <nil>
Dec 31 18:51:20.050330379 (627h22m19.921413434s) [seg_pos={0 0}, upload=549740]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:51:20.050590054 (627h22m19.921673099s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050601495 (627h22m19.92168455s) [noise=true , address=45.91.116.4:4939     , piece_id=573B2GPT2CUKNDQVQMQVWRJC7E66MEWOPDUCLBPUT6XT7UMTGOYQ, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050666860 (627h22m19.921749925s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050675766 (627h22m19.921758801s) [noise=true , address=45.91.116.7:4012     , piece_id=GHP65MP56NN4KMNFUOGRDOGLKQEQZXDTSXXM6ZPG7D7UHQ5VGP5Q, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050859085 (627h22m19.92194213s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Dec 31 18:51:20.050868464 (627h22m19.921951499s) [noise=true , address=45.91.116.14:4191    , piece_id=CNQ3U2JMQ6GUS6HQF745CGASHWJWKBB4P4DANLG3YX52P33VEFXA, seg_pos={0 0}, upload=549740]: Long tail cancellation due to optimal threshold
Dec 31 18:51:20.050893631 (627h22m19.921976666s) [seg_pos={0 0}, upload=549740]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:51:20.050999182 (627h22m19.922082217s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:51:20.051007077 (627h22m19.922090112s) [upload=549740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:51:20.351538912 (627h22m20.222621947s) [upload=549740]: Done uploading segments...
Dec 31 18:51:20.351557628 (627h22m20.222640673s) [upload=549740]: Upload finished. err: <nil>
Duration: 30.00248653s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
2 out of 60 is failed (threshold=6) [.X...................X......................................]
duration: 
3.560794133s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:51:39 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.560845791s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................X........................................]
duration: 
6.231896797s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:51:37 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.23191437s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
26.287292787s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:51:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 26.287327522s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
42.275168055s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:50:42 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 42.275189015s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [X.X...................X.....................................]
duration: 
3.738541402s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:50:37 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.738580866s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration: 
5.861513501s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:50:31 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.861544341s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [X....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X..]
duration: 
5.694185554s
trace: 
https://jaeger.dev.storj.io/trace/1480d529023b13fe
FAIL (2025-12-31 18:50:25 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, Piece ID: ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ) context deadline exceeded; piecestore: (Node ID: 1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, Piece ID: SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ) context deadline exceeded; piecestore: (Node ID: 12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, Piece ID: PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA) context deadline exceeded
======LOGS======
Dec 31 18:48:47.031938933 (627h19m46.903021968s) [upload=549707]: Starting upload
Dec 31 18:48:47.031996332 (627h19m46.903079367s) [upload=549707]: Done starting upload
Dec 31 18:48:47.032104358 (627h19m46.903187393s) [upload=549707]: Uploading segments...
Dec 31 18:48:47.032175804 (627h19m46.903258839s) [upload=549707]: Got next segment. Inline: false
Dec 31 18:48:47.032218615 (627h19m46.90330166s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:48:47.032223214 (627h19m46.903306249s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:48:47.279944541 (627h19m47.151027586s) [seg_pos={0 0}, upload=549707]: Begin upload segment...
Dec 31 18:48:47.280001078 (627h19m47.151084123s) [seg_pos={0 0}, upload=549707]: Done begin upload segment.
Dec 31 18:48:47.280035273 (627h19m47.151118318s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280044271 (627h19m47.151127316s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280124443 (627h19m47.151207508s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280583046 (627h19m47.151666091s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281010670 (627h19m47.152093715s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281553685 (627h19m47.15263673s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282018239 (627h19m47.153101274s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282487383 (627h19m47.153570428s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.283037149 (627h19m47.154120184s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.284031493 (627h19m47.155114548s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.285609928 (627h19m47.156692973s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.287621438 (627h19m47.158704483s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.291256019 (627h19m47.162339064s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.295643393 (627h19m47.166726438s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.298832916 (627h19m47.169915951s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.300043982 (627h19m47.171127027s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:48.992079416 (627h19m48.863162451s) [upload=549707]: Next returned nil segment
Dec 31 18:48:48.992114844 (627h19m48.863197889s) [upload=549707]: Waiting for error group managing segments...
Dec 31 18:48:49.275319185 (627h19m49.14640222s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.290745579 (627h19m49.161828624s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.298867163 (627h19m49.169950198s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.315269275 (627h19m49.18635232s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.316605139 (627h19m49.187688184s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.358950441 (627h19m49.230033476s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.384041378 (627h19m49.255124413s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.456493777 (627h19m49.327576812s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.546715692 (627h19m49.417798727s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.549201495 (627h19m49.42028453s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.557954943 (627h19m49.429037988s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.587425770 (627h19m49.458508815s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597235348 (627h19m49.468318383s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597255066 (627h19m49.468338111s) [seg_pos={0 0}, upload=549707]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:48:49.597489122 (627h19m49.468572177s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597497428 (627h19m49.468580463s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597616214 (627h19m49.468699249s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597632275 (627h19m49.46871532s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597853916 (627h19m49.468936972s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597866740 (627h19m49.468949796s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597894794 (627h19m49.468977839s) [seg_pos={0 0}, upload=549707]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:48:49.597975929 (627h19m49.469058964s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:48:49.597981239 (627h19m49.469064274s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:48:49.897517339 (627h19m49.768600394s) [upload=549707]: Done uploading segments...
Dec 31 18:48:49.897540743 (627h19m49.768623778s) [upload=549707]: Upload finished. err: <nil>
Duration: 5.694215721s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [.X.X...................X....................................]
duration: 
3.64918014s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:50:14 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.649209106s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
34.541308164s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:50:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 34.541339192s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration: 
6.132419552s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:49:56 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.132436985s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
24 out of 60 is failed (threshold=3) [XX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X.]
duration: 
5.821041956s
trace: 
https://jaeger.dev.storj.io/trace/1480d529023b13fe
FAIL (2025-12-31 18:49:49 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, Piece ID: ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ) context deadline exceeded; piecestore: (Node ID: 1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, Piece ID: SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ) context deadline exceeded; piecestore: (Node ID: 12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, Piece ID: PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA) context deadline exceeded
======LOGS======
Dec 31 18:48:47.031938933 (627h19m46.903021968s) [upload=549707]: Starting upload
Dec 31 18:48:47.031996332 (627h19m46.903079367s) [upload=549707]: Done starting upload
Dec 31 18:48:47.032104358 (627h19m46.903187393s) [upload=549707]: Uploading segments...
Dec 31 18:48:47.032175804 (627h19m46.903258839s) [upload=549707]: Got next segment. Inline: false
Dec 31 18:48:47.032218615 (627h19m46.90330166s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:48:47.032223214 (627h19m46.903306249s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:48:47.279944541 (627h19m47.151027586s) [seg_pos={0 0}, upload=549707]: Begin upload segment...
Dec 31 18:48:47.280001078 (627h19m47.151084123s) [seg_pos={0 0}, upload=549707]: Done begin upload segment.
Dec 31 18:48:47.280035273 (627h19m47.151118318s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280044271 (627h19m47.151127316s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280124443 (627h19m47.151207508s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280583046 (627h19m47.151666091s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281010670 (627h19m47.152093715s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281553685 (627h19m47.15263673s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282018239 (627h19m47.153101274s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282487383 (627h19m47.153570428s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.283037149 (627h19m47.154120184s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.284031493 (627h19m47.155114548s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.285609928 (627h19m47.156692973s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.287621438 (627h19m47.158704483s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.291256019 (627h19m47.162339064s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.295643393 (627h19m47.166726438s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.298832916 (627h19m47.169915951s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.300043982 (627h19m47.171127027s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:48.992079416 (627h19m48.863162451s) [upload=549707]: Next returned nil segment
Dec 31 18:48:48.992114844 (627h19m48.863197889s) [upload=549707]: Waiting for error group managing segments...
Dec 31 18:48:49.275319185 (627h19m49.14640222s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.290745579 (627h19m49.161828624s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.298867163 (627h19m49.169950198s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.315269275 (627h19m49.18635232s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.316605139 (627h19m49.187688184s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.358950441 (627h19m49.230033476s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.384041378 (627h19m49.255124413s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.456493777 (627h19m49.327576812s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.546715692 (627h19m49.417798727s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.549201495 (627h19m49.42028453s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.557954943 (627h19m49.429037988s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.587425770 (627h19m49.458508815s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597235348 (627h19m49.468318383s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597255066 (627h19m49.468338111s) [seg_pos={0 0}, upload=549707]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:48:49.597489122 (627h19m49.468572177s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597497428 (627h19m49.468580463s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597616214 (627h19m49.468699249s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597632275 (627h19m49.46871532s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597853916 (627h19m49.468936972s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597866740 (627h19m49.468949796s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597894794 (627h19m49.468977839s) [seg_pos={0 0}, upload=549707]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:48:49.597975929 (627h19m49.469058964s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:48:49.597981239 (627h19m49.469064274s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:48:49.897517339 (627h19m49.768600394s) [upload=549707]: Done uploading segments...
Dec 31 18:48:49.897540743 (627h19m49.768623778s) [upload=549707]: Upload finished. err: <nil>
Duration: 5.821069448s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration: 
5.875206651s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:49:29 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.875235366s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
25 out of 60 is failed (threshold=3) [XXX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..X]
duration: 
30.005974242s
trace: 
https://jaeger.dev.storj.io/trace/1480d529023b13fe
FAIL (2025-12-31 18:49:16 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, Piece ID: ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ) context deadline exceeded; piecestore: (Node ID: 1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, Piece ID: SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ) context deadline exceeded; piecestore: (Node ID: 12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, Piece ID: PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA) context deadline exceeded
======LOGS======
Dec 31 18:48:47.031938933 (627h19m46.903021968s) [upload=549707]: Starting upload
Dec 31 18:48:47.031996332 (627h19m46.903079367s) [upload=549707]: Done starting upload
Dec 31 18:48:47.032104358 (627h19m46.903187393s) [upload=549707]: Uploading segments...
Dec 31 18:48:47.032175804 (627h19m46.903258839s) [upload=549707]: Got next segment. Inline: false
Dec 31 18:48:47.032218615 (627h19m46.90330166s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:48:47.032223214 (627h19m46.903306249s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:48:47.279944541 (627h19m47.151027586s) [seg_pos={0 0}, upload=549707]: Begin upload segment...
Dec 31 18:48:47.280001078 (627h19m47.151084123s) [seg_pos={0 0}, upload=549707]: Done begin upload segment.
Dec 31 18:48:47.280035273 (627h19m47.151118318s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280044271 (627h19m47.151127316s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280124443 (627h19m47.151207508s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.280583046 (627h19m47.151666091s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281010670 (627h19m47.152093715s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.281553685 (627h19m47.15263673s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282018239 (627h19m47.153101274s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.282487383 (627h19m47.153570428s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.283037149 (627h19m47.154120184s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.284031493 (627h19m47.155114548s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.285609928 (627h19m47.156692973s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.287621438 (627h19m47.158704483s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.291256019 (627h19m47.162339064s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.295643393 (627h19m47.166726438s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.298832916 (627h19m47.169915951s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:47.300043982 (627h19m47.171127027s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Uploading piece...
Dec 31 18:48:48.992079416 (627h19m48.863162451s) [upload=549707]: Next returned nil segment
Dec 31 18:48:48.992114844 (627h19m48.863197889s) [upload=549707]: Waiting for error group managing segments...
Dec 31 18:48:49.275319185 (627h19m49.14640222s) [noise=true , address=145.79.227.9:4367    , piece_id=BHGD4CQ2R24BF6ZPKIPGF4YDGWBKUURRHIXQZLTJONALWTK2CVVQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.290745579 (627h19m49.161828624s) [noise=true , address=145.79.227.11:4729   , piece_id=PTVS3Z4SPOYXS4VNJG54OAZ4AAWNB6HMTIQFN4GGD76JVTNRVGRA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.298867163 (627h19m49.169950198s) [noise=true , address=145.79.227.4:4185    , piece_id=POKYSCAY2A575N576XN4QD3SE32S5DWPRYNNU2OWV4I7YM3OXCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.315269275 (627h19m49.18635232s) [noise=true , address=145.79.227.16:4911   , piece_id=VHTHIS3H3YTVA5MSKVXIPHEVHJGZCNKWSYJ35HNR4PBWYJANNKVA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.316605139 (627h19m49.187688184s) [noise=true , address=145.79.227.13:4802   , piece_id=FTPQB55EBSZN2GHUSPUNLDZADUC4KC6S3HJWH6DYNCSRC7VJ7YYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.358950441 (627h19m49.230033476s) [noise=true , address=145.79.227.36:4519   , piece_id=73D5L4OJJ2LKWBTLT7ZARUOC3BEBJ5SXBE7UMXA5EUBGJVBCCEYQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.384041378 (627h19m49.255124413s) [noise=true , address=145.79.227.7:4293    , piece_id=AZQM5UKF5IAAM7DIR3A6WABR25I23PVXFLSCWHUJ4O2OMHXVMCBQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.456493777 (627h19m49.327576812s) [noise=true , address=77.90.31.19:4842     , piece_id=SLQLVNEPYYWRXXCAV6V3LUEVX5GNUFRDKKXDLCASLPE4M4WDQUHQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.546715692 (627h19m49.417798727s) [noise=true , address=77.90.31.10:4519     , piece_id=ZDCI2IVY2PJMHBYXN4O2WPGG6QVRL5BCZXKS2BMH3RJYQBARIXGQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.549201495 (627h19m49.42028453s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZQI7ZA3P4CJNLHGJJ5VD64OSTSSLQ446YD3PY2DLJJRRF6EUDYA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.557954943 (627h19m49.429037988s) [noise=true , address=77.90.31.17:4770     , piece_id=2FILUV4JLUU6XNU6ENKKZQISI5LCUBLLQYW756TAIXOJAPGSB4FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.587425770 (627h19m49.458508815s) [noise=true , address=45.91.116.8:4047     , piece_id=PDMTMIB6ASBFXS6A7XEZV27AHN524KYUFVJNHG36U5ABBG7NW7YA, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597235348 (627h19m49.468318383s) [noise=true , address=45.91.116.7:4009     , piece_id=CEO34TP32V4A3HH3TTDBGNTV2PKAJ5GWR4RV6UM73DB2SAJKCRCQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: <nil>
Dec 31 18:48:49.597255066 (627h19m49.468338111s) [seg_pos={0 0}, upload=549707]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:48:49.597489122 (627h19m49.468572177s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597497428 (627h19m49.468580463s) [noise=true , address=45.91.116.11:4118    , piece_id=RI7SFHKZ6T3DC3BY3NRW2PSCQ7GW723X4J3B2VVKPVB23JJJRKQQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597616214 (627h19m49.468699249s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597632275 (627h19m49.46871532s) [noise=true , address=45.91.116.6:4973     , piece_id=GUJYN3V4QSCIWRCEMG5KEBCC7743LHGI4HF7ZNBXIJQ6U5GIQY7A, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597853916 (627h19m49.468936972s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Dec 31 18:48:49.597866740 (627h19m49.468949796s) [noise=true , address=77.90.31.15:4700     , piece_id=HRTFBN2ZU5NSEBLUERLGY7Q4TN2KFE72JRPMNBNMATQ3ZYSFZ3FQ, seg_pos={0 0}, upload=549707]: Long tail cancellation due to optimal threshold
Dec 31 18:48:49.597894794 (627h19m49.468977839s) [seg_pos={0 0}, upload=549707]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:48:49.597975929 (627h19m49.469058964s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:48:49.597981239 (627h19m49.469064274s) [upload=549707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:48:49.897517339 (627h19m49.768600394s) [upload=549707]: Done uploading segments...
Dec 31 18:48:49.897540743 (627h19m49.768623778s) [upload=549707]: Upload finished. err: <nil>
Duration: 30.005993609s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
15.421852759s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:49:16 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 15.421885011s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [..X.X...................X...................................]
duration: 
3.385278126s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:49:15 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.385293305s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
15.394557799s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:48:58 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 15.394576155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration: 
6.246416269s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:48:39 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.246439363s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
32.49157976s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:48:26 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 32.491593919s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [...X.X...................X..................................]
duration: 
3.46398158s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:48:08 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.464009313s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
24 out of 60 is failed (threshold=3) [.XXX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX..]
duration: 
6.57274808s
trace: 
https://jaeger.dev.storj.io/trace/39d3c6c039fcf272
FAIL (2025-12-31 18:47:54 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
gments...
Dec 31 18:46:11.888766278 (627h17m11.759849323s) [upload=549667]: Got next segment. Inline: false
Dec 31 18:46:11.888804371 (627h17m11.759887406s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:46:11.888809941 (627h17m11.759892976s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:46:12.138007799 (627h17m12.009090844s) [seg_pos={0 0}, upload=549667]: Begin upload segment...
Dec 31 18:46:12.138058545 (627h17m12.009141581s) [seg_pos={0 0}, upload=549667]: Done begin upload segment.
Dec 31 18:46:12.138100645 (627h17m12.00918369s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138130753 (627h17m12.009213788s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138942869 (627h17m12.010025914s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139442892 (627h17m12.010525927s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139887729 (627h17m12.010970764s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141408123 (627h17m12.012491158s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141921070 (627h17m12.013004115s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.142781860 (627h17m12.013864895s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.144041749 (627h17m12.015124794s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.145305344 (627h17m12.016388379s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.146473639 (627h17m12.017556675s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147657864 (627h17m12.01874091s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147835302 (627h17m12.018918347s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149259434 (627h17m12.020342469s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149816224 (627h17m12.020899259s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.150983797 (627h17m12.022066842s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:13.845223347 (627h17m13.716306392s) [upload=549667]: Next returned nil segment
Dec 31 18:46:13.845241601 (627h17m13.716324646s) [upload=549667]: Waiting for error group managing segments...
Dec 31 18:46:14.127164582 (627h17m13.998247617s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129292684 (627h17m14.000375719s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129907566 (627h17m14.000990611s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.131239191 (627h17m14.002322226s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.140415934 (627h17m14.01149898s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.148946729 (627h17m14.020029774s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.156379682 (627h17m14.027462727s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.158560755 (627h17m14.02964379s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.159138956 (627h17m14.030222002s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.172081561 (627h17m14.043164606s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.313933516 (627h17m14.185016551s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.441196343 (627h17m14.312279378s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486714596 (627h17m14.357797631s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486735826 (627h17m14.357818871s) [seg_pos={0 0}, upload=549667]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:46:14.486944383 (627h17m14.358027418s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF
Dec 31 18:46:14.486950716 (627h17m14.358033751s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487051326 (627h17m14.358134371s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qsv8fYepBmZ5RYqo42q94CxRqUUmW2xP5abmXwM5GukQRXfPA): protocol: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection
Dec 31 18:46:14.487072106 (627h17m14.358155151s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487175223 (627h17m14.358258278s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection
Dec 31 18:46:14.487185312 (627h17m14.358268367s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487211221 (627h17m14.358294266s) [seg_pos={0 0}, upload=549667]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:46:14.487308096 (627h17m14.358391141s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:46:14.487314187 (627h17m14.358397222s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:46:14.789329618 (627h17m14.660412663s) [upload=549667]: Done uploading segments...
Dec 31 18:46:14.789367069 (627h17m14.660450114s) [upload=549667]: Upload finished. err: <nil>
Duration: 6.572772386s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
38.054541578s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:47:53 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 38.054559652s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................X...................................]
duration: 
5.950672428s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:47:41 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.950698889s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [X...X.X...................X.................................]
duration: 
3.46356928s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:47:17 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.463606071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration: 
5.836745902s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:47:16 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.836775018s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
31.485201347s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:47:15 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 31.48521952s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
24 out of 60 is failed (threshold=3) [..XXX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX.]
duration: 
5.844933782s
trace: 
https://jaeger.dev.storj.io/trace/39d3c6c039fcf272
FAIL (2025-12-31 18:46:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
gments...
Dec 31 18:46:11.888766278 (627h17m11.759849323s) [upload=549667]: Got next segment. Inline: false
Dec 31 18:46:11.888804371 (627h17m11.759887406s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:46:11.888809941 (627h17m11.759892976s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:46:12.138007799 (627h17m12.009090844s) [seg_pos={0 0}, upload=549667]: Begin upload segment...
Dec 31 18:46:12.138058545 (627h17m12.009141581s) [seg_pos={0 0}, upload=549667]: Done begin upload segment.
Dec 31 18:46:12.138100645 (627h17m12.00918369s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138130753 (627h17m12.009213788s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138942869 (627h17m12.010025914s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139442892 (627h17m12.010525927s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139887729 (627h17m12.010970764s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141408123 (627h17m12.012491158s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141921070 (627h17m12.013004115s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.142781860 (627h17m12.013864895s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.144041749 (627h17m12.015124794s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.145305344 (627h17m12.016388379s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.146473639 (627h17m12.017556675s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147657864 (627h17m12.01874091s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147835302 (627h17m12.018918347s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149259434 (627h17m12.020342469s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149816224 (627h17m12.020899259s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.150983797 (627h17m12.022066842s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:13.845223347 (627h17m13.716306392s) [upload=549667]: Next returned nil segment
Dec 31 18:46:13.845241601 (627h17m13.716324646s) [upload=549667]: Waiting for error group managing segments...
Dec 31 18:46:14.127164582 (627h17m13.998247617s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129292684 (627h17m14.000375719s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129907566 (627h17m14.000990611s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.131239191 (627h17m14.002322226s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.140415934 (627h17m14.01149898s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.148946729 (627h17m14.020029774s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.156379682 (627h17m14.027462727s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.158560755 (627h17m14.02964379s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.159138956 (627h17m14.030222002s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.172081561 (627h17m14.043164606s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.313933516 (627h17m14.185016551s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.441196343 (627h17m14.312279378s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486714596 (627h17m14.357797631s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486735826 (627h17m14.357818871s) [seg_pos={0 0}, upload=549667]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:46:14.486944383 (627h17m14.358027418s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF
Dec 31 18:46:14.486950716 (627h17m14.358033751s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487051326 (627h17m14.358134371s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qsv8fYepBmZ5RYqo42q94CxRqUUmW2xP5abmXwM5GukQRXfPA): protocol: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection
Dec 31 18:46:14.487072106 (627h17m14.358155151s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487175223 (627h17m14.358258278s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection
Dec 31 18:46:14.487185312 (627h17m14.358268367s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487211221 (627h17m14.358294266s) [seg_pos={0 0}, upload=549667]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:46:14.487308096 (627h17m14.358391141s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:46:14.487314187 (627h17m14.358397222s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:46:14.789329618 (627h17m14.660412663s) [upload=549667]: Done uploading segments...
Dec 31 18:46:14.789367069 (627h17m14.660450114s) [upload=549667]: Upload finished. err: <nil>
Duration: 5.844951025s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
25 out of 60 is failed (threshold=3) [X..XXX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XXX]
duration: 
30.002096628s
trace: 
https://jaeger.dev.storj.io/trace/39d3c6c039fcf272
FAIL (2025-12-31 18:46:41 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
gments...
Dec 31 18:46:11.888766278 (627h17m11.759849323s) [upload=549667]: Got next segment. Inline: false
Dec 31 18:46:11.888804371 (627h17m11.759887406s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:46:11.888809941 (627h17m11.759892976s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:46:12.138007799 (627h17m12.009090844s) [seg_pos={0 0}, upload=549667]: Begin upload segment...
Dec 31 18:46:12.138058545 (627h17m12.009141581s) [seg_pos={0 0}, upload=549667]: Done begin upload segment.
Dec 31 18:46:12.138100645 (627h17m12.00918369s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138130753 (627h17m12.009213788s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.138942869 (627h17m12.010025914s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139442892 (627h17m12.010525927s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.139887729 (627h17m12.010970764s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141408123 (627h17m12.012491158s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.141921070 (627h17m12.013004115s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.142781860 (627h17m12.013864895s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.144041749 (627h17m12.015124794s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.145305344 (627h17m12.016388379s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.146473639 (627h17m12.017556675s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147657864 (627h17m12.01874091s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.147835302 (627h17m12.018918347s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149259434 (627h17m12.020342469s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.149816224 (627h17m12.020899259s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:12.150983797 (627h17m12.022066842s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Uploading piece...
Dec 31 18:46:13.845223347 (627h17m13.716306392s) [upload=549667]: Next returned nil segment
Dec 31 18:46:13.845241601 (627h17m13.716324646s) [upload=549667]: Waiting for error group managing segments...
Dec 31 18:46:14.127164582 (627h17m13.998247617s) [noise=true , address=145.79.227.27:4691   , piece_id=4A3VIVD7NVFJP6ZYAIFSBHGECFLS42J2RRAFN4DSPMB6RQKYQI5Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129292684 (627h17m14.000375719s) [noise=true , address=145.79.227.46:4603   , piece_id=UYIYFACFL4UTBD2KVIMNIAW2HZQRJ764N4N53EDHEMJJSEQV6EAQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.129907566 (627h17m14.000990611s) [noise=true , address=145.79.227.52:4447   , piece_id=TJSWMEYT7W7G4JSM7KB2STV5I3PGW5ZMPCJCYROWPXOO24MTY24A, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.131239191 (627h17m14.002322226s) [noise=true , address=145.79.227.6:4259    , piece_id=DCE5L36IRL6PZ6TTEBFOTBJBTP6KKIQKQVQFWCHOSYFMFSW7XBHQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.140415934 (627h17m14.01149898s) [noise=true , address=145.79.227.19:4079   , piece_id=QIA7PPEOYMJQFFN3UM7BCMJRAL2E7VFCQC5R3RZD2R5IKOLR3OYA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.148946729 (627h17m14.020029774s) [noise=true , address=145.79.227.51:4411   , piece_id=6KBI2LASFRA7TU7IJD2OEYOLB2TSSWNM5FPKIL5TUJA3WVP372BQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.156379682 (627h17m14.027462727s) [noise=true , address=145.79.227.5:4223    , piece_id=4QEEEGN6GTPW3J3L2JK473WTOSJBNJTAHO4MLSGT3B7QJSX6RC2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.158560755 (627h17m14.02964379s) [noise=true , address=145.79.227.41:4085   , piece_id=NPXQSR3CCBKJ5R5DIH4LQAVGKBTTR3U6RWOSO7ENCLQUVAGXTBWQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.159138956 (627h17m14.030222002s) [noise=true , address=145.79.227.28:4727   , piece_id=RZ2YEXFAPUK33XAK3RXH5NIXKBVGKERQH7HSX5PIMMUO4EV4EBUA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.172081561 (627h17m14.043164606s) [noise=true , address=145.79.227.3:4150    , piece_id=MGYB437IHHI54GKL524BHW3DMIBELLLXIV5W54YMIQN3BZS5CGFA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.313933516 (627h17m14.185016551s) [noise=true , address=77.90.31.11:4555     , piece_id=XK3YRDLIP2IWIDIS53P6S3ROKFTTZFN37NQEHEYTWSCC6CA2PP2Q, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.441196343 (627h17m14.312279378s) [noise=true , address=77.90.31.14:4661     , piece_id=EJU6VGQGGEDKDGTPN76GEUEW66TB24MF5KT42N6YXVX6E7O7SYEQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486714596 (627h17m14.357797631s) [noise=true , address=45.91.116.11:4118    , piece_id=C7XXP446ZA3LT73T7XHVXNMPJJSVRBRQTUIGKNB6LYMT5D2M5KCQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: <nil>
Dec 31 18:46:14.486735826 (627h17m14.357818871s) [seg_pos={0 0}, upload=549667]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:46:14.486944383 (627h17m14.358027418s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF
Dec 31 18:46:14.486950716 (627h17m14.358033751s) [noise=true , address=145.79.227.40:4049   , piece_id=5INEVVXUM4CKJ6K6FXRRB5KN3ZZNVS6FGEQZK7IQEKZSHGFXQ5UA, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487051326 (627h17m14.358134371s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qsv8fYepBmZ5RYqo42q94CxRqUUmW2xP5abmXwM5GukQRXfPA): protocol: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42018->45.91.116.12:4228: use of closed network connection
Dec 31 18:46:14.487072106 (627h17m14.358155151s) [noise=true , address=45.91.116.12:4228    , piece_id=K5RMXXI2SGQ6J23ECVQZNJYQDJLT7TNEMGD42T24I6NQKUPLDAIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487175223 (627h17m14.358258278s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36728->45.91.116.9:4261: use of closed network connection
Dec 31 18:46:14.487185312 (627h17m14.358268367s) [noise=true , address=45.91.116.9:4261     , piece_id=IBWGMDFEC547KBO47D4ZURQJCMQCNXYTAJEUQYORRVIOZBZG2OIQ, seg_pos={0 0}, upload=549667]: Long tail cancellation due to optimal threshold
Dec 31 18:46:14.487211221 (627h17m14.358294266s) [seg_pos={0 0}, upload=549667]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:46:14.487308096 (627h17m14.358391141s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:46:14.487314187 (627h17m14.358397222s) [upload=549667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:46:14.789329618 (627h17m14.660412663s) [upload=549667]: Done uploading segments...
Dec 31 18:46:14.789367069 (627h17m14.660450114s) [upload=549667]: Upload finished. err: <nil>
Duration: 30.002129269s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration: 
6.197065708s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:46:30 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.197093401s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
24.241100218s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:46:22 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 24.241127582s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [.X...X.X...................X................................]
duration: 
3.597397021s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:46:22 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.597424413s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................X................................]
duration: 
5.924414535s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:45:59 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.924434152s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
29.417247549s
trace: 
https://jaeger.dev.storj.io/trace/24432a4fc7a385da
FAIL (2025-12-31 18:45:41 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648107778 (627h8m3.519190823s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648486920 (627h8m3.519569965s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.648843990 (627h8m3.519927035s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649285190 (627h8m3.520368235s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649634716 (627h8m3.520717751s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.649989111 (627h8m3.521072156s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650347623 (627h8m3.521430668s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.650715394 (627h8m3.521798439s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.651585130 (627h8m3.522668175s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652042801 (627h8m3.523125836s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652460777 (627h8m3.523543822s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.652926143 (627h8m3.524009178s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.654529877 (627h8m3.525612912s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.656264951 (627h8m3.527347986s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.659324617 (627h8m3.530407662s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.662463203 (627h8m3.533546248s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:03.665326735 (627h8m3.536409781s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Uploading piece...
Dec 31 18:37:05.121169544 (627h8m4.992252619s) [upload=549533]: Next returned nil segment
Dec 31 18:37:05.121186426 (627h8m4.992269481s) [upload=549533]: Waiting for error group managing segments...
Dec 31 18:37:05.493475557 (627h8m5.364558592s) [noise=true , address=64.49.13.138:4490    , piece_id=LSEVOGUTOL4FKEHQS6H542XTKJNMGX4WULOHPCPXPJ5SNEBQU7KA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.602994467 (627h8m5.474077512s) [noise=true , address=145.79.227.14:4858   , piece_id=E7M3BTU56RYW6POPI7T35IFD5DSE2VNVHZHOYTLBHRPJJU4GHRGA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.627459732 (627h8m5.498542787s) [noise=true , address=145.79.227.43:4166   , piece_id=3ODERP44NMR3VV2SHP2CXSGKWH64Y2CH6G3YOT3QYEDZDUYMAGVA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.637909839 (627h8m5.508992884s) [noise=true , address=145.79.227.35:4515   , piece_id=ZEJ3RLBEIQVCBVJL56ODMLYAXMZXENJ6CB5ZZRTBW6HEHFOG2TMQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.683777739 (627h8m5.554860774s) [noise=true , address=145.79.227.6:4287    , piece_id=CM67SR4I6MDYU56JXH5NTTFQGRUFYJAZC27YT2XPXUULEZDNUSEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.711588996 (627h8m5.582672041s) [noise=true , address=77.90.31.17:4802     , piece_id=RSQ3POHH7DBIFS3ZPJZ7HNW4K7ERCMDTF7KC63KPROWZZLZ7JIJQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.723273444 (627h8m5.594356479s) [noise=true , address=77.90.31.12:4611     , piece_id=ZAXXFHOVYRAEIKXXXTJYDJC3SDBOH3GSEGHYGKMHK3MM42I5TPYA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.838882139 (627h8m5.709965184s) [noise=true , address=77.90.31.11:4559     , piece_id=I6SU3ZAMV723V4RTMSJKRFZY35KCTP3TTOHL7UAKPR6REJKWTZWQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.846600877 (627h8m5.717683922s) [noise=true , address=45.91.116.14:4195    , piece_id=SGXWVXANKMETFZHUE3WI2FJI55JLTXF2SVV2D2Y7GXWNOBCWQCNA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:05.858828230 (627h8m5.729911275s) [noise=true , address=45.91.116.11:4139    , piece_id=I7EU6LAQ72C3P5TILBLKRGGWDN2RBHMIBXTQYVUFC7ZSBICSC3UQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.391976308 (627h8m6.263059343s) [noise=true , address=145.79.227.30:4778   , piece_id=HCKVT7GUWTA3F35TKNSE5CGVEIPBVV63MYVHJKQPY7TFECYRC7EQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.451470513 (627h8m6.322553549s) [noise=true , address=193.149.164.143:4696 , piece_id=DF3WJ2BLW6RX3OEAOULAXB2375ZUYNM6KM6ARJFD4U7OBKHVBOEA, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.477640595 (627h8m6.34872363s) [noise=true , address=145.79.227.40:4055   , piece_id=WB6BJIBSCF7CTGF3JVDVZPPRHIM4ZHZP4BPDQEFKVFSIZOSM2XOQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483491506 (627h8m6.354574551s) [noise=true , address=145.79.227.34:4925   , piece_id=NH4WRJBOJKCRZYCH2H23VCEYVPXPTLB3HBCCGN6L5U5K3P77KPFQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: <nil>
Dec 31 18:37:06.483516744 (627h8m6.35459979s) [seg_pos={0 0}, upload=549533]: Segment reached optimal threshold of 14 pieces.
Dec 31 18:37:06.483734759 (627h8m6.354817804s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.483743796 (627h8m6.354826841s) [noise=true , address=145.79.227.33:4876   , piece_id=2LA6NHTCMVMAY4LHIL3DSCX4OXHWY2WMG7J2NMMPBO7PEVVEOBBQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484054658 (627h8m6.355137703s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484063545 (627h8m6.35514659s) [noise=true , address=77.90.31.18:4840     , piece_id=YS3MAD3V4BGSQENVDOKLG334NBQDF4JG2OLYMK2Q6QJKUH4XPOPQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484205926 (627h8m6.355288961s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484213520 (627h8m6.355296565s) [noise=true , address=145.79.227.49:4359   , piece_id=JVWHFG6TDDJZ4EY2E6HSWKHDSA3REXHQ4ULAEMHA2KPJ73X5WMUQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484359078 (627h8m6.355442123s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF
Dec 31 18:37:06.484367073 (627h8m6.355450118s) [noise=true , address=145.79.227.33:4885   , piece_id=W7IMHDBWRQLQVDLYDGVNAPXUUDC2BVXHHMTGB5AKUGMB5P2WQITQ, seg_pos={0 0}, upload=549533]: Long tail cancellation due to optimal threshold
Dec 31 18:37:06.484387882 (627h8m6.355470917s) [seg_pos={0 0}, upload=549533]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 31 18:37:06.484470069 (627h8m6.355553104s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:37:06.484476792 (627h8m6.355559837s) [upload=549533]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:37:06.808174710 (627h8m6.679257755s) [upload=549533]: Done uploading segments...
Dec 31 18:37:06.808200198 (627h8m6.679283233s) [upload=549533]: Upload finished. err: <nil>
Duration: 29.417278307s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................X...............................]
duration: 
6.17505097s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:45:38 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.175079575s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
24 out of 60 is failed (threshold=3) [.X..XXX....X.X.X.X.....XXX.X.X.X.X.X....XX.X....X...X.X...XX]
duration: 
30.001770981s
trace: 
https://jaeger.dev.storj.io/trace/3bd179aac3fc54a8
FAIL (2025-12-31 18:45:27 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, Piece ID: AGSGNGX62LV4I3HYO6JT2QRYQRCPTKAJW3EIGPU53JTJTGTLRBRA) context deadline exceeded; piecestore: (Node ID: 1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, Piece ID: AYDQG5J4KTQQEW2MOCHI7PDGQQ4XKXQ6TVHMZ5ZIJWMOZMBSG26A) context deadline exceeded
======LOGS======
Dec 31 18:44:57.824104730 (627h15m57.695187765s) [upload=549651]: Starting upload
Dec 31 18:44:57.824158333 (627h15m57.695241368s) [upload=549651]: Done starting upload
Dec 31 18:44:57.824193400 (627h15m57.695276435s) [upload=549651]: Uploading segments...
Dec 31 18:44:57.824345669 (627h15m57.695428704s) [upload=549651]: Got next segment. Inline: false
Dec 31 18:44:57.824371980 (627h15m57.695455015s) [upload=549651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 31 18:44:57.824376608 (627h15m57.695459643s) [upload=549651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 31 18:44:58.074265341 (627h15m57.945348376s) [seg_pos={0 0}, upload=549651]: Begin upload segment...
Dec 31 18:44:58.074311490 (627h15m57.945394535s) [seg_pos={0 0}, upload=549651]: Done begin upload segment.
Dec 31 18:44:58.074345144 (627h15m57.945428209s) [noise=true , address=45.91.116.11:4119    , piece_id=AZSITQNRV54FFB6OMTW65JQYQVN65NETKHNKL66A4CCXBTUSHKBA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.074396381 (627h15m57.945479426s) [noise=true , address=145.79.227.43:4158   , piece_id=IYGFNQQUIJRBQPS2ZH6RB4MTCQAPAPC4AJCG7PFQRZC2S7X4NATQ, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.074875754 (627h15m57.945958799s) [noise=true , address=77.90.31.14:4661     , piece_id=OKNDYP6E3YNWEIKWL3B5KZT5N2ISO36DJZEQPJJTJEDXRTP6IIYA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.075204570 (627h15m57.946287605s) [noise=true , address=145.79.227.24:4583   , piece_id=MZ66ZYFZWK2R3MFYK3YT26MHOILC5DDKU4AVMSEPNCETJP6WAE5A, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.075540890 (627h15m57.946623925s) [noise=true , address=145.79.227.8:4331    , piece_id=RB76BX33Z5GDOBBJI5JCMLEXJCKHVSMTNWGAYZUA2TEPYCZYLJ6Q, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.076117519 (627h15m57.947200554s) [noise=true , address=145.79.227.13:4802   , piece_id=EZTESNWTTRUGW4SSHHUY6I5AAYDPCJ7LEEJNXG36WMLJ4VJX2HZA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.076263306 (627h15m57.947346341s) [noise=true , address=145.79.227.27:4689   , piece_id=32QXTHP3MUXPUSEKOHAGISCKWYKA4TH63DLND6GZ64NEVH3SM2CQ, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.076551374 (627h15m57.94763442s) [noise=true , address=145.79.227.36:4517   , piece_id=KCM5XX3DVQDD5UNGHMJVPU3WKS7YXUNQMWG72RRKZSXQJ26IFDFA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.076846908 (627h15m57.947929943s) [noise=true , address=77.90.31.17:4773     , piece_id=AGSGNGX62LV4I3HYO6JT2QRYQRCPTKAJW3EIGPU53JTJTGTLRBRA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.077273700 (627h15m57.948356745s) [noise=true , address=145.79.227.48:4303   , piece_id=252A2W5M5RQYZMLSFTOCQZWQSFMCVRMLBYVGXGNHJF2RPTOQVKRQ, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.077333354 (627h15m57.948416389s) [noise=true , address=145.79.227.47:4267   , piece_id=OIPMYO6ALYIVCGRHMONX4O7BYHJWID5HA6AIS5HXHEEHNS3UALWQ, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.077630599 (627h15m57.948713635s) [noise=true , address=145.79.227.41:4085   , piece_id=O2TOCIFJPWIPRI56WZ6DNGILHPNIPPWN2KWMMX56VI7W3RLZGJ3A, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.077675094 (627h15m57.948758139s) [noise=true , address=77.90.31.15:4697     , piece_id=53QUTEO6LIDD6QZDY74J2GML7WKPTLM5FT6E3DIRUM3FPFGP4EBA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.077978582 (627h15m57.949061617s) [noise=true , address=45.91.116.13:4153    , piece_id=AYDQG5J4KTQQEW2MOCHI7PDGQQ4XKXQ6TVHMZ5ZIJWMOZMBSG26A, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.078154447 (627h15m57.949237482s) [noise=true , address=145.79.227.2:4115    , piece_id=3OZ3XCE6BP6JXD6IHJ6NO3GPNHN24EFOJAQW6GK7VYT7UUZGIMQA, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:58.078261421 (627h15m57.949344456s) [noise=true , address=145.79.227.39:4014   , piece_id=QPYHYMQEAXF3QJKUJON2HTCUYDLZUU4B5M2JIDIUTYUPV4KFHAWQ, seg_pos={0 0}, upload=549651]: Uploading piece...
Dec 31 18:44:59.776933532 (627h15m59.648016567s) [upload=549651]: Next returned nil segment
Dec 31 18:44:59.776953750 (627h15m59.648036785s) [upload=549651]: Waiting for error group managing segments...
Dec 31 18:45:00.052334764 (627h15m59.923417799s) [noise=true , address=145.79.227.48:4303   , piece_id=252A2W5M5RQYZMLSFTOCQZWQSFMCVRMLBYVGXGNHJF2RPTOQVKRQ, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.052462398 (627h15m59.923545443s) [noise=true , address=145.79.227.13:4802   , piece_id=EZTESNWTTRUGW4SSHHUY6I5AAYDPCJ7LEEJNXG36WMLJ4VJX2HZA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.066974771 (627h15m59.938057806s) [noise=true , address=145.79.227.36:4517   , piece_id=KCM5XX3DVQDD5UNGHMJVPU3WKS7YXUNQMWG72RRKZSXQJ26IFDFA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.072911496 (627h15m59.943994541s) [noise=true , address=145.79.227.47:4267   , piece_id=OIPMYO6ALYIVCGRHMONX4O7BYHJWID5HA6AIS5HXHEEHNS3UALWQ, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.073338519 (627h15m59.944421564s) [noise=true , address=145.79.227.39:4014   , piece_id=QPYHYMQEAXF3QJKUJON2HTCUYDLZUU4B5M2JIDIUTYUPV4KFHAWQ, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.081883730 (627h15m59.952966775s) [noise=true , address=145.79.227.2:4115    , piece_id=3OZ3XCE6BP6JXD6IHJ6NO3GPNHN24EFOJAQW6GK7VYT7UUZGIMQA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.091033904 (627h15m59.962116939s) [noise=true , address=145.79.227.8:4331    , piece_id=RB76BX33Z5GDOBBJI5JCMLEXJCKHVSMTNWGAYZUA2TEPYCZYLJ6Q, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.091069521 (627h15m59.962152556s) [noise=true , address=145.79.227.41:4085   , piece_id=O2TOCIFJPWIPRI56WZ6DNGILHPNIPPWN2KWMMX56VI7W3RLZGJ3A, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.091477918 (627h15m59.962560953s) [noise=true , address=145.79.227.24:4583   , piece_id=MZ66ZYFZWK2R3MFYK3YT26MHOILC5DDKU4AVMSEPNCETJP6WAE5A, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.104744610 (627h15m59.975827655s) [noise=true , address=145.79.227.27:4689   , piece_id=32QXTHP3MUXPUSEKOHAGISCKWYKA4TH63DLND6GZ64NEVH3SM2CQ, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.248399659 (627h16m0.119482725s) [noise=true , address=77.90.31.17:4773     , piece_id=AGSGNGX62LV4I3HYO6JT2QRYQRCPTKAJW3EIGPU53JTJTGTLRBRA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.309674917 (627h16m0.180757962s) [noise=true , address=77.90.31.15:4697     , piece_id=53QUTEO6LIDD6QZDY74J2GML7WKPTLM5FT6E3DIRUM3FPFGP4EBA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.401313790 (627h16m0.272396825s) [noise=true , address=45.91.116.13:4153    , piece_id=AYDQG5J4KTQQEW2MOCHI7PDGQQ4XKXQ6TVHMZ5ZIJWMOZMBSG26A, seg_pos={0 0}, upload=549651]: Done uploading piece. err: <nil>
Dec 31 18:45:00.401332004 (627h16m0.272415049s) [seg_pos={0 0}, upload=549651]: Segment reached optimal threshold of 13 pieces.
Dec 31 18:45:00.401502609 (627h16m0.272585654s) [noise=true , address=77.90.31.14:4661     , piece_id=OKNDYP6E3YNWEIKWL3B5KZT5N2ISO36DJZEQPJJTJEDXRTP6IIYA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: write tcp 188.166.225.170:41370->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:41370->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41370->77.90.31.14:4661: use of closed network connection
Dec 31 18:45:00.401508571 (627h16m0.272591616s) [noise=true , address=77.90.31.14:4661     , piece_id=OKNDYP6E3YNWEIKWL3B5KZT5N2ISO36DJZEQPJJTJEDXRTP6IIYA, seg_pos={0 0}, upload=549651]: Long tail cancellation due to optimal threshold
Dec 31 18:45:00.401560569 (627h16m0.272643615s) [noise=true , address=145.79.227.43:4158   , piece_id=IYGFNQQUIJRBQPS2ZH6RB4MTCQAPAPC4AJCG7PFQRZC2S7X4NATQ, seg_pos={0 0}, upload=549651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2): protocol: expected piece hash; context canceled; EOF
Dec 31 18:45:00.401569055 (627h16m0.2726521s) [noise=true , address=145.79.227.43:4158   , piece_id=IYGFNQQUIJRBQPS2ZH6RB4MTCQAPAPC4AJCG7PFQRZC2S7X4NATQ, seg_pos={0 0}, upload=549651]: Long tail cancellation due to optimal threshold
Dec 31 18:45:00.401671020 (627h16m0.272754075s) [noise=true , address=45.91.116.11:4119    , piece_id=AZSITQNRV54FFB6OMTW65JQYQVN65NETKHNKL66A4CCXBTUSHKBA, seg_pos={0 0}, upload=549651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Dec 31 18:45:00.401680067 (627h16m0.272763112s) [noise=true , address=45.91.116.11:4119    , piece_id=AZSITQNRV54FFB6OMTW65JQYQVN65NETKHNKL66A4CCXBTUSHKBA, seg_pos={0 0}, upload=549651]: Long tail cancellation due to optimal threshold
Dec 31 18:45:00.401763526 (627h16m0.272846561s) [seg_pos={0 0}, upload=549651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 31 18:45:00.401884746 (627h16m0.272967792s) [upload=549651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 31 18:45:00.401891129 (627h16m0.272974164s) [upload=549651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 31 18:45:00.692700261 (627h16m0.563783326s) [upload=549651]: Done uploading segments...
Dec 31 18:45:00.692724917 (627h16m0.563807963s) [upload=549651]: Upload finished. err: <nil>
Duration: 30.001792321s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [..X...X.X...................X...............................]
duration: 
3.405497488s
trace: 
https://jaeger.dev.storj.io/trace/1c0a173ba9d72fc4
FAIL (2025-12-31 18:45:17 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.405521473s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration: 
6.242309357s
trace: 
https://jaeger.dev.storj.io/trace/9459b27b9ebbd
FAIL (2025-12-31 18:45:03 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.242341247s edge gateway us-select-1