Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 876859 reports (Page 2365 of 17538)
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)
antiblip:
1 out of 15 is failed (threshold=6) [..........X....]
duration:
62.075019ms
remote:
"tcp:34.120.119.150:443"
response headers:
Content-Type=text/html; charset=UTF-8
Referrer-Policy=no-referrer
Content-Length=298
Date=Tue, 19 May 2026 06:01:51 GMT
Alt-Svc=h3=":443"; ma=2592000
target:
https://www.tardigrade.io/
trace:
https://jaeger.dev.storj.io/trace/66ea192edffbca9d
FAIL (2026-05-19 06:04:19 UTC)
orbiter warning: unexpected status code "503 Service Unavailable"
"\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n"
Duration: 62.103171ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)
antiblip:
1 out of 15 is failed (threshold=6) [...........X...]
duration:
70.031ms
remote:
"tcp:34.120.119.150:443"
response headers:
Content-Type=text/html; charset=UTF-8
Referrer-Policy=no-referrer
Content-Length=298
Date=Tue, 19 May 2026 06:01:51 GMT
Alt-Svc=h3=":443"; ma=2592000
target:
https://www.tardigrade.io/
trace:
https://jaeger.dev.storj.io/trace/66ea192edffbca9d
FAIL (2026-05-19 06:03:37 UTC)
orbiter warning: unexpected status code "503 Service Unavailable"
"\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n"
Duration: 70.056708ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)
antiblip:
1 out of 15 is failed (threshold=6) [............X..]
duration:
64.749171ms
remote:
"tcp:34.120.119.150:443"
response headers:
Content-Type=text/html; charset=UTF-8
Referrer-Policy=no-referrer
Content-Length=298
Date=Tue, 19 May 2026 06:01:51 GMT
Alt-Svc=h3=":443"; ma=2592000
target:
https://www.tardigrade.io/
trace:
https://jaeger.dev.storj.io/trace/66ea192edffbca9d
FAIL (2026-05-19 06:02:32 UTC)
orbiter warning: unexpected status code "503 Service Unavailable"
"\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n"
Duration: 64.768518ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)
antiblip:
1 out of 15 is failed (threshold=6) [.............X.]
duration:
67.222731ms
remote:
"tcp:34.120.119.150:443"
response headers:
Content-Type=text/html; charset=UTF-8
Referrer-Policy=no-referrer
Content-Length=298
Date=Tue, 19 May 2026 06:01:51 GMT
Alt-Svc=h3=":443"; ma=2592000
target:
https://www.tardigrade.io/
trace:
https://jaeger.dev.storj.io/trace/66ea192edffbca9d
FAIL (2026-05-19 06:02:09 UTC)
orbiter warning: unexpected status code "503 Service Unavailable"
"\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n"
Duration: 67.24283ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)
antiblip:
1 out of 15 is failed (threshold=6) [..............X]
duration:
120.812109ms
remote:
"tcp:34.120.119.150:443"
response headers:
Content-Type=text/html; charset=UTF-8
Referrer-Policy=no-referrer
Content-Length=298
Date=Tue, 19 May 2026 06:01:51 GMT
Alt-Svc=h3=":443"; ma=2592000
target:
https://www.tardigrade.io/
trace:
https://jaeger.dev.storj.io/trace/66ea192edffbca9d
FAIL (2026-05-19 06:01:51 UTC)
orbiter warning: unexpected status code "503 Service Unavailable"
"\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n"
Duration: 120.85934ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.848607996s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:25:56 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.84863138s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
5.875518812s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:24:45 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.875542948s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
5.714866822s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:23:41 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.714892582s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
5.806850363s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:22:45 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.806873606s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
5.918169914s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:21:40 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.918193821s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
1.926828044s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:21:18 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.926886776s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.969391806s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:20:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 5.969416863s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
5.807580998s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:20:25 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.807604002s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
1.920403967s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:20:20 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.920427613s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
1.882766451s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:19:46 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.882794454s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
6.237410639s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:19:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.237434264s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.616604038s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:19:35 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.616627973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
5.945636933s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:19:31 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.945657191s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
5.814348619s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:19:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 5.814372294s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
1.885855223s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:19:12 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.88587966s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
5.841200075s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:19:05 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.841215856s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
5.331851978s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:19:05 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.331875873s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
1.856534027s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:18:39 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.856553544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
7.345315783s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:18:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 7.345342414s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
6.131489237s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:18:17 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.131517932s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.797678814s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:18:15 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.79770286s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
5.638168869s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:18:05 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.638193325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.99406097s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:17:48 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.994090606s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
1.920210297s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:17:41 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.920236317s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.54989983s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:17:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.549922272s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
5.655539966s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:17:32 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.655564483s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
1.89223223s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:17:23 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.892254972s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
5.623660908s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:16:58 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.623678752s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.983605498s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:16:57 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.983635835s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.353361439s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:16:57 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.35338359s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.775040496s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:16:26 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.775068611s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
1.865175826s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:16:25 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.865198368s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
6.07596489s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:16:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.075994116s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
5.737943654s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:16:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.737966156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
6.573209054s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:15:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.573246586s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.723631344s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:15:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 5.723654797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
1.874948194s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:15:19 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.874965496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.718628195s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:15:14 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.71865765s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.726014036s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:15:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 5.72604211s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
5.663925165s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:15:03 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.66395384s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
1.868101847s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:15:02 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.868127086s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
6.200648009s
trace:
https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b
FAIL (2026-05-19 05:14:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
m2.100136312s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece...
May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment
May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments...
May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564     , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection
May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806   , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761   , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656    , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792    , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487  , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984   , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection
May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509  , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105  , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection
May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816     , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164    , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634     , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073  , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection
May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975  , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection
May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767    , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537   , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF
May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments...
May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0)
Duration: 6.200666263s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
5.670123645s
trace:
https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3
FAIL (2026-05-19 05:14:31 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload
May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload
May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments...
May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false
May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded
May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments...
May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded
Duration: 5.670155265s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
1.890245661s
trace:
https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa
FAIL (2026-05-19 05:14:29 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.890263135s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
5.721790108s
trace:
https://jaeger.dev.storj.io/trace/4be74ab012e432ab
FAIL (2026-05-19 05:14:28 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.721813093s core uplink us1