Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.710506187s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:54:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.710531305s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.945530395s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:54:33 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.945558407s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 7.307334653s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:54:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 7.307367816s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.884950642s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:54:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.88497994s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.962971859s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:53:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 6.963001024s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.521138666s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:53:41 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.521167591s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.82060562s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:53:20 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.820632942s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.4393542s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:53:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.439391801s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.900434038s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:52:53 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.900461951s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.668606275s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:52:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.668622396s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.987324264s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:52:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.987347147s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.787435759s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:52:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.787459684s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.903000194s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:52:03 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.903027657s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.401275474s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:51:55 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.401301482s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.866633782s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:51:44 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.866656868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.710911709s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:51:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.710932599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 8.103762352s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:51:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 8.1037879s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.871801973s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:51:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.871845506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.916493332s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:50:53 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.91651778s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.733648866s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:50:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.733673893s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.747679537s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:50:33 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.747720026s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.184174329s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:50:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.184198544s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.675434172s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:50:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.675458959s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.850290243s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:50:03 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.850325141s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.129835777s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:49:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.129869381s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.380375892s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:49:49 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.380403303s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.73017037s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:49:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.730194605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 7.128526017s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:49:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 7.128579248s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.996328448s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:49:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.996352323s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.66217355s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:48:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.662196605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.876722237s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:48:47 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.876744489s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.843919756s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:48:19 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.843945345s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.932540715s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:48:11 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.932565773s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.902601377s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:48:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.902687061s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.684110935s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:47:44 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.684138637s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 7.487593318s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:47:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 7.487616753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 8.23588728s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:47:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 8.235904002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.736912763s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:47:19 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.736939534s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.919359433s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:47:12 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.919374441s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.624712581s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:47:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.6247376s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.77844524s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:47:03 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.778472221s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.552934026s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:46:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.552976296s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.709407751s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:46:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.7094333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.877497315s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:46:43 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.877526672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.878031764s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:46:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.878055038s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.312014827s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 04:45:55 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 6.312072096s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.863112238s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 04:45:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.863129882s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.444631747s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:45:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.444657977s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.677675788s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 04:45:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.677700384s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.58287971s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 04:45:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.58289417s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)